2024-09-21T05:58:09.486 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T05:58:09.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T05:58:09.612 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913527' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkuU0l3k7IoxjSoDqu62OTwFp/rjn2eqL/TVaRRXzKEFfdzEHCC7yHkILd1KFSoRUvnBubJMuMYXKCV//aFQD8= smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZXyrlQxGc5e9HrZEEl4WJqi4bpYIegp1QFdZlsnjT745SGzL1D0PtkjHuvCHCbw4Xho377t295ZG7Z9IOlpCo= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBydtLVHLAx176mj28asmYMpRaKes3YuvUHcfjNUnrLC6KFKvxZUCgpsPQzaB6FvXEzTgy7q5baOxuCXPWZDrHI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T05:58:09.612 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T05:58:09.612 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T05:58:09.613 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T05:58:09.614 INFO:teuthology.task.internal:Checking packages... 2024-09-21T05:58:09.637 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T05:58:09.637 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T05:58:09.637 INFO:teuthology.packaging:ref: None 2024-09-21T05:58:09.637 INFO:teuthology.packaging:tag: None 2024-09-21T05:58:09.638 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:58:09.638 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T05:58:09.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T05:58:09.788 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T05:58:09.789 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T05:58:09.796 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T05:58:09.796 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T05:58:09.809 INFO:teuthology.task.internal:Saving configuration 2024-09-21T05:58:09.830 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T05:58:09.835 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T05:58:09.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:53:11.654996', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkuU0l3k7IoxjSoDqu62OTwFp/rjn2eqL/TVaRRXzKEFfdzEHCC7yHkILd1KFSoRUvnBubJMuMYXKCV//aFQD8='} 2024-09-21T05:58:09.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:53:11.653838', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZXyrlQxGc5e9HrZEEl4WJqi4bpYIegp1QFdZlsnjT745SGzL1D0PtkjHuvCHCbw4Xho377t295ZG7Z9IOlpCo='} 2024-09-21T05:58:09.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 05:53:11.652489', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBydtLVHLAx176mj28asmYMpRaKes3YuvUHcfjNUnrLC6KFKvxZUCgpsPQzaB6FvXEzTgy7q5baOxuCXPWZDrHI='} 2024-09-21T05:58:09.904 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T05:58:09.911 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T05:58:09.911 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T05:58:09.911 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T05:58:09.911 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T05:58:09.994 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbfe8ef75b0>, signals=[15]) 2024-09-21T05:58:09.995 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T05:58:10.001 INFO:teuthology.task.internal:Opening connections... 2024-09-21T05:58:10.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T05:58:10.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:58:10.081 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T05:58:10.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:58:10.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-09-21T05:58:10.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T05:58:10.229 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T05:58:10.242 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-21T05:58:10.260 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-21T05:58:10.260 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:58:10.318 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:58:10.319 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:58:10.320 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-21T05:58:10.344 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-21T05:58:10.362 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-21T05:58:10.362 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-21T05:58:10.420 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:58:10.421 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:58:10.421 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-21T05:58:10.444 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-09-21T05:58:10.463 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-09-21T05:58:10.463 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-09-21T05:58:10.521 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T05:58:10.522 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T05:58:10.523 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T05:58:10.523 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-09-21T05:58:10.544 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T05:58:10.554 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T05:58:10.560 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T05:58:10.560 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:58:10.563 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:58:10.565 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-09-21T05:58:10.581 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T05:58:10.587 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T05:58:10.588 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:58:10.620 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:58:10.623 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-09-21T05:58:10.651 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T05:58:10.727 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T05:58:10.742 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T05:58:10.742 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T05:58:10.742 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T05:58:10.742 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T05:58:10.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T05:58:10.759 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-21T05:58:10.817 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-21T05:58:10.817 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-503.el9.x86_64 2024-09-21T05:58:10.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-09-21T05:58:14.338 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T05:58:16.317 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T05:58:21.982 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-21T05:58:23.924 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-21T05:58:24.712 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T05:58:30.301 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T05:58:32.291 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T05:58:32.292 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T05:58:32.392 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-21T05:58:32.407 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-21T05:58:32.407 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-21T05:58:32.407 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-21T05:58:32.407 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-21T05:58:32.408 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:58:32.409 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 79 M 2024-09-21T05:58:32.409 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 126 M 2024-09-21T05:58:32.409 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-21T05:58:32.595 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 407 kB/s | 36 kB 00:00 2024-09-21T05:58:32.978 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T05:58:33.453 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-21T05:58:33.737 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-21T05:58:33.737 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-21T05:58:33.737 INFO:teuthology.orchestra.run.smithi038.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-21T05:58:34.453 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-21T05:58:34.865 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-21T05:58:34.865 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-21T05:58:35.843 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-21T05:58:35.844 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-21T05:58:38.392 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-21T05:58:39.051 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:58:39.140 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:58:41.884 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:58:42.018 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:58:47.148 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:58:47.186 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:58:52.319 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:59:31.525 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:59:31.565 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:59:31.880 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:59:31.880 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T05:59:31.880 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T05:59:31.880 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:59:32.776 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-21T05:59:33.154 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:59:33.242 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:59:33.243 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:59:33.243 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T05:59:33.243 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T05:59:33.243 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T05:59:33.243 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T05:59:33.243 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T05:59:33.243 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T05:59:33.302 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T05:59:33.302 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T05:59:33.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-21T05:59:33.334 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-21T05:59:33.334 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-21T05:59:33.334 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-21T05:59:33.334 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-21T05:59:33.334 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T05:59:33.335 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T05:59:33.336 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T05:59:33.337 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T05:59:33.337 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-508.el9.x86_64 2024-09-21T05:59:33.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T05:59:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-21T05:59:35.271 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T05:59:35.299 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-21T05:59:35.301 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-21T05:59:35.316 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.ksKQ9YQgx2 2024-09-21T05:59:35.316 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ksKQ9YQgx2 2024-09-21T05:59:35.386 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.ksKQ9YQgx2 2024-09-21T05:59:35.536 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.ksKQ9YQgx2 is 6KB 2024-09-21T05:59:35.584 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.ksKQ9YQgx2 2024-09-21T05:59:35.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T05:59:35.661 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T05:59:35.661 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T05:59:35.661 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T05:59:35.661 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T05:59:35.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T05:59:35.805 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-21T06:00:05.808 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:00:05.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:00:05.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:00:24.303 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-09-21T06:00:33.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:00:33.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:01:33.306 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:01:45.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:01:45.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:01:45.612 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-21T06:01:45.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:01:45.971 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:01:45.972 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-21T06:01:45.988 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:01:45.989 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:01:45.989 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:01:45.989 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:01:46.989 DEBUG:teuthology.parallel:result is None 2024-09-21T06:01:46.990 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:01:47.005 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:01:47.006 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:01:47.008 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:01:47.011 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:01:47.030 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:01:47.129 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:01:47.148 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:01:47.148 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:01:47.150 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:01:47.153 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:01:47.248 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:01:47.257 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:01:47.257 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:01:47.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:01:47.274 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:01:47.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:01:47.292 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:01:47.294 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:01:47.317 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:01:47.351 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.373 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.378 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.388 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.399 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.405 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:01:47.407 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:01:47.416 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:01:47.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:01:47.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:01:47.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:01:47.448 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:01:47.460 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:01:47.460 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:01:47.489 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:01:47.491 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:01:47.507 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:47.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:47.639 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:47.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:47.767 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:01:47.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:01:47.835 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:47.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:47.931 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:48.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:48.058 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:01:48.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:01:48.124 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:48.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:01:48.222 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:48.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:01:48.351 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:01:48.351 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:01:48.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-21T06:01:48.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-21T06:01:48.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-09-21T06:01:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:01:48.468 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:01:48.498 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:01:48.947 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:01:48.955 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:01:48.955 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:01:48.984 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:01:48.996 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:01:48.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-21T06:01:49.058 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-21T06:01:49.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-21T06:01:49.132 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-21T06:01:49.134 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-09-21T06:01:49.181 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-09-21T06:01:49.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:01:49.183 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-21T06:01:49.223 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-21T06:01:49.224 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-21T06:01:49.250 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-21T06:01:49.251 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-09-21T06:01:49.271 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-09-21T06:01:49.272 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:01:49.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:01:49.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:01:49.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:01:49.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:01:49.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:01:49.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:01:49.358 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:01:49.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:01:49.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:01:49.432 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:01:49.463 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:01:49.472 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:01:49.482 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:01:49.482 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi044.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:05:49.873 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-09-21T06:05:49.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:05:49.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:05:49.949 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-21T06:05:50.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-21T06:05:50.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T06:05:50.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:05:50.119 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-21T06:05:50.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-21T06:05:50.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-21T06:05:50.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:05:50.271 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-21T06:05:50.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-21T06:05:50.350 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:05:50.360 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:05:50.360 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:05:50.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:05:50.362 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:05:50.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:05:50.365 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:05:50.365 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:05:50.392 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:05:50.393 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:05:50.407 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:05:50.409 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:05:50.418 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:05:50.432 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-21T06:05:50.432 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:05:50.436 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-21T06:05:50.444 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-21T06:05:50.448 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-21T06:05:50.456 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-09-21T06:05:50.458 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:05:50.464 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:05:50.468 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-09-21T06:05:50.472 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:05:50.479 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:05:50.487 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:05:50.502 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:05:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:05:50.530 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:05:50.531 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-21T06:05:50.531 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.531 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.531 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.531 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.541 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:05:50.544 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:05:50.545 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-21T06:05:50.545 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.545 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.545 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.545 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.561 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.565 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:05:50.566 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:05:50.577 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:05:50.577 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:05:50.577 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:05:50.578 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:05:50.583 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:05:50.583 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:05:50.583 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:05:50.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:05:50.585 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:05:50.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:05:50.586 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:05:50.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:05:50.736 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:05:50.736 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:05:50.740 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:05:50.740 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:05:50.741 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:05:50.741 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:05:50.844 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:05:50.844 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:05:50.845 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:05:50.852 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:05:50.852 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:05:50.852 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:05:50.855 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:05:50.855 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:05:50.855 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:05:50.871 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:05:50.871 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:05:50.880 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:05:50.880 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:05:50.881 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:05:50.881 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:05:50.937 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:05:50.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:05:50.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:05:51.013 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:05:51.023 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:05:51.026 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:05:51.081 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-09-21T06:05:51.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-09-21T06:05:51.093 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-21T06:05:51.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-21T06:05:51.112 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-21T06:05:51.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-21T06:05:51.316 INFO:teuthology.orchestra.run.smithi174.stdout:45 files removed 2024-09-21T06:05:51.326 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-21T06:05:51.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:05:51.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:05:51.362 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-21T06:05:51.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:05:51.902 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T06:05:51.912 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T06:05:51.968 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-21T06:05:52.194 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T06:05:52.204 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T06:05:52.260 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:05:52.470 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T06:05:52.480 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T06:05:52.544 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T06:05:53.103 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T06:05:54.294 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T06:05:54.844 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.3 MB 00:02 2024-09-21T06:05:54.856 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T06:05:56.145 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T06:05:57.195 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-21T06:06:00.598 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T06:06:01.788 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-21T06:06:02.149 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-21T06:06:02.646 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-21T06:06:03.078 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T06:06:04.147 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-21T06:06:04.347 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-21T06:06:05.343 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-21T06:06:05.476 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:06:08.501 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:06:10.644 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:10.645 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:10.656 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:06:10.657 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:06:10.658 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:06:10.659 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:06:10.661 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:06:10.663 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:06:10.664 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:06:10.727 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:06:10.754 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:06:10.755 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:06:10.756 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:06:10.757 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:06:10.758 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:06:10.759 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:06:10.760 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:06:10.761 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:06:10.762 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:06:10.763 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:06:10.764 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:06:10.765 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-21T06:06:10.766 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T06:06:10.767 INFO:teuthology.orchestra.run.smithi174.stdout:Install 149 Packages 2024-09-21T06:06:10.767 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-09-21T06:06:10.767 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:10.767 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 228 M 2024-09-21T06:06:10.767 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-21T06:06:10.982 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T06:06:11.124 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T06:06:11.493 INFO:teuthology.orchestra.run.smithi174.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T06:06:11.735 INFO:teuthology.orchestra.run.smithi174.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T06:06:11.853 INFO:teuthology.orchestra.run.smithi174.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:06:11.878 INFO:teuthology.orchestra.run.smithi174.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.0 MB/s | 148 kB 00:00 2024-09-21T06:06:11.953 INFO:teuthology.orchestra.run.smithi174.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 23 MB/s | 2.3 MB 00:00 2024-09-21T06:06:12.053 INFO:teuthology.orchestra.run.smithi174.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-09-21T06:06:12.262 INFO:teuthology.orchestra.run.smithi174.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.0 MB 00:00 2024-09-21T06:06:12.487 INFO:teuthology.orchestra.run.smithi174.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:06:12.529 INFO:teuthology.orchestra.run.smithi174.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 605 kB/s | 25 kB 00:00 2024-09-21T06:06:12.796 INFO:teuthology.orchestra.run.smithi174.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 20 MB/s | 10 MB 00:00 2024-09-21T06:06:12.854 INFO:teuthology.orchestra.run.smithi174.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T06:06:12.913 INFO:teuthology.orchestra.run.smithi174.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 466 kB/s | 27 kB 00:00 2024-09-21T06:06:12.963 INFO:teuthology.orchestra.run.smithi174.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T06:06:13.038 INFO:teuthology.orchestra.run.smithi174.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T06:06:13.105 INFO:teuthology.orchestra.run.smithi174.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:06:13.172 INFO:teuthology.orchestra.run.smithi174.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T06:06:13.247 INFO:teuthology.orchestra.run.smithi174.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T06:06:13.277 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.278 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.290 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:06:13.291 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.292 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:06:13.292 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.294 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:06:13.297 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.298 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.363 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.364 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.365 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-21T06:06:13.378 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:06:13.379 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:06:13.380 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:06:13.381 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:06:13.382 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:06:13.383 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:06:13.384 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:06:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:06:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:06:13.387 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:06:13.388 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:06:13.389 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:06:13.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:06:13.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:06:13.392 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:06:13.393 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================= 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout:Install 149 Packages 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 8 Packages 2024-09-21T06:06:13.394 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:06:13.395 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 228 M 2024-09-21T06:06:13.395 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-21T06:06:13.395 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:06:13.395 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.395 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:06:13.456 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:13.472 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:06:13.473 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:06:13.474 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-21T06:06:13.475 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:06:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:06:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:06:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:06:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:06:13.476 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:06:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:06:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:06:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:06:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:06:13.477 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:06:13.478 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:06:13.479 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:06:13.480 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:06:13.481 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:06:13.482 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:06:13.483 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:06:13.484 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Install 149 Packages 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 8 Packages 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 228 M 2024-09-21T06:06:13.485 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-21T06:06:13.523 INFO:teuthology.orchestra.run.smithi174.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T06:06:13.690 INFO:teuthology.orchestra.run.smithi174.stdout:(19/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T06:06:13.707 INFO:teuthology.orchestra.run.smithi174.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 246 kB/s | 45 kB 00:00 2024-09-21T06:06:13.740 INFO:teuthology.orchestra.run.smithi174.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T06:06:13.767 INFO:teuthology.orchestra.run.smithi044.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T06:06:13.774 INFO:teuthology.orchestra.run.smithi174.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T06:06:13.799 INFO:teuthology.orchestra.run.smithi174.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T06:06:13.824 INFO:teuthology.orchestra.run.smithi174.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:06:13.825 INFO:teuthology.orchestra.run.smithi038.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-21T06:06:13.850 INFO:teuthology.orchestra.run.smithi174.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:06:13.875 INFO:teuthology.orchestra.run.smithi174.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:06:13.959 INFO:teuthology.orchestra.run.smithi174.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-21T06:06:14.009 INFO:teuthology.orchestra.run.smithi044.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T06:06:14.026 INFO:teuthology.orchestra.run.smithi174.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 18 MB/s | 3.1 MB 00:00 2024-09-21T06:06:14.043 INFO:teuthology.orchestra.run.smithi174.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 410 kB/s | 34 kB 00:00 2024-09-21T06:06:14.068 INFO:teuthology.orchestra.run.smithi044.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T06:06:14.093 INFO:teuthology.orchestra.run.smithi174.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T06:06:14.367 INFO:teuthology.orchestra.run.smithi038.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.6 MB/s | 873 kB 00:00 2024-09-21T06:06:14.534 INFO:teuthology.orchestra.run.smithi038.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 891 kB/s | 148 kB 00:00 2024-09-21T06:06:14.534 INFO:teuthology.orchestra.run.smithi044.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.9 MB/s | 2.3 MB 00:00 2024-09-21T06:06:14.560 INFO:teuthology.orchestra.run.smithi174.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T06:06:14.652 INFO:teuthology.orchestra.run.smithi174.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T06:06:14.710 INFO:teuthology.orchestra.run.smithi044.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-21T06:06:15.002 INFO:teuthology.orchestra.run.smithi174.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 16 MB/s | 40 MB 00:02 2024-09-21T06:06:15.027 INFO:teuthology.orchestra.run.smithi174.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 131 kB/s | 49 kB 00:00 2024-09-21T06:06:15.035 INFO:teuthology.orchestra.run.smithi044.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.0 MB 00:00 2024-09-21T06:06:15.042 INFO:teuthology.orchestra.run.smithi038.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 5.5 MB 00:01 2024-09-21T06:06:15.052 INFO:teuthology.orchestra.run.smithi174.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T06:06:15.078 INFO:teuthology.orchestra.run.smithi174.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:06:15.145 INFO:teuthology.orchestra.run.smithi174.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 277 kB/s | 18 kB 00:00 2024-09-21T06:06:15.185 INFO:teuthology.orchestra.run.smithi174.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.8 MB/s | 784 kB 00:00 2024-09-21T06:06:15.284 INFO:teuthology.orchestra.run.smithi038.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.0 MB/s | 2.3 MB 00:00 2024-09-21T06:06:15.319 INFO:teuthology.orchestra.run.smithi174.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 460 kB/s | 80 kB 00:00 2024-09-21T06:06:15.402 INFO:teuthology.orchestra.run.smithi174.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T06:06:15.434 INFO:teuthology.orchestra.run.smithi038.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-09-21T06:06:15.436 INFO:teuthology.orchestra.run.smithi174.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-21T06:06:15.461 INFO:teuthology.orchestra.run.smithi174.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T06:06:15.512 INFO:teuthology.orchestra.run.smithi174.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:06:15.554 INFO:teuthology.orchestra.run.smithi174.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T06:06:15.579 INFO:teuthology.orchestra.run.smithi174.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T06:06:15.621 INFO:teuthology.orchestra.run.smithi174.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-21T06:06:15.755 INFO:teuthology.orchestra.run.smithi174.stdout:(47/157): ceph-mgr-dashboard-19.3.0-5120.g18432 8.3 MB/s | 14 MB 00:01 2024-09-21T06:06:15.779 INFO:teuthology.orchestra.run.smithi174.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-09-21T06:06:15.852 INFO:teuthology.orchestra.run.smithi044.stdout:(7/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 22 MB/s | 18 MB 00:00 2024-09-21T06:06:15.880 INFO:teuthology.orchestra.run.smithi174.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-21T06:06:15.905 INFO:teuthology.orchestra.run.smithi174.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 851 kB/s | 107 kB 00:00 2024-09-21T06:06:15.939 INFO:teuthology.orchestra.run.smithi174.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-21T06:06:15.964 INFO:teuthology.orchestra.run.smithi174.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T06:06:16.007 INFO:teuthology.orchestra.run.smithi174.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 481 kB/s | 33 kB 00:00 2024-09-21T06:06:16.040 INFO:teuthology.orchestra.run.smithi174.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-21T06:06:16.057 INFO:teuthology.orchestra.run.smithi174.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 371 kB/s | 18 kB 00:00 2024-09-21T06:06:16.073 INFO:teuthology.orchestra.run.smithi174.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-21T06:06:16.099 INFO:teuthology.orchestra.run.smithi174.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-21T06:06:16.124 INFO:teuthology.orchestra.run.smithi174.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:06:16.141 INFO:teuthology.orchestra.run.smithi174.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:06:16.175 INFO:teuthology.orchestra.run.smithi174.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-21T06:06:16.216 INFO:teuthology.orchestra.run.smithi174.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T06:06:16.233 INFO:teuthology.orchestra.run.smithi174.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T06:06:16.250 INFO:teuthology.orchestra.run.smithi174.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T06:06:16.269 INFO:teuthology.orchestra.run.smithi044.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 25 MB/s | 10 MB 00:00 2024-09-21T06:06:16.276 INFO:teuthology.orchestra.run.smithi174.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-21T06:06:16.301 INFO:teuthology.orchestra.run.smithi174.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T06:06:16.318 INFO:teuthology.orchestra.run.smithi174.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 923 kB/s | 38 kB 00:00 2024-09-21T06:06:16.368 INFO:teuthology.orchestra.run.smithi174.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-21T06:06:16.460 INFO:teuthology.orchestra.run.smithi174.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T06:06:16.486 INFO:teuthology.orchestra.run.smithi044.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 7.0 MB/s | 20 MB 00:02 2024-09-21T06:06:16.511 INFO:teuthology.orchestra.run.smithi044.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 104 kB/s | 25 kB 00:00 2024-09-21T06:06:16.527 INFO:teuthology.orchestra.run.smithi174.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-21T06:06:16.535 INFO:teuthology.orchestra.run.smithi038.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 4.0 MB/s | 5.0 MB 00:01 2024-09-21T06:06:16.561 INFO:teuthology.orchestra.run.smithi044.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:06:16.585 INFO:teuthology.orchestra.run.smithi174.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T06:06:16.611 INFO:teuthology.orchestra.run.smithi174.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T06:06:16.612 INFO:teuthology.orchestra.run.smithi044.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T06:06:16.653 INFO:teuthology.orchestra.run.smithi174.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-21T06:06:16.662 INFO:teuthology.orchestra.run.smithi044.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T06:06:16.687 INFO:teuthology.orchestra.run.smithi174.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T06:06:16.711 INFO:teuthology.orchestra.run.smithi174.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T06:06:16.758 INFO:teuthology.orchestra.run.smithi044.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.8 MB/s | 766 kB 00:00 2024-09-21T06:06:16.762 INFO:teuthology.orchestra.run.smithi174.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T06:06:16.804 INFO:teuthology.orchestra.run.smithi044.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.4 MB/s | 158 kB 00:00 2024-09-21T06:06:16.837 INFO:teuthology.orchestra.run.smithi174.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T06:06:16.871 INFO:teuthology.orchestra.run.smithi174.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T06:06:16.888 INFO:teuthology.orchestra.run.smithi044.stdout:(16/157): ceph-base-19.3.0-5120.g18432218.el9.x 1.7 MB/s | 5.5 MB 00:03 2024-09-21T06:06:16.896 INFO:teuthology.orchestra.run.smithi174.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T06:06:16.913 INFO:teuthology.orchestra.run.smithi044.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.1 MB/s | 127 kB 00:00 2024-09-21T06:06:16.921 INFO:teuthology.orchestra.run.smithi174.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T06:06:16.947 INFO:teuthology.orchestra.run.smithi174.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T06:06:16.972 INFO:teuthology.orchestra.run.smithi174.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T06:06:16.997 INFO:teuthology.orchestra.run.smithi174.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-21T06:06:17.081 INFO:teuthology.orchestra.run.smithi174.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T06:06:17.106 INFO:teuthology.orchestra.run.smithi174.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T06:06:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 24 MB/s | 5.3 MB 00:00 2024-09-21T06:06:17.131 INFO:teuthology.orchestra.run.smithi174.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-21T06:06:17.157 INFO:teuthology.orchestra.run.smithi174.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:06:17.164 INFO:teuthology.orchestra.run.smithi044.stdout:(19/157): libradosstriper1-19.3.0-5120.g1843221 1.8 MB/s | 507 kB 00:00 2024-09-21T06:06:17.181 INFO:teuthology.orchestra.run.smithi044.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 897 kB/s | 45 kB 00:00 2024-09-21T06:06:17.182 INFO:teuthology.orchestra.run.smithi174.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-21T06:06:17.207 INFO:teuthology.orchestra.run.smithi174.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T06:06:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T06:06:17.241 INFO:teuthology.orchestra.run.smithi174.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T06:06:17.256 INFO:teuthology.orchestra.run.smithi044.stdout:(22/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T06:06:17.266 INFO:teuthology.orchestra.run.smithi174.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T06:06:17.282 INFO:teuthology.orchestra.run.smithi044.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T06:06:17.291 INFO:teuthology.orchestra.run.smithi174.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:06:17.317 INFO:teuthology.orchestra.run.smithi174.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:06:17.332 INFO:teuthology.orchestra.run.smithi044.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:06:17.357 INFO:teuthology.orchestra.run.smithi044.stdout:(25/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T06:06:17.383 INFO:teuthology.orchestra.run.smithi044.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:06:17.392 INFO:teuthology.orchestra.run.smithi174.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T06:06:17.409 INFO:teuthology.orchestra.run.smithi174.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-09-21T06:06:17.426 INFO:teuthology.orchestra.run.smithi174.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T06:06:17.433 INFO:teuthology.orchestra.run.smithi044.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:06:17.451 INFO:teuthology.orchestra.run.smithi174.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-21T06:06:17.468 INFO:teuthology.orchestra.run.smithi174.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 858 kB/s | 36 kB 00:00 2024-09-21T06:06:17.483 INFO:teuthology.orchestra.run.smithi044.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 687 kB/s | 34 kB 00:00 2024-09-21T06:06:17.485 INFO:teuthology.orchestra.run.smithi174.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T06:06:17.510 INFO:teuthology.orchestra.run.smithi174.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-21T06:06:17.527 INFO:teuthology.orchestra.run.smithi174.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T06:06:17.534 INFO:teuthology.orchestra.run.smithi044.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:06:17.561 INFO:teuthology.orchestra.run.smithi174.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T06:06:17.577 INFO:teuthology.orchestra.run.smithi174.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:06:17.603 INFO:teuthology.orchestra.run.smithi174.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-21T06:06:17.678 INFO:teuthology.orchestra.run.smithi174.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-21T06:06:17.727 INFO:teuthology.orchestra.run.smithi038.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 7.8 MB/s | 18 MB 00:02 2024-09-21T06:06:17.728 INFO:teuthology.orchestra.run.smithi174.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:06:17.762 INFO:teuthology.orchestra.run.smithi174.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:06:17.912 INFO:teuthology.orchestra.run.smithi174.stdout:(107/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T06:06:17.937 INFO:teuthology.orchestra.run.smithi174.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 111 kB/s | 19 kB 00:00 2024-09-21T06:06:17.952 INFO:teuthology.orchestra.run.smithi038.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 4.7 MB/s | 20 MB 00:04 2024-09-21T06:06:17.977 INFO:teuthology.orchestra.run.smithi038.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 101 kB/s | 25 kB 00:00 2024-09-21T06:06:17.979 INFO:teuthology.orchestra.run.smithi174.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T06:06:18.004 INFO:teuthology.orchestra.run.smithi174.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 434 kB/s | 26 kB 00:00 2024-09-21T06:06:18.009 INFO:teuthology.orchestra.run.smithi044.stdout:(30/157): ceph-mgr-dashboard-19.3.0-5120.g18432 30 MB/s | 14 MB 00:00 2024-09-21T06:06:18.038 INFO:teuthology.orchestra.run.smithi174.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-21T06:06:18.044 INFO:teuthology.orchestra.run.smithi038.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T06:06:18.072 INFO:teuthology.orchestra.run.smithi174.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2024-09-21T06:06:18.097 INFO:teuthology.orchestra.run.smithi174.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 745 kB/s | 67 kB 00:00 2024-09-21T06:06:18.136 INFO:teuthology.orchestra.run.smithi038.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 294 kB/s | 27 kB 00:00 2024-09-21T06:06:18.148 INFO:teuthology.orchestra.run.smithi174.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T06:06:18.173 INFO:teuthology.orchestra.run.smithi174.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:06:18.198 INFO:teuthology.orchestra.run.smithi174.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:06:18.220 INFO:teuthology.orchestra.run.smithi038.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 381 kB/s | 32 kB 00:00 2024-09-21T06:06:18.224 INFO:teuthology.orchestra.run.smithi174.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T06:06:18.248 INFO:teuthology.orchestra.run.smithi174.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-21T06:06:18.274 INFO:teuthology.orchestra.run.smithi174.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T06:06:18.284 INFO:teuthology.orchestra.run.smithi044.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 27 MB/s | 7.4 MB 00:00 2024-09-21T06:06:18.307 INFO:teuthology.orchestra.run.smithi174.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T06:06:18.333 INFO:teuthology.orchestra.run.smithi174.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T06:06:18.337 INFO:teuthology.orchestra.run.smithi038.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.4 MB/s | 766 kB 00:00 2024-09-21T06:06:18.351 INFO:teuthology.orchestra.run.smithi044.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:06:18.358 INFO:teuthology.orchestra.run.smithi174.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:06:18.387 INFO:teuthology.orchestra.run.smithi038.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T06:06:18.393 INFO:teuthology.orchestra.run.smithi044.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.2 MB/s | 49 kB 00:00 2024-09-21T06:06:18.425 INFO:teuthology.orchestra.run.smithi174.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-21T06:06:18.437 INFO:teuthology.orchestra.run.smithi038.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:06:18.444 INFO:teuthology.orchestra.run.smithi044.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 324 kB/s | 16 kB 00:00 2024-09-21T06:06:18.450 INFO:teuthology.orchestra.run.smithi174.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-21T06:06:18.475 INFO:teuthology.orchestra.run.smithi174.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-21T06:06:18.501 INFO:teuthology.orchestra.run.smithi174.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-21T06:06:18.513 INFO:teuthology.orchestra.run.smithi038.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T06:06:18.519 INFO:teuthology.orchestra.run.smithi044.stdout:(35/157): rbd-mirror-19.3.0-5120.g18432218.el9. 2.7 MB/s | 3.1 MB 00:01 2024-09-21T06:06:18.526 INFO:teuthology.orchestra.run.smithi174.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T06:06:18.551 INFO:teuthology.orchestra.run.smithi174.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T06:06:18.553 INFO:teuthology.orchestra.run.smithi044.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.6 MB/s | 285 kB 00:00 2024-09-21T06:06:18.578 INFO:teuthology.orchestra.run.smithi174.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T06:06:18.602 INFO:teuthology.orchestra.run.smithi174.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:06:18.603 INFO:teuthology.orchestra.run.smithi044.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T06:06:18.630 INFO:teuthology.orchestra.run.smithi038.stdout:(18/157): ceph-radosgw-19.3.0-5120.g18432218.el 5.0 MB/s | 10 MB 00:02 2024-09-21T06:06:18.635 INFO:teuthology.orchestra.run.smithi174.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T06:06:18.669 INFO:teuthology.orchestra.run.smithi174.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-21T06:06:18.680 INFO:teuthology.orchestra.run.smithi038.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 909 kB/s | 45 kB 00:00 2024-09-21T06:06:18.694 INFO:teuthology.orchestra.run.smithi174.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-21T06:06:18.711 INFO:teuthology.orchestra.run.smithi174.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 988 kB/s | 16 kB 00:00 2024-09-21T06:06:18.712 INFO:teuthology.orchestra.run.smithi044.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.0 MB/s | 784 kB 00:00 2024-09-21T06:06:18.730 INFO:teuthology.orchestra.run.smithi038.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T06:06:18.736 INFO:teuthology.orchestra.run.smithi174.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:06:18.770 INFO:teuthology.orchestra.run.smithi174.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T06:06:18.782 INFO:teuthology.orchestra.run.smithi038.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T06:06:18.787 INFO:teuthology.orchestra.run.smithi174.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T06:06:18.804 INFO:teuthology.orchestra.run.smithi174.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-21T06:06:18.847 INFO:teuthology.orchestra.run.smithi038.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T06:06:18.854 INFO:teuthology.orchestra.run.smithi174.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-21T06:06:18.879 INFO:teuthology.orchestra.run.smithi174.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-09-21T06:06:18.905 INFO:teuthology.orchestra.run.smithi174.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-21T06:06:18.914 INFO:teuthology.orchestra.run.smithi038.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:06:18.939 INFO:teuthology.orchestra.run.smithi174.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T06:06:18.964 INFO:teuthology.orchestra.run.smithi174.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 886 kB/s | 74 kB 00:00 2024-09-21T06:06:18.964 INFO:teuthology.orchestra.run.smithi038.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:06:18.989 INFO:teuthology.orchestra.run.smithi174.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:06:19.014 INFO:teuthology.orchestra.run.smithi174.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T06:06:19.015 INFO:teuthology.orchestra.run.smithi038.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:06:19.040 INFO:teuthology.orchestra.run.smithi174.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T06:06:19.065 INFO:teuthology.orchestra.run.smithi174.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:06:19.090 INFO:teuthology.orchestra.run.smithi174.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:06:19.141 INFO:teuthology.orchestra.run.smithi174.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:06:19.149 INFO:teuthology.orchestra.run.smithi038.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 8.3 MB/s | 5.3 MB 00:00 2024-09-21T06:06:19.199 INFO:teuthology.orchestra.run.smithi038.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:06:19.237 INFO:teuthology.orchestra.run.smithi044.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-21T06:06:19.249 INFO:teuthology.orchestra.run.smithi038.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T06:06:19.308 INFO:teuthology.orchestra.run.smithi038.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T06:06:19.425 INFO:teuthology.orchestra.run.smithi174.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-21T06:06:19.482 INFO:teuthology.orchestra.run.smithi174.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 3.4 MB 00:00 2024-09-21T06:06:19.541 INFO:teuthology.orchestra.run.smithi038.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.9 MB/s | 3.1 MB 00:00 2024-09-21T06:06:19.616 INFO:teuthology.orchestra.run.smithi174.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 307 kB/s | 41 kB 00:00 2024-09-21T06:06:19.733 INFO:teuthology.orchestra.run.smithi174.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.9 MB/s | 1.8 MB 00:00 2024-09-21T06:06:19.758 INFO:teuthology.orchestra.run.smithi174.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-21T06:06:19.804 INFO:teuthology.orchestra.run.smithi044.stdout:(40/157): ceph-test-19.3.0-5120.g18432218.el9.x 12 MB/s | 40 MB 00:03 2024-09-21T06:06:19.808 INFO:teuthology.orchestra.run.smithi174.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-21T06:06:19.909 INFO:teuthology.orchestra.run.smithi174.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.0 MB/s | 2.3 MB 00:00 2024-09-21T06:06:19.967 INFO:teuthology.orchestra.run.smithi174.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-21T06:06:19.974 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:06:19.974 INFO:teuthology.orchestra.run.smithi174.stdout:Total 25 MB/s | 228 MB 00:09 2024-09-21T06:06:20.071 INFO:teuthology.orchestra.run.smithi044.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 590 kB/s | 801 kB 00:01 2024-09-21T06:06:20.367 INFO:teuthology.orchestra.run.smithi038.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.9 MB/s | 7.4 MB 00:00 2024-09-21T06:06:20.421 INFO:teuthology.orchestra.run.smithi044.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 161 kB/s | 191 kB 00:01 2024-09-21T06:06:20.434 INFO:teuthology.orchestra.run.smithi038.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:06:20.484 INFO:teuthology.orchestra.run.smithi038.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 991 kB/s | 49 kB 00:00 2024-09-21T06:06:20.635 INFO:teuthology.orchestra.run.smithi038.stdout:(34/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T06:06:20.651 INFO:teuthology.orchestra.run.smithi038.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 98 kB/s | 16 kB 00:00 2024-09-21T06:06:20.685 INFO:teuthology.orchestra.run.smithi038.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:06:20.688 INFO:teuthology.orchestra.run.smithi044.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 289 kB/s | 253 kB 00:00 2024-09-21T06:06:20.727 INFO:teuthology.orchestra.run.smithi038.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 443 kB/s | 18 kB 00:00 2024-09-21T06:06:20.777 INFO:teuthology.orchestra.run.smithi038.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.1 MB/s | 784 kB 00:00 2024-09-21T06:06:20.836 INFO:teuthology.orchestra.run.smithi038.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-21T06:06:20.903 INFO:teuthology.orchestra.run.smithi038.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T06:06:20.945 INFO:teuthology.orchestra.run.smithi038.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-21T06:06:20.978 INFO:teuthology.orchestra.run.smithi038.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-21T06:06:21.020 INFO:teuthology.orchestra.run.smithi038.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-21T06:06:21.046 INFO:teuthology.orchestra.run.smithi038.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T06:06:21.071 INFO:teuthology.orchestra.run.smithi038.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:06:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:06:21.122 INFO:teuthology.orchestra.run.smithi038.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T06:06:21.172 INFO:teuthology.orchestra.run.smithi044.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 142 kB/s | 106 kB 00:00 2024-09-21T06:06:21.217 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-21T06:06:21.368 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-21T06:06:21.368 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-21T06:06:21.389 INFO:teuthology.orchestra.run.smithi038.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-21T06:06:21.413 INFO:teuthology.orchestra.run.smithi044.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 186 kB/s | 135 kB 00:00 2024-09-21T06:06:21.430 INFO:teuthology.orchestra.run.smithi038.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-21T06:06:21.456 INFO:teuthology.orchestra.run.smithi038.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-21T06:06:21.481 INFO:teuthology.orchestra.run.smithi038.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-21T06:06:21.515 INFO:teuthology.orchestra.run.smithi038.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T06:06:21.540 INFO:teuthology.orchestra.run.smithi038.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T06:06:21.590 INFO:teuthology.orchestra.run.smithi038.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-21T06:06:21.641 INFO:teuthology.orchestra.run.smithi038.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T06:06:21.664 INFO:teuthology.orchestra.run.smithi044.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 788 kB/s | 1.2 MB 00:01 2024-09-21T06:06:21.699 INFO:teuthology.orchestra.run.smithi038.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-21T06:06:21.766 INFO:teuthology.orchestra.run.smithi038.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-09-21T06:06:21.817 INFO:teuthology.orchestra.run.smithi038.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-21T06:06:21.839 INFO:teuthology.orchestra.run.smithi044.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-21T06:06:21.875 INFO:teuthology.orchestra.run.smithi038.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T06:06:22.015 INFO:teuthology.orchestra.run.smithi044.stdout:(48/157): python3-requests-2.25.1-8.el9.noarch. 148 kB/s | 125 kB 00:00 2024-09-21T06:06:22.584 INFO:teuthology.orchestra.run.smithi038.stdout:(60/157): ceph-test-19.3.0-5120.g18432218.el9.x 9.0 MB/s | 40 MB 00:04 2024-09-21T06:06:22.584 INFO:teuthology.orchestra.run.smithi038.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 1.0 MB/s | 581 kB 00:00 2024-09-21T06:06:22.584 INFO:teuthology.orchestra.run.smithi038.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-21T06:06:22.584 INFO:teuthology.orchestra.run.smithi038.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 183 kB/s | 24 kB 00:00 2024-09-21T06:06:22.584 INFO:teuthology.orchestra.run.smithi038.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-21T06:06:22.585 INFO:teuthology.orchestra.run.smithi044.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-21T06:06:22.585 INFO:teuthology.orchestra.run.smithi044.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 651 kB/s | 22 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 851 kB/s | 107 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 987 kB/s | 33 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(55/157): python3-urllib3-1.26.5-6.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T06:06:22.586 INFO:teuthology.orchestra.run.smithi044.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 589 kB/s | 24 kB 00:00 2024-09-21T06:06:22.622 INFO:teuthology.orchestra.run.smithi044.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T06:06:22.661 INFO:teuthology.orchestra.run.smithi038.stdout:(65/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-21T06:06:22.669 INFO:teuthology.orchestra.run.smithi044.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-09-21T06:06:22.697 INFO:teuthology.orchestra.run.smithi038.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-21T06:06:22.720 INFO:teuthology.orchestra.run.smithi038.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-21T06:06:22.736 INFO:teuthology.orchestra.run.smithi044.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T06:06:22.761 INFO:teuthology.orchestra.run.smithi044.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T06:06:22.786 INFO:teuthology.orchestra.run.smithi044.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-21T06:06:22.862 INFO:teuthology.orchestra.run.smithi044.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2024-09-21T06:06:22.919 INFO:teuthology.orchestra.run.smithi038.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-21T06:06:23.181 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-21T06:06:23.182 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-21T06:06:23.304 INFO:teuthology.orchestra.run.smithi044.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-09-21T06:06:23.379 INFO:teuthology.orchestra.run.smithi038.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-21T06:06:23.487 INFO:teuthology.orchestra.run.smithi038.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-21T06:06:23.571 INFO:teuthology.orchestra.run.smithi044.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-21T06:06:23.637 INFO:teuthology.orchestra.run.smithi044.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T06:06:23.946 INFO:teuthology.orchestra.run.smithi044.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-21T06:06:24.346 INFO:teuthology.orchestra.run.smithi044.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.1 MB/s | 4.9 MB 00:01 2024-09-21T06:06:24.388 INFO:teuthology.orchestra.run.smithi044.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-09-21T06:06:24.430 INFO:teuthology.orchestra.run.smithi044.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T06:06:24.464 INFO:teuthology.orchestra.run.smithi044.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-21T06:06:24.556 INFO:teuthology.orchestra.run.smithi044.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T06:06:24.579 INFO:teuthology.orchestra.run.smithi038.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-09-21T06:06:24.648 INFO:teuthology.orchestra.run.smithi044.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-21T06:06:24.681 INFO:teuthology.orchestra.run.smithi044.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 763 kB/s | 26 kB 00:00 2024-09-21T06:06:24.715 INFO:teuthology.orchestra.run.smithi044.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 576 kB/s | 19 kB 00:00 2024-09-21T06:06:24.790 INFO:teuthology.orchestra.run.smithi044.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T06:06:24.824 INFO:teuthology.orchestra.run.smithi044.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-21T06:06:25.129 INFO:teuthology.orchestra.run.smithi038.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.0 MB/s | 4.9 MB 00:02 2024-09-21T06:06:25.162 INFO:teuthology.orchestra.run.smithi038.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-21T06:06:25.213 INFO:teuthology.orchestra.run.smithi038.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T06:06:25.249 INFO:teuthology.orchestra.run.smithi044.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-21T06:06:25.263 INFO:teuthology.orchestra.run.smithi038.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T06:06:25.405 INFO:teuthology.orchestra.run.smithi038.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T06:06:25.458 INFO:teuthology.orchestra.run.smithi044.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-09-21T06:06:25.539 INFO:teuthology.orchestra.run.smithi038.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-09-21T06:06:25.550 INFO:teuthology.orchestra.run.smithi044.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T06:06:25.589 INFO:teuthology.orchestra.run.smithi038.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T06:06:25.608 INFO:teuthology.orchestra.run.smithi044.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T06:06:25.639 INFO:teuthology.orchestra.run.smithi038.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-21T06:06:25.650 INFO:teuthology.orchestra.run.smithi044.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T06:06:25.750 INFO:teuthology.orchestra.run.smithi044.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-21T06:06:25.756 INFO:teuthology.orchestra.run.smithi038.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T06:06:25.807 INFO:teuthology.orchestra.run.smithi038.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-21T06:06:25.817 INFO:teuthology.orchestra.run.smithi044.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T06:06:25.926 INFO:teuthology.orchestra.run.smithi044.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-21T06:06:25.968 INFO:teuthology.orchestra.run.smithi044.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T06:06:26.010 INFO:teuthology.orchestra.run.smithi044.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-21T06:06:26.274 INFO:teuthology.orchestra.run.smithi038.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-09-21T06:06:26.302 INFO:teuthology.orchestra.run.smithi044.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-21T06:06:26.344 INFO:teuthology.orchestra.run.smithi044.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T06:06:26.386 INFO:teuthology.orchestra.run.smithi044.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T06:06:26.415 INFO:teuthology.orchestra.run.smithi038.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-21T06:06:26.478 INFO:teuthology.orchestra.run.smithi044.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-21T06:06:26.528 INFO:teuthology.orchestra.run.smithi044.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-21T06:06:26.553 INFO:teuthology.orchestra.run.smithi044.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-21T06:06:26.565 INFO:teuthology.orchestra.run.smithi038.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-21T06:06:26.579 INFO:teuthology.orchestra.run.smithi044.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T06:06:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T06:06:26.658 INFO:teuthology.orchestra.run.smithi038.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-09-21T06:06:26.679 INFO:teuthology.orchestra.run.smithi044.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T06:06:26.704 INFO:teuthology.orchestra.run.smithi044.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-21T06:06:26.709 INFO:teuthology.orchestra.run.smithi038.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-21T06:06:26.746 INFO:teuthology.orchestra.run.smithi044.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-21T06:06:26.772 INFO:teuthology.orchestra.run.smithi044.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-21T06:06:26.930 INFO:teuthology.orchestra.run.smithi044.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-09-21T06:06:26.971 INFO:teuthology.orchestra.run.smithi038.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 1.0 MB/s | 269 kB 00:00 2024-09-21T06:06:27.048 INFO:teuthology.orchestra.run.smithi044.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-21T06:06:27.089 INFO:teuthology.orchestra.run.smithi044.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-21T06:06:27.115 INFO:teuthology.orchestra.run.smithi044.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 771 kB/s | 19 kB 00:00 2024-09-21T06:06:27.150 INFO:teuthology.orchestra.run.smithi038.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 888 kB/s | 159 kB 00:00 2024-09-21T06:06:27.232 INFO:teuthology.orchestra.run.smithi044.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:06:27.249 INFO:teuthology.orchestra.run.smithi044.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T06:06:27.266 INFO:teuthology.orchestra.run.smithi044.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-21T06:06:27.267 INFO:teuthology.orchestra.run.smithi038.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T06:06:27.299 INFO:teuthology.orchestra.run.smithi044.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T06:06:27.325 INFO:teuthology.orchestra.run.smithi044.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:06:27.326 INFO:teuthology.orchestra.run.smithi038.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-21T06:06:27.376 INFO:teuthology.orchestra.run.smithi044.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T06:06:27.386 INFO:teuthology.orchestra.run.smithi038.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 920 kB/s | 54 kB 00:00 2024-09-21T06:06:27.417 INFO:teuthology.orchestra.run.smithi044.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T06:06:27.434 INFO:teuthology.orchestra.run.smithi044.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T06:06:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:06:27.493 INFO:teuthology.orchestra.run.smithi044.stdout:(117/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-09-21T06:06:27.510 INFO:teuthology.orchestra.run.smithi044.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-21T06:06:27.552 INFO:teuthology.orchestra.run.smithi044.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-21T06:06:27.585 INFO:teuthology.orchestra.run.smithi044.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.5 MB/s | 303 kB 00:00 2024-09-21T06:06:27.627 INFO:teuthology.orchestra.run.smithi044.stdout:(121/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-21T06:06:27.653 INFO:teuthology.orchestra.run.smithi044.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-21T06:06:27.686 INFO:teuthology.orchestra.run.smithi044.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T06:06:27.712 INFO:teuthology.orchestra.run.smithi044.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T06:06:27.737 INFO:teuthology.orchestra.run.smithi044.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T06:06:27.762 INFO:teuthology.orchestra.run.smithi044.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-21T06:06:27.788 INFO:teuthology.orchestra.run.smithi044.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-21T06:06:27.813 INFO:teuthology.orchestra.run.smithi044.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-21T06:06:27.818 INFO:teuthology.orchestra.run.smithi038.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2024-09-21T06:06:27.861 INFO:teuthology.orchestra.run.smithi038.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T06:06:27.902 INFO:teuthology.orchestra.run.smithi038.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T06:06:27.980 INFO:teuthology.orchestra.run.smithi044.stdout:(129/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.3 MB/s | 16 MB 00:01 2024-09-21T06:06:28.039 INFO:teuthology.orchestra.run.smithi044.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-09-21T06:06:28.053 INFO:teuthology.orchestra.run.smithi038.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-21T06:06:28.080 INFO:teuthology.orchestra.run.smithi044.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-21T06:06:28.094 INFO:teuthology.orchestra.run.smithi038.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 861 kB/s | 36 kB 00:00 2024-09-21T06:06:28.106 INFO:teuthology.orchestra.run.smithi044.stdout:(132/157): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2024-09-21T06:06:28.131 INFO:teuthology.orchestra.run.smithi044.stdout:(133/157): python3-more-itertools-8.12.0-2.el9. 875 kB/s | 79 kB 00:00 2024-09-21T06:06:28.136 INFO:teuthology.orchestra.run.smithi038.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T06:06:28.156 INFO:teuthology.orchestra.run.smithi044.stdout:(134/157): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-21T06:06:28.181 INFO:teuthology.orchestra.run.smithi044.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-21T06:06:28.207 INFO:teuthology.orchestra.run.smithi044.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:06:28.232 INFO:teuthology.orchestra.run.smithi044.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T06:06:28.257 INFO:teuthology.orchestra.run.smithi044.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-09-21T06:06:28.283 INFO:teuthology.orchestra.run.smithi044.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-21T06:06:28.308 INFO:teuthology.orchestra.run.smithi044.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T06:06:28.311 INFO:teuthology.orchestra.run.smithi038.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-21T06:06:28.333 INFO:teuthology.orchestra.run.smithi044.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-21T06:06:28.359 INFO:teuthology.orchestra.run.smithi044.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T06:06:28.362 INFO:teuthology.orchestra.run.smithi038.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:06:28.385 INFO:teuthology.orchestra.run.smithi044.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-21T06:06:28.409 INFO:teuthology.orchestra.run.smithi044.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T06:06:28.434 INFO:teuthology.orchestra.run.smithi044.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T06:06:28.451 INFO:teuthology.orchestra.run.smithi044.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-21T06:06:28.454 INFO:teuthology.orchestra.run.smithi038.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-21T06:06:28.485 INFO:teuthology.orchestra.run.smithi044.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:06:28.510 INFO:teuthology.orchestra.run.smithi044.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:06:28.537 INFO:teuthology.orchestra.run.smithi038.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 766 kB/s | 64 kB 00:00 2024-09-21T06:06:28.560 INFO:teuthology.orchestra.run.smithi044.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T06:06:28.589 INFO:teuthology.orchestra.run.smithi038.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T06:06:28.688 INFO:teuthology.orchestra.run.smithi038.stdout:(103/157): python3-numpy-1.20.1-5.el9.x86_64.rp 1.8 MB/s | 5.1 MB 00:02 2024-09-21T06:06:28.713 INFO:teuthology.orchestra.run.smithi038.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-21T06:06:28.727 INFO:teuthology.orchestra.run.smithi044.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T06:06:28.764 INFO:teuthology.orchestra.run.smithi038.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:06:28.797 INFO:teuthology.orchestra.run.smithi038.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:06:28.814 INFO:teuthology.orchestra.run.smithi038.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T06:06:28.931 INFO:teuthology.orchestra.run.smithi038.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:06:28.948 INFO:teuthology.orchestra.run.smithi038.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-21T06:06:28.973 INFO:teuthology.orchestra.run.smithi038.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:06:28.999 INFO:teuthology.orchestra.run.smithi038.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:06:29.024 INFO:teuthology.orchestra.run.smithi038.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:06:29.058 INFO:teuthology.orchestra.run.smithi038.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T06:06:29.100 INFO:teuthology.orchestra.run.smithi038.stdout:(114/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-21T06:06:29.141 INFO:teuthology.orchestra.run.smithi038.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-21T06:06:29.153 INFO:teuthology.orchestra.run.smithi044.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 3.2 MB 00:00 2024-09-21T06:06:29.167 INFO:teuthology.orchestra.run.smithi038.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T06:06:29.192 INFO:teuthology.orchestra.run.smithi038.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-21T06:06:29.226 INFO:teuthology.orchestra.run.smithi038.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-21T06:06:29.251 INFO:teuthology.orchestra.run.smithi038.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T06:06:29.285 INFO:teuthology.orchestra.run.smithi038.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T06:06:29.310 INFO:teuthology.orchestra.run.smithi038.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:06:29.336 INFO:teuthology.orchestra.run.smithi038.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:06:29.369 INFO:teuthology.orchestra.run.smithi038.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T06:06:29.395 INFO:teuthology.orchestra.run.smithi038.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T06:06:29.420 INFO:teuthology.orchestra.run.smithi038.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T06:06:29.445 INFO:teuthology.orchestra.run.smithi038.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-21T06:06:29.470 INFO:teuthology.orchestra.run.smithi038.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T06:06:29.471 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-21T06:06:29.496 INFO:teuthology.orchestra.run.smithi038.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-21T06:06:29.554 INFO:teuthology.orchestra.run.smithi038.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T06:06:29.579 INFO:teuthology.orchestra.run.smithi038.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:06:29.587 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:06:29.594 INFO:teuthology.orchestra.run.smithi044.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-21T06:06:29.604 INFO:teuthology.orchestra.run.smithi038.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:06:29.638 INFO:teuthology.orchestra.run.smithi038.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-21T06:06:29.663 INFO:teuthology.orchestra.run.smithi038.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-09-21T06:06:29.689 INFO:teuthology.orchestra.run.smithi038.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T06:06:29.712 INFO:teuthology.orchestra.run.smithi044.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-09-21T06:06:29.714 INFO:teuthology.orchestra.run.smithi038.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:06:29.734 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:06:29.737 INFO:teuthology.orchestra.run.smithi044.stdout:(154/157): NetworkManager-team-1.51.0-1.el9.x86 70 kB/s | 41 kB 00:00 2024-09-21T06:06:29.739 INFO:teuthology.orchestra.run.smithi038.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T06:06:29.765 INFO:teuthology.orchestra.run.smithi038.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 554 kB/s | 28 kB 00:00 2024-09-21T06:06:29.791 INFO:teuthology.orchestra.run.smithi038.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 604 kB/s | 31 kB 00:00 2024-09-21T06:06:29.817 INFO:teuthology.orchestra.run.smithi038.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:06:29.833 INFO:teuthology.orchestra.run.smithi038.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 2.2 MB/s | 36 kB 00:00 2024-09-21T06:06:29.858 INFO:teuthology.orchestra.run.smithi038.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-21T06:06:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:06:29.884 INFO:teuthology.orchestra.run.smithi038.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:06:29.905 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:06:29.909 INFO:teuthology.orchestra.run.smithi038.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:06:29.930 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:06:29.934 INFO:teuthology.orchestra.run.smithi038.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:06:29.959 INFO:teuthology.orchestra.run.smithi038.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-21T06:06:29.982 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:06:29.985 INFO:teuthology.orchestra.run.smithi038.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T06:06:30.010 INFO:teuthology.orchestra.run.smithi038.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T06:06:30.069 INFO:teuthology.orchestra.run.smithi038.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T06:06:30.322 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:06:30.362 INFO:teuthology.orchestra.run.smithi044.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 325 kB/s | 249 kB 00:00 2024-09-21T06:06:30.411 INFO:teuthology.orchestra.run.smithi038.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T06:06:30.431 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:30.478 INFO:teuthology.orchestra.run.smithi038.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 7.3 MB/s | 3.4 MB 00:00 2024-09-21T06:06:30.558 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:30.582 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:30.628 INFO:teuthology.orchestra.run.smithi038.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-21T06:06:30.662 INFO:teuthology.orchestra.run.smithi044.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-21T06:06:30.670 INFO:teuthology.orchestra.run.smithi038.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 984 kB/s | 41 kB 00:00 2024-09-21T06:06:30.674 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:30.711 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:06:30.712 INFO:teuthology.orchestra.run.smithi038.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.7 MB/s | 1.8 MB 00:00 2024-09-21T06:06:30.737 INFO:teuthology.orchestra.run.smithi038.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-09-21T06:06:30.749 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:06:30.762 INFO:teuthology.orchestra.run.smithi044.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-21T06:06:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:06:30.769 INFO:teuthology.orchestra.run.smithi044.stdout:Total 13 MB/s | 228 MB 00:17 2024-09-21T06:06:30.779 INFO:teuthology.orchestra.run.smithi038.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T06:06:30.838 INFO:teuthology.orchestra.run.smithi038.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-21T06:06:30.900 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:06:30.942 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:06:30.970 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:31.068 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:31.096 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:31.159 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:31.181 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:31.390 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:31.519 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:31.637 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:06:31.747 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:31.830 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:31.970 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-21T06:06:32.057 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-21T06:06:32.140 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-21T06:06:32.165 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:06:32.193 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:06:32.228 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:06:32.301 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:06:32.365 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:06:32.405 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:06:32.449 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:06:32.482 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:06:32.509 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:06:32.578 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:06:32.631 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:06:32.670 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:06:32.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:06:32.787 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:06:32.835 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:06:32.876 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:06:32.905 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:06:32.975 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:06:33.019 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:06:33.093 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:06:33.234 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:06:33.288 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:06:33.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:06:33.892 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:06:33.929 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:06:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:06:34.010 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:06:34.052 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:06:34.065 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-21T06:06:34.066 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-21T06:06:34.220 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:06:34.286 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:06:34.384 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:06:34.450 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:06:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:06:34.572 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:06:34.609 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:06:34.656 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:06:34.691 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:06:34.735 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:06:34.777 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:06:34.879 INFO:teuthology.orchestra.run.smithi038.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-21T06:06:34.885 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:06:34.886 INFO:teuthology.orchestra.run.smithi038.stdout:Total 11 MB/s | 228 MB 00:21 2024-09-21T06:06:34.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:06:34.953 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:06:34.994 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:06:35.096 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:06:35.204 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:06:35.243 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:06:35.277 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:06:35.302 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:06:35.376 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:06:35.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:06:35.543 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:06:35.570 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:06:35.604 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:06:35.643 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:06:35.675 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:06:35.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:06:35.740 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:06:35.773 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:06:35.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:06:35.849 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:06:35.936 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:06:35.987 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:06:36.018 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:06:36.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:06:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-21T06:06:36.169 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:06:36.330 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-21T06:06:36.330 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-21T06:06:36.882 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:06:36.941 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:06:36.975 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:06:37.075 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:06:37.139 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:06:37.184 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:06:37.271 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:06:37.311 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:06:37.502 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:06:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:06:37.611 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:06:38.247 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:06:38.380 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:06:38.696 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-21T06:06:38.696 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-21T06:06:39.601 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:06:39.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:06:39.714 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:06:39.747 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:06:40.071 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:06:40.110 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:40.256 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:40.415 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:06:40.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:06:40.496 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-21T06:06:40.583 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:06:40.698 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:06:40.921 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:06:40.950 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:06:40.961 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:06:40.979 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:40.993 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:06:41.047 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:06:41.050 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:41.072 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:06:41.405 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:06:41.518 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:41.647 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:41.686 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:41.803 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:41.840 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:06:41.870 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:06:42.031 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:06:42.097 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:06:42.133 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:42.224 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:42.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:42.322 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:42.343 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:42.365 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:42.579 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:42.720 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:42.842 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:06:42.931 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:43.018 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:43.246 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:06:43.384 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:06:43.428 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:06:43.497 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:43.505 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:06:43.543 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:43.555 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:06:43.594 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:06:43.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:06:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:06:43.698 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:06:43.771 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:06:43.829 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:06:43.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:06:43.894 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:06:43.978 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:06:44.014 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:06:44.057 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:06:44.086 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:06:44.110 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:44.146 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:06:44.162 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:06:44.218 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:06:44.239 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:06:44.239 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:06:44.239 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:06:44.239 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:44.273 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:06:44.304 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:06:44.448 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:06:44.504 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:06:45.060 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:06:45.151 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:06:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-21T06:06:45.186 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:06:45.229 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:06:45.250 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:06:45.267 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:06:45.309 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:06:45.424 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:06:45.492 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:06:45.554 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:06:45.570 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:06:45.610 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:06:45.635 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:06:45.658 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:06:45.700 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:06:45.720 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:06:45.794 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:06:45.831 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:06:45.868 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:06:45.915 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:06:46.059 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:06:46.159 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:06:46.177 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:46.228 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:06:46.279 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:06:46.308 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:06:46.337 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:46.422 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:06:46.430 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:06:46.458 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:06:46.462 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:06:46.488 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:06:46.505 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:06:46.612 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:06:46.646 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:06:46.670 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:06:46.694 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:06:46.722 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:06:46.736 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:06:46.750 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:46.761 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:06:46.838 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:06:46.863 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:06:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:46.948 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:06:46.976 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:06:46.977 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:47.002 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:06:47.018 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:06:47.046 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:06:47.081 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:06:47.120 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:06:47.155 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:47.161 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:06:47.200 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:06:47.234 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:06:47.268 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:06:47.310 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:06:47.310 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:06:47.344 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:06:47.433 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:06:47.475 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:06:47.500 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:06:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:06:47.586 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:47.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:06:47.652 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:47.691 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:06:47.889 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:06:48.004 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:06:48.032 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:06:48.067 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:06:48.143 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:06:48.193 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:06:48.241 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:06:48.284 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:06:48.317 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:06:48.345 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:06:48.416 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:06:48.447 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:06:48.477 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:06:48.495 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:06:48.506 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:06:48.528 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:06:48.550 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:06:48.632 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:06:48.642 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:06:48.685 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:06:48.733 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:06:48.757 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:06:48.810 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:06:48.832 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:06:48.854 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:06:48.881 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:06:48.944 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:06:48.959 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:06:48.989 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:06:49.102 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:06:49.160 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:06:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:06:49.220 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:06:49.300 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:06:49.724 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:06:49.824 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:06:49.858 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:06:49.901 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:06:49.947 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:06:49.998 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:06:50.095 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:06:50.167 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:06:50.223 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:06:50.233 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:06:50.329 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:06:50.391 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:06:50.465 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:06:50.510 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:06:50.546 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:06:50.594 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:06:50.629 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:06:50.673 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:06:50.715 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:06:50.858 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:06:50.895 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:06:50.936 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:06:51.044 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:06:51.078 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:06:51.119 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:06:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:06:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:06:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:06:51.417 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:06:51.450 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:06:51.478 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:06:51.512 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:06:51.519 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:06:51.552 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:06:51.592 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:06:51.607 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:06:51.621 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:06:51.636 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:06:51.655 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:06:51.668 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:06:51.689 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:06:51.740 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:06:51.773 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:06:51.865 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:06:51.913 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:06:51.943 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:06:52.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:06:52.056 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:52.077 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:06:52.129 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:06:52.149 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:52.178 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:06:52.214 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:06:52.751 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:06:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:52.839 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:52.869 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:06:52.901 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:06:52.950 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:06:52.985 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:06:53.102 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:06:53.151 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:06:53.196 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:06:53.296 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:06:53.339 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:06:53.531 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:06:53.561 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:06:53.641 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:06:54.327 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:06:54.455 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:06:55.205 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:55.249 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:55.782 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:06:55.849 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:55.864 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:06:55.893 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:06:55.926 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:06:55.933 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:06:55.933 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-09-21T06:06:55.933 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-09-21T06:06:55.934 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:56.011 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:06:56.104 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:06:56.105 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:06:56.105 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:06:56.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:06:56.108 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:06:56.125 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:06:56.125 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:06:56.125 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:06:56.125 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:56.137 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:06:56.286 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:06:56.330 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:56.415 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:06:56.444 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:06:56.480 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:06:57.013 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:06:57.041 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:57.113 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:06:57.143 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:06:57.727 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:06:57.754 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:06:57.755 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:06:57.755 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:06:57.755 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:06:57.755 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:06:57.755 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:57.978 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:06:58.002 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:58.470 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:06:58.494 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:06:58.494 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:06:58.494 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:06:58.495 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:06:58.495 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:06:58.495 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:06:58.600 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:06:58.657 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:06:58.720 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:06:58.907 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:06:58.954 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:06:59.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:06:59.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:06:59.267 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:06:59.304 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:06:59.336 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:06:59.372 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:06:59.534 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:59.564 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:06:59.764 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:06:59.795 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:06:59.827 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:06:59.893 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:06:59.918 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:00.185 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:07:00.226 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:07:00.310 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:07:00.310 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:07:00.310 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:07:00.310 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:00.352 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:07:03.097 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:03.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:04.122 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:04.149 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:04.263 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:04.425 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:07:04.460 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:04.484 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:04.535 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:04.548 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:04.645 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:07:04.700 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:07:05.666 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:07:05.704 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:05.728 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:05.729 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:05.729 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:07:05.729 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:05.729 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:05.729 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:05.780 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:05.803 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:05.803 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:05.803 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:07:05.803 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:05.855 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:05.878 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:05.879 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:05.879 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:07:05.879 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:05.879 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:05.879 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:06.198 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:06.221 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:06.221 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:06.221 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:07:06.221 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:06.221 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:06.222 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:08.543 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:07:08.543 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-21T06:07:08.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:08.723 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:07:08.739 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:07:08.739 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:08.739 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:07:08.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:10.227 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:07:10.268 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:07:10.308 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:07:10.340 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:07:10.367 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:07:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:07:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:10.567 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:07:10.614 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:07:10.644 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:07:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:07:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:10.682 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:07:10.729 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:07:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:07:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:07:11.193 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:11.193 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:07:11.193 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:07:11.193 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:07:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:07:11.347 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:07:11.384 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:07:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:07:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:07:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:07:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:07:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:07:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:07:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:07:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:07:12.239 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:07:12.330 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:07:12.371 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:07:12.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:07:12.491 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:07:12.507 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:07:12.520 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:07:12.542 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:07:12.553 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:07:12.567 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:07:12.567 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:12.630 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:07:12.651 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:12.652 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:12.668 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:12.736 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:12.760 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:07:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:12.766 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-21T06:07:12.779 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-21T06:07:12.780 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-21T06:07:12.780 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-21T06:07:12.780 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:12.954 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:12.954 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:12.982 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:07:12.999 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:07:12.999 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:12.999 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:07:12.999 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:13.038 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:13.101 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:14.675 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:07:14.703 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:07:14.704 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:14.704 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:07:14.704 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:07:14.704 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:07:14.704 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:14.942 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:07:14.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:15.468 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:07:15.493 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:07:15.493 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:15.493 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:07:15.493 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:07:15.494 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:07:15.494 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:15.599 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:07:15.658 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:07:15.730 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:07:15.924 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:07:15.970 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:07:16.058 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:07:16.061 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:16.116 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:16.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:07:16.315 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:07:16.370 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:07:16.401 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:07:16.437 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:07:16.899 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:07:16.928 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:07:16.960 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:07:17.029 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:07:17.077 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:17.133 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:17.166 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:07:17.485 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:17.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:17.572 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:17.676 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:07:17.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:07:18.764 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:07:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:18.819 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:07:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:18.820 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:18.864 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:18.887 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:18.887 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:07:18.887 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:18.939 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:18.962 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:18.962 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:18.963 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:07:18.963 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:18.963 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:18.963 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:07:19.161 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:07:19.162 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:07:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:07:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:07:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:07:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:07:19.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:07:19.164 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:07:19.165 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:07:19.166 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:07:19.167 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:07:19.168 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:07:19.169 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:07:19.170 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:07:19.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:07:19.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:07:19.173 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:07:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:19.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:07:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:21.572 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:07:21.599 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:21.720 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:07:21.900 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:07:21.942 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:07:21.968 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:21.982 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:21.982 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:21.982 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-09-21T06:07:21.982 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:21.982 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.983 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.984 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:07:21.985 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:07:21.986 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:07:21.987 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.988 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:07:21.989 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:21.990 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.991 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:07:21.992 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:07:21.993 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:07:21.994 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:07:21.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:07:21.994 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-21T06:07:22.018 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:22.030 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:07:22.134 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:07:22.189 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:07:22.450 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:23.232 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:07:23.262 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:23.287 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:07:23.287 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:23.288 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:07:23.288 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:23.288 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:07:23.288 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:23.355 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:07:23.355 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:23.355 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:07:23.355 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:23.447 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:07:23.472 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:23.554 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:07:23.603 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:07:23.645 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:07:23.684 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:07:23.711 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:07:23.822 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:23.847 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:07:23.848 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:07:23.848 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:07:23.848 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:23.848 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:07:23.848 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:07:23.959 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:07:23.989 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:07:24.019 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:07:24.072 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:07:24.689 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:24.744 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:24.748 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:25.667 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:07:25.766 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:07:25.809 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:07:25.893 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:07:25.928 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:07:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:07:25.979 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:07:25.979 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:26.047 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:26.047 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:26.122 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:26.147 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:07:26.152 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:26.152 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:26.332 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:26.333 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:26.417 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:26.483 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:28.128 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:07:28.169 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:07:28.218 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:07:28.258 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:07:28.285 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:07:28.500 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:07:28.548 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:07:28.578 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:07:28.608 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:07:28.654 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:07:29.314 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:29.368 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:29.390 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:07:30.294 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:07:30.390 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:07:30.437 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:07:30.541 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:07:30.577 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:07:30.602 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:07:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:07:30.628 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:30.720 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:07:30.720 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:30.804 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:07:30.837 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:07:30.843 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:30.843 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:31.031 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:07:31.031 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:31.107 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:07:31.176 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:07:32.810 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:07:32.811 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:07:32.812 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:07:32.813 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:07:32.814 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:07:32.815 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:07:32.816 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:07:32.817 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:07:32.818 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:07:32.819 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:07:32.820 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:07:32.821 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:07:32.822 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:07:32.823 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:07:32.824 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:07:32.824 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:07:32.824 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:07:32.824 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:07:32.824 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:07:35.616 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:35.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-21T06:07:35.617 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.619 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:07:35.620 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:07:35.621 INFO:teuthology.orchestra.run.smithi044.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:07:35.622 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:07:35.623 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.624 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:07:35.625 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:07:35.626 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:07:35.627 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:07:35.628 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:07:35.629 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:07:35.630 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:07:35.631 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:07:35.631 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:07:35.631 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:07:35.631 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-21T06:07:36.240 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:37.545 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:37.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:07:37.545 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:07:37.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:07:37.547 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:07:37.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:07:37.560 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:07:37.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:07:37.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:07:37.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:07:37.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:07:37.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:07:37.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:07:37.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:07:37.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:07:37.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:07:37.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:07:40.420 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:07:40.420 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:40.420 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-21T06:07:40.420 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:40.420 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.421 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.422 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:07:40.423 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:07:40.424 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:07:40.425 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.426 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:07:40.427 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:07:40.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:07:40.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:07:40.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:07:40.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:07:40.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:07:40.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:07:40.430 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:07:40.431 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.432 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:07:40.433 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-21T06:07:40.947 DEBUG:teuthology.parallel:result is None 2024-09-21T06:07:40.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:41.092 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:07:41.115 INFO:teuthology.orchestra.run.smithi038.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.115 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.115 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:07:41.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:41.263 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:07:41.289 INFO:teuthology.orchestra.run.smithi044.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.289 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.290 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:07:41.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:41.443 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:07:41.470 INFO:teuthology.orchestra.run.smithi174.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.470 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:07:41.470 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:07:41.472 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:07:41.472 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:07:41.472 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:07:41.501 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:07:41.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:07:41.534 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:07:41.534 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:07:41.566 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:07:41.566 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:07:41.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:07:41.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:07:41.660 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:07:41.660 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:07:41.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:07:41.758 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:07:41.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:07:41.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:07:41.856 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:07:41.856 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:07:41.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:07:41.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:07:41.951 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:07:41.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:07:41.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:07:42.047 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:07:42.048 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:07:42.073 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:07:42.139 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:07:42.139 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:07:42.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:07:42.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:07:42.236 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:07:42.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:07:42.266 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:07:42.333 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:07:42.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:07:42.358 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:07:42.423 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:07:42.513 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:07:42.513 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:42.513 INFO:tasks.cephadm:Cluster fsid is d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:07:42.513 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:07:42.513 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.38', 'mon.b': '172.21.15.44', 'mon.c': '172.21.15.174'} 2024-09-21T06:07:42.514 INFO:tasks.cephadm:First mon is mon.a on smithi038 2024-09-21T06:07:42.514 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:07:42.514 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:07:42.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname $(hostname -s) 2024-09-21T06:07:42.545 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-09-21T06:07:42.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-09-21T06:07:42.596 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:07:42.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:42.747 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:07:42.893 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:07:42.895 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:07:42.895 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:07:42.895 DEBUG:teuthology.orchestra.run.smithi038:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:43.443 INFO:teuthology.orchestra.run.smithi038.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:07 /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:43.444 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:43.979 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:07 /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:43.981 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:44.551 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:07 /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:44.551 DEBUG:teuthology.orchestra.run.smithi038:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:44.571 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:44.591 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:07:44.626 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:07:44.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:07:44.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:07:44.634 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:07:46.151 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:07:46.266 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:07:46.308 INFO:teuthology.orchestra.run.smithi038.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-21T06:08:44.385 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-09-21T06:09:00.877 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T06:09:01.181 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:09:01.181 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:09:01.181 INFO:teuthology.orchestra.run.smithi038.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:09:01.181 INFO:teuthology.orchestra.run.smithi038.stdout: "repo_digests": [ 2024-09-21T06:09:01.182 INFO:teuthology.orchestra.run.smithi038.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:09:01.182 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:09:01.182 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:09:01.207 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph 2024-09-21T06:09:01.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-09-21T06:09:01.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-09-21T06:09:01.307 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /etc/ceph 2024-09-21T06:09:01.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-09-21T06:09:01.362 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-09-21T06:09:01.388 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:09:01.389 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-21T06:09:01.389 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:09:01.389 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:09:01.390 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:09:01.391 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:09:01.392 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:09:01.392 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:09:01.408 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d022e7d2-77df-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T06:09:01.408 DEBUG:teuthology.orchestra.run.smithi038:mon.a> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:09:01.451 DEBUG:teuthology.orchestra.run.smithi038:mgr.x> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:09:01.493 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:09:01.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.38 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:09:01.704 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:09:01.704 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.38', '--skip-admin-label'] 2024-09-21T06:09:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:09:01.705 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying podman|docker is present... 2024-09-21T06:09:01.729 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:09:01.729 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying lvm2 is present... 2024-09-21T06:09:01.729 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying time synchronization is in place... 2024-09-21T06:09:01.737 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:09:01.737 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:09:01.743 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:09:01.743 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:09:01.750 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-21T06:09:01.757 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-21T06:09:01.757 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:09:01.757 INFO:teuthology.orchestra.run.smithi038.stdout:Repeating the final host check... 2024-09-21T06:09:01.789 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:09:01.789 INFO:teuthology.orchestra.run.smithi038.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:09:01.789 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl is present 2024-09-21T06:09:01.789 INFO:teuthology.orchestra.run.smithi038.stdout:lvcreate is present 2024-09-21T06:09:01.796 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:09:01.796 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:09:01.802 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:09:01.802 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:09:01.809 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-21T06:09:01.815 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-21T06:09:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:09:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Host looks OK 2024-09-21T06:09:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Cluster fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Acquiring lock 140327260080496 on /run/cephadm/d022e7d2-77df-11ef-baf5-efdc52797490.lock 2024-09-21T06:09:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:Lock 140327260080496 acquired on /run/cephadm/d022e7d2-77df-11ef-baf5-efdc52797490.lock 2024-09-21T06:09:01.817 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 3300 ... 2024-09-21T06:09:01.817 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 6789 ... 2024-09-21T06:09:01.817 INFO:teuthology.orchestra.run.smithi038.stdout:Base mon IP(s) is [172.21.15.38:3300, 172.21.15.38:6789], mon addrv is [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-21T06:09:01.820 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.38 metric 100 2024-09-21T06:09:01.820 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.38 metric 100 2024-09-21T06:09:01.823 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:09:01.823 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:09:01.823 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1761sec hoplimit 64 pref medium 2024-09-21T06:09:01.825 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:09:01.825 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:09:01.825 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:09:01.825 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:09:01.826 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-21T06:09:01.826 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:09:01.826 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-21T06:09:01.826 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-21T06:09:01.826 INFO:teuthology.orchestra.run.smithi038.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:09:01.827 INFO:teuthology.orchestra.run.smithi038.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:09:01.827 INFO:teuthology.orchestra.run.smithi038.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:09:02.301 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:09:02.302 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:09:03.222 INFO:teuthology.orchestra.run.smithi038.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:09:03.222 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:09:03.222 INFO:teuthology.orchestra.run.smithi038.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:09:04.212 INFO:teuthology.orchestra.run.smithi038.stdout:stat: stdout 167 167 2024-09-21T06:09:04.212 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial keys... 2024-09-21T06:09:05.152 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQAAY+5mJaCtJRAAVYQ4yTosC+LGNTPWVW7Lxg== 2024-09-21T06:09:06.057 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQABY+5mp1YlHRAAhkWuDhVUPJMbvW8IFSJajA== 2024-09-21T06:09:06.945 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQACY+5m+jllGBAAT2SwpPP5Ha81skhBvCnciQ== 2024-09-21T06:09:06.946 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial monmap... 2024-09-21T06:09:07.811 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:09:07.811 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:09:07.811 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:07.811 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:09:07.811 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool for a [v2:172.21.15.38:3300,v1:172.21.15.38:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:09:07.812 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = quincy 2024-09-21T06:09:07.812 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: set fsid to d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:07.812 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:09:07.812 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:09:07.812 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mon... 2024-09-21T06:09:08.751 INFO:teuthology.orchestra.run.smithi038.stdout:create mon.a on 2024-09-21T06:09:08.974 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:09:09.127 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:09:09.341 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target. 2024-09-21T06:09:09.341 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target. 2024-09-21T06:09:09.593 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:09:09.593 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:09:09.764 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target.wants/ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490@.service. 2024-09-21T06:09:11.481 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:09:11.481 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-21T06:09:11.490 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:09:11.490 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:09:11.491 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-21T06:09:11.491 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:09:11.491 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon to start... 2024-09-21T06:09:11.492 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon... 2024-09-21T06:09:14.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:14 smithi038 ceph-mon[30847]: from='client.? 172.21.15.38:0/3746446792' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:09:21.336 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout id: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 4s) 2024-09-21T06:09:21.338 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:mon is available 2024-09-21T06:09:21.339 INFO:teuthology.orchestra.run.smithi038.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:09:23.811 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:23 smithi038 ceph-mon[30847]: from='client.? 172.21.15.38:0/2645539886' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:09:23.811 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:23 smithi038 ceph-mon[30847]: from='client.? 172.21.15.38:0/2645539886' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:09:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:09:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:24.051 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:24.052 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:09:24.053 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:09:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:09:24.054 INFO:teuthology.orchestra.run.smithi038.stdout:Generating new minimal ceph.conf... 2024-09-21T06:09:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:24 smithi038 ceph-mon[30847]: from='client.? 172.21.15.38:0/765082295' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:09:25.088 INFO:teuthology.orchestra.run.smithi038.stdout:Restarting the monitor... 2024-09-21T06:09:25.372 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 systemd[1]: Stopping Ceph mon.a for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:09:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a[30843]: 2024-09-21T06:09:25.369+0000 7f6d642cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:09:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a[30843]: 2024-09-21T06:09:25.369+0000 7f6d642cc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:09:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 podman[31088]: 2024-09-21 06:09:25.564859769 +0000 UTC m=+0.306944403 container died b596de6b2a03b1c2ff5198ba40c400f7acc1627861f274549064a5de02db38e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:09:26.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 podman[31088]: 2024-09-21 06:09:25.911345642 +0000 UTC m=+0.653430269 container cleanup b596de6b2a03b1c2ff5198ba40c400f7acc1627861f274549064a5de02db38e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:09:26.188 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:25 smithi038 bash[31088]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:09:26.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 podman[31100]: 2024-09-21 06:09:26.187148847 +0000 UTC m=+0.619199080 container remove b596de6b2a03b1c2ff5198ba40c400f7acc1627861f274549064a5de02db38e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T06:09:26.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:09:26.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 systemd[1]: Stopped Ceph mon.a for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:09:26.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 systemd[1]: Starting Ceph mon.a for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:09:26.823 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 podman[31195]: 2024-09-21 06:09:26.474547583 +0000 UTC m=+0.016165963 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:09:26.823 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 podman[31195]: 2024-09-21 06:09:26.596478736 +0000 UTC m=+0.138097145 container create 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:09:26.823 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 podman[31195]: 2024-09-21 06:09:26.781928559 +0000 UTC m=+0.323546936 container init 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:09:26.823 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 podman[31195]: 2024-09-21 06:09:26.785163363 +0000 UTC m=+0.326781731 container start 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:09:26.823 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: pidfile_write: ignore empty --pid-file 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: load: jerasure load: lrc 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Git sha 0 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: DB SUMMARY 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: DB Session ID: TSY0Q6Q0V7WTWMKSSS1D 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95993 ; 2024-09-21T06:09:26.824 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.env: 0x55d1d937ed60 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.info_log: 0x55d1ddf67360 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.statistics: (nil) 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.use_fsync: 0 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:09:26.825 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.db_log_dir: 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.wal_dir: 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:09:26.826 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.write_buffer_manager: 0x55d1ddf6bd60 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:09:26.827 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:09:26.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:09:26.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:09:26.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:09:26.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:09:26.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.unordered_write: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.row_cache: None 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.wal_filter: None 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.wal_compression: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:09:26.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:09:26.830 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_open_files: -1 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Compression algorithms supported: 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kZSTD supported: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:09:26.831 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.merge_operator: 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_filter: None 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:09:26.832 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d1ddf66fa0) 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_type: 0 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: data_block_index_type: 0 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_shortening: 1 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: checksum: 4 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: no_block_cache: 0 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache: 0x55d1d9f2b610 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:09:26.833 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_options: 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: capacity : 536870912 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: num_shard_bits : 4 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: strict_capacity_limit : 0 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_cache_compressed: (nil) 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: persistent_cache: (nil) 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_size: 4096 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_size_deviation: 10 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_restart_interval: 16 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: index_block_restart_interval: 1 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: metadata_block_size: 4096 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: partition_filters: 0 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: use_delta_encoding: 1 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: filter_policy: bloomfilter 2024-09-21T06:09:26.834 INFO:journalctl@ceph.mon.a.smithi038.stdout: whole_key_filtering: 1 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: verify_compression: 0 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: format_version: 5 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: enable_index_compression: 1 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: block_align: 0 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: max_auto_readahead_size: 262144 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: prepopulate_block_cache: 0 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression: NoCompression 2024-09-21T06:09:26.835 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.num_levels: 7 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:09:26.836 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:09:26.837 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:09:26.839 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.ttl: 2592000 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:09:26.840 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: be4fcdd1-75d1-4566-a39b-762f74a2adcc 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898966821714, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898966823104, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91980, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 293, "table_properties": {"data_size": 90021, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11865, "raw_average_key_size": 47, "raw_value_size": 83301, "raw_average_value_size": 335, "num_data_blocks": 12, "num_entries": 248, "num_filter_entries": 248, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726898966, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "be4fcdd1-75d1-4566-a39b-762f74a2adcc", "db_session_id": "TSY0Q6Q0V7WTWMKSSS1D", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:09:26.841 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726898966823201, "job": 1, "event": "recovery_finished"} 2024-09-21T06:09:26.842 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:09:26.842 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:09:26.842 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d1ddf8aa80 2024-09-21T06:09:26.842 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: DB pointer 0x55d1ded30000 2024-09-21T06:09:26.842 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:09:26.871 INFO:teuthology.orchestra.run.smithi038.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** DB Stats ** 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:09:27.082 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: L0 2/0 91.68 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: Sum 2/0 91.68 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 99.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:09:27.083 INFO:journalctl@ceph.mon.a.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 99.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Cumulative compaction: 0.00 GB write, 22.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Interval compaction: 0.00 GB write, 22.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Block cache BinnedLRUCache@0x55d1d9f2b610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:09:27.084 INFO:journalctl@ceph.mon.a.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: starting mon.a rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???) e1 preinit fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).mds e1 new map 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: e1 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: btime 2024-09-21T06:09:10:509012+0000 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: legacy client fscid: -1 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout: No filesystems configured 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:09:27.085 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 bash[31195]: 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 systemd[1]: Started Ceph mon.a for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: monmap epoch 1 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: last_changed 2024-09-21T06:09:07.258217+0000 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: min_mon_release 19 (squid) 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: election_strategy: 1 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: fsmap 2024-09-21T06:09:27.086 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:09:27.087 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:26 smithi038 ceph-mon[31215]: mgrmap e1: no daemons active 2024-09-21T06:09:27.825 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:09:27.847 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:09:27.847 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mgr... 2024-09-21T06:09:27.848 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:09:27.848 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:09:28.124 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:09:28.124 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:09:28.320 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490.target.wants/ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-d022e7d2-77df-11ef-baf5-efdc52797490@.service. 2024-09-21T06:09:28.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:28 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3603594801' entity='client.admin' 2024-09-21T06:09:28.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:28 smithi038 podman[31426]: 2024-09-21 06:09:28.598976712 +0000 UTC m=+0.141980087 container create 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:09:29.358 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-21T06:09:29.366 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:09:29.367 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:09:29.367 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-21T06:09:29.367 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:09:29.377 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:09:29.377 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr to start... 2024-09-21T06:09:29.387 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr... 2024-09-21T06:09:29.534 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:29 smithi038 podman[31426]: 2024-09-21 06:09:29.273983009 +0000 UTC m=+0.816986396 container init 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:09:29.534 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:29 smithi038 podman[31426]: 2024-09-21 06:09:29.277512881 +0000 UTC m=+0.820516254 container start 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:09:29.534 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:29 smithi038 bash[31426]: 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 2024-09-21T06:09:29.534 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:29 smithi038 systemd[1]: Started Ceph mgr.x for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:09:30.210 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:29 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1246610216' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:09:30.571 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:30.571 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:09:30.571 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:09:30.572 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:09:30.573 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:09:30.574 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:09:30.574 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:09:30.577 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:09:30.578 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:09:10:509012+0000", 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:09:30.579 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:09:10.509913+0000", 2024-09-21T06:09:30.580 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:30.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:30.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:09:30.581 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:09:30.581 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:09:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:33 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/896846676' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:09:33.776 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:33.780 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:09:33.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:09:33.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:09:33.781 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:09:33.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:09:33.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:09:33.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.784 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:09:10:509012+0000", 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:09:33.785 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:09:10.509913+0000", 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:33.786 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:33.787 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:09:33.787 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:09:33.787 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:09:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: Activating manager daemon x 2024-09-21T06:09:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: mgrmap e2: x(active, starting, since 0.00549785s) 2024-09-21T06:09:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: Manager daemon x is now available 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' 2024-09-21T06:09:34.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:34 smithi038 ceph-mon[31215]: from='mgr.14100 172.21.15.38:0/2959982136' entity='mgr.x' 2024-09-21T06:09:36.802 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:36 smithi038 ceph-mon[31215]: mgrmap e3: x(active, since 1.01098s) 2024-09-21T06:09:36.802 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:36 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3122027101' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:09:37.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:09:37.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:09:10:509012+0000", 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:37.064 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:09:10.509913+0000", 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:09:37.065 INFO:teuthology.orchestra.run.smithi038.stdout:mgr is available 2024-09-21T06:09:37.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:37 smithi038 ceph-mon[31215]: mgrmap e4: x(active, since 2s) 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:09:38.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:09:38.198 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling cephadm module... 2024-09-21T06:09:38.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:38 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/202215591' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:09:39.960 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:39 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/614104012' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:09:39.960 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setuser ceph since I am not root 2024-09-21T06:09:39.960 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setgroup ceph since I am not root 2024-09-21T06:09:40.930 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:40 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/614104012' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:09:40.930 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:40 smithi038 ceph-mon[31215]: mgrmap e5: x(active, since 5s) 2024-09-21T06:09:41.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:09:41.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:09:41.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:09:41.611 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:09:41.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:09:41.612 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:09:41.612 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-21T06:09:41.612 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 5... 2024-09-21T06:09:41.919 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2584708517' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:09:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: Active manager daemon x restarted 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: Activating manager daemon x 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: mgrmap e6: x(active, starting, since 0.00398905s) 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:09:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:44 smithi038 ceph-mon[31215]: Manager daemon x is now available 2024-09-21T06:09:46.601 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:09:46.602 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:09:46.602 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:09:46.602 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:09:46.602 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 5 is available 2024-09-21T06:09:46.602 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:09:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: mgrmap e7: x(active, since 1.01046s) 2024-09-21T06:09:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:09:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:46 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:09:48.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-mon[31215]: mgrmap e8: x(active, since 2s) 2024-09-21T06:09:48.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1079939828' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:09:48.447 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:09:48.321+0000 7eff4d5e9640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:09:48] ENGINE Error in HTTPServer.serve 2024-09-21T06:09:48.447 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Traceback (most recent call last): 2024-09-21T06:09:48.447 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._connections.run(self.expiration_interval) 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._run(expiration_interval) 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s = self.context.wrap_socket( 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: return self.sslsocket_class._create( 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self.do_handshake() 2024-09-21T06:09:48.448 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:09:48.449 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._sslobj.do_handshake() 2024-09-21T06:09:48.449 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:09:48.449 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:09:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:09:48.725 INFO:teuthology.orchestra.run.smithi038.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:09:49.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1079939828' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:09:49.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: mgrmap e9: x(active, since 3s) 2024-09-21T06:09:49.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: [21/Sep/2024:06:09:48] ENGINE Bus STARTING 2024-09-21T06:09:49.471 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: [21/Sep/2024:06:09:48] ENGINE Serving on http://172.21.15.38:8765 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: [21/Sep/2024:06:09:48] ENGINE Serving on https://172.21.15.38:7150 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: [21/Sep/2024:06:09:48] ENGINE Bus STARTED 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:49 smithi038 ceph-mon[31215]: [21/Sep/2024:06:09:48] ENGINE Error in HTTPServer.serve 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: Traceback (most recent call last): 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._run(expiration_interval) 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:09:49.472 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: s = self.context.wrap_socket( 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: return self.sslsocket_class._create( 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: self.do_handshake() 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._sslobj.do_handshake() 2024-09-21T06:09:49.473 INFO:journalctl@ceph.mon.a.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:09:50.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:50 smithi038 ceph-mon[31215]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:50.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:50 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:50.714 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:50 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:09:51.306 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:09:51.306 INFO:teuthology.orchestra.run.smithi038.stdout:Generating ssh key... 2024-09-21T06:09:51.623 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:51 smithi038 ceph-mon[31215]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Generating public/private rsa key pair. 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Your identification has been saved in /tmp/tmpu5lb83rn/key 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Your public key has been saved in /tmp/tmpu5lb83rn/key.pub 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: The key fingerprint is: 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: SHA256:V900a5qceEi6w9QZiA5Sl7sG8GzQ7Bz95iYO10D/PxA ceph-d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: The key's randomart image is: 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: +---[RSA 3072]----+ 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | o.... ..| 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | o.+.+. . . oo| 2024-09-21T06:09:52.487 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | .B.o.+. o. .o.| 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | .Boo ++E* = | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | . ..Soo=.* | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | . =o=.o. | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | = o+ o | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | . . o | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: | . | 2024-09-21T06:09:52.488 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:09:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: +----[SHA256]-----+ 2024-09-21T06:09:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:53 smithi038 ceph-mon[31215]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:53 smithi038 ceph-mon[31215]: Generating ssh key... 2024-09-21T06:09:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:53 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:53 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:53.828 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:09:53.828 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:09:53.828 INFO:teuthology.orchestra.run.smithi038.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:09:53.835 INFO:teuthology.orchestra.run.smithi038.stdout:Adding host smithi038... 2024-09-21T06:09:54.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:54 smithi038 ceph-mon[31215]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:55.421 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:55 smithi038 ceph-mon[31215]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:09:56.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:56 smithi038 ceph-mon[31215]: Deploying cephadm binary to smithi038 2024-09-21T06:09:58.777 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Added host 'smithi038' with addr '172.21.15.38' 2024-09-21T06:09:58.777 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying unmanaged mon service... 2024-09-21T06:09:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:59 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:09:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:59 smithi038 ceph-mon[31215]: Added host smithi038 2024-09-21T06:09:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:09:59 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:00.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:00 smithi038 ceph-mon[31215]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:00.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:00 smithi038 ceph-mon[31215]: Saving service mon spec with placement count:5 2024-09-21T06:10:00.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:00 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:00.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:00 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:00.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:10:00.994 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying unmanaged mgr service... 2024-09-21T06:10:02.381 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:02 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:02.381 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:02 smithi038 ceph-mon[31215]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:02.381 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:02 smithi038 ceph-mon[31215]: Saving service mgr spec with placement count:2 2024-09-21T06:10:02.381 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:02 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:02.637 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:10:04.178 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:04 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:04.178 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:04 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4123748494' entity='client.admin' 2024-09-21T06:10:04.178 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:04 smithi038 ceph-mon[31215]: from='mgr.14118 172.21.15.38:0/1916412101' entity='mgr.x' 2024-09-21T06:10:05.053 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling the dashboard module... 2024-09-21T06:10:05.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:05 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/652851382' entity='client.admin' 2024-09-21T06:10:06.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:06 smithi038 ceph-mon[31215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:06.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:06 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3638556193' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:10:06.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setuser ceph since I am not root 2024-09-21T06:10:06.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setgroup ceph since I am not root 2024-09-21T06:10:07.686 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:07 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3638556193' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:10:07.686 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:07 smithi038 ceph-mon[31215]: mgrmap e10: x(active, since 21s) 2024-09-21T06:10:08.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:10:08.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T06:10:08.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:10:08.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:10:08.197 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:10:08.198 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:10:08.198 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-21T06:10:08.198 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 10... 2024-09-21T06:10:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:08 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4191024577' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:10:12.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: Active manager daemon x restarted 2024-09-21T06:10:12.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: Activating manager daemon x 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: mgrmap e11: x(active, starting, since 0.0089138s) 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:10:12.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:11 smithi038 ceph-mon[31215]: Manager daemon x is now available 2024-09-21T06:10:13.042 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:12 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:13.042 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:12 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:10:13.042 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:12 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:10:13.042 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:12 smithi038 ceph-mon[31215]: mgrmap e12: x(active, since 1.00815s) 2024-09-21T06:10:13.295 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:10:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T06:10:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:10:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:10:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 10 is available 2024-09-21T06:10:13.296 INFO:teuthology.orchestra.run.smithi038.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:10:13.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-mon[31215]: [21/Sep/2024:06:10:13] ENGINE Bus STARTING 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:10:13.614+0000 7fd8cf7cf640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:10:13] ENGINE Error in HTTPServer.serve 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Traceback (most recent call last): 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._connections.run(self.expiration_interval) 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._run(expiration_interval) 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s = self.context.wrap_socket( 2024-09-21T06:10:13.987 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: return self.sslsocket_class._create( 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self.do_handshake() 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._sslobj.do_handshake() 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:10:13.988 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:10:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:10:15.045 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: [21/Sep/2024:06:10:13] ENGINE Serving on https://172.21.15.38:7150 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: [21/Sep/2024:06:10:13] ENGINE Error in HTTPServer.serve 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: Traceback (most recent call last): 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._run(expiration_interval) 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:10:15.046 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: s = self.context.wrap_socket( 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: return self.sslsocket_class._create( 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: self.do_handshake() 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._sslobj.do_handshake() 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: [21/Sep/2024:06:10:13] ENGINE Serving on http://172.21.15.38:8765 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: [21/Sep/2024:06:10:13] ENGINE Bus STARTED 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: mgrmap e13: x(active, since 2s) 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:15.047 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:14 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:15.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUW7q63cZmGIYqfYachztVFeDqPt0wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2MTAxNVoXDTM0\nMDkyMjA2MTAxNVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM4MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA2ASL+CjOEFQjGjt8VE4GgUIw09DAOPziw/X8\nwIY/HFLGvjy1FHHPLDyYBmVTFp28Vc+59ua/N6VVGMZ3w2kvHkMowDWhTSvjnalU\nOCA1zhSWOx6SW3SsVmhoGiuZZIgCgQNo8YpSSqO4yO9oDO5fwZ6vq27N/fXAMmJn\n9TI/k9TkrR/7MLnHtO8bJ+RAhVBfpFqGKSYpW0B/KHhiaiLtE9173bIfysbmpCbM\npQkyStJOtNs7kI8aswlVbJAMO9N9QStvo1dU8y62w+QCeXxbhltX+l5FmVCvnnea\nf5B08K+sRDPcaLivtrGdex0Cno8/bnHyVYgn80OtjeRFZTNx7AsNMTpHelRXOh5m\n/ZVRhlWkii4SDpucEu7brKG9PFgLIlsumtv9Z4Ue+a1LaEAbZRgKlhHR3iY3UG85\nb+Cr7cy9QMD6AEInaKeHi7KJSl4kxmQjMZzQ58gvPZJ28Pocaz/wfGSRYuHOYtJd\nrzlmNLxnReYOm0ivfKnvBLeTC8L6dy+tgrPUiXbvBqBjpyDJNRrMw+Qw49UseuMq\ntPxoRdaRo3Gxm9h0meXKPX/7gOh39o0Qrvl5Z6lxQjHHO5Z6lBnA7+290mnDMUVe\ng1JrgyxgCth0YZ3I7cspWTEFooydn8SHPT3vNwkSXxvjadbyYUHjzTBG7exBbhea\n+uqrI10CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDM4ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPJjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAi\nUszCwD25ERz4zIW1aINcusnRk2Eavmmx0JDye2FkFIdFu5FRdiUylgMneoXnJKu8\nEGsbi0FJAWFa7nkj/x2zrvtkF8BBLdFrS2mPOTsQwXBAW7lT4KeJtAZnNFNOADqN\n9TqBqbtfOMAuVnjB+lsIeJTp8D3Cp2xxd06bFF+Z5qJaZPF/aCOb6i+V9qWMcfNG\nDemrXc5UYnqbsdSxOQ2QAdpx7cfKtd9GQCMq+gZJfQLucEaytROmxyPYD1HK66zF\n6DE6gWe/GkSPCsmUS8H6ZEfVUs0d2v+GnxZ4zCfji/kITcdMaDERLWl4wtrQeEWQ\n3mIm+uzbTYfGrldRzVlt8Xk1xa7gLh/pUMaebMnwYBSU5Fb594I4HQs0gFvX3WuY\nDpZjKAH78gXGI04gnb7zznN25ZxPJVveU4zUXHZOZb7VWSDnbxlbMM3boQrXQKeD\nLnfmg0oZK6Xu9dZomvzVkxVMTShFoVa1hPl/4o5crioPI4iyuI8dHCWwhm4iIX+z\nNu84gzML2GCtNeZKtfWnPyOkKsij3T11asGKEydSYjPDyGAp9ov4yUdccC12xrMO\n1jXBajhvzjMoXcY5W7p7qUkcAzfgbxYrAilX7mnQ5YcfIA03+7lAf2SA5dlI1QbX\nM6EzbYHCA7S3myBtTPx+7VY3SCmtOWabVpDW+sJayA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA2ASL+CjOEFQjGjt8VE4GgUIw09DAOPziw/X8wIY/HFLGvjy1\nFHHPLDyYBmVTFp28Vc+59ua/N6VVGMZ3w2kvHkMowDWhTSvjnalUOCA1zhSWOx6S\nW3SsVmhoGiuZZIgCgQNo8YpSSqO4yO9oDO5fwZ6vq27N/fXAMmJn9TI/k9TkrR/7\nMLnHtO8bJ+RAhVBfpFqGKSYpW0B/KHhiaiLtE9173bIfysbmpCbMpQkyStJOtNs7\nkI8aswlVbJAMO9N9QStvo1dU8y62w+QCeXxbhltX+l5FmVCvnneaf5B08K+sRDPc\naLivtrGdex0Cno8/bnHyVYgn80OtjeRFZTNx7AsNMTpHelRXOh5m/ZVRhlWkii4S\nDpucEu7brKG9PFgLIlsumtv9Z4Ue+a1LaEAbZRgKlhHR3iY3UG85b+Cr7cy9QMD6\nAEInaKeHi7KJSl4kxmQjMZzQ58gvPZJ28Pocaz/wfGSRYuHOYtJdrzlmNLxnReYO\nm0ivfKnvBLeTC8L6dy+tgrPUiXbvBqBjpyDJNRrMw+Qw49UseuMqtPxoRdaRo3Gx\nm9h0meXKPX/7gOh39o0Qrvl5Z6lxQjHHO5Z6lBnA7+290mnDMUVeg1JrgyxgCth0\nYZ3I7cspWTEFooydn8SHPT3vNwkSXxvjadbyYUHjzTBG7exBbhea+uqrI10CAwEA\nAQKCAgAA2me+clQkrrMNdU2vkY1SBl5l/8LlQWPDOAioWVS3emuMMHYwn1ByUXJH\nmC/Z/NkpEkR0QVi2Ugys0oqCNuX3kyFT56z8PopMGEabtXjbmFY4OTiFFvK1S/1D\n7ocmZVPJNFJo8yMRu2V37wYfWEkAMphpWhXYhRdzZiht81BaokfIQpeTNjCf5M/b\nz6QiQqfWC4DQecpGW3yvvrtOGwGKXLYSsT48kUjePhmnJIr9I6kplVy+Bz/+PrEG\ngufMIVuIczD3hAPzCpdbMl6AzKkZ4JN6NX7F3700fYQahooHsfyWr7O/pXcVhsxj\nQkE9OhNF5DpQ9H7f5ZUHue6SOz/zF62RcbeMshltiOSQvohPSESsdPz7pCNwpH68\npSFlP+UJFYeW02WT1PXOWpLi/fsnVTWqrRgIUlksx4touVHCHX9+Y1lGAFjmHrut\n0IMKf7n07PhQ78W3GmnkOD0SWHBFY6fNr8Stf3vDAe7M2xcqIBZMU2odn2xJpeSt\n/4bLgp3I7s1QZphSaqBvRz6Yv509DIV/V+3sy2JCM64Mwnb1/X/jXonQiSWRdAyH\nIYE9BT+3qSNmz0RimOxd6yesOz/a9aEJ0iCNbPxrlQomxa7xzeVUQ9UUFubnWESL\n4VZOay1h/Px+wgmQF/Fz+RzdoXFKbgI7MfiMZV0yj86Dh6P6YQKCAQEA+s26R3HA\nRAvsivQDkmjlbscYkpH8YFnZrGgGyZmCYfvBwoAiFiPYapGTUmTzahm/gY3f8s6N\nCqgibSG897r9Q4EJbB1iUfQKev9RXEdGBbbE22A+Nul3JlgLTkiFrzxZ+E/i2HCS\ny3GvdyT7ycKIDYffkKKun7KCPxECM8FbbKPChh9w4eqzDITZpaYISTPfG+lOY66N\nOQwvqkoxglEQwsrfT7ZZI5NpsGmnjiuy9jZY5J2YI4R+U6tQf/9m0KUcJtzaqSv/\n+mUbADXfJ61cgFUvoJFn6G9un9ifsa0N3p6smyuz3Q0wBLpaWirH5yRTEXMawQag\n9a1DW9ZpoBiEsQKCAQEA3H5QQiFPl9ZMGtmz20sOxkUSVVY8+GrTnbqOZy65gmN3\nxlYYMG8CdL/cVgv5qi3X//yTvbbp3pIvcIPmR5QIg7AMTHW9I5CzboDDTAQGjbe0\ndeUqXivOy2LZyELw+CyPSrvKRQzu6xTWmuA5j5k9qQOWF6neR9HiVhpI3QndGOPt\nSDf8evx0DkAR7tS0jrxoM21mkt7sT5Y8cnzYBtAKQeM/rBoteurQpiXjjY1ZFfTj\nh2tko6bpB6xilvxdAmj151qne+rI1g0/MNEhnEUBFMAGFRhL++iqWmcpYCvSBGeg\nNebqmmzcJuom0GMA6R/HVy8NjqjxO44kIrgzgh3kbQKCAQA9wTRR7S9jUfBPkp/i\niBOeQEXLqUiUTOttKTwqnbLd/4iJJNW/z9m0+91jl1ncUTS3aMCw360Y56d6aalG\n8nL0ESzJwz53YXjHKmDVMPOL6qH0RnFrQfdFqL4362GHcXvRyZHYq3dpwrdqxd99\noXmwozkoOvZ2ehTaBI0fQ0gIqxX1wn4gEpM9zORuhkBaDfysubjEkLFTT63Y52Xj\naaSP4jY0QXkXam/GsW1Bc38gYudme2t/q1sTrQYoTjH5w/33j8ADkcL427ZXSeyF\nr4ksTE1q4wLL18xMbaF8tVjJ7RYhKxShpGKjd2NR+mC4iFgv3sDCsKgndh802Mmv\nUvoxAoIBAQDJLMpne+MWAyVO/kC2nYXuasjuaY+ZjEZly/fvttb1W3HF2Xmafz57\nbS5IqAZ0Of2xBy95UfGR7EkyXHX36t3V4QNno6kdUQIVmZAWxDmChhE13BBK+adl\nNFzF9iXMGUPoCOzlEYbPoCSqDFkYZtW2ZppEHu27E4lxy+udGUnMUvGFCefoAnyV\nH+n8wb+317ku6utCp/huKQIf5z5nANvK/99xVDUYyDP00+8JkOSuPtB2FwsssbY+\nFQ+i+MCX2VI7cyAK1M3HVzDHhpgm72KsHwOtrYxuW/tKHoPGxlSJRk8LvxNgMGCx\ndMRTL3F+QktrhXfWKNho4SihMPV2C3YFAoIBACmq+528oj5t1dXpn2Jv/Gkcjtux\nqHcl+GkWTVR1HP9cuXDHSi12CJydaAES0s76m6/I1x8ZcxHEFq8luEgBCE4brjzb\nHN4OFRHVWYCbLNuqlt+2FDqqdl1c5MLYEd2LDhWVrjRdDoxq9EtueDcgYDozCc0K\n8i3NZsaZcpEE9qbcs+Y6nMSFWAI4zfIHBX/S+GcamC4EocBGR7Xj1UfcreRMBDcA\ncoJ2EdFRNWjVqg8Df9NZ2lcSgtDVbv+dMIqkxGxVaqfHx1c7+ezUVtJrsV9vZYIv\n4MMaRENrJG5B6LKwAYxQX1+o7x0BMZhXbDkeNqe3A8HVdGXkZuJ5ZWPw/MA=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:10:15.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:15 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:16.726 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:10:17.348 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:17 smithi038 ceph-mon[31215]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:17.348 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:17 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:18.066 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:10:18.066 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial admin user... 2024-09-21T06:10:18.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:18 smithi038 ceph-mon[31215]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:18.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:18 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:19.484 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$UoxM9RbjJt5.tUOG95C10OJ4QktOd4TFybJnh9p77cNC9LCfwvrY2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726899018, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:10:19.484 INFO:teuthology.orchestra.run.smithi038.stdout:Fetching dashboard port number... 2024-09-21T06:10:20.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:19 smithi038 ceph-mon[31215]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:20.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:19 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:20.740 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:10:20.750 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:10:20.750 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-21T06:10:20.758 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:10:20.758 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-21T06:10:20.758 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-21T06:10:20.758 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph Dashboard is now available at: 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: URL: https://smithi038.front.sepia.ceph.com:8443/ 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: User: admin 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: Password: zp46e9q2gl 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:20.760 INFO:teuthology.orchestra.run.smithi038.stdout:Saving cluster configuration to /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config directory 2024-09-21T06:10:21.065 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:20 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1651251014' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:10:21.930 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: ceph telemetry on 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.931 INFO:teuthology.orchestra.run.smithi038.stdout:For more information see: 2024-09-21T06:10:21.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.932 INFO:teuthology.orchestra.run.smithi038.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:10:21.932 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:21.932 INFO:teuthology.orchestra.run.smithi038.stdout:Bootstrap complete. 2024-09-21T06:10:21.972 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:10:21.973 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:10:21.973 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:10:21.989 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:10:21.989 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:10:21.989 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:10:22.047 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:10:22.047 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:10:22.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:10:22.112 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:10:22.112 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:10:22.112 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:10:22.168 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:10:22.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:10:22.260 INFO:teuthology.orchestra.run.smithi038.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:22.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:10:22.325 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:22.339 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:10:22.381 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt/QfNh9QSnsJ3VkdXrFeDVvgiQMPBQyOBSA0KuAcBlX1kqXK69swbcwgsKijS3GFsZonad7nBJkSaFlv3rsBhRuLoU+yLiXcfULPd/VBCxNXghuZY22EMCnIGwQ+UXU/je6m+RKMSsJJfJQVk+7k305B83oFQGfpdS+aUK5ra/nXUMtkckfqADBgd4aSAKUb7oqqL3rEOy8PfqI7DQy4u81PZkuQifha2JC4+13v126fOFDG+VdQtkHB7AjT8J8W7849PtqmwhueDs3xHvYZQhqPyFrYOHEcZi4iXMlZnYdAZNiZ03ra3j7c46BSPVcuIZCz1Mlp1WEqlK3WbUwNGknGnz5U4DQNRsRIMDJck5amwhF73osvkREwOCl9TpXuAAQEHME+7AI/3Vxmc7DokQuMDsg7nyvkUoTXhd6o6TTOQEatqpuy9xESqJC5KcBgOVru1OE29bh1iEPEh7fV0xuwMa/G1IsuXQeAdtQvdqR71m1YPGv1EVYm3xyQb7Cs= ceph-d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:22.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:10:22.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:22 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2019512436' entity='client.admin' 2024-09-21T06:10:22.663 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:23.952 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:10:23.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:10:24.451 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:24.548 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:24 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3426782998' entity='client.admin' 2024-09-21T06:10:25.479 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: mgrmap e14: x(active, since 12s) 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:25.480 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:25 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:26 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:26.815 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi044 2024-09-21T06:10:26.815 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:10:26.815 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:10:26.835 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:10:26.835 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:26.893 INFO:tasks.cephadm:Adding host smithi044 to orchestrator... 2024-09-21T06:10:26.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch host add smithi044 2024-09-21T06:10:27.148 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:27.606 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:27 smithi038 ceph-mon[31215]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:27.606 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:27 smithi038 ceph-mon[31215]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:27.606 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:27 smithi038 ceph-mon[31215]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:10:28.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:28 smithi038 ceph-mon[31215]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:29.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:29 smithi038 ceph-mon[31215]: Deploying cephadm binary to smithi044 2024-09-21T06:10:31.550 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi044' with addr '172.21.15.44' 2024-09-21T06:10:32.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:10:32.420 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:32.793 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:32.794 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: Added host smithi044 2024-09-21T06:10:32.794 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:32.794 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:32.794 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:32.794 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:32 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:33.086 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:33.086 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}] 2024-09-21T06:10:33.640 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-09-21T06:10:33.640 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:10:33.640 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:10:33.660 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:10:33.660 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:33.718 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-09-21T06:10:33.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch host add smithi174 2024-09-21T06:10:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:33.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:33 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:33.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:33 smithi038 ceph-mon[31215]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:10:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:34 smithi038 ceph-mon[31215]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:36.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:36.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:36.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:36.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:36.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:36.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-09-21T06:10:36.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:36.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:35 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: Deploying cephadm binary to smithi174 2024-09-21T06:10:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-21T06:10:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:37 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:38.317 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-09-21T06:10:38.943 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:10:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: Added host smithi174 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:39.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:39 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:39.836 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:10:39.836 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-09-21T06:10:40.377 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:10:40.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:10:40.627 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:10:40.907 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:40 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:40.907 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:40 smithi038 ceph-mon[31215]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:40.908 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:40 smithi038 ceph-mon[31215]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:10:41.649 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-09-21T06:10:41.920 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/312071846' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:10:42.204 INFO:tasks.cephadm:Adding mon.a on smithi038 2024-09-21T06:10:42.204 INFO:tasks.cephadm:Adding mon.b on smithi044 2024-09-21T06:10:42.204 INFO:tasks.cephadm:Adding mon.c on smithi174 2024-09-21T06:10:42.204 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c' 2024-09-21T06:10:42.463 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T06:10:42.510 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T06:10:42.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/312071846' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:42.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:42 smithi038 ceph-mon[31215]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T06:10:43.261 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-09-21T06:10:43.903 DEBUG:teuthology.orchestra.run.smithi044:mon.b> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:10:43.905 DEBUG:teuthology.orchestra.run.smithi174:mon.c> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:10:43.908 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:10:43.908 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:10:44.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:44.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: Saving service mon spec with placement smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c;count:3 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:44.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:43 smithi038 ceph-mon[31215]: Deploying daemon mon.c on smithi174 2024-09-21T06:10:44.928 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:45 smithi038 ceph-mon[31215]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:46.816 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:10:46.816 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","modified":"2024-09-21T06:09:07.258217Z","created":"2024-09-21T06:09:07.258217Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:10:46.817 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-09-21T06:10:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 podman[34793]: 2024-09-21 06:10:47.609098117 +0000 UTC m=+0.114935947 container create 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:10:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:47 smithi038 ceph-mon[31215]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:47 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/946944094' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 podman[34793]: 2024-09-21 06:10:47.836736213 +0000 UTC m=+0.342574044 container init 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 podman[34793]: 2024-09-21 06:10:47.840408088 +0000 UTC m=+0.346245919 container start 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pidfile_write: ignore empty --pid-file 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: load: jerasure load: lrc 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Git sha 0 2024-09-21T06:10:48.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: DB SUMMARY 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: DB Session ID: B2RYPZOLVQV4YTI22WQ2 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:10:48.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.env: 0x563c1975cd60 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.info_log: 0x563c1e99f360 2024-09-21T06:10:48.147 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:10:48.148 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.statistics: (nil) 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.use_fsync: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:10:48.149 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.db_log_dir: 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.wal_dir: 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.write_buffer_manager: 0x563c1e9a3d60 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:10:48.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.unordered_write: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.row_cache: None 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.wal_filter: None 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:10:48.151 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.wal_compression: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:10:48.152 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_open_files: -1 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:10:48.153 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Compression algorithms supported: 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kZSTD supported: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:10:48.154 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.merge_operator: 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_filter: None 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563c1e99efa0) 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:10:48.155 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_type: 0 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_index_type: 0 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_shortening: 1 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: checksum: 4 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: no_block_cache: 0 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache: 0x563c1a963610 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_options: 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: capacity : 536870912 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_shard_bits : 4 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: strict_capacity_limit : 0 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:10:48.156 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_compressed: (nil) 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: persistent_cache: (nil) 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size: 4096 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size_deviation: 10 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_restart_interval: 16 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_block_restart_interval: 1 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: metadata_block_size: 4096 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: partition_filters: 0 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: use_delta_encoding: 1 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: filter_policy: bloomfilter 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: whole_key_filtering: 1 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: verify_compression: 0 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: format_version: 5 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_index_compression: 1 2024-09-21T06:10:48.157 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_align: 0 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout: max_auto_readahead_size: 262144 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout: prepopulate_block_cache: 0 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression: NoCompression 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.num_levels: 7 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:10:48.158 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:10:48.159 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:10:48.160 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:10:48.161 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:10:48.162 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.ttl: 2592000 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:10:48.163 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 13b69cec-160e-4001-9f5f-0137bed787dd 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899047877142, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899047877576, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726899047, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "13b69cec-160e-4001-9f5f-0137bed787dd", "db_session_id": "B2RYPZOLVQV4YTI22WQ2", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899047877671, "job": 1, "event": "recovery_finished"} 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563c1e9c2a80 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: DB pointer 0x563c1f768000 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** DB Stats ** 2024-09-21T06:10:48.164 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-21T06:10:48.165 INFO:journalctl@ceph.mon.c.smithi174.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:10:48.166 INFO:journalctl@ceph.mon.c.smithi174.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache BinnedLRUCache@0x563c1a963610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: using public_addr v2:172.21.15.174:0/0 -> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: starting mon.c rank -1 at public addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] at bind addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(???) e0 preinit fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 bash[34793]: 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 systemd[1]: Started Ceph mon.c for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: e1 2024-09-21T06:10:48.167 INFO:journalctl@ceph.mon.c.smithi174.stdout: btime 2024-09-21T06:09:10:509012+0000 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout: legacy client fscid: -1 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout: No filesystems configured 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:10:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Added host smithi044 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.169 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Deploying cephadm binary to smithi174 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.170 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Added host smithi174 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/312071846' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/312071846' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.171 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:10:48.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Saving service mon spec with placement smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c;count:3 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: Deploying daemon mon.c on smithi174 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/946944094' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:10:48.173 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:47 smithi174 ceph-mon[34815]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:10:48.405 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:10:48.405 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:10:48.687 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: mon.a calling monitor election 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: mon.c calling monitor election 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: monmap epoch 2 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: last_changed 2024-09-21T06:10:47.908321+0000 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: min_mon_release 19 (squid) 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: election_strategy: 1 2024-09-21T06:10:53.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: fsmap 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: mgrmap e14: x(active, since 41s) 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: overall HEALTH_OK 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:10:53.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:52 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: mon.a calling monitor election 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: mon.c calling monitor election 2024-09-21T06:10:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: monmap epoch 2 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: last_changed 2024-09-21T06:10:47.908321+0000 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: min_mon_release 19 (squid) 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: election_strategy: 1 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:10:53.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: fsmap 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: mgrmap e14: x(active, since 41s) 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: overall HEALTH_OK 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:10:53.489 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:52 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:10:53.763 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:10:53.763 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","modified":"2024-09-21T06:10:47.908321Z","created":"2024-09-21T06:09:07.258217Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:10:53.763 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-21T06:10:54.108 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:54 smithi174 ceph-mon[34815]: Deploying daemon mon.b on smithi044 2024-09-21T06:10:54.109 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:54 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/2825649187' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:10:54.109 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:54 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:54.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:54 smithi038 ceph-mon[31215]: Deploying daemon mon.b on smithi044 2024-09-21T06:10:54.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:54 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/2825649187' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:10:54.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:54 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:10:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:10:55 smithi174 ceph-mon[34815]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:55.429 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:10:55.429 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:10:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:10:55 smithi038 ceph-mon[31215]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:10:55.681 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:10:56.359 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:10:56.359 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","modified":"2024-09-21T06:10:47.908321Z","created":"2024-09-21T06:09:07.258217Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:10:56.359 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-21T06:10:56.705 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:10:56 smithi044 ceph-mon[34369]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:10:57.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:10:56 smithi044 bash[34349]: ed8d4f326caf950f6925acc6fcd49c1a321ad2a4778e157ca53ef275da15c978 2024-09-21T06:10:57.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:10:56 smithi044 systemd[1]: Started Ceph mon.b for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:10:57.944 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:10:57.945 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:10:58.195 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: mon.c calling monitor election 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: mon.a calling monitor election 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:02.072 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: monmap epoch 3 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: min_mon_release 19 (squid) 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: election_strategy: 1 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: fsmap 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: mgrmap e14: x(active, since 49s) 2024-09-21T06:11:02.073 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: overall HEALTH_OK 2024-09-21T06:11:02.074 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.074 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.074 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.074 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:01 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.129 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:11:02.130 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","modified":"2024-09-21T06:10:56.697216Z","created":"2024-09-21T06:09:07.258217Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:11:02.130 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 3 2024-09-21T06:11:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: mon.c calling monitor election 2024-09-21T06:11:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: mon.a calling monitor election 2024-09-21T06:11:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: monmap epoch 3 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: min_mon_release 19 (squid) 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: election_strategy: 1 2024-09-21T06:11:02.131 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: fsmap 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: mgrmap e14: x(active, since 49s) 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: overall HEALTH_OK 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.132 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:01 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.723 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:11:02.723 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:11:02.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:02 smithi174 ceph-mon[34815]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:02.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:02 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:02.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:02 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/3229369641' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:11:02.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:02 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:02.974 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:02 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:02.984 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:03.079 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:02 smithi038 ceph-mon[31215]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:03.080 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:02 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:03.080 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:02 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/3229369641' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:11:03.080 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:02 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:03.080 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:02 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:03.604 INFO:teuthology.orchestra.run.smithi038.stdout:# minimal ceph.conf for d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:03.604 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-09-21T06:11:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: mon_host = [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-21T06:11:04.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:04.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: mon.c calling monitor election 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: mon.a calling monitor election 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: monmap epoch 3 2024-09-21T06:11:04.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: min_mon_release 19 (squid) 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: election_strategy: 1 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: fsmap 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: mgrmap e14: x(active, since 49s) 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: overall HEALTH_OK 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/3229369641' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:03 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.314 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:11:04.314 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:11:04.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:11:04.341 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:11:04.341 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:04.407 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:11:04.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:11:04.436 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:11:04.437 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:04.503 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:11:04.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:11:04.534 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:11:04.534 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:04.603 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T06:11:04.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mon.b calling monitor election 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mon.b calling monitor election 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mon.c calling monitor election 2024-09-21T06:11:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mon.a calling monitor election 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: monmap epoch 3 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: min_mon_release 19 (squid) 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: election_strategy: 1 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: fsmap 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: mgrmap e14: x(active, since 51s) 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: overall HEALTH_OK 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: Reconfiguring daemon mon.a on smithi038 2024-09-21T06:11:04.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:04 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mon.b calling monitor election 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mon.b calling monitor election 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mon.c calling monitor election 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mon.a calling monitor election 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: monmap epoch 3 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:04.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: min_mon_release 19 (squid) 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: election_strategy: 1 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: fsmap 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: mgrmap e14: x(active, since 51s) 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: overall HEALTH_OK 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:11:04.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:04.989 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:04.989 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:04.989 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: Reconfiguring daemon mon.a on smithi038 2024-09-21T06:11:04.989 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:04 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mon.b calling monitor election 2024-09-21T06:11:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mon.b calling monitor election 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mon.c calling monitor election 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mon.a calling monitor election 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: monmap epoch 3 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: last_changed 2024-09-21T06:10:56.697216+0000 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: created 2024-09-21T06:09:07.258217+0000 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: min_mon_release 19 (squid) 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: election_strategy: 1 2024-09-21T06:11:05.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: 0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: fsmap 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: mgrmap e14: x(active, since 51s) 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: overall HEALTH_OK 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:05.157 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:05.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: Reconfiguring daemon mon.a on smithi038 2024-09-21T06:11:05.158 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:04 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:05.392 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:06.633 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setuser ceph since I am not root 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ignoring --setgroup ceph since I am not root 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:06.634 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:06 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:11:06.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:06.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:06 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='mgr.14152 172.21.15.38:0/695066700' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:06.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:06 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:11:07.000 INFO:tasks.cephadm:Adding mgr.x on smithi038 2024-09-21T06:11:07.000 INFO:tasks.cephadm:Adding mgr.y on smithi044 2024-09-21T06:11:07.000 INFO:tasks.cephadm:Adding mgr.z on smithi174 2024-09-21T06:11:07.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi038=x;smithi044=y;smithi174=z' 2024-09-21T06:11:07.258 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:11:07.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:07 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:11:07.612 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:07 smithi174 ceph-mon[34815]: mgrmap e15: x(active, since 54s) 2024-09-21T06:11:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:07 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:11:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:07 smithi044 ceph-mon[34369]: mgrmap e15: x(active, since 54s) 2024-09-21T06:11:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:07 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/202233934' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:11:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:07 smithi038 ceph-mon[31215]: mgrmap e15: x(active, since 54s) 2024-09-21T06:11:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: Active manager daemon x restarted 2024-09-21T06:11:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: Activating manager daemon x 2024-09-21T06:11:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:11:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: mgrmap e16: x(active, starting, since 0.00559893s) 2024-09-21T06:11:11.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:11.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:11.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:11.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:11:11.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:11:11.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:11:11.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:11:11.897 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:11 smithi174 ceph-mon[34815]: Manager daemon x is now available 2024-09-21T06:11:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: Active manager daemon x restarted 2024-09-21T06:11:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: Activating manager daemon x 2024-09-21T06:11:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:11:11.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: mgrmap e16: x(active, starting, since 0.00559893s) 2024-09-21T06:11:11.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:11.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:11.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:11.907 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:11:11.907 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:11:11.907 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:11:11.907 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:11:11.907 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:11 smithi044 ceph-mon[34369]: Manager daemon x is now available 2024-09-21T06:11:11.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: Active manager daemon x restarted 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: Activating manager daemon x 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: mgrmap e16: x(active, starting, since 0.00559893s) 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:11:11.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:11:11.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:11:11.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:11:11.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:11:11.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:11:11.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:11 smithi038 ceph-mon[31215]: Manager daemon x is now available 2024-09-21T06:11:12.731 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mgr update... 2024-09-21T06:11:12.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:11:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:11:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:12 smithi174 ceph-mon[34815]: mgrmap e17: x(active, since 1.01126s) 2024-09-21T06:11:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:11:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:11:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:12 smithi044 ceph-mon[34369]: mgrmap e17: x(active, since 1.01126s) 2024-09-21T06:11:12.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:12.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:11:12.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:11:12.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:12 smithi038 ceph-mon[31215]: mgrmap e17: x(active, since 1.01126s) 2024-09-21T06:11:13.511 DEBUG:teuthology.orchestra.run.smithi044:mgr.y> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:11:13.514 DEBUG:teuthology.orchestra.run.smithi174:mgr.z> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:11:13.516 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:11:13.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:11:13.519 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:11:13.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:11:13.561 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:11:13.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:11:13.604 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:11:13.604 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:11:13.647 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:11:13.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:11:13.695 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:11:13.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:11:13.739 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:11:13.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:11:13.792 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:11:13.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: Saving service mgr spec with placement smithi038=x;smithi044=y;smithi174=z;count:3 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.795 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.801 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:11:13.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:11:13.847 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:11:13.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:11:13.891 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:11:13.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:11:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: Saving service mgr spec with placement smithi038=x;smithi044=y;smithi174=z;count:3 2024-09-21T06:11:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: Saving service mgr spec with placement smithi038=x;smithi044=y;smithi174=z;count:3 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:13.937 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:11:13.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:11:14.000 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:11:14.001 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:11:14.058 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:11:14.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:11:14.076 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:14.080 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:11:14.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:11:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:14.127 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:11:14.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:11:14.172 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:11:14.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:11:14.225 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:11:14.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:11:14.276 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:11:14.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:11:14.333 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:11:14.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:11:14.342 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:14.362 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T06:11:14.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T06:11:14.409 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:11:14.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:11:14.464 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:11:14.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:11:14.516 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:11:14.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:11:14.563 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T06:11:14.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T06:11:14.618 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T06:11:14.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T06:11:14.669 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T06:11:14.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T06:11:14.721 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:11:14.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:11:14.776 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:11:14.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:11:14.824 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:11:14.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:11:14.882 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T06:11:14.882 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi038') 2024-09-21T06:11:14.894 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:11:14.630+0000 7fe6147ff640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:11:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: Traceback (most recent call last): 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._connections.run(self.expiration_interval) 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._run(expiration_interval) 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:11:14.895 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: s = self.context.wrap_socket( 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: return self.sslsocket_class._create( 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self.do_handshake() 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: self._sslobj.do_handshake() 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:11:14.896 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: mgrmap e18: x(active, since 3s) 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.146 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: mgrmap e18: x(active, since 3s) 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: mgrmap e18: x(active, since 3s) 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:15.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f49c003fd60 msgr2=0x7f49c0042270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f49c003fd60 0x7f49c0042270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009bd0 tx=0x7f49c4005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d41037e0 msgr2=0x7f49d4076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d41037e0 0x7f49d4076e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49d0005ab0 tx=0x7f49d00042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 shutdown_connections 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f49c003fd60 0x7f49c0042270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49d4105210 0x7f49d4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4104870 0x7f49d4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 --2- 172.21.15.38:0/2210146687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49d41037e0 0x7f49d4076e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:15.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 >> 172.21.15.38:0/2210146687 conn(0x7f49d40ff150 msgr2=0x7f49d4107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:15.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 shutdown_connections 2024-09-21T06:11:15.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:15.824+0000 7f49dba18640 1 -- 172.21.15.38:0/2210146687 wait complete. 2024-09-21T06:11:16.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: [21/Sep/2024:06:11:14] ENGINE Bus STARTING 2024-09-21T06:11:16.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: [21/Sep/2024:06:11:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: Traceback (most recent call last): 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._run(expiration_interval) 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: s = self.context.wrap_socket( 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: return self.sslsocket_class._create( 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:11:16.237 INFO:journalctl@ceph.mon.a.smithi038.stdout: self.do_handshake() 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout: self._sslobj.do_handshake() 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: [21/Sep/2024:06:11:14] ENGINE Serving on https://172.21.15.38:7150 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: [21/Sep/2024:06:11:14] ENGINE Serving on http://172.21.15.38:8765 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: [21/Sep/2024:06:11:14] ENGINE Bus STARTED 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2601124112' entity='client.admin' 2024-09-21T06:11:16.238 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:15 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2210146687' entity='client.admin' 2024-09-21T06:11:16.347 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: [21/Sep/2024:06:11:14] ENGINE Bus STARTING 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: [21/Sep/2024:06:11:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: Traceback (most recent call last): 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._run(expiration_interval) 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:11:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: s = self.context.wrap_socket( 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: return self.sslsocket_class._create( 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: self.do_handshake() 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._sslobj.do_handshake() 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: [21/Sep/2024:06:11:14] ENGINE Serving on https://172.21.15.38:7150 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: [21/Sep/2024:06:11:14] ENGINE Serving on http://172.21.15.38:8765 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: [21/Sep/2024:06:11:14] ENGINE Bus STARTED 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:16.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:16.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:16.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2601124112' entity='client.admin' 2024-09-21T06:11:16.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:15 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2210146687' entity='client.admin' 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: [21/Sep/2024:06:11:14] ENGINE Bus STARTING 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: [21/Sep/2024:06:11:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: Traceback (most recent call last): 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._run(expiration_interval) 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:11:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: s = self.context.wrap_socket( 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: return self.sslsocket_class._create( 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: self.do_handshake() 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._sslobj.do_handshake() 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: [21/Sep/2024:06:11:14] ENGINE Serving on https://172.21.15.38:7150 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: [21/Sep/2024:06:11:14] ENGINE Serving on http://172.21.15.38:8765 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: [21/Sep/2024:06:11:14] ENGINE Bus STARTED 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:16.407 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"} : dispatch 2024-09-21T06:11:16.407 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:16.407 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:16.407 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2601124112' entity='client.admin' 2024-09-21T06:11:16.407 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:15 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2210146687' entity='client.admin' 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 -- 172.21.15.38:0/298157398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 msgr2=0x7f57f81063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 --2- 172.21.15.38:0/298157398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 0x7f57f81063a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009860 tx=0x7f57f402a340 comp rx=0 tx=0).stop 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 -- 172.21.15.38:0/298157398 shutdown_connections 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 --2- 172.21.15.38:0/298157398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 --2- 172.21.15.38:0/298157398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 0x7f57f8108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 --2- 172.21.15.38:0/298157398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 0x7f57f81063a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.514+0000 7f57ffbed640 1 -- 172.21.15.38:0/298157398 >> 172.21.15.38:0/298157398 conn(0x7f57f80fdfa0 msgr2=0x7f57f8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:16.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.515+0000 7f57ffbed640 1 -- 172.21.15.38:0/298157398 shutdown_connections 2024-09-21T06:11:16.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.515+0000 7f57ffbed640 1 -- 172.21.15.38:0/298157398 wait complete. 2024-09-21T06:11:16.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 Processor -- start 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 -- start start 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 0x7f57f81039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 0x7f57f81022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f57f810f1b0 con 0x7f57f8109480 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57f810f030 con 0x7f57f806c340 2024-09-21T06:11:16.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57ffbed640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57f810f330 con 0x7f57f81068e0 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.516+0000 7f57fe18a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43674/0 (socket says 172.21.15.38:43674) 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 -- 172.21.15.38:0/2629743054 learned_addr learned my addr 172.21.15.38:0/2629743054 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fd188640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 0x7f57f81022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 -- 172.21.15.38:0/2629743054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 msgr2=0x7f57f81022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 0x7f57f81022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 -- 172.21.15.38:0/2629743054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 msgr2=0x7f57f81039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 0x7f57f81039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 -- 172.21.15.38:0/2629743054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f8102ee0 con 0x7f57f8109480 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.517+0000 7f57fe18a640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009fd0 tx=0x7f57f000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.518+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0004b20 con 0x7f57f8109480 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.518+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f81a3e50 con 0x7f57f8109480 2024-09-21T06:11:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.518+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(24 keys) ==== 1048+0+0 (secure 0 0 0) 0x7f57f0003df0 con 0x7f57f8109480 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.518+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f001a020 con 0x7f57f8109480 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.518+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81a41f0 con 0x7f57f8109480 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.519+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f57f001d020 con 0x7f57f8109480 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.519+0000 7f57eeffd640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 0x7f57e4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.519+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f810f930 con 0x7f57f8109480 2024-09-21T06:11:16.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.519+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f57f00554b0 con 0x7f57f8109480 2024-09-21T06:11:16.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.520+0000 7f57fd989640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 0x7f57e4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:16.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.520+0000 7f57fd989640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 0x7f57e4042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57f4035040 tx=0x7f57f402af60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:16.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.525+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57f001dbd0 con 0x7f57f8109480 2024-09-21T06:11:16.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.723+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f57f8106d30 con 0x7f57f8109480 2024-09-21T06:11:16.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.726+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v12)=0 v12) ==== 114+0+0 (secure 0 0 0) 0x7f57f8106d30 con 0x7f57f8109480 2024-09-21T06:11:16.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.727+0000 7f57eeffd640 1 -- 172.21.15.38:0/2629743054 <== mon.0 v2:172.21.15.38:3300/0 8 ==== config(25 keys) ==== 1073+0+0 (secure 0 0 0) 0x7f57f0004020 con 0x7f57f8109480 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 msgr2=0x7f57e4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 0x7f57e4042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f57f4035040 tx=0x7f57f402af60 comp rx=0 tx=0).stop 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 msgr2=0x7f57f81027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009fd0 tx=0x7f57f000c800 comp rx=0 tx=0).stop 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 shutdown_connections 2024-09-21T06:11:16.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57e403fb70 0x7f57e4042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57f8109480 0x7f57f81027e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57f81068e0 0x7f57f81022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 --2- 172.21.15.38:0/2629743054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57f806c340 0x7f57f81039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 >> 172.21.15.38:0/2629743054 conn(0x7f57f80fdfa0 msgr2=0x7f57f8104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 shutdown_connections 2024-09-21T06:11:16.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:16.729+0000 7f57ffbed640 1 -- 172.21.15.38:0/2629743054 wait complete. 2024-09-21T06:11:17.066 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.394 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: Deploying daemon mgr.z on smithi174 2024-09-21T06:11:17.395 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:17 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2629743054' entity='client.admin' 2024-09-21T06:11:17.399 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-21T06:11:17.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-21T06:11:17.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T06:11:17.510 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: Deploying daemon mgr.z on smithi174 2024-09-21T06:11:17.512 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:17 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2629743054' entity='client.admin' 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Updating smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:17.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:17.657 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:17.657 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:17.657 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: Deploying daemon mgr.z on smithi174 2024-09-21T06:11:17.657 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:17 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2629743054' entity='client.admin' 2024-09-21T06:11:17.816 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi038') 2024-09-21T06:11:17.816 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi038') 2024-09-21T06:11:17.847 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.849 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.850 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.850 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.852 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:17.852 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.145 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:17 smithi174 systemd[1]: Starting Ceph mgr.z for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:11:18.472 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 podman[36679]: 2024-09-21 06:11:18.083350047 +0000 UTC m=+0.025686788 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:11:18.473 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 podman[36679]: 2024-09-21 06:11:18.185970055 +0000 UTC m=+0.128306785 container create 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:11:18.473 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 podman[36679]: 2024-09-21 06:11:18.387939808 +0000 UTC m=+0.330276542 container init 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:11:18.473 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 podman[36679]: 2024-09-21 06:11:18.391104037 +0000 UTC m=+0.333440767 container start 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:11:18.473 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 ceph-mgr[36698]: -- 172.21.15.174:0/1028764647 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640396f70e0 con 0x56403e49a480 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 -- 172.21.15.38:0/2490791853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98109df0 msgr2=0x7efc98110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2490791853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98109df0 0x7efc98110620 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc90009ca0 tx=0x7efc9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 -- 172.21.15.38:0/2490791853 shutdown_connections 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2490791853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98109df0 0x7efc98110620 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2490791853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2490791853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98103b60 0x7efc98103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 -- 172.21.15.38:0/2490791853 >> 172.21.15.38:0/2490791853 conn(0x7efc9807b850 msgr2=0x7efc9807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 -- 172.21.15.38:0/2490791853 shutdown_connections 2024-09-21T06:11:18.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.482+0000 7efc9d68b640 1 -- 172.21.15.38:0/2490791853 wait complete. 2024-09-21T06:11:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.483+0000 7efc9d68b640 1 Processor -- start 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.483+0000 7efc9d68b640 1 -- start start 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.483+0000 7efc9d68b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.483+0000 7efc9d68b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc9819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.483+0000 7efc9d68b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 0x7efc9819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc9d68b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113990 con 0x7efc98103b60 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc9d68b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113810 con 0x7efc98109df0 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc9d68b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113b10 con 0x7efc981094a0 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43704/0 (socket says 172.21.15.38:43704) 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 -- 172.21.15.38:0/2208374106 learned_addr learned my addr 172.21.15.38:0/2208374106 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc967fc640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc9819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc977fe640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 0x7efc9819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 -- 172.21.15.38:0/2208374106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 msgr2=0x7efc9819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc9819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 -- 172.21.15.38:0/2208374106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 msgr2=0x7efc9819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 0x7efc9819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 -- 172.21.15.38:0/2208374106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc981a01d0 con 0x7efc98103b60 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc977fe640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 0x7efc9819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc967fc640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc9819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc96ffd640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c920 tx=0x7efc8800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88007c70 con 0x7efc98103b60 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.484+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(25 keys) ==== 1073+0+0 (secure 0 0 0) 0x7efc88007e10 con 0x7efc98103b60 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.485+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc981a04c0 con 0x7efc98103b60 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.485+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88018730 con 0x7efc98103b60 2024-09-21T06:11:18.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.485+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc980755f0 con 0x7efc98103b60 2024-09-21T06:11:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.485+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc98104de0 con 0x7efc98103b60 2024-09-21T06:11:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.486+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7efc880188d0 con 0x7efc98103b60 2024-09-21T06:11:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.486+0000 7efc7ffff640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 0x7efc800420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.486+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efc88054640 con 0x7efc98103b60 2024-09-21T06:11:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.486+0000 7efc967fc640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 0x7efc800420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.487+0000 7efc967fc640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 0x7efc800420b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc981064c0 tx=0x7efc8c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.491+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc88014030 con 0x7efc98103b60 2024-09-21T06:11:18.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.686+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7efc9810bbe0 con 0x7efc98103b60 2024-09-21T06:11:18.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.690+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7efc880203a0 con 0x7efc98103b60 2024-09-21T06:11:18.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.692+0000 7efc7ffff640 1 -- 172.21.15.38:0/2208374106 <== mon.0 v2:172.21.15.38:3300/0 8 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7efc88005630 con 0x7efc98103b60 2024-09-21T06:11:18.702 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.702 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.702 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.703 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.703 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.697+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 msgr2=0x7efc800420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.697+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 0x7efc800420b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc981064c0 tx=0x7efc8c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.697+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 msgr2=0x7efc9819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.697+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c920 tx=0x7efc8800cde0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 shutdown_connections 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efc8003fba0 0x7efc800420b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc98109df0 0x7efc9819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc981094a0 0x7efc9819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 --2- 172.21.15.38:0/2208374106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc98103b60 0x7efc9819a320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.698+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 >> 172.21.15.38:0/2208374106 conn(0x7efc9807b850 msgr2=0x7efc98107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.706+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 shutdown_connections 2024-09-21T06:11:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.711+0000 7efc9d68b640 1 -- 172.21.15.38:0/2208374106 wait complete. 2024-09-21T06:11:18.720 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.739+0000 7fe662fa5640 1 -- 172.21.15.38:0/1885001651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c111f40 msgr2=0x7fe65c10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.739+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1885001651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c111f40 0x7fe65c10a3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe64c009900 tx=0x7fe64c02a440 comp rx=0 tx=0).stop 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.740+0000 7fe662fa5640 1 -- 172.21.15.38:0/1885001651 shutdown_connections 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.740+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1885001651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c11cc30 0x7fe65c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.740+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1885001651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe65c10a9e0 0x7fe65c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.740+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1885001651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c111f40 0x7fe65c10a3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.740+0000 7fe662fa5640 1 -- 172.21.15.38:0/1885001651 >> 172.21.15.38:0/1885001651 conn(0x7fe65c070ec0 msgr2=0x7fe65c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:18.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.747+0000 7fe662fa5640 1 -- 172.21.15.38:0/1885001651 shutdown_connections 2024-09-21T06:11:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.752+0000 7fe662fa5640 1 -- 172.21.15.38:0/1885001651 wait complete. 2024-09-21T06:11:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.753+0000 7fe662fa5640 1 Processor -- start 2024-09-21T06:11:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.753+0000 7fe662fa5640 1 -- start start 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.753+0000 7fe662fa5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 0x7fe65c11a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe660d41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 0x7fe65c11a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe660d41640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 0x7fe65c11a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43730/0 (socket says 172.21.15.38:43730) 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe660d41640 1 -- 172.21.15.38:0/1138952392 learned_addr learned my addr 172.21.15.38:0/1138952392 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 0x7fe65c113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe662fa5640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe65c11cc30 0x7fe65c113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe662fa5640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c122a00 con 0x7fe65c10a9e0 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe662fa5640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c122880 con 0x7fe65c111f40 2024-09-21T06:11:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe662fa5640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c122b80 con 0x7fe65c11cc30 2024-09-21T06:11:18.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.754+0000 7fe65bfff640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 0x7fe65c113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.758+0000 7fe65bfff640 1 -- 172.21.15.38:0/1138952392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe65c11cc30 msgr2=0x7fe65c113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.758+0000 7fe65bfff640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe65c11cc30 0x7fe65c113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.758+0000 7fe65bfff640 1 -- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 msgr2=0x7fe65c11a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:18.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.758+0000 7fe65bfff640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 0x7fe65c11a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:18.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.758+0000 7fe65bfff640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c114410 con 0x7fe65c111f40 2024-09-21T06:11:18.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.760+0000 7fe65bfff640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 0x7fe65c113650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06c6e0 tx=0x7fe65400be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.761+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654019070 con 0x7fe65c111f40 2024-09-21T06:11:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.761+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fe6540148f0 con 0x7fe65c111f40 2024-09-21T06:11:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.761+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654012890 con 0x7fe65c111f40 2024-09-21T06:11:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.761+0000 7fe662fa5640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c1190b0 con 0x7fe65c111f40 2024-09-21T06:11:18.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.761+0000 7fe662fa5640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c119620 con 0x7fe65c111f40 2024-09-21T06:11:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.766+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fe65401c070 con 0x7fe65c111f40 2024-09-21T06:11:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.766+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c10adf0 con 0x7fe65c111f40 2024-09-21T06:11:18.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.767+0000 7fe659ffb640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 0x7fe644042100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:18.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.767+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe6540541f0 con 0x7fe65c111f40 2024-09-21T06:11:18.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.769+0000 7fe660d41640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 0x7fe644042100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:18.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.770+0000 7fe660d41640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 0x7fe644042100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0093d0 tx=0x7fe64c009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:18.773 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:18.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.785+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe65401d3b0 con 0x7fe65c111f40 2024-09-21T06:11:18.894 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 bash[36679]: 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 2024-09-21T06:11:18.895 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:11:18 smithi174 systemd[1]: Started Ceph mgr.z for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:11:18.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.987+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fe65c119940 con 0x7fe65c111f40 2024-09-21T06:11:18.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.996+0000 7fe659ffb640 1 -- 172.21.15.38:0/1138952392 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v14)=0 v14) ==== 115+0+0 (secure 0 0 0) 0x7fe654014b10 con 0x7fe65c111f40 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 msgr2=0x7fe644042100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 0x7fe644042100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0093d0 tx=0x7fe64c009560 comp rx=0 tx=0).stop 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 msgr2=0x7fe65c113650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 0x7fe65c113650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe65c06c6e0 tx=0x7fe65400be00 comp rx=0 tx=0).stop 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 shutdown_connections 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe64403fbf0 0x7fe644042100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe65c11cc30 0x7fe65c113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe65c111f40 0x7fe65c113650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 --2- 172.21.15.38:0/1138952392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe65c10a9e0 0x7fe65c11a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 >> 172.21.15.38:0/1138952392 conn(0x7fe65c070ec0 msgr2=0x7fe65c11e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 shutdown_connections 2024-09-21T06:11:19.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:18.998+0000 7fe6437fe640 1 -- 172.21.15.38:0/1138952392 wait complete. 2024-09-21T06:11:19.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:19.811 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: Deploying daemon mgr.y on smithi044 2024-09-21T06:11:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2208374106' entity='client.admin' 2024-09-21T06:11:19.812 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:19 smithi174 ceph-mon[34815]: from='client.? ' entity='client.admin' 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: Deploying daemon mgr.y on smithi044 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2208374106' entity='client.admin' 2024-09-21T06:11:19.861 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:19 smithi038 ceph-mon[31215]: from='client.? ' entity='client.admin' 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: Deploying daemon mgr.y on smithi044 2024-09-21T06:11:19.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2208374106' entity='client.admin' 2024-09-21T06:11:19.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:19 smithi044 ceph-mon[34369]: from='client.? ' entity='client.admin' 2024-09-21T06:11:20.612 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 systemd[1]: Starting Ceph mgr.y for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:11:20.884 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 podman[35879]: 2024-09-21 06:11:20.513691822 +0000 UTC m=+0.015824220 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:11:20.884 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 podman[35879]: 2024-09-21 06:11:20.626527272 +0000 UTC m=+0.128659657 container create 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-21T06:11:20.884 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 podman[35879]: 2024-09-21 06:11:20.845496554 +0000 UTC m=+0.347628950 container init 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:11:20.885 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 podman[35879]: 2024-09-21 06:11:20.848653165 +0000 UTC m=+0.350785560 container start 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:11:20.885 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 ceph-mgr[35898]: -- 172.21.15.44:0/2248235584 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601c7dc90e0 con 0x5601ccb6c480 2024-09-21T06:11:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/43688882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 msgr2=0x7f3e2810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/43688882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e2810d660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009900 tx=0x7f3e1402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/43688882 shutdown_connections 2024-09-21T06:11:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/43688882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/43688882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e2810d660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/43688882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 0x7f3e28104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/43688882 >> 172.21.15.38:0/43688882 conn(0x7f3e280fe2c0 msgr2=0x7f3e28100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/43688882 shutdown_connections 2024-09-21T06:11:20.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.949+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/43688882 wait complete. 2024-09-21T06:11:20.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 Processor -- start 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 -- start start 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 0x7f3e28102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28113880 con 0x7f3e28105110 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28113700 con 0x7f3e281047c0 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2dd9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28113a00 con 0x7f3e2810dc20 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2cd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 0x7f3e28102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53180/0 (socket says 172.21.15.38:53180) 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e27fff640 1 -- 172.21.15.38:0/486016045 learned_addr learned my addr 172.21.15.38:0/486016045 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:20.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.950+0000 7f3e2d59c640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 -- 172.21.15.38:0/486016045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 msgr2=0x7f3e28102f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28102f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 -- 172.21.15.38:0/486016045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 msgr2=0x7f3e28102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 0x7f3e28102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 -- 172.21.15.38:0/486016045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e281a8570 con 0x7f3e28105110 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e2d59c640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e27fff640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005940 tx=0x7f3e140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1403f030 con 0x7f3e28105110 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3e14031880 con 0x7f3e28105110 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e281a8800 con 0x7f3e28105110 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14035070 con 0x7f3e28105110 2024-09-21T06:11:20.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.951+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e281a8d30 con 0x7f3e28105110 2024-09-21T06:11:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.953+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e28104bd0 con 0x7f3e28105110 2024-09-21T06:11:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.953+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f3e14042030 con 0x7f3e28105110 2024-09-21T06:11:20.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.953+0000 7f3e25ffb640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 0x7f3e18042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.953+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3e14074920 con 0x7f3e28105110 2024-09-21T06:11:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.953+0000 7f3e2cd9b640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 0x7f3e18042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:20.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.954+0000 7f3e2cd9b640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 0x7f3e18042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e28103f50 tx=0x7f3e1c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:20.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.958+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e1403bd10 con 0x7f3e28105110 2024-09-21T06:11:21.155 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 bash[35879]: 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 2024-09-21T06:11:21.155 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:11:20 smithi044 systemd[1]: Started Ceph mgr.y for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:11:21.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.161+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3e281a90c0 con 0x7f3e28105110 2024-09-21T06:11:21.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.164+0000 7f3e25ffb640 1 -- 172.21.15.38:0/486016045 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f3e14036cc0 con 0x7f3e28105110 2024-09-21T06:11:21.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.166+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 msgr2=0x7f3e18042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.166+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 0x7f3e18042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e28103f50 tx=0x7f3e1c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:21.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.166+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 msgr2=0x7f3e28102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.166+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005940 tx=0x7f3e140042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 shutdown_connections 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3e1803fb70 0x7f3e18042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3e2810dc20 0x7f3e28102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e28105110 0x7f3e28102a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 --2- 172.21.15.38:0/486016045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e281047c0 0x7f3e28102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 >> 172.21.15.38:0/486016045 conn(0x7f3e280fe2c0 msgr2=0x7f3e281077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 shutdown_connections 2024-09-21T06:11:21.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.167+0000 7f3e2dd9d640 1 -- 172.21.15.38:0/486016045 wait complete. 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 -- 172.21.15.38:0/279950262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 msgr2=0x7f537010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 --2- 172.21.15.38:0/279950262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537010f520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5360009900 tx=0x7f536002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 -- 172.21.15.38:0/279950262 shutdown_connections 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 --2- 172.21.15.38:0/279950262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537010f520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 --2- 172.21.15.38:0/279950262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53701083a0 0x7f53701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 --2- 172.21.15.38:0/279950262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5370102a60 0x7f5370102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 -- 172.21.15.38:0/279950262 >> 172.21.15.38:0/279950262 conn(0x7f5370079730 msgr2=0x7f5370079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 -- 172.21.15.38:0/279950262 shutdown_connections 2024-09-21T06:11:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.345+0000 7f5376dbe640 1 -- 172.21.15.38:0/279950262 wait complete. 2024-09-21T06:11:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 Processor -- start 2024-09-21T06:11:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 -- start start 2024-09-21T06:11:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53701083a0 0x7f537019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5370112960 con 0x7f5370108cf0 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53701127e0 con 0x7f5370102a60 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5376dbe640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5370112ae0 con 0x7f53701083a0 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f537535b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5374b5a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f537535b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53208/0 (socket says 172.21.15.38:53208) 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f5374b5a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56158/0 (socket says 172.21.15.38:56158) 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f537535b640 1 -- 172.21.15.38:0/2874663403 learned_addr learned my addr 172.21.15.38:0/2874663403 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.346+0000 7f536ffff640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53701083a0 0x7f537019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 -- 172.21.15.38:0/2874663403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53701083a0 msgr2=0x7f537019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53701083a0 0x7f537019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 -- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 msgr2=0x7f537019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 -- 172.21.15.38:0/2874663403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53701a0350 con 0x7f5370102a60 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f537535b640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5374b5a640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5368005fd0 tx=0x7f536800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536800cd80 con 0x7f5370102a60 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f5368005020 con 0x7f5370102a60 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53701a0640 con 0x7f5370102a60 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53680116b0 con 0x7f5370102a60 2024-09-21T06:11:21.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.347+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53701a6da0 con 0x7f5370102a60 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.348+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f5368011910 con 0x7f5370102a60 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.348+0000 7f536dffb640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 0x7f5358042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.348+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5368054850 con 0x7f5370102a60 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.349+0000 7f536ffff640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 0x7f5358042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.349+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5370102e70 con 0x7f5370102a60 2024-09-21T06:11:21.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.349+0000 7f536ffff640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 0x7f5358042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5370102620 tx=0x7f5364005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.354+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5368016030 con 0x7f5370102a60 2024-09-21T06:11:21.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1918981094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e41049b0 msgr2=0x7fe6e4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1918981094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e41049b0 0x7fe6e4104dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009900 tx=0x7fe6cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:21.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1918981094 shutdown_connections 2024-09-21T06:11:21.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1918981094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e410de10 0x7fe6e4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1918981094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e4105300 0x7fe6e410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1918981094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e41049b0 0x7fe6e4104dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1918981094 >> 172.21.15.38:0/1918981094 conn(0x7fe6e4079730 msgr2=0x7fe6e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1918981094 shutdown_connections 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.521+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1918981094 wait complete. 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 Processor -- start 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 -- start start 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e41049b0 0x7fe6e419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 0x7fe6e419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4113a70 con 0x7fe6e410de10 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e41138f0 con 0x7fe6e4105300 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e8b57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4113bf0 con 0x7fe6e41049b0 2024-09-21T06:11:21.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.522+0000 7fe6e2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53226/0 (socket says 172.21.15.38:53226) 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 -- 172.21.15.38:0/1087461672 learned_addr learned my addr 172.21.15.38:0/1087461672 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e259c640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e41049b0 0x7fe6e419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e1d9b640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 0x7fe6e419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 -- 172.21.15.38:0/1087461672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e41049b0 msgr2=0x7fe6e419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e41049b0 0x7fe6e419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 -- 172.21.15.38:0/1087461672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 msgr2=0x7fe6e419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 0x7fe6e419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 -- 172.21.15.38:0/1087461672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e41a04b0 con 0x7fe6e410de10 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e1d9b640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 0x7fe6e419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e2d9d640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00eb10 tx=0x7fe6dc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc004b20 con 0x7fe6e410de10 2024-09-21T06:11:21.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e41a07a0 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fe6dc004cc0 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc010690 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.523+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e41a6f00 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.525+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e4104dc0 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.525+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fe6dc010830 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.525+0000 7fe6db7fe640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 0x7fe6d0042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.525+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe6dc054b00 con 0x7fe6e410de10 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.525+0000 7fe6e259c640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 0x7fe6d0042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:21.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.526+0000 7fe6e259c640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 0x7fe6d0042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0314b0 tx=0x7fe6cc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:21.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.535+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6dc019da0 con 0x7fe6e410de10 2024-09-21T06:11:21.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.553+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f537002e640 con 0x7f5370102a60 2024-09-21T06:11:21.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.562+0000 7f536dffb640 1 -- 172.21.15.38:0/2874663403 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v17)=0 v17) ==== 133+0+0 (secure 0 0 0) 0x7f536800f360 con 0x7f5370102a60 2024-09-21T06:11:21.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.564+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 msgr2=0x7f5358042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.564+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 0x7f5358042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5370102620 tx=0x7f5364005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.564+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 msgr2=0x7f537019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.564+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5368005fd0 tx=0x7f536800ee80 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 shutdown_connections 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f535803fb70 0x7f5358042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5370108cf0 0x7f537019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53701083a0 0x7f537019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 --2- 172.21.15.38:0/2874663403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5370102a60 0x7f537019a3e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 >> 172.21.15.38:0/2874663403 conn(0x7f5370079730 msgr2=0x7f537006b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 shutdown_connections 2024-09-21T06:11:21.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.565+0000 7f5376dbe640 1 -- 172.21.15.38:0/2874663403 wait complete. 2024-09-21T06:11:21.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.738+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fe6e402e640 con 0x7fe6e410de10 2024-09-21T06:11:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.745+0000 7fe6db7fe640 1 -- 172.21.15.38:0/1087461672 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7fe6dc019a10 con 0x7fe6e410de10 2024-09-21T06:11:21.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 msgr2=0x7fe6d0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 0x7fe6d0042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0314b0 tx=0x7fe6cc0058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 msgr2=0x7fe6e419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:21.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00eb10 tx=0x7fe6dc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 shutdown_connections 2024-09-21T06:11:21.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6d003fb70 0x7fe6d0042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6e410de10 0x7fe6e419fd80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6e4105300 0x7fe6e419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 --2- 172.21.15.38:0/1087461672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6e41049b0 0x7fe6e419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 >> 172.21.15.38:0/1087461672 conn(0x7fe6e4079730 msgr2=0x7fe6e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.748+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 shutdown_connections 2024-09-21T06:11:21.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.749+0000 7fe6e8b57640 1 -- 172.21.15.38:0/1087461672 wait complete. 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1216502159' entity='client.admin' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/486016045' entity='client.admin' 2024-09-21T06:11:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:21 smithi174 ceph-mon[34815]: from='client.? ' entity='client.admin' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1216502159' entity='client.admin' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/486016045' entity='client.admin' 2024-09-21T06:11:21.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:21 smithi038 ceph-mon[31215]: from='client.? ' entity='client.admin' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1216502159' entity='client.admin' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/486016045' entity='client.admin' 2024-09-21T06:11:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:21 smithi044 ceph-mon[34369]: from='client.? ' entity='client.admin' 2024-09-21T06:11:22.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 -- 172.21.15.38:0/3858617134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac810de60 msgr2=0x7f6ac8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 --2- 172.21.15.38:0/3858617134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac810de60 0x7f6ac8110330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009900 tx=0x7f6ac002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 -- 172.21.15.38:0/3858617134 shutdown_connections 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 --2- 172.21.15.38:0/3858617134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac810de60 0x7f6ac8110330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 --2- 172.21.15.38:0/3858617134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8105380 0x7f6ac810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 --2- 172.21.15.38:0/3858617134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac8104a30 0x7f6ac8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 -- 172.21.15.38:0/3858617134 >> 172.21.15.38:0/3858617134 conn(0x7f6ac80797b0 msgr2=0x7f6ac8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 -- 172.21.15.38:0/3858617134 shutdown_connections 2024-09-21T06:11:22.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.456+0000 7f6acd8da640 1 -- 172.21.15.38:0/3858617134 wait complete. 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.457+0000 7f6acd8da640 1 Processor -- start 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 -- start start 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 0x7f6ac819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 0x7f6ac819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8113ac0 con 0x7f6ac8105380 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8113940 con 0x7f6ac8104a30 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6acd8da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac8113c40 con 0x7f6ac810de60 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6ac67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6ac67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53258/0 (socket says 172.21.15.38:53258) 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6ac67fc640 1 -- 172.21.15.38:0/1542973708 learned_addr learned my addr 172.21.15.38:0/1542973708 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6ac6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 0x7f6ac819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.458+0000 7f6ac77fe640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 0x7f6ac819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 -- 172.21.15.38:0/1542973708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 msgr2=0x7f6ac819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 0x7f6ac819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 -- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 msgr2=0x7f6ac819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 -- 172.21.15.38:0/1542973708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac81a03e0 con 0x7f6ac8104a30 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac67fc640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac77fe640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 0x7f6ac819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6ac6ffd640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 0x7f6ac819a470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800e9f0 tx=0x7f6ab800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800ccc0 con 0x7f6ac8104a30 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6ab8005020 con 0x7f6ac8104a30 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8004a00 con 0x7f6ac8104a30 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac81a06d0 con 0x7f6ac8104a30 2024-09-21T06:11:22.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.459+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac81a6e30 con 0x7f6ac8104a30 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.460+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f6ab8004ba0 con 0x7f6ac8104a30 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.461+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8104e40 con 0x7f6ac8104a30 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.461+0000 7f6acc8d8640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 0x7f6ab0042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.461+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6ab80553f0 con 0x7f6ac8104a30 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.461+0000 7f6ac67fc640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 0x7f6ab0042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:22.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.461+0000 7f6ac67fc640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 0x7f6ab0042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ac81000a0 tx=0x7f6abc0097a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:22.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.466+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ab8013190 con 0x7f6ac8104a30 2024-09-21T06:11:22.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.666+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f6ac81a71a0 con 0x7f6ac8104a30 2024-09-21T06:11:22.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.676+0000 7f6acc8d8640 1 -- 172.21.15.38:0/1542973708 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f6ab8005560 con 0x7f6ac8104a30 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 msgr2=0x7f6ab0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 0x7f6ab0042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ac81000a0 tx=0x7f6abc0097a0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 msgr2=0x7f6ac819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 0x7f6ac819a470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800e9f0 tx=0x7f6ab800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 shutdown_connections 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab003fb70 0x7f6ab0042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ac810de60 0x7f6ac819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ac8105380 0x7f6ac819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 --2- 172.21.15.38:0/1542973708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ac8104a30 0x7f6ac819a470 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:22.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 >> 172.21.15.38:0/1542973708 conn(0x7f6ac80797b0 msgr2=0x7f6ac8107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:22.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 shutdown_connections 2024-09-21T06:11:22.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:22.678+0000 7f6acd8da640 1 -- 172.21.15.38:0/1542973708 wait complete. 2024-09-21T06:11:22.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1087461672' entity='client.admin' 2024-09-21T06:11:22.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3694045251' entity='client.admin' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:22.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: Reconfiguring daemon mgr.x on smithi038 2024-09-21T06:11:22.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:22 smithi038 ceph-mon[31215]: from='client.? ' entity='client.admin' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1087461672' entity='client.admin' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3694045251' entity='client.admin' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.056 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.057 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: Reconfiguring daemon mgr.x on smithi038 2024-09-21T06:11:23.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:22 smithi044 ceph-mon[34369]: from='client.? ' entity='client.admin' 2024-09-21T06:11:23.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1087461672' entity='client.admin' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3694045251' entity='client.admin' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:11:23.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:11:23.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:11:23.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:23.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: Reconfiguring daemon mgr.x on smithi038 2024-09-21T06:11:23.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:22 smithi174 ceph-mon[34815]: from='client.? ' entity='client.admin' 2024-09-21T06:11:23.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 -- 172.21.15.38:0/3061150754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d01083d0 msgr2=0x7fc2d01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3061150754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d01083d0 0x7fc2d01087e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009900 tx=0x7fc2c402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 -- 172.21.15.38:0/3061150754 shutdown_connections 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3061150754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 0x7fc2d010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3061150754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d01083d0 0x7fc2d01087e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3061150754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d0102ae0 0x7fc2d0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 -- 172.21.15.38:0/3061150754 >> 172.21.15.38:0/3061150754 conn(0x7fc2d0079760 msgr2=0x7fc2d0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 -- 172.21.15.38:0/3061150754 shutdown_connections 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.687+0000 7fc2d6778640 1 -- 172.21.15.38:0/3061150754 wait complete. 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.688+0000 7fc2d6778640 1 Processor -- start 2024-09-21T06:11:23.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.688+0000 7fc2d6778640 1 -- start start 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d01083d0 0x7fc2d00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 0x7fc2d01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0112990 con 0x7fc2d0102ae0 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0112810 con 0x7fc2d0108d20 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0112b10 con 0x7fc2d01083d0 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53276/0 (socket says 172.21.15.38:53276) 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 -- 172.21.15.38:0/3118318825 learned_addr learned my addr 172.21.15.38:0/3118318825 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cf7fe640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d01083d0 0x7fc2d00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d4d15640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 0x7fc2d01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 -- 172.21.15.38:0/3118318825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d01083d0 msgr2=0x7fc2d00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d01083d0 0x7fc2d00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 -- 172.21.15.38:0/3118318825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 msgr2=0x7fc2d01000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 0x7fc2d01000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 -- 172.21.15.38:0/3118318825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d01a8730 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cffff640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000e9f0 tx=0x7fc2c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000cd80 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d01a8a20 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fc2c00054d0 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0010470 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.689+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d01a8ee0 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.690+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fc2c0010670 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.690+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d0103d10 con 0x7fc2d0102ae0 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.691+0000 7fc2cd7fa640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 0x7fc2b8042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:23.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.691+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc2c0054b30 con 0x7fc2d0102ae0 2024-09-21T06:11:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.691+0000 7fc2cf7fe640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 0x7fc2b8042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.691+0000 7fc2cf7fe640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 0x7fc2b8042080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40314b0 tx=0x7fc2c40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:23.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.696+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2c0016330 con 0x7fc2d0102ae0 2024-09-21T06:11:23.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.755+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7fc2c00199c0 con 0x7fc2d0102ae0 2024-09-21T06:11:23.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.887+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fc2d002e640 con 0x7fc2d0102ae0 2024-09-21T06:11:23.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:23 smithi038 ceph-mon[31215]: Standby manager daemon z started 2024-09-21T06:11:23.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:23 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:11:23.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:23 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:23.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:23 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:11:23.889 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:23 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:23.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.890+0000 7fc2cd7fa640 1 -- 172.21.15.38:0/3118318825 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v21)=0 v21) ==== 138+0+0 (secure 0 0 0) 0x7fc2c006dc40 con 0x7fc2d0102ae0 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 msgr2=0x7fc2b8042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 0x7fc2b8042080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40314b0 tx=0x7fc2c40058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 msgr2=0x7fc2d00ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000e9f0 tx=0x7fc2c000edf0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 shutdown_connections 2024-09-21T06:11:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc2b803fb70 0x7fc2b8042080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2d0108d20 0x7fc2d01000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d01083d0 0x7fc2d00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 --2- 172.21.15.38:0/3118318825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2d0102ae0 0x7fc2d00ff670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.893+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 >> 172.21.15.38:0/3118318825 conn(0x7fc2d0079760 msgr2=0x7fc2d0101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.894+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 shutdown_connections 2024-09-21T06:11:23.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:23.894+0000 7fc2d6778640 1 -- 172.21.15.38:0/3118318825 wait complete. 2024-09-21T06:11:24.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:23 smithi174 ceph-mon[34815]: Standby manager daemon z started 2024-09-21T06:11:24.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:23 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:11:24.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:23 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:24.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:23 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:11:24.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:23 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:24.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:23 smithi044 ceph-mon[34369]: Standby manager daemon z started 2024-09-21T06:11:24.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:23 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:11:24.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:23 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:24.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:23 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:11:24.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:23 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.174:0/3777094579' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:24.803 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:24 smithi038 ceph-mon[31215]: mgrmap e19: x(active, since 12s), standbys: z 2024-09-21T06:11:24.803 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:24 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:11:24.803 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:24 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3118318825' entity='client.admin' 2024-09-21T06:11:24.803 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:24 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2321615309' entity='client.admin' 2024-09-21T06:11:25.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:24 smithi174 ceph-mon[34815]: mgrmap e19: x(active, since 12s), standbys: z 2024-09-21T06:11:25.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:24 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:11:25.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:24 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3118318825' entity='client.admin' 2024-09-21T06:11:25.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:24 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2321615309' entity='client.admin' 2024-09-21T06:11:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:24 smithi044 ceph-mon[34369]: mgrmap e19: x(active, since 12s), standbys: z 2024-09-21T06:11:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:24 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:11:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:24 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3118318825' entity='client.admin' 2024-09-21T06:11:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:24 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2321615309' entity='client.admin' 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 -- 172.21.15.38:0/3406324886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34102a60 msgr2=0x7f8a34102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3406324886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34102a60 0x7f8a34102e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009900 tx=0x7f8a2402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 -- 172.21.15.38:0/3406324886 shutdown_connections 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3406324886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a34108cf0 0x7f8a3410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3406324886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a341083a0 0x7f8a341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3406324886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34102a60 0x7f8a34102e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 -- 172.21.15.38:0/3406324886 >> 172.21.15.38:0/3406324886 conn(0x7f8a34079730 msgr2=0x7f8a34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 -- 172.21.15.38:0/3406324886 shutdown_connections 2024-09-21T06:11:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.725+0000 7f8a3a225640 1 -- 172.21.15.38:0/3406324886 wait complete. 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 Processor -- start 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 -- start start 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a34102a60 0x7f8a3419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a341083a0 0x7f8a3419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34112960 con 0x7f8a34108cf0 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341127e0 con 0x7f8a34102a60 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a3a225640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34112ae0 con 0x7f8a341083a0 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a33fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53244/0 (socket says 172.21.15.38:53244) 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a33fff640 1 -- 172.21.15.38:0/3694045251 learned_addr learned my addr 172.21.15.38:0/3694045251 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a2affd640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a341083a0 0x7f8a3419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.726+0000 7f8a337fe640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a34102a60 0x7f8a3419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 -- 172.21.15.38:0/3694045251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a341083a0 msgr2=0x7f8a3419b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a341083a0 0x7f8a3419b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 -- 172.21.15.38:0/3694045251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a34102a60 msgr2=0x7f8a3419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a34102a60 0x7f8a3419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 -- 172.21.15.38:0/3694045251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a341a6540 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a33fff640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00eaa0 tx=0x7f8a2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00cdb0 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8a2c005020 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a341a6830 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0116d0 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.727+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a341a6d20 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.728+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f8a2c011870 con 0x7f8a34108cf0 2024-09-21T06:11:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.728+0000 7f8a317fa640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 0x7f8a200420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.728+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8a2c054830 con 0x7f8a34108cf0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.729+0000 7f8a337fe640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 0x7f8a200420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.729+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a34102e70 con 0x7f8a34108cf0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.729+0000 7f8a337fe640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 0x7f8a200420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406b9c0 tx=0x7f8a240058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.734+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a2c016030 con 0x7f8a34108cf0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.938+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f8a3402e640 con 0x7f8a34108cf0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.942+0000 7f8a317fa640 1 -- 172.21.15.38:0/3694045251 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) ==== 127+0+0 (secure 0 0 0) 0x7f8a2c021da0 con 0x7f8a34108cf0 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.944+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 msgr2=0x7f8a200420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.944+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 0x7f8a200420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a3406b9c0 tx=0x7f8a240058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.944+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 msgr2=0x7f8a3419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.944+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00eaa0 tx=0x7f8a2c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 shutdown_connections 2024-09-21T06:11:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a2003fba0 0x7f8a200420b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a34108cf0 0x7f8a3419bd30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a341083a0 0x7f8a3419b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 --2- 172.21.15.38:0/3694045251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a34102a60 0x7f8a3419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 >> 172.21.15.38:0/3694045251 conn(0x7f8a34079730 msgr2=0x7f8a34101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 shutdown_connections 2024-09-21T06:11:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:21.945+0000 7f8a3a225640 1 -- 172.21.15.38:0/3694045251 wait complete. 2024-09-21T06:11:26.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:26 smithi038 ceph-mon[31215]: Standby manager daemon y started 2024-09-21T06:11:26.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:26 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:11:26.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:26 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:26.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:26 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:11:26.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:26 smithi038 ceph-mon[31215]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:26.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 -- 172.21.15.38:0/2764094136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c1094a0 msgr2=0x7f845c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 --2- 172.21.15.38:0/2764094136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c1094a0 0x7f845c1098b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f844c009900 tx=0x7f844c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:26.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 -- 172.21.15.38:0/2764094136 shutdown_connections 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 --2- 172.21.15.38:0/2764094136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 --2- 172.21.15.38:0/2764094136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c1094a0 0x7f845c1098b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 --2- 172.21.15.38:0/2764094136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c103b60 0x7f845c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 -- 172.21.15.38:0/2764094136 >> 172.21.15.38:0/2764094136 conn(0x7f845c07b850 msgr2=0x7f845c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 -- 172.21.15.38:0/2764094136 shutdown_connections 2024-09-21T06:11:26.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.375+0000 7f846381b640 1 -- 172.21.15.38:0/2764094136 wait complete. 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.376+0000 7f846381b640 1 Processor -- start 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.376+0000 7f846381b640 1 -- start start 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.376+0000 7f846381b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c1094a0 0x7f845c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f845c113b00 con 0x7f845c103b60 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f845c113980 con 0x7f845c109df0 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f845c113c80 con 0x7f845c1094a0 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53336/0 (socket says 172.21.15.38:53336) 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 -- 172.21.15.38:0/1403657104 learned_addr learned my addr 172.21.15.38:0/1403657104 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f8461db8640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f8460db6640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c1094a0 0x7f845c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 -- 172.21.15.38:0/1403657104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c1094a0 msgr2=0x7f845c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c1094a0 0x7f845c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 -- 172.21.15.38:0/1403657104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 msgr2=0x7f845c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 -- 172.21.15.38:0/1403657104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c1a0440 con 0x7f845c103b60 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f8461db8640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84615b7640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845800d950 tx=0x7f845800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458017070 con 0x7f845c103b60 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f845800de80 con 0x7f845c103b60 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c1a0730 con 0x7f845c103b60 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.377+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845800f620 con 0x7f845c103b60 2024-09-21T06:11:26.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.378+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c1a6e90 con 0x7f845c103b60 2024-09-21T06:11:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.378+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845c103f70 con 0x7f845c103b60 2024-09-21T06:11:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.380+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f8458005030 con 0x7f845c103b60 2024-09-21T06:11:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.381+0000 7f84527fc640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 0x7f84480b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.381+0000 7f8460db6640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 0x7f84480b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.381+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f84580e5280 con 0x7f845c103b60 2024-09-21T06:11:26.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.381+0000 7f8460db6640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 0x7f84480b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f844c02a930 tx=0x7f844c005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.384+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84580ad710 con 0x7f845c103b60 2024-09-21T06:11:26.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 -- 172.21.15.38:0/3105102623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98108cf0 msgr2=0x7f5a9810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/3105102623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98108cf0 0x7f5a9810f520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009ca0 tx=0x7f5a9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 -- 172.21.15.38:0/3105102623 shutdown_connections 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/3105102623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98108cf0 0x7f5a9810f520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/3105102623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 0x7f5a981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/3105102623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98102a60 0x7f5a98102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 -- 172.21.15.38:0/3105102623 >> 172.21.15.38:0/3105102623 conn(0x7f5a98079730 msgr2=0x7f5a98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 -- 172.21.15.38:0/3105102623 shutdown_connections 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.529+0000 7f5a9e47d640 1 -- 172.21.15.38:0/3105102623 wait complete. 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 Processor -- start 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 -- start start 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 0x7f5a98199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 0x7f5a9819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5a98112960 con 0x7f5a98102a60 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a981127e0 con 0x7f5a98108cf0 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.530+0000 7f5a9e47d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a98112ae0 con 0x7f5a981083a0 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53154/0 (socket says 172.21.15.38:53154) 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 -- 172.21.15.38:0/1216502159 learned_addr learned my addr 172.21.15.38:0/1216502159 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a8ffff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 0x7f5a98199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a9ca1a640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 0x7f5a9819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 -- 172.21.15.38:0/1216502159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 msgr2=0x7f5a98199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 0x7f5a98199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 -- 172.21.15.38:0/1216502159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 msgr2=0x7f5a9819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 0x7f5a9819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 -- 172.21.15.38:0/1216502159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9819f320 con 0x7f5a98102a60 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a9ca1a640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 0x7f5a9819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009970 tx=0x7f5a88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800d020 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f5a8800d1c0 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9819f610 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8800cc00 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.531+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9806ae60 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.532+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f5a88018420 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.532+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a98102e70 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.533+0000 7f5a95ffb640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 0x7f5a84042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.533+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5a88055bf0 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.533+0000 7f5a8ffff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 0x7f5a84042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.533+0000 7f5a8ffff640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 0x7f5a84042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a9806a3f0 tx=0x7f5a80005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.538+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a8800cda0 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.731+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5a9806b9f0 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.735+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1216502159 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7f5a88017d90 con 0x7f5a98102a60 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 msgr2=0x7f5a84042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 0x7f5a84042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a9806a3f0 tx=0x7f5a80005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 msgr2=0x7f5a981993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009970 tx=0x7f5a88009e30 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 shutdown_connections 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8403fb70 0x7f5a84042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a98108cf0 0x7f5a9819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a981083a0 0x7f5a98199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 --2- 172.21.15.38:0/1216502159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a98102a60 0x7f5a981993b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 >> 172.21.15.38:0/1216502159 conn(0x7f5a98079730 msgr2=0x7f5a98104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 shutdown_connections 2024-09-21T06:11:26.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:20.737+0000 7f5a9e47d640 1 -- 172.21.15.38:0/1216502159 wait complete. 2024-09-21T06:11:26.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.578+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f845c19b600 con 0x7f845c103b60 2024-09-21T06:11:26.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.583+0000 7f84527fc640 1 -- 172.21.15.38:0/1403657104 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v24)=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f84580b1af0 con 0x7f845c103b60 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 msgr2=0x7f84480b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 0x7f84480b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f844c02a930 tx=0x7f844c005a40 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 msgr2=0x7f845c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845800d950 tx=0x7f845800dd50 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 shutdown_connections 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84480b64d0 0x7f84480b89e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f845c109df0 0x7f845c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f845c1094a0 0x7f845c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 --2- 172.21.15.38:0/1403657104 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f845c103b60 0x7f845c19a4d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:26.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 >> 172.21.15.38:0/1403657104 conn(0x7f845c07b850 msgr2=0x7f845c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:26.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 shutdown_connections 2024-09-21T06:11:26.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.586+0000 7f846381b640 1 -- 172.21.15.38:0/1403657104 wait complete. 2024-09-21T06:11:26.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:26 smithi174 ceph-mon[34815]: Standby manager daemon y started 2024-09-21T06:11:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:26 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:11:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:26 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:26 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:11:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:26 smithi174 ceph-mon[34815]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:26 smithi044 ceph-mon[34369]: Standby manager daemon y started 2024-09-21T06:11:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:26 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:11:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:26 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:11:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:26 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:11:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:26 smithi044 ceph-mon[34369]: from='mgr.? 172.21.15.44:0/1661757457' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:11:27.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:27 smithi038 ceph-mon[31215]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:11:27.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:27 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:11:27.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:27 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1779655774' entity='client.admin' 2024-09-21T06:11:27.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:27 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1403657104' entity='client.admin' 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 -- 172.21.15.38:0/1156971597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 msgr2=0x7fafa8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 --2- 172.21.15.38:0/1156971597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa8110640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009900 tx=0x7fafa002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 -- 172.21.15.38:0/1156971597 shutdown_connections 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 --2- 172.21.15.38:0/1156971597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa8110640 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 --2- 172.21.15.38:0/1156971597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 0x7fafa81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 --2- 172.21.15.38:0/1156971597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 0x7fafa8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 -- 172.21.15.38:0/1156971597 >> 172.21.15.38:0/1156971597 conn(0x7fafa80ff610 msgr2=0x7fafa8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 -- 172.21.15.38:0/1156971597 shutdown_connections 2024-09-21T06:11:27.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.395+0000 7fafb0503640 1 -- 172.21.15.38:0/1156971597 wait complete. 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 Processor -- start 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 -- start start 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 0x7fafa819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 0x7fafa819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8113ad0 con 0x7fafa8109e10 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8113950 con 0x7fafa81094c0 2024-09-21T06:11:27.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafb0503640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8113c50 con 0x7fafa8103b80 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafaeaa0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafaeaa0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53348/0 (socket says 172.21.15.38:53348) 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafaeaa0640 1 -- 172.21.15.38:0/1513721486 learned_addr learned my addr 172.21.15.38:0/1513721486 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafada9e640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 0x7fafa819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.396+0000 7fafae29f640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 0x7fafa819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 -- 172.21.15.38:0/1513721486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 msgr2=0x7fafa819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 0x7fafa819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 -- 172.21.15.38:0/1513721486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 msgr2=0x7fafa819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 0x7fafa819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 -- 172.21.15.38:0/1513721486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa81a02f0 con 0x7fafa8109e10 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafaeaa0640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006010 tx=0x7fafa0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa003f030 con 0x7fafa8109e10 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fafa0004490 con 0x7fafa8109e10 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa81a0580 con 0x7fafa8109e10 2024-09-21T06:11:27.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81a0a60 con 0x7fafa8109e10 2024-09-21T06:11:27.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.397+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0035070 con 0x7fafa8109e10 2024-09-21T06:11:27.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.398+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa8103f90 con 0x7fafa8109e10 2024-09-21T06:11:27.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.400+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fafa0042030 con 0x7fafa8109e10 2024-09-21T06:11:27.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.401+0000 7fafa77fe640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 0x7faf900b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.401+0000 7fafae29f640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 0x7faf900b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.401+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fafa0105b60 con 0x7fafa8109e10 2024-09-21T06:11:27.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.402+0000 7fafae29f640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 0x7faf900b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faf98007ec0 tx=0x7faf980075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.404+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafa0105e20 con 0x7fafa8109e10 2024-09-21T06:11:27.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fafa810bc00 con 0x7fafa8109e10 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 -- 172.21.15.38:0/1994858748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 msgr2=0x7f9d2c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 --2- 172.21.15.38:0/1994858748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c10d850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009900 tx=0x7f9d2002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 -- 172.21.15.38:0/1994858748 shutdown_connections 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 --2- 172.21.15.38:0/1994858748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c10de10 0x7f9d2c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 --2- 172.21.15.38:0/1994858748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c10d850 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 --2- 172.21.15.38:0/1994858748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 -- 172.21.15.38:0/1994858748 >> 172.21.15.38:0/1994858748 conn(0x7f9d2c079730 msgr2=0x7f9d2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 -- 172.21.15.38:0/1994858748 shutdown_connections 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.596+0000 7f9d33c23640 1 -- 172.21.15.38:0/1994858748 wait complete. 2024-09-21T06:11:27.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 Processor -- start 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 -- start start 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c10de10 0x7f9d2c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c113a70 con 0x7f9d2c105300 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1138f0 con 0x7f9d2c1049b0 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d33c23640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c113bf0 con 0x7f9d2c10de10 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d311be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d311be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53364/0 (socket says 172.21.15.38:53364) 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d311be640 1 -- 172.21.15.38:0/3087321463 learned_addr learned my addr 172.21.15.38:0/3087321463 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:27.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d319bf640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.597+0000 7f9d321c0640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c10de10 0x7f9d2c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 -- 172.21.15.38:0/3087321463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c10de10 msgr2=0x7f9d2c103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c10de10 0x7f9d2c103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 -- 172.21.15.38:0/3087321463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 msgr2=0x7f9d2c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 -- 172.21.15.38:0/3087321463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c1a8760 con 0x7f9d2c105300 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d319bf640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d311be640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d20005940 tx=0x7f9d200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2003f030 con 0x7f9d2c105300 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9d20031880 con 0x7f9d2c105300 2024-09-21T06:11:27.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c1a89f0 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20035070 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.598+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a8f20 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.599+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c104dc0 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.601+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f9d20042030 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.602+0000 7f9d1effd640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 0x7f9d180b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.602+0000 7f9d319bf640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 0x7f9d180b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.602+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9d201060b0 con 0x7f9d2c105300 2024-09-21T06:11:27.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.602+0000 7fafa77fe640 1 -- 172.21.15.38:0/1513721486 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v25)=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7fafa00d23d0 con 0x7fafa8109e10 2024-09-21T06:11:27.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.602+0000 7f9d319bf640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 0x7f9d180b8ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c104140 tx=0x7f9d28005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:27.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 msgr2=0x7faf900b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 0x7faf900b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faf98007ec0 tx=0x7faf980075b0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 msgr2=0x7fafa819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006010 tx=0x7fafa0004270 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 shutdown_connections 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faf900b6500 0x7faf900b8a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafa8109e10 0x7fafa819fc80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafa81094c0 0x7fafa819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 --2- 172.21.15.38:0/1513721486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafa8103b80 0x7fafa819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 >> 172.21.15.38:0/1513721486 conn(0x7fafa80ff610 msgr2=0x7fafa8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 shutdown_connections 2024-09-21T06:11:27.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.605+0000 7fafb0503640 1 -- 172.21.15.38:0/1513721486 wait complete. 2024-09-21T06:11:27.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.609+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d200d2880 con 0x7f9d2c105300 2024-09-21T06:11:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:27 smithi174 ceph-mon[34815]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:11:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:27 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:11:27.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:27 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1779655774' entity='client.admin' 2024-09-21T06:11:27.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:27 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1403657104' entity='client.admin' 2024-09-21T06:11:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:27 smithi044 ceph-mon[34369]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:11:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:27 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:11:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:27 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1779655774' entity='client.admin' 2024-09-21T06:11:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:27 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1403657104' entity='client.admin' 2024-09-21T06:11:27.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.802+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f9d2c1039f0 con 0x7f9d2c105300 2024-09-21T06:11:27.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.807+0000 7f9d1effd640 1 -- 172.21.15.38:0/3087321463 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f9d200d77c0 con 0x7f9d2c105300 2024-09-21T06:11:27.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 msgr2=0x7f9d180b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 0x7f9d180b8ae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c104140 tx=0x7f9d28005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:27.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 msgr2=0x7f9d2c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:27.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d20005940 tx=0x7f9d200042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 shutdown_connections 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d180b65d0 0x7f9d180b8ae0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d2c10de10 0x7f9d2c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d2c105300 0x7f9d2c102c30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 --2- 172.21.15.38:0/3087321463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d2c1049b0 0x7f9d2c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.809+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 >> 172.21.15.38:0/3087321463 conn(0x7f9d2c079730 msgr2=0x7f9d2c0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.810+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 shutdown_connections 2024-09-21T06:11:27.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.810+0000 7f9d33c23640 1 -- 172.21.15.38:0/3087321463 wait complete. 2024-09-21T06:11:28.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:28 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1513721486' entity='client.admin' 2024-09-21T06:11:28.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:28 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3087321463' entity='client.admin' 2024-09-21T06:11:28.723 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:28 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1439007568' entity='client.admin' 2024-09-21T06:11:28.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:28 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1513721486' entity='client.admin' 2024-09-21T06:11:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:28 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3087321463' entity='client.admin' 2024-09-21T06:11:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:28 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1439007568' entity='client.admin' 2024-09-21T06:11:28.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 -- 172.21.15.38:0/2973259224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 msgr2=0x7f55dc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/2973259224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc102ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009900 tx=0x7f55cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:28.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 -- 172.21.15.38:0/2973259224 shutdown_connections 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/2973259224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc108d20 0x7f55dc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/2973259224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc1083d0 0x7f55dc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/2973259224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc102ef0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 -- 172.21.15.38:0/2973259224 >> 172.21.15.38:0/2973259224 conn(0x7f55dc079760 msgr2=0x7f55dc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 -- 172.21.15.38:0/2973259224 shutdown_connections 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.721+0000 7f55e0dd0640 1 -- 172.21.15.38:0/2973259224 wait complete. 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.722+0000 7f55e0dd0640 1 Processor -- start 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.722+0000 7f55e0dd0640 1 -- start start 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc1083d0 0x7f55dc19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc108d20 0x7f55dc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc112990 con 0x7f55dc102ae0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc112810 con 0x7f55dc1083d0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55e0dd0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc112b10 con 0x7f55dc108d20 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53408/0 (socket says 172.21.15.38:53408) 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 -- 172.21.15.38:0/1257984404 learned_addr learned my addr 172.21.15.38:0/1257984404 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55d9d9b640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc1083d0 0x7f55dc19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55dad9d640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc108d20 0x7f55dc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 -- 172.21.15.38:0/1257984404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc108d20 msgr2=0x7f55dc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc108d20 0x7f55dc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 -- 172.21.15.38:0/1257984404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc1083d0 msgr2=0x7f55dc19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc1083d0 0x7f55dc19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 -- 172.21.15.38:0/1257984404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc1a03e0 con 0x7f55dc102ae0 2024-09-21T06:11:28.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.723+0000 7f55da59c640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009230 tx=0x7f55cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.724+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc03f030 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.724+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f55cc003aa0 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.724+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc1a0670 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.724+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc035070 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.724+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc1a6e30 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.725+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc103d10 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.726+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f55cc042030 con 0x7f55dc102ae0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.727+0000 7f55cb7fe640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 0x7f55c40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.727+0000 7f55d9d9b640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 0x7f55c40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:28.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.727+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f55cc106210 con 0x7f55dc102ae0 2024-09-21T06:11:28.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.727+0000 7f55d9d9b640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 0x7f55c40b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55dc079e60 tx=0x7f55d000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:28.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.730+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55cc0d2a80 con 0x7f55dc102ae0 2024-09-21T06:11:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:28 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1513721486' entity='client.admin' 2024-09-21T06:11:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:28 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3087321463' entity='client.admin' 2024-09-21T06:11:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:28 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1439007568' entity='client.admin' 2024-09-21T06:11:28.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.920+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f55dc102ef0 con 0x7f55dc102ae0 2024-09-21T06:11:28.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.925+0000 7f55cb7fe640 1 -- 172.21.15.38:0/1257984404 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7f55cc0d79c0 con 0x7f55dc102ae0 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 msgr2=0x7f55c40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 0x7f55c40b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55dc079e60 tx=0x7f55d000b390 comp rx=0 tx=0).stop 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 msgr2=0x7f55dc19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009230 tx=0x7f55cc004270 comp rx=0 tx=0).stop 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 shutdown_connections 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55c40b64d0 0x7f55c40b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55dc108d20 0x7f55dc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55dc1083d0 0x7f55dc19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 --2- 172.21.15.38:0/1257984404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55dc102ae0 0x7f55dc19a470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 >> 172.21.15.38:0/1257984404 conn(0x7f55dc079760 msgr2=0x7f55dc101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 shutdown_connections 2024-09-21T06:11:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.927+0000 7f55e0dd0640 1 -- 172.21.15.38:0/1257984404 wait complete. 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 -- 172.21.15.38:0/3725950474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c102a90 msgr2=0x7f0f1c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 --2- 172.21.15.38:0/3725950474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c102a90 0x7f0f1c102ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009900 tx=0x7f0f0c02a410 comp rx=0 tx=0).stop 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 -- 172.21.15.38:0/3725950474 shutdown_connections 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 --2- 172.21.15.38:0/3725950474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c108d20 0x7f0f1c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 --2- 172.21.15.38:0/3725950474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 --2- 172.21.15.38:0/3725950474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c102a90 0x7f0f1c102ea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 -- 172.21.15.38:0/3725950474 >> 172.21.15.38:0/3725950474 conn(0x7f0f1c079750 msgr2=0x7f0f1c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 -- 172.21.15.38:0/3725950474 shutdown_connections 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.057+0000 7f0f20b47640 1 -- 172.21.15.38:0/3725950474 wait complete. 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 Processor -- start 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 -- start start 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 0x7f0f1c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 0x7f0f1c1a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c112990 con 0x7f0f1c1083d0 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c112810 con 0x7f0f1c108d20 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.058+0000 7f0f20b47640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c112b10 con 0x7f0f1c102a90 2024-09-21T06:11:29.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53428/0 (socket says 172.21.15.38:53428) 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 -- 172.21.15.38:0/2410960159 learned_addr learned my addr 172.21.15.38:0/2410960159 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f1ad9d640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 0x7f0f1c1a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f1a59c640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 0x7f0f1c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 -- 172.21.15.38:0/2410960159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 msgr2=0x7f0f1c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 0x7f0f1c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 -- 172.21.15.38:0/2410960159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 msgr2=0x7f0f1c1a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 0x7f0f1c1a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 -- 172.21.15.38:0/2410960159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c1a25c0 con 0x7f0f1c1083d0 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f1a59c640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 0x7f0f1c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f1ad9d640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 0x7f0f1c1a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:11:29.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f19d9b640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9c0 tx=0x7f0f1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000cd80 con 0x7f0f1c1083d0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f0f100054d0 con 0x7f0f1c1083d0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10010430 con 0x7f0f1c1083d0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c1a28b0 con 0x7f0f1c1083d0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.059+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1a90d0 con 0x7f0f1c1083d0 2024-09-21T06:11:29.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.060+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c103d10 con 0x7f0f1c1083d0 2024-09-21T06:11:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.062+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f0f100046c0 con 0x7f0f1c1083d0 2024-09-21T06:11:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.063+0000 7f0f0b7fe640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 0x7f0f040b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.063+0000 7f0f1a59c640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 0x7f0f040b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.063+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0f100e5c40 con 0x7f0f1c1083d0 2024-09-21T06:11:29.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.063+0000 7f0f1a59c640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 0x7f0f040b8b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005f70 tx=0x7f0f0c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.067+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f100ae030 con 0x7f0f1c1083d0 2024-09-21T06:11:29.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.259+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f0f1c19d840 con 0x7f0f1c1083d0 2024-09-21T06:11:29.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.259+0000 7f0f0b7fe640 1 -- 172.21.15.38:0/2410960159 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v28)=0 v28) ==== 108+0+0 (secure 0 0 0) 0x7f0f1c19d840 con 0x7f0f1c1083d0 2024-09-21T06:11:29.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.261+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 msgr2=0x7f0f040b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.261+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 0x7f0f040b8b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005f70 tx=0x7f0f0c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.261+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 msgr2=0x7f0f1c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.261+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9c0 tx=0x7f0f1000ee80 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 shutdown_connections 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f040b6600 0x7f0f040b8b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1c108d20 0x7f0f1c1a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f1c1083d0 0x7f0f1c19ccb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 --2- 172.21.15.38:0/2410960159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f1c102a90 0x7f0f1c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 >> 172.21.15.38:0/2410960159 conn(0x7f0f1c079750 msgr2=0x7f0f1c06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 shutdown_connections 2024-09-21T06:11:29.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:29.262+0000 7f0f20b47640 1 -- 172.21.15.38:0/2410960159 wait complete. 2024-09-21T06:11:29.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 -- 172.21.15.38:0/4105559872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f410de70 msgr2=0x7f89f4110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 --2- 172.21.15.38:0/4105559872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f410de70 0x7f89f4110380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009ca0 tx=0x7f89ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 -- 172.21.15.38:0/4105559872 shutdown_connections 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 --2- 172.21.15.38:0/4105559872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f410de70 0x7f89f4110380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 --2- 172.21.15.38:0/4105559872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f41052f0 0x7f89f410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 --2- 172.21.15.38:0/4105559872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41048c0 0x7f89f4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 -- 172.21.15.38:0/4105559872 >> 172.21.15.38:0/4105559872 conn(0x7f89f4079770 msgr2=0x7f89f4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 -- 172.21.15.38:0/4105559872 shutdown_connections 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.076+0000 7f89fc249640 1 -- 172.21.15.38:0/4105559872 wait complete. 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 Processor -- start 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 -- start start 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41052f0 0x7f89f419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f410de70 0x7f89f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4113b40 con 0x7f89f41048c0 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41139c0 con 0x7f89f41052f0 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89fc249640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4113cc0 con 0x7f89f410de70 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89f9fe5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89f9fe5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53316/0 (socket says 172.21.15.38:53316) 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89f9fe5640 1 -- 172.21.15.38:0/1779655774 learned_addr learned my addr 172.21.15.38:0/1779655774 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.077+0000 7f89f97e4640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41052f0 0x7f89f419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89fa7e6640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f410de70 0x7f89f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 -- 172.21.15.38:0/1779655774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f410de70 msgr2=0x7f89f419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f410de70 0x7f89f419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 -- 172.21.15.38:0/1779655774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41052f0 msgr2=0x7f89f419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41052f0 0x7f89f419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 -- 172.21.15.38:0/1779655774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41a03a0 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89f9fe5640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89f000e9f0 tx=0x7f89f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f000ccc0 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f89f00108e0 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41a0690 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0018790 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.078+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41a6eb0 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.079+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f406c200 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.080+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f89f0010430 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.081+0000 7f89eaffd640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 0x7f89e007d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.081+0000 7f89f97e4640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 0x7f89e007d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.081+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f89f009d200 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.081+0000 7f89f97e4640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 0x7f89e007d560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89f410fb10 tx=0x7f89e400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.086+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89f0010e00 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.158+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f89f0061300 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.287+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f89f4104cd0 con 0x7f89f41048c0 2024-09-21T06:11:29.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.293+0000 7f89eaffd640 1 -- 172.21.15.38:0/1779655774 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f89f0065790 con 0x7f89f41048c0 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.295+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 msgr2=0x7f89e007d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.295+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 0x7f89e007d560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89f410fb10 tx=0x7f89e400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.295+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 msgr2=0x7f89f419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.295+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89f000e9f0 tx=0x7f89f000edf0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 shutdown_connections 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f89e007b050 0x7f89e007d560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89f410de70 0x7f89f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f41052f0 0x7f89f419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 --2- 172.21.15.38:0/1779655774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89f41048c0 0x7f89f419a4f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 >> 172.21.15.38:0/1779655774 conn(0x7f89f4079770 msgr2=0x7f89f4107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 shutdown_connections 2024-09-21T06:11:29.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:26.296+0000 7f89fc249640 1 -- 172.21.15.38:0/1779655774 wait complete. 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 -- 172.21.15.38:0/3546244703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc102ae0 msgr2=0x7f55fc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 --2- 172.21.15.38:0/3546244703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc102ae0 0x7f55fc102ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 -- 172.21.15.38:0/3546244703 shutdown_connections 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 --2- 172.21.15.38:0/3546244703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc108d20 0x7f55fc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 --2- 172.21.15.38:0/3546244703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc1083d0 0x7f55fc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 --2- 172.21.15.38:0/3546244703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc102ae0 0x7f55fc102ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 -- 172.21.15.38:0/3546244703 >> 172.21.15.38:0/3546244703 conn(0x7f55fc079790 msgr2=0x7f55fc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 -- 172.21.15.38:0/3546244703 shutdown_connections 2024-09-21T06:11:29.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.344+0000 7f5603d75640 1 -- 172.21.15.38:0/3546244703 wait complete. 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 Processor -- start 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 -- start start 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 0x7f55fc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc1083d0 0x7f55fc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1129e0 con 0x7f55fc108d20 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc112860 con 0x7f55fc1083d0 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5603d75640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc112b60 con 0x7f55fc102ae0 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5602312640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5602312640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53296/0 (socket says 172.21.15.38:53296) 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5601310640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc1083d0 0x7f55fc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.345+0000 7f5602312640 1 -- 172.21.15.38:0/2321615309 learned_addr learned my addr 172.21.15.38:0/2321615309 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5601b11640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 0x7f55fc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 -- 172.21.15.38:0/2321615309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 msgr2=0x7f55fc19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 0x7f55fc19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 -- 172.21.15.38:0/2321615309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc1083d0 msgr2=0x7f55fc19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc1083d0 0x7f55fc19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 -- 172.21.15.38:0/2321615309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc1a65b0 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5601b11640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 0x7f55fc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5602312640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55f400d950 tx=0x7f55f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017030 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f55f4004020 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4003bc0 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc1a68a0 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.346+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc1a6de0 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.347+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc102ef0 con 0x7f55fc108d20 2024-09-21T06:11:29.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.348+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f55f401a070 con 0x7f55fc108d20 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.348+0000 7f55eeffd640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 0x7f55e807d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.349+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f55f409c570 con 0x7f55fc108d20 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.349+0000 7f5601b11640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 0x7f55e807d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.349+0000 7f5601b11640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 0x7f55e807d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000f80 tx=0x7f55f8009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.355+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55f4021070 con 0x7f55fc108d20 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.544+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f55fc10ab50 con 0x7f55fc108d20 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.549+0000 7f55eeffd640 1 -- 172.21.15.38:0/2321615309 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f55f4064ba0 con 0x7f55fc108d20 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 msgr2=0x7f55e807d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 0x7f55e807d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000f80 tx=0x7f55f8009360 comp rx=0 tx=0).stop 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 msgr2=0x7f55fc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55f400d950 tx=0x7f55f400de10 comp rx=0 tx=0).stop 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 shutdown_connections 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55e807b020 0x7f55e807d530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55fc108d20 0x7f55fc19bd70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55fc1083d0 0x7f55fc19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 --2- 172.21.15.38:0/2321615309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55fc102ae0 0x7f55fc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:29.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 >> 172.21.15.38:0/2321615309 conn(0x7f55fc079790 msgr2=0x7f55fc1064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:29.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 shutdown_connections 2024-09-21T06:11:29.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:24.552+0000 7f5603d75640 1 -- 172.21.15.38:0/2321615309 wait complete. 2024-09-21T06:11:29.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:29 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1257984404' entity='client.admin' 2024-09-21T06:11:30.119 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:30.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:29 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1257984404' entity='client.admin' 2024-09-21T06:11:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:29 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1257984404' entity='client.admin' 2024-09-21T06:11:30.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 -- 172.21.15.38:0/3402288125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 msgr2=0x7fde7010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 --2- 172.21.15.38:0/3402288125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7010f540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fde68009ca0 tx=0x7fde6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 -- 172.21.15.38:0/3402288125 shutdown_connections 2024-09-21T06:11:30.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 --2- 172.21.15.38:0/3402288125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7010f540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 --2- 172.21.15.38:0/3402288125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 --2- 172.21.15.38:0/3402288125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 0x7fde70102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 -- 172.21.15.38:0/3402288125 >> 172.21.15.38:0/3402288125 conn(0x7fde70079740 msgr2=0x7fde70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 -- 172.21.15.38:0/3402288125 shutdown_connections 2024-09-21T06:11:30.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.703+0000 7fde762cd640 1 -- 172.21.15.38:0/3402288125 wait complete. 2024-09-21T06:11:30.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.704+0000 7fde762cd640 1 Processor -- start 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.704+0000 7fde762cd640 1 -- start start 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 0x7fde7019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde7019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112980 con 0x7fde70108d10 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112800 con 0x7fde701083c0 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde762cd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112b00 con 0x7fde70102a80 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde7486a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde7486a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39042/0 (socket says 172.21.15.38:39042) 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde7019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde7486a640 1 -- 172.21.15.38:0/526070166 learned_addr learned my addr 172.21.15.38:0/526070166 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6ffff640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 0x7fde7019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 -- 172.21.15.38:0/526070166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 msgr2=0x7fde7019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 0x7fde7019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 -- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 msgr2=0x7fde7019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde6f7fe640 1 -- 172.21.15.38:0/526070166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde701a0370 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.705+0000 7fde7486a640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde6f7fe640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde7019a9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde64005fd0 tx=0x7fde6400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64009c00 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde701a0660 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fde64009da0 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64003dc0 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.706+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde701a6dc0 con 0x7fde701083c0 2024-09-21T06:11:30.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.707+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde70103d00 con 0x7fde701083c0 2024-09-21T06:11:30.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.709+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fde640035f0 con 0x7fde701083c0 2024-09-21T06:11:30.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.709+0000 7fde6d7fa640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 0x7fde580b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:30.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.710+0000 7fde6ffff640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 0x7fde580b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:30.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.710+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fde640e5130 con 0x7fde701083c0 2024-09-21T06:11:30.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.710+0000 7fde6ffff640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 0x7fde580b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde60009bd0 tx=0x7fde60005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:30.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.713+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde64017020 con 0x7fde701083c0 2024-09-21T06:11:30.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.907+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fde7019b530 con 0x7fde701083c0 2024-09-21T06:11:30.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.915+0000 7fde6d7fa640 1 -- 172.21.15.38:0/526070166 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7fde7019b530 con 0x7fde701083c0 2024-09-21T06:11:30.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 msgr2=0x7fde580b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 0x7fde580b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fde60009bd0 tx=0x7fde60005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 msgr2=0x7fde7019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde7019a9a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde64005fd0 tx=0x7fde6400dde0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 shutdown_connections 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde580b64d0 0x7fde580b89e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde70108d10 0x7fde7019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde701083c0 0x7fde7019a9a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 --2- 172.21.15.38:0/526070166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde70102a80 0x7fde7019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 >> 172.21.15.38:0/526070166 conn(0x7fde70079740 msgr2=0x7fde7006be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 shutdown_connections 2024-09-21T06:11:30.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:30.918+0000 7fde762cd640 1 -- 172.21.15.38:0/526070166 wait complete. 2024-09-21T06:11:31.492 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.948+0000 7f9a18712640 1 -- 172.21.15.38:0/2347496076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a101083a0 msgr2=0x7f9a101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.948+0000 7f9a18712640 1 --2- 172.21.15.38:0/2347496076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a101083a0 0x7f9a101087b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009900 tx=0x7f9a0002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 -- 172.21.15.38:0/2347496076 shutdown_connections 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 --2- 172.21.15.38:0/2347496076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 --2- 172.21.15.38:0/2347496076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a101083a0 0x7f9a101087b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 --2- 172.21.15.38:0/2347496076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a10102a60 0x7f9a10102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 -- 172.21.15.38:0/2347496076 >> 172.21.15.38:0/2347496076 conn(0x7f9a10079730 msgr2=0x7f9a10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 -- 172.21.15.38:0/2347496076 shutdown_connections 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 -- 172.21.15.38:0/2347496076 wait complete. 2024-09-21T06:11:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 Processor -- start 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.949+0000 7f9a18712640 1 -- start start 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 0x7f9a1019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101129a0 con 0x7f9a10102a60 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10112820 con 0x7f9a101083a0 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a18712640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10112b20 con 0x7f9a10108cf0 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53384/0 (socket says 172.21.15.38:53384) 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 -- 172.21.15.38:0/1439007568 learned_addr learned my addr 172.21.15.38:0/1439007568 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a15cad640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 0x7f9a1019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a16caf640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 -- 172.21.15.38:0/1439007568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 msgr2=0x7f9a1019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 -- 172.21.15.38:0/1439007568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 msgr2=0x7f9a1019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 0x7f9a1019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 -- 172.21.15.38:0/1439007568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a101a65e0 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a15cad640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 0x7f9a1019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a16caf640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.950+0000 7f9a164ae640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d950 tx=0x7f9a0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.951+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.951+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9a0c009c30 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.951+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a101a68d0 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.951+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00f620 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.951+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101a6e60 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.952+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a10102e70 con 0x7f9a10102a60 2024-09-21T06:11:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.953+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f9a0c0109a0 con 0x7f9a10102a60 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.954+0000 7f9a077fe640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 0x7f99fc0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.954+0000 7f9a15cad640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 0x7f99fc0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.954+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9a0c0e5340 con 0x7f9a10102a60 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.955+0000 7f9a15cad640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 0x7f99fc0b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a000314b0 tx=0x7f9a000058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:27.957+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a0c0ad7d0 con 0x7f9a10102a60 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.145+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f9a1002e640 con 0x7f9a10102a60 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.149+0000 7f9a077fe640 1 -- 172.21.15.38:0/1439007568 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v27)=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f9a0c0b1bb0 con 0x7f9a10102a60 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 msgr2=0x7f99fc0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 0x7f99fc0b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a000314b0 tx=0x7f9a000058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 msgr2=0x7f9a1019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d950 tx=0x7f9a0c00de10 comp rx=0 tx=0).stop 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 shutdown_connections 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99fc0b64d0 0x7f99fc0b89e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a10108cf0 0x7f9a1019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101083a0 0x7f9a1019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 --2- 172.21.15.38:0/1439007568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a10102a60 0x7f9a1019b2d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 >> 172.21.15.38:0/1439007568 conn(0x7f9a10079730 msgr2=0x7f9a101052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 shutdown_connections 2024-09-21T06:11:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:28.152+0000 7f9a18712640 1 -- 172.21.15.38:0/1439007568 wait complete. 2024-09-21T06:11:32.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:31 smithi038 ceph-mon[31215]: from='client.? ' entity='client.admin' 2024-09-21T06:11:32.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:31 smithi174 ceph-mon[34815]: from='client.? ' entity='client.admin' 2024-09-21T06:11:32.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:31 smithi044 ceph-mon[34369]: from='client.? ' entity='client.admin' 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 -- 172.21.15.38:0/2555119178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc102a80 msgr2=0x7f91cc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2555119178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc102a80 0x7f91cc102e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009ca0 tx=0x7f91bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 -- 172.21.15.38:0/2555119178 shutdown_connections 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2555119178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc108d10 0x7f91cc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2555119178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 0x7f91cc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2555119178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc102a80 0x7f91cc102e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 -- 172.21.15.38:0/2555119178 >> 172.21.15.38:0/2555119178 conn(0x7f91cc079740 msgr2=0x7f91cc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 -- 172.21.15.38:0/2555119178 shutdown_connections 2024-09-21T06:11:32.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.593+0000 7f91d1a45640 1 -- 172.21.15.38:0/2555119178 wait complete. 2024-09-21T06:11:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.594+0000 7f91d1a45640 1 Processor -- start 2024-09-21T06:11:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.594+0000 7f91d1a45640 1 -- start start 2024-09-21T06:11:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.594+0000 7f91d1a45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc102a80 0x7f91cc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.594+0000 7f91d1a45640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 0x7f91cc19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.594+0000 7f91d1a45640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91d1a45640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1129e0 con 0x7f91cc108d10 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91d1a45640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc112860 con 0x7f91cc102a80 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91d1a45640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc112b60 con 0x7f91cc1083c0 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39054/0 (socket says 172.21.15.38:39054) 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 -- 172.21.15.38:0/2589363896 learned_addr learned my addr 172.21.15.38:0/2589363896 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91caffd640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc102a80 0x7f91cc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91ca7fc640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 0x7f91cc19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 -- 172.21.15.38:0/2589363896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 msgr2=0x7f91cc19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 0x7f91cc19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 -- 172.21.15.38:0/2589363896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc102a80 msgr2=0x7f91cc19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc102a80 0x7f91cc19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 -- 172.21.15.38:0/2589363896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc1a0400 con 0x7f91cc108d10 2024-09-21T06:11:32.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91cb7fe640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91c400d750 tx=0x7f91c400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.595+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4017070 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.596+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f91c40097c0 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.596+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc1a06f0 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.596+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4004bb0 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.596+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1a6e50 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.597+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc102e90 con 0x7f91cc108d10 2024-09-21T06:11:32.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.598+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f91c4005220 con 0x7f91cc108d10 2024-09-21T06:11:32.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.599+0000 7f91d0a43640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 0x7f91b80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:32.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.599+0000 7f91caffd640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 0x7f91b80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:32.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.599+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f91c40e4fe0 con 0x7f91cc108d10 2024-09-21T06:11:32.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.600+0000 7f91caffd640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 0x7f91b80b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005e30 tx=0x7f91bc031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:32.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.604+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91c40ad470 con 0x7f91cc108d10 2024-09-21T06:11:32.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.835+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f91cc1a7020 con 0x7f91cc108d10 2024-09-21T06:11:32.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.840+0000 7f91d0a43640 1 -- 172.21.15.38:0/2589363896 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f91c40b1850 con 0x7f91cc108d10 2024-09-21T06:11:32.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 msgr2=0x7f91b80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 0x7f91b80b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005e30 tx=0x7f91bc031000 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 msgr2=0x7f91cc19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f91c400d750 tx=0x7f91c400db50 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 shutdown_connections 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91b80b6550 0x7f91b80b8a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91cc108d10 0x7f91cc19fcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91cc1083c0 0x7f91cc19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 --2- 172.21.15.38:0/2589363896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91cc102a80 0x7f91cc19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.843+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 >> 172.21.15.38:0/2589363896 conn(0x7f91cc079740 msgr2=0x7f91cc1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.844+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 shutdown_connections 2024-09-21T06:11:32.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:32.844+0000 7f91d1a45640 1 -- 172.21.15.38:0/2589363896 wait complete. 2024-09-21T06:11:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:33.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:32 smithi174 ceph-mon[34815]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:33.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:32 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2589363896' entity='client.admin' 2024-09-21T06:11:33.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:32 smithi038 ceph-mon[31215]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:33.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:32 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2589363896' entity='client.admin' 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 -- 172.21.15.38:0/470853318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354108d00 msgr2=0x7ff35410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 --2- 172.21.15.38:0/470853318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354108d00 0x7ff35410f530 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009ca0 tx=0x7ff34c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 -- 172.21.15.38:0/470853318 shutdown_connections 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 --2- 172.21.15.38:0/470853318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354108d00 0x7ff35410f530 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 --2- 172.21.15.38:0/470853318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3541083b0 0x7ff3541087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 --2- 172.21.15.38:0/470853318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff354102a70 0x7ff354102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 -- 172.21.15.38:0/470853318 >> 172.21.15.38:0/470853318 conn(0x7ff354079730 msgr2=0x7ff354079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 -- 172.21.15.38:0/470853318 shutdown_connections 2024-09-21T06:11:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.363+0000 7ff359b77640 1 -- 172.21.15.38:0/470853318 wait complete. 2024-09-21T06:11:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.364+0000 7ff359b77640 1 Processor -- start 2024-09-21T06:11:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.364+0000 7ff359b77640 1 -- start start 2024-09-21T06:11:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3541083b0 0x7ff35419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff354108d00 0x7ff35419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff354112970 con 0x7ff354102a70 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3541127f0 con 0x7ff354108d00 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff359b77640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff354112af0 con 0x7ff3541083b0 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39066/0 (socket says 172.21.15.38:39066) 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 -- 172.21.15.38:0/1117461390 learned_addr learned my addr 172.21.15.38:0/1117461390 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff353fff640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff354108d00 0x7ff35419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff352ffd640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3541083b0 0x7ff35419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 -- 172.21.15.38:0/1117461390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3541083b0 msgr2=0x7ff35419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3541083b0 0x7ff35419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 -- 172.21.15.38:0/1117461390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff354108d00 msgr2=0x7ff35419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff354108d00 0x7ff35419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 -- 172.21.15.38:0/1117461390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3541a03a0 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.365+0000 7ff3537fe640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff34400d770 tx=0x7ff34400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.366+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344017070 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.366+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7ff3440054d0 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.366+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3541a0690 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.366+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344004d00 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.366+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3541a6df0 con 0x7ff354102a70 2024-09-21T06:11:33.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.367+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff354103cf0 con 0x7ff354102a70 2024-09-21T06:11:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.369+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7ff344004ea0 con 0x7ff354102a70 2024-09-21T06:11:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.370+0000 7ff350ff9640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 0x7ff3400b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.370+0000 7ff352ffd640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 0x7ff3400b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.370+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff3440e5500 con 0x7ff354102a70 2024-09-21T06:11:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.371+0000 7ff352ffd640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 0x7ff3400b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0095f0 tx=0x7ff33c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:33.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.374+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3440b1cd0 con 0x7ff354102a70 2024-09-21T06:11:33.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:32 smithi044 ceph-mon[34369]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:32 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2589363896' entity='client.admin' 2024-09-21T06:11:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.568+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff35419b560 con 0x7ff354102a70 2024-09-21T06:11:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.569+0000 7ff350ff9640 1 -- 172.21.15.38:0/1117461390 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v30)=0 v30) ==== 106+0+0 (secure 0 0 0) 0x7ff3440b6c10 con 0x7ff354102a70 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 msgr2=0x7ff3400b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 0x7ff3400b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0095f0 tx=0x7ff33c005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 msgr2=0x7ff35419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff34400d770 tx=0x7ff34400dc30 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 shutdown_connections 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3400b64d0 0x7ff3400b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff354108d00 0x7ff35419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3541083b0 0x7ff35419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 --2- 172.21.15.38:0/1117461390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff354102a70 0x7ff35419a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 >> 172.21.15.38:0/1117461390 conn(0x7ff354079730 msgr2=0x7ff3541019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:33.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 shutdown_connections 2024-09-21T06:11:33.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:33.571+0000 7ff359b77640 1 -- 172.21.15.38:0/1117461390 wait complete. 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 -- 172.21.15.38:0/461996058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c1094b0 msgr2=0x7f180c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 --2- 172.21.15.38:0/461996058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c1094b0 0x7f180c1098c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1800009900 tx=0x7f180002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 -- 172.21.15.38:0/461996058 shutdown_connections 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 --2- 172.21.15.38:0/461996058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c109e00 0x7f180c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 --2- 172.21.15.38:0/461996058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c1094b0 0x7f180c1098c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 --2- 172.21.15.38:0/461996058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 -- 172.21.15.38:0/461996058 >> 172.21.15.38:0/461996058 conn(0x7f180c077c60 msgr2=0x7f180c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 -- 172.21.15.38:0/461996058 shutdown_connections 2024-09-21T06:11:34.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.429+0000 7f1810c67640 1 -- 172.21.15.38:0/461996058 wait complete. 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 Processor -- start 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 -- start start 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c1094b0 0x7f180c103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c109e00 0x7f180c103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f180c113ac0 con 0x7f180c109e00 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f180c113940 con 0x7f180c101f70 2024-09-21T06:11:34.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f1810c67640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f180c113c40 con 0x7f180c1094b0 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f180a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f180a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:59402/0 (socket says 172.21.15.38:59402) 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.430+0000 7f180a59c640 1 -- 172.21.15.38:0/3654742375 learned_addr learned my addr 172.21.15.38:0/3654742375 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f1809d9b640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c1094b0 0x7f180c103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180ad9d640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c109e00 0x7f180c103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 -- 172.21.15.38:0/3654742375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c1094b0 msgr2=0x7f180c103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c1094b0 0x7f180c103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 -- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c109e00 msgr2=0x7f180c103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c109e00 0x7f180c103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 -- 172.21.15.38:0/3654742375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c1a8710 con 0x7f180c101f70 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f180a59c640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00d950 tx=0x7f17fc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc017070 con 0x7f180c101f70 2024-09-21T06:11:34.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180c1a8a00 con 0x7f180c101f70 2024-09-21T06:11:34.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f17fc009c30 con 0x7f180c101f70 2024-09-21T06:11:34.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.431+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00f620 con 0x7f180c101f70 2024-09-21T06:11:34.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.432+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180c1a8f10 con 0x7f180c101f70 2024-09-21T06:11:34.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.432+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f180c102380 con 0x7f180c101f70 2024-09-21T06:11:34.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.434+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f17fc0109a0 con 0x7f180c101f70 2024-09-21T06:11:34.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.435+0000 7f17fb7fe640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 0x7f17f40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.435+0000 7f1809d9b640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 0x7f17f40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.435+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f17fc0e5270 con 0x7f180c101f70 2024-09-21T06:11:34.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.436+0000 7f1809d9b640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 0x7f17f40b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1800005940 tx=0x7f18000058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.438+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17fc0b1ac0 con 0x7f180c101f70 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 -- 172.21.15.38:0/2536660143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e24110180 msgr2=0x7f2e241125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 --2- 172.21.15.38:0/2536660143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e24110180 0x7f2e241125a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009ca0 tx=0x7f2e1c02a950 comp rx=0 tx=0).stop 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 -- 172.21.15.38:0/2536660143 shutdown_connections 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 --2- 172.21.15.38:0/2536660143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e24110180 0x7f2e241125a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 --2- 172.21.15.38:0/2536660143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24102f20 0x7f2e2410fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 --2- 172.21.15.38:0/2536660143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e241025d0 0x7f2e241029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 -- 172.21.15.38:0/2536660143 >> 172.21.15.38:0/2536660143 conn(0x7f2e24079730 msgr2=0x7f2e24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 -- 172.21.15.38:0/2536660143 shutdown_connections 2024-09-21T06:11:34.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.621+0000 7f2e2be15640 1 -- 172.21.15.38:0/2536660143 wait complete. 2024-09-21T06:11:34.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 Processor -- start 2024-09-21T06:11:34.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 -- start start 2024-09-21T06:11:34.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e24102f20 0x7f2e2419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24110180 0x7f2e241a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e24115c70 con 0x7f2e241025d0 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e24115af0 con 0x7f2e24110180 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2be15640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2e24115df0 con 0x7f2e24102f20 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e29bb1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e29bb1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39132/0 (socket says 172.21.15.38:39132) 2024-09-21T06:11:34.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e29bb1640 1 -- 172.21.15.38:0/824629632 learned_addr learned my addr 172.21.15.38:0/824629632 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e293b0640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e24102f20 0x7f2e2419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.622+0000 7f2e2a3b2640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24110180 0x7f2e241a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 -- 172.21.15.38:0/824629632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e24102f20 msgr2=0x7f2e2419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e24102f20 0x7f2e2419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 -- 172.21.15.38:0/824629632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24110180 msgr2=0x7f2e241a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24110180 0x7f2e241a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 -- 172.21.15.38:0/824629632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e241a2490 con 0x7f2e241025d0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e29bb1640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000d770 tx=0x7f2e2000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20017070 con 0x7f2e241025d0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f2e20009820 con 0x7f2e241025d0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e241a2780 con 0x7f2e241025d0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004b80 con 0x7f2e241025d0 2024-09-21T06:11:34.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.623+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e241a8fa0 con 0x7f2e241025d0 2024-09-21T06:11:34.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.624+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e241029e0 con 0x7f2e241025d0 2024-09-21T06:11:34.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.626+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f2e20004d20 con 0x7f2e241025d0 2024-09-21T06:11:34.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.627+0000 7f2e1affd640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 0x7f2e100b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:34.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.627+0000 7f2e293b0640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 0x7f2e100b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:34.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.628+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2e200e54a0 con 0x7f2e241025d0 2024-09-21T06:11:34.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.628+0000 7f2e293b0640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 0x7f2e100b8a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e24103dd0 tx=0x7f2e1400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:34.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.631+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e200ad990 con 0x7f2e241025d0 2024-09-21T06:11:34.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.631+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f180c104210 con 0x7f180c101f70 2024-09-21T06:11:34.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.638+0000 7f17fb7fe640 1 -- 172.21.15.38:0/3654742375 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v32)=0 v32) ==== 120+0+0 (secure 0 0 0) 0x7f180c104210 con 0x7f180c101f70 2024-09-21T06:11:34.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.640+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 msgr2=0x7f17f40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.640+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 0x7f17f40b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1800005940 tx=0x7f18000058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.640+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 msgr2=0x7f180c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.640+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00d950 tx=0x7f17fc00de10 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 shutdown_connections 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17f40b64d0 0x7f17f40b89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f180c109e00 0x7f180c103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f180c1094b0 0x7f180c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 --2- 172.21.15.38:0/3654742375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f180c101f70 0x7f180c102f10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 >> 172.21.15.38:0/3654742375 conn(0x7f180c077c60 msgr2=0x7f180c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 shutdown_connections 2024-09-21T06:11:34.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.641+0000 7f1810c67640 1 -- 172.21.15.38:0/3654742375 wait complete. 2024-09-21T06:11:34.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.829+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2e241a9200 con 0x7f2e241025d0 2024-09-21T06:11:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.834+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7f2e200b1d70 con 0x7f2e241025d0 2024-09-21T06:11:34.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.835+0000 7f2e1affd640 1 -- 172.21.15.38:0/824629632 <== mon.0 v2:172.21.15.38:3300/0 8 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e200acda0 con 0x7f2e241025d0 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 msgr2=0x7f2e100b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 0x7f2e100b8a90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e24103dd0 tx=0x7f2e1400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 msgr2=0x7f2e2419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000d770 tx=0x7f2e2000db70 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 shutdown_connections 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e100b6580 0x7f2e100b8a90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e24110180 0x7f2e241a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e24102f20 0x7f2e2419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 --2- 172.21.15.38:0/824629632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e241025d0 0x7f2e2419c5e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 >> 172.21.15.38:0/824629632 conn(0x7f2e24079730 msgr2=0x7f2e24109d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:34.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 shutdown_connections 2024-09-21T06:11:34.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.837+0000 7f2e2be15640 1 -- 172.21.15.38:0/824629632 wait complete. 2024-09-21T06:11:34.914 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:34 smithi038 ceph-mon[31215]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:34 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/213760952' entity='client.admin' 2024-09-21T06:11:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:34 smithi038 ceph-mon[31215]: from='client.? ' entity='client.admin' 2024-09-21T06:11:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:34 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/824629632' entity='client.admin' 2024-09-21T06:11:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:34 smithi174 ceph-mon[34815]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:34 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/213760952' entity='client.admin' 2024-09-21T06:11:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:34 smithi174 ceph-mon[34815]: from='client.? ' entity='client.admin' 2024-09-21T06:11:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:34 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/824629632' entity='client.admin' 2024-09-21T06:11:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:34 smithi044 ceph-mon[34369]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:34 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/213760952' entity='client.admin' 2024-09-21T06:11:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:34 smithi044 ceph-mon[34369]: from='client.? ' entity='client.admin' 2024-09-21T06:11:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:34 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/824629632' entity='client.admin' 2024-09-21T06:11:35.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 -- 172.21.15.38:0/2156441672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad0105380 msgr2=0x7fcad010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 --2- 172.21.15.38:0/2156441672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad0105380 0x7fcad010d8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009900 tx=0x7fcac402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:35.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 -- 172.21.15.38:0/2156441672 shutdown_connections 2024-09-21T06:11:35.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 --2- 172.21.15.38:0/2156441672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad010de60 0x7fcad0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 --2- 172.21.15.38:0/2156441672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad0105380 0x7fcad010d8d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 --2- 172.21.15.38:0/2156441672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 -- 172.21.15.38:0/2156441672 >> 172.21.15.38:0/2156441672 conn(0x7fcad00797b0 msgr2=0x7fcad0079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 -- 172.21.15.38:0/2156441672 shutdown_connections 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.335+0000 7fcad6271640 1 -- 172.21.15.38:0/2156441672 wait complete. 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 Processor -- start 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 -- start start 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad0105380 0x7fcad0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0113af0 con 0x7fcad010de60 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0113970 con 0x7fcad0104a30 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.336+0000 7fcad6271640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0113c70 con 0x7fcad0105380 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcacffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39082/0 (socket says 172.21.15.38:39082) 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 -- 172.21.15.38:0/213760952 learned_addr learned my addr 172.21.15.38:0/213760952 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcacffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:59388/0 (socket says 172.21.15.38:59388) 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcacf7fe640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad0105380 0x7fcad0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 -- 172.21.15.38:0/213760952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad0105380 msgr2=0x7fcad0102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad0105380 0x7fcad0102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 -- 172.21.15.38:0/213760952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 msgr2=0x7fcad0102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 -- 172.21.15.38:0/213760952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad01a8760 con 0x7fcad010de60 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcad480e640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcac800eaa0 tx=0x7fcac800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac800cdb0 con 0x7fcad010de60 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.337+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fcac8005020 con 0x7fcad010de60 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.338+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80116d0 con 0x7fcad010de60 2024-09-21T06:11:35.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.338+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad01a8a50 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.338+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad01a8fb0 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.339+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad0104e40 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.340+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fcac8005560 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.341+0000 7fcacd7fa640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 0x7fcab80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.341+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcac80e5bd0 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.341+0000 7fcacffff640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 0x7fcab80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.342+0000 7fcacffff640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 0x7fcab80b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcad01041c0 tx=0x7fcac000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.344+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcac8016030 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.543+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fcad01a9360 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.547+0000 7fcacd7fa640 1 -- 172.21.15.38:0/213760952 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v31)=0 v31) ==== 108+0+0 (secure 0 0 0) 0x7fcac80b24c0 con 0x7fcad010de60 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 msgr2=0x7fcab80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 0x7fcab80b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcad01041c0 tx=0x7fcac000b390 comp rx=0 tx=0).stop 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 msgr2=0x7fcad01031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:35.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcac800eaa0 tx=0x7fcac800ef60 comp rx=0 tx=0).stop 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 shutdown_connections 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcab80b6550 0x7fcab80b8a60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcad010de60 0x7fcad01031f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad0105380 0x7fcad0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 --2- 172.21.15.38:0/213760952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad0104a30 0x7fcad0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 >> 172.21.15.38:0/213760952 conn(0x7fcad00797b0 msgr2=0x7fcad0107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 shutdown_connections 2024-09-21T06:11:35.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.551+0000 7fcad6271640 1 -- 172.21.15.38:0/213760952 wait complete. 2024-09-21T06:11:36.183 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:36 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4283222711' entity='client.admin' 2024-09-21T06:11:36.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:36 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4283222711' entity='client.admin' 2024-09-21T06:11:36.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:36 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4283222711' entity='client.admin' 2024-09-21T06:11:37.311 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:37 smithi038 ceph-mon[31215]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 -- 172.21.15.38:0/1294262236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 msgr2=0x7f2324103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 --2- 172.21.15.38:0/1294262236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f2324103fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2314009900 tx=0x7f231402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 -- 172.21.15.38:0/1294262236 shutdown_connections 2024-09-21T06:11:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 --2- 172.21.15.38:0/1294262236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 0x7f2324110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 --2- 172.21.15.38:0/1294262236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 0x7f2324109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 --2- 172.21.15.38:0/1294262236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f2324103fc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 -- 172.21.15.38:0/1294262236 >> 172.21.15.38:0/1294262236 conn(0x7f23240ff600 msgr2=0x7f2324101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 -- 172.21.15.38:0/1294262236 shutdown_connections 2024-09-21T06:11:37.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.341+0000 7f232a904640 1 -- 172.21.15.38:0/1294262236 wait complete. 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.342+0000 7f232a904640 1 Processor -- start 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.342+0000 7f232a904640 1 -- start start 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 0x7f232419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 0x7f232419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2324113c40 con 0x7f2324103bb0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2324113ac0 con 0x7f23241094f0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f232a904640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2324113dc0 con 0x7f2324109e40 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39166/0 (socket says 172.21.15.38:39166) 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 -- 172.21.15.38:0/701010591 learned_addr learned my addr 172.21.15.38:0/701010591 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f23237fe640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 0x7f232419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2328ea1640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 0x7f232419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 -- 172.21.15.38:0/701010591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 msgr2=0x7f232419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 0x7f232419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 -- 172.21.15.38:0/701010591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 msgr2=0x7f232419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 0x7f232419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.343+0000 7f2323fff640 1 -- 172.21.15.38:0/701010591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23241a0540 con 0x7f2324103bb0 2024-09-21T06:11:37.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f2323fff640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2314005ab0 tx=0x7f23140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231403f030 con 0x7f2324103bb0 2024-09-21T06:11:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2314003cd0 con 0x7f2324103bb0 2024-09-21T06:11:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23241a07d0 con 0x7f2324103bb0 2024-09-21T06:11:37.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314035070 con 0x7f2324103bb0 2024-09-21T06:11:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.344+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23241a6f90 con 0x7f2324103bb0 2024-09-21T06:11:37.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.345+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2324103fc0 con 0x7f2324103bb0 2024-09-21T06:11:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.347+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f2314042030 con 0x7f2324103bb0 2024-09-21T06:11:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.348+0000 7f23217fa640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 0x7f230c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.348+0000 7f23237fe640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 0x7f230c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.348+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2314106190 con 0x7f2324103bb0 2024-09-21T06:11:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.348+0000 7f23237fe640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 0x7f230c0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324108e40 tx=0x7f2318005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:37.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.351+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23140d2960 con 0x7f2324103bb0 2024-09-21T06:11:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:37 smithi174 ceph-mon[34815]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:37 smithi044 ceph-mon[34369]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:37.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.540+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f232419b700 con 0x7f2324103bb0 2024-09-21T06:11:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.545+0000 7f23217fa640 1 -- 172.21.15.38:0/701010591 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v35)=0 v35) ==== 120+0+0 (secure 0 0 0) 0x7f23140d78a0 con 0x7f2324103bb0 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 msgr2=0x7f230c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 0x7f230c0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324108e40 tx=0x7f2318005f90 comp rx=0 tx=0).stop 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 msgr2=0x7f232419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2314005ab0 tx=0x7f23140042f0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 shutdown_connections 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f230c0b6550 0x7f230c0b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2324109e40 0x7f232419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23241094f0 0x7f232419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 --2- 172.21.15.38:0/701010591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2324103bb0 0x7f232419a5d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 >> 172.21.15.38:0/701010591 conn(0x7f23240ff600 msgr2=0x7f2324101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.547+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 shutdown_connections 2024-09-21T06:11:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:37.548+0000 7f232a904640 1 -- 172.21.15.38:0/701010591 wait complete. 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/1290080981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c84102a60 msgr2=0x7f9c84102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/1290080981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c84102a60 0x7f9c84102e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009900 tx=0x7f9c8002a410 comp rx=0 tx=0).stop 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/1290080981 shutdown_connections 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/1290080981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84108cf0 0x7f9c8410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/1290080981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c841083a0 0x7f9c841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/1290080981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c84102a60 0x7f9c84102e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/1290080981 >> 172.21.15.38:0/1290080981 conn(0x7f9c84079730 msgr2=0x7f9c84079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/1290080981 shutdown_connections 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.806+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/1290080981 wait complete. 2024-09-21T06:11:38.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 Processor -- start 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 -- start start 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84102a60 0x7f9c84199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 0x7f9c8419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841129b0 con 0x7f9c841083a0 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84112830 con 0x7f9c84108cf0 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c8c5bb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84112b30 con 0x7f9c84102a60 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.807+0000 7f9c89b56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39162/0 (socket says 172.21.15.38:39162) 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 -- 172.21.15.38:0/4283222711 learned_addr learned my addr 172.21.15.38:0/4283222711 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c8a357640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84102a60 0x7f9c84199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c8ab58640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 0x7f9c8419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 -- 172.21.15.38:0/4283222711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84102a60 msgr2=0x7f9c84199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84102a60 0x7f9c84199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 -- 172.21.15.38:0/4283222711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 msgr2=0x7f9c8419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 0x7f9c8419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 -- 172.21.15.38:0/4283222711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8419f270 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c8ab58640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 0x7f9c8419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c89b56640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400e9c0 tx=0x7f9c7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400cd80 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f9c740054d0 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8419f560 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74010430 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.808+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841a5cc0 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.810+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c84102e70 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.812+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f9c740046c0 con 0x7f9c841083a0 2024-09-21T06:11:38.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.813+0000 7f9c7b7fe640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 0x7f9c700b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.813+0000 7f9c8a357640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 0x7f9c700b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.813+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9c740e5dd0 con 0x7f9c841083a0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.814+0000 7f9c8a357640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 0x7f9c700b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c80004770 tx=0x7f9c80005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.816+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c74056710 con 0x7f9c841083a0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:34.835+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 7 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9c74005680 con 0x7f9c841083a0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.012+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f9c8419a430 con 0x7f9c841083a0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.018+0000 7f9c7b7fe640 1 -- 172.21.15.38:0/4283222711 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7f9c8419a430 con 0x7f9c841083a0 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 msgr2=0x7f9c700b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 0x7f9c700b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c80004770 tx=0x7f9c80005a40 comp rx=0 tx=0).stop 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 msgr2=0x7f9c841998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400e9c0 tx=0x7f9c7400ee80 comp rx=0 tx=0).stop 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 shutdown_connections 2024-09-21T06:11:38.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9c700b6550 0x7f9c700b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c84108cf0 0x7f9c8419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9c841083a0 0x7f9c841998a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 --2- 172.21.15.38:0/4283222711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c84102a60 0x7f9c84199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 >> 172.21.15.38:0/4283222711 conn(0x7f9c84079730 msgr2=0x7f9c841013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 shutdown_connections 2024-09-21T06:11:38.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:35.021+0000 7f9c8c5bb640 1 -- 172.21.15.38:0/4283222711 wait complete. 2024-09-21T06:11:38.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:38 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/701010591' entity='client.admin' 2024-09-21T06:11:38.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:38 smithi038 ceph-mon[31215]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:38.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:38 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/701010591' entity='client.admin' 2024-09-21T06:11:38.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:38 smithi174 ceph-mon[34815]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:38 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/701010591' entity='client.admin' 2024-09-21T06:11:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:38 smithi044 ceph-mon[34369]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 -- 172.21.15.38:0/1713227721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2204102a60 msgr2=0x7f2204102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 --2- 172.21.15.38:0/1713227721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2204102a60 0x7f2204102e70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009900 tx=0x7f21f402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 -- 172.21.15.38:0/1713227721 shutdown_connections 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 --2- 172.21.15.38:0/1713227721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204108cf0 0x7f220410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 --2- 172.21.15.38:0/1713227721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22041083a0 0x7f22041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 --2- 172.21.15.38:0/1713227721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2204102a60 0x7f2204102e70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 -- 172.21.15.38:0/1713227721 >> 172.21.15.38:0/1713227721 conn(0x7f2204079760 msgr2=0x7f2204079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 -- 172.21.15.38:0/1713227721 shutdown_connections 2024-09-21T06:11:40.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 -- 172.21.15.38:0/1713227721 wait complete. 2024-09-21T06:11:40.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.010+0000 7f22092b0640 1 Processor -- start 2024-09-21T06:11:40.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 -- start start 2024-09-21T06:11:40.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204102a60 0x7f220419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2204108cf0 0x7f22041a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2204113bf0 con 0x7f22041083a0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2204113a70 con 0x7f2204102a60 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22092b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2204113d70 con 0x7f2204108cf0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22027fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22027fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41830/0 (socket says 172.21.15.38:41830) 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22027fc640 1 -- 172.21.15.38:0/1306651143 learned_addr learned my addr 172.21.15.38:0/1306651143 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f2202ffd640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204102a60 0x7f220419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.011+0000 7f22037fe640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2204108cf0 0x7f22041a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 -- 172.21.15.38:0/1306651143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2204108cf0 msgr2=0x7f22041a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2204108cf0 0x7f22041a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 -- 172.21.15.38:0/1306651143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204102a60 msgr2=0x7f220419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204102a60 0x7f220419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 -- 172.21.15.38:0/1306651143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22041a2630 con 0x7f22041083a0 2024-09-21T06:11:40.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22027fc640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c8c0 tx=0x7f21f800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007bb0 con 0x7f22041083a0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22041a2920 con 0x7f22041083a0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f21f8007d50 con 0x7f22041083a0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80188c0 con 0x7f22041083a0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.012+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041a9140 con 0x7f22041083a0 2024-09-21T06:11:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.013+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2204103ce0 con 0x7f22041083a0 2024-09-21T06:11:40.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.016+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f21f800fb60 con 0x7f22041083a0 2024-09-21T06:11:40.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.017+0000 7f21ebfff640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 0x7f21ec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:40.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.017+0000 7f2202ffd640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 0x7f21ec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:40.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.017+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f21f80e5a30 con 0x7f22041083a0 2024-09-21T06:11:40.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.018+0000 7f2202ffd640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 0x7f21ec0b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009230 tx=0x7f21f40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.020+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21f8014030 con 0x7f22041083a0 2024-09-21T06:11:40.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.214+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f220419d8b0 con 0x7f22041083a0 2024-09-21T06:11:40.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.220+0000 7f21ebfff640 1 -- 172.21.15.38:0/1306651143 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v36)=0 v36) ==== 121+0+0 (secure 0 0 0) 0x7f21f80adf50 con 0x7f22041083a0 2024-09-21T06:11:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 msgr2=0x7f21ec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 0x7f21ec0b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009230 tx=0x7f21f40058d0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 msgr2=0x7f220419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c8c0 tx=0x7f21f800cd80 comp rx=0 tx=0).stop 2024-09-21T06:11:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 shutdown_connections 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f21ec0b6500 0x7f21ec0b8a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2204108cf0 0x7f22041a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f22041083a0 0x7f220419cd20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 --2- 172.21.15.38:0/1306651143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2204102a60 0x7f220419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.222+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 >> 172.21.15.38:0/1306651143 conn(0x7f2204079760 msgr2=0x7f22041061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.223+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 shutdown_connections 2024-09-21T06:11:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.223+0000 7f22092b0640 1 -- 172.21.15.38:0/1306651143 wait complete. 2024-09-21T06:11:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 -- 172.21.15.38:0/1237616377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb8105310 msgr2=0x7fdfb810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 --2- 172.21.15.38:0/1237616377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb8105310 0x7fdfb810d860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009900 tx=0x7fdfa802a410 comp rx=0 tx=0).stop 2024-09-21T06:11:41.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 -- 172.21.15.38:0/1237616377 shutdown_connections 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 --2- 172.21.15.38:0/1237616377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb810de20 0x7fdfb8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 --2- 172.21.15.38:0/1237616377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb8105310 0x7fdfb810d860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 --2- 172.21.15.38:0/1237616377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb81049c0 0x7fdfb8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 -- 172.21.15.38:0/1237616377 >> 172.21.15.38:0/1237616377 conn(0x7fdfb8079710 msgr2=0x7fdfb8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 -- 172.21.15.38:0/1237616377 shutdown_connections 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.659+0000 7fdfc076a640 1 -- 172.21.15.38:0/1237616377 wait complete. 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 Processor -- start 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 -- start start 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb8105310 0x7fdfb819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb810de20 0x7fdfb819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8113ba0 con 0x7fdfb81049c0 2024-09-21T06:11:41.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8113a20 con 0x7fdfb810de20 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfc076a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8113d20 con 0x7fdfb8105310 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfbe506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfbe506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41858/0 (socket says 172.21.15.38:41858) 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfbe506640 1 -- 172.21.15.38:0/3051525012 learned_addr learned my addr 172.21.15.38:0/3051525012 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.660+0000 7fdfbed07640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb810de20 0x7fdfb819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbdd05640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb8105310 0x7fdfb819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 -- 172.21.15.38:0/3051525012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb8105310 msgr2=0x7fdfb819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb8105310 0x7fdfb819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 -- 172.21.15.38:0/3051525012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb810de20 msgr2=0x7fdfb819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb810de20 0x7fdfb819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 -- 172.21.15.38:0/3051525012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81a04c0 con 0x7fdfb81049c0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfbe506640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e9f0 tx=0x7fdfb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400cd80 con 0x7fdfb81049c0 2024-09-21T06:11:41.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdfb4010900 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81a07b0 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4018920 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.661+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a6f10 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.662+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb806c280 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.664+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fdfb4010ab0 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.665+0000 7fdfaf7fe640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 0x7fdfa40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.665+0000 7fdfbdd05640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 0x7fdfa40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.665+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdfb40e5f50 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.665+0000 7fdfbdd05640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 0x7fdfa40b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009230 tx=0x7fdfa8032b90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.668+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfb40ae3e0 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.858+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fdfb8104dd0 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.864+0000 7fdfaf7fe640 1 -- 172.21.15.38:0/3051525012 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v37)=0 v37) ==== 119+0+0 (secure 0 0 0) 0x7fdfb40b27c0 con 0x7fdfb81049c0 2024-09-21T06:11:41.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 msgr2=0x7fdfa40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 0x7fdfa40b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009230 tx=0x7fdfa8032b90 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 msgr2=0x7fdfb819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e9f0 tx=0x7fdfb400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 shutdown_connections 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdfa40b6550 0x7fdfa40b8a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfb810de20 0x7fdfb819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfb8105310 0x7fdfb819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 --2- 172.21.15.38:0/3051525012 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfb81049c0 0x7fdfb819a550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.866+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 >> 172.21.15.38:0/3051525012 conn(0x7fdfb8079710 msgr2=0x7fdfb81078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.867+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 shutdown_connections 2024-09-21T06:11:41.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:40.867+0000 7fdfc076a640 1 -- 172.21.15.38:0/3051525012 wait complete. 2024-09-21T06:11:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:41 smithi038 ceph-mon[31215]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1306651143' entity='client.admin' 2024-09-21T06:11:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3051525012' entity='client.admin' 2024-09-21T06:11:41.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:41 smithi174 ceph-mon[34815]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:41.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:41 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1306651143' entity='client.admin' 2024-09-21T06:11:41.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:41 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3051525012' entity='client.admin' 2024-09-21T06:11:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:41 smithi044 ceph-mon[34369]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:41 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1306651143' entity='client.admin' 2024-09-21T06:11:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:41 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3051525012' entity='client.admin' 2024-09-21T06:11:43.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:43 smithi038 ceph-mon[31215]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:43 smithi174 ceph-mon[34815]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:43 smithi044 ceph-mon[34369]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:44.143 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.143 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.144 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.304 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.305 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.305 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.531 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.531 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.531 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.532 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd022e7d2-77df-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi038') 2024-09-21T06:11:44.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:11:45.281 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:45.403 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:45 smithi038 ceph-mon[31215]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:45 smithi174 ceph-mon[34815]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:45 smithi044 ceph-mon[34369]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.740+0000 7f6f090e7640 1 -- 172.21.15.38:0/636859921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 msgr2=0x7f6f04102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.740+0000 7f6f090e7640 1 --2- 172.21.15.38:0/636859921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f04102a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009900 tx=0x7f6ef402a480 comp rx=0 tx=0).stop 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 -- 172.21.15.38:0/636859921 shutdown_connections 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 --2- 172.21.15.38:0/636859921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 0x7f6f04112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 --2- 172.21.15.38:0/636859921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 0x7f6f0410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 --2- 172.21.15.38:0/636859921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f04102a60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 -- 172.21.15.38:0/636859921 >> 172.21.15.38:0/636859921 conn(0x7f6f04079740 msgr2=0x7f6f04079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 -- 172.21.15.38:0/636859921 shutdown_connections 2024-09-21T06:11:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 -- 172.21.15.38:0/636859921 wait complete. 2024-09-21T06:11:45.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.741+0000 7f6f090e7640 1 Processor -- start 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 -- start start 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 0x7f6f0419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 0x7f6f041a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04115de0 con 0x7f6f04102650 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04115c60 con 0x7f6f04102fa0 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f090e7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04115f60 con 0x7f6f04110200 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f02d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f02d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41868/0 (socket says 172.21.15.38:41868) 2024-09-21T06:11:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f02d9d640 1 -- 172.21.15.38:0/2195333452 learned_addr learned my addr 172.21.15.38:0/2195333452 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f0359e640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 0x7f6f041a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f0259c640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 0x7f6f0419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f02d9d640 1 -- 172.21.15.38:0/2195333452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 msgr2=0x7f6f041a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.742+0000 7f6f02d9d640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 0x7f6f041a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f02d9d640 1 -- 172.21.15.38:0/2195333452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 msgr2=0x7f6f0419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f02d9d640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 0x7f6f0419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f02d9d640 1 -- 172.21.15.38:0/2195333452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f041a2680 con 0x7f6f04102650 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f02d9d640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40314b0 tx=0x7f6ef4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef403f070 con 0x7f6f04102650 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f041a2910 con 0x7f6f04102650 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ef4031bf0 con 0x7f6f04102650 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4035030 con 0x7f6f04102650 2024-09-21T06:11:45.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.743+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f041a90d0 con 0x7f6f04102650 2024-09-21T06:11:45.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.744+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0406c1e0 con 0x7f6f04102650 2024-09-21T06:11:45.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.746+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f6ef4042070 con 0x7f6f04102650 2024-09-21T06:11:45.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.746+0000 7f6eebfff640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 0x7f6eec0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:45.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.746+0000 7f6f0259c640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 0x7f6eec0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:45.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.747+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6ef4105b30 con 0x7f6f04102650 2024-09-21T06:11:45.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.747+0000 7f6f0259c640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 0x7f6eec0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f04103fa0 tx=0x7f6ef800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:45.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.751+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ef40d23a0 con 0x7f6f04102650 2024-09-21T06:11:45.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.938+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6f0419d840 con 0x7f6f04102650 2024-09-21T06:11:45.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.938+0000 7f6eebfff640 1 -- 172.21.15.38:0/2195333452 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22533 (secure 0 0 0) 0x7f6f0419d840 con 0x7f6f04102650 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global dev auth_debug true 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global basic log_to_file true 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global basic log_to_journald false 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global basic log_to_stderr false 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:11:45.941 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global dev ms_die_on_bug true 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global dev ms_die_on_old_message true 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global dev ms_die_on_skipped_message false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:11:45.942 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced debug_mon 20/20 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced debug_ms 1/1 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:11:45.943 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced debug_client 20/20 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:11:45.944 INFO:teuthology.orchestra.run.smithi038.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev bdev_debug_aio true 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced bdev_enable_discard true 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced debug_bluefs 1/20 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced debug_bluestore 1/20 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced debug_ms 1/1 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced debug_osd 20/20 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:11:45.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_op_order true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:11:45.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced debug_mds 20/20 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced debug_ms 2/2 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds dev mds_debug_frag true 2024-09-21T06:11:45.947 INFO:teuthology.orchestra.run.smithi038.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds dev mds_verify_scatter true 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced client_dirsize_rbytes false * 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced client_mount_timeout 600 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced debug_client 20/20 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced debug_ms 1/1 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:11:45.948 INFO:teuthology.orchestra.run.smithi038.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 msgr2=0x7f6eec0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 0x7f6eec0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6f04103fa0 tx=0x7f6ef800b390 comp rx=0 tx=0).stop 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 msgr2=0x7f6f0419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40314b0 tx=0x7f6ef4003c10 comp rx=0 tx=0).stop 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 shutdown_connections 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6eec0b64d0 0x7f6eec0b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f04110200 0x7f6f041a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f04102fa0 0x7f6f0419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 --2- 172.21.15.38:0/2195333452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f04102650 0x7f6f0419c710 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 >> 172.21.15.38:0/2195333452 conn(0x7f6f04079740 msgr2=0x7f6f04111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 shutdown_connections 2024-09-21T06:11:45.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:45.941+0000 7f6f090e7640 1 -- 172.21.15.38:0/2195333452 wait complete. 2024-09-21T06:11:46.534 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:11:46.534 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:11:46.534 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:11:46.551 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:11:46.551 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-21 06:10:25.404720583 +0000 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-21 06:05:16.871451100 +0000 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-21 06:05:16.871451100 +0000 2024-09-21T06:11:46.608 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-21 06:05:16.871451100 +0000 2024-09-21T06:11:46.609 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:11:46.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2195333452' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2195333452' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:11:46.670 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: Reconfiguring daemon mon.b on smithi044 2024-09-21T06:11:46.671 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2195333452' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:11:46.674 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-21T06:11:46.674 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-21T06:11:46.674 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000296878 s, 1.7 MB/s 2024-09-21T06:11:46.675 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:11:46.732 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-21 06:10:25.431720086 +0000 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-21 06:05:17.195445124 +0000 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-21 06:05:17.195445124 +0000 2024-09-21T06:11:46.788 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-21 06:05:17.195445124 +0000 2024-09-21T06:11:46.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:11:46.853 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-21T06:11:46.853 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-21T06:11:46.853 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000285134 s, 1.8 MB/s 2024-09-21T06:11:46.854 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:11:46.911 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-21 06:10:25.458719588 +0000 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-21 06:05:17.542438724 +0000 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-21 06:05:17.542438724 +0000 2024-09-21T06:11:46.967 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-21 06:05:17.542438724 +0000 2024-09-21T06:11:46.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:11:47.031 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-21T06:11:47.031 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-21T06:11:47.031 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000415279 s, 1.2 MB/s 2024-09-21T06:11:47.032 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:11:47.089 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-21 06:10:25.494718925 +0000 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-21 06:05:17.875432582 +0000 2024-09-21T06:11:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-21 06:05:17.875432582 +0000 2024-09-21T06:11:47.146 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-21 06:05:17.875432582 +0000 2024-09-21T06:11:47.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:11:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-21T06:11:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-21T06:11:47.209 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000342085 s, 1.5 MB/s 2024-09-21T06:11:47.210 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:11:47.267 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-21T06:11:47.267 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:11:47.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:11:47.287 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-21T06:11:47.345 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:11:47.345 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:47.345 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T06:11:47.345 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:47.345 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:47.346 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 06:11:20.341155227 +0000 2024-09-21T06:11:47.346 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 06:05:31.660974706 +0000 2024-09-21T06:11:47.346 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 06:05:31.660974706 +0000 2024-09-21T06:11:47.346 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 06:05:31.660974706 +0000 2024-09-21T06:11:47.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:11:47.415 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T06:11:47.416 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T06:11:47.416 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000281703 s, 1.8 MB/s 2024-09-21T06:11:47.417 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:11:47.476 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:47.532 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 06:11:20.341155227 +0000 2024-09-21T06:11:47.533 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 06:05:32.023969505 +0000 2024-09-21T06:11:47.533 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 06:05:32.023969505 +0000 2024-09-21T06:11:47.533 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 06:05:32.023969505 +0000 2024-09-21T06:11:47.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:11:47.595 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:47.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:47.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:47.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:47.598 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T06:11:47.598 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T06:11:47.598 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000362426 s, 1.4 MB/s 2024-09-21T06:11:47.600 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:47.657 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-21T06:11:47.713 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 06:11:20.341155227 +0000 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 06:05:32.365964605 +0000 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 06:05:32.365964605 +0000 2024-09-21T06:11:47.714 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 06:05:32.365964605 +0000 2024-09-21T06:11:47.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:11:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:47.778 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T06:11:47.778 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T06:11:47.778 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000223505 s, 2.3 MB/s 2024-09-21T06:11:47.779 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:11:47.837 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:47.892 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-21 06:11:20.342155213 +0000 2024-09-21T06:11:47.893 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-21 06:05:32.701959791 +0000 2024-09-21T06:11:47.893 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-21 06:05:32.701959791 +0000 2024-09-21T06:11:47.893 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-21 06:05:32.701959791 +0000 2024-09-21T06:11:47.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:11:47.957 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-21T06:11:47.957 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-21T06:11:47.957 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000215728 s, 2.4 MB/s 2024-09-21T06:11:47.958 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:11:48.014 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T06:11:48.014 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:11:48.030 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:11:48.030 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 06:11:17.900178893 +0000 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 06:05:24.160883452 +0000 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 06:05:24.160883452 +0000 2024-09-21T06:11:48.087 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 06:05:24.160883452 +0000 2024-09-21T06:11:48.087 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:11:48.152 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T06:11:48.153 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T06:11:48.153 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000251599 s, 2.0 MB/s 2024-09-21T06:11:48.154 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:11:48.210 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-09-21T06:11:48.265 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 06:11:17.901178881 +0000 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 06:05:24.489879297 +0000 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 06:05:24.489879297 +0000 2024-09-21T06:11:48.266 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 06:05:24.489879297 +0000 2024-09-21T06:11:48.267 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:11:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T06:11:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T06:11:48.329 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000209821 s, 2.4 MB/s 2024-09-21T06:11:48.330 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:11:48.387 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 06:11:17.901178881 +0000 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 06:05:24.811875229 +0000 2024-09-21T06:11:48.443 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 06:05:24.811875229 +0000 2024-09-21T06:11:48.444 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 06:05:24.811875229 +0000 2024-09-21T06:11:48.444 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:11:48.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:11:48.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: Reconfiguring daemon mon.c on smithi174 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:48.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.506 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T06:11:48.507 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T06:11:48.507 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000193939 s, 2.6 MB/s 2024-09-21T06:11:48.508 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:11:48.565 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-09-21T06:11:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:11:48.619 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 06:11:17.901178881 +0000 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 06:05:25.140871073 +0000 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 06:05:25.140871073 +0000 2024-09-21T06:11:48.620 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 06:05:25.140871073 +0000 2024-09-21T06:11:48.620 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:11:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:11:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: Reconfiguring daemon mon.c on smithi174 2024-09-21T06:11:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:48.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:48.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:48.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T06:11:48.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T06:11:48.684 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000226173 s, 2.3 MB/s 2024-09-21T06:11:48.685 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:11:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:11:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: Reconfiguring daemon mon.c on smithi174 2024-09-21T06:11:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:11:48.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:48.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:11:48.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:11:48.742 INFO:tasks.cephadm:Deploying osd.0 on smithi038 with /dev/vg_nvme/lv_4... 2024-09-21T06:11:48.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:11:49.006 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:49.386 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:49 smithi038 ceph-mon[31215]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:49.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:49 smithi174 ceph-mon[34815]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:49 smithi044 ceph-mon[34369]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:11:51.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi038:vg_nvme/lv_4 2024-09-21T06:11:51.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:51 smithi038 ceph-mon[31215]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:51.546 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:11:51.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:51 smithi174 ceph-mon[34815]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:51.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:51 smithi044 ceph-mon[34369]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 -- 172.21.15.38:0/2426241506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca01094a0 msgr2=0x7f1ca01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 --2- 172.21.15.38:0/2426241506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca01094a0 0x7f1ca01098b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009900 tx=0x7f1c9402a410 comp rx=0 tx=0).stop 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 -- 172.21.15.38:0/2426241506 shutdown_connections 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 --2- 172.21.15.38:0/2426241506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca0109df0 0x7f1ca0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 --2- 172.21.15.38:0/2426241506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca01094a0 0x7f1ca01098b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 --2- 172.21.15.38:0/2426241506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0103b60 0x7f1ca0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 -- 172.21.15.38:0/2426241506 >> 172.21.15.38:0/2426241506 conn(0x7f1ca007b850 msgr2=0x7f1ca007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 -- 172.21.15.38:0/2426241506 shutdown_connections 2024-09-21T06:11:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 -- 172.21.15.38:0/2426241506 wait complete. 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.037+0000 7f1ca6030640 1 Processor -- start 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 -- start start 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 0x7f1ca019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0109df0 0x7f1ca019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0113bd0 con 0x7f1ca0103b60 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0113a50 con 0x7f1ca0109df0 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1ca6030640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca0113d50 con 0x7f1ca01094a0 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43488/0 (socket says 172.21.15.38:43488) 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 -- 172.21.15.38:0/1282641901 learned_addr learned my addr 172.21.15.38:0/1282641901 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9ffff640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0109df0 0x7f1ca019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9effd640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 0x7f1ca019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 -- 172.21.15.38:0/1282641901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 msgr2=0x7f1ca019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 0x7f1ca019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 -- 172.21.15.38:0/1282641901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0109df0 msgr2=0x7f1ca019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.038+0000 7f1c9f7fe640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0109df0 0x7f1ca019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9f7fe640 1 -- 172.21.15.38:0/1282641901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca01a0510 con 0x7f1ca0103b60 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9effd640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 0x7f1ca019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9f7fe640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000e9f0 tx=0x7f1c9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000cd80 con 0x7f1ca0103b60 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1c90010900 con 0x7f1ca0103b60 2024-09-21T06:11:52.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca01a0800 con 0x7f1ca0103b60 2024-09-21T06:11:52.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90018920 con 0x7f1ca0103b60 2024-09-21T06:11:52.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.039+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01a6f60 con 0x7f1ca0103b60 2024-09-21T06:11:52.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.040+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca0103f70 con 0x7f1ca0103b60 2024-09-21T06:11:52.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.042+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f1c90010ab0 con 0x7f1ca0103b60 2024-09-21T06:11:52.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.042+0000 7f1c9cff9640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 0x7f1c880b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:11:52.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.042+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1c900e5f50 con 0x7f1ca0103b60 2024-09-21T06:11:52.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.042+0000 7f1c9effd640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 0x7f1c880b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:11:52.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.043+0000 7f1c9effd640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 0x7f1c880b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009230 tx=0x7f1c94009650 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:11:52.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.045+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c900ae3e0 con 0x7f1ca0103b60 2024-09-21T06:11:52.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:11:52.245+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1ca0063800 con 0x7f1c880b6550 2024-09-21T06:11:52.625 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:11:52.625 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:11:52.625 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:52.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:11:52.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:11:52.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:52.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:11:52.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:11:52.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:11:53.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:53 smithi174 ceph-mon[34815]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:53 smithi174 ceph-mon[34815]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:53.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:53 smithi044 ceph-mon[34369]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:53 smithi044 ceph-mon[34369]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:53.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:53 smithi038 ceph-mon[31215]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:53.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:53 smithi038 ceph-mon[31215]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3802237430' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"}]': finished 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:11:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3743271945' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3802237430' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"}]': finished 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:11:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3743271945' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:11:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3802237430' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"} : dispatch 2024-09-21T06:11:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b14f970-8964-441c-94f3-4ab77aa6be8d"}]': finished 2024-09-21T06:11:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:11:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:11:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3743271945' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:11:56.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:56 smithi038 ceph-mon[31215]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:57.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:56 smithi174 ceph-mon[34815]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:57.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:56 smithi044 ceph-mon[34369]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:58.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:11:58 smithi038 ceph-mon[31215]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:59.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:11:58 smithi174 ceph-mon[34815]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:11:59.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:11:58 smithi044 ceph-mon[34369]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:00.814 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:00 smithi038 ceph-mon[31215]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:01.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:00 smithi174 ceph-mon[34815]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:00 smithi044 ceph-mon[34369]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:02.970 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:02 smithi038 ceph-mon[31215]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:03.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:02 smithi174 ceph-mon[34815]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:03.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:02 smithi044 ceph-mon[34369]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:03.962 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:03 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:12:03.962 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:03 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:03.962 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:03 smithi038 ceph-mon[31215]: Deploying daemon osd.0 on smithi038 2024-09-21T06:12:04.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:03 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:12:04.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:03 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:04.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:03 smithi174 ceph-mon[34815]: Deploying daemon osd.0 on smithi038 2024-09-21T06:12:04.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:03 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:12:04.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:03 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:04.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:03 smithi044 ceph-mon[34369]: Deploying daemon osd.0 on smithi038 2024-09-21T06:12:04.923 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:04 smithi038 ceph-mon[31215]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:05.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:04 smithi174 ceph-mon[34815]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:04 smithi044 ceph-mon[34369]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:06.914 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:06 smithi038 ceph-mon[31215]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:07.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:06 smithi174 ceph-mon[34815]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:07.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:06 smithi044 ceph-mon[34369]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:08.930 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:08 smithi038 ceph-mon[31215]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:08 smithi174 ceph-mon[34815]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:08 smithi044 ceph-mon[34369]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:10.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:10 smithi038 ceph-mon[31215]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:10.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:11.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:10 smithi174 ceph-mon[34815]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:10 smithi044 ceph-mon[34369]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:13.375 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:13.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:13.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:13.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:13.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.978+0000 7f1c9cff9640 1 -- 172.21.15.38:0/1282641901 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1ca0063800 con 0x7f1c880b6550 2024-09-21T06:12:13.980 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 0 on host 'smithi038' 2024-09-21T06:12:13.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 msgr2=0x7f1c880b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 0x7f1c880b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009230 tx=0x7f1c94009650 comp rx=0 tx=0).stop 2024-09-21T06:12:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 msgr2=0x7f1ca019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000e9f0 tx=0x7f1c9000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 shutdown_connections 2024-09-21T06:12:13.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1c880b6550 0x7f1c880b8a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0109df0 0x7f1ca019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ca01094a0 0x7f1ca019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 --2- 172.21.15.38:0/1282641901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ca0103b60 0x7f1ca019a5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.980+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 >> 172.21.15.38:0/1282641901 conn(0x7f1ca007b850 msgr2=0x7f1ca01054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.981+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 shutdown_connections 2024-09-21T06:12:13.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:12:13.981+0000 7f1ca6030640 1 -- 172.21.15.38:0/1282641901 wait complete. 2024-09-21T06:12:14.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:14.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:14.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:14.568 DEBUG:teuthology.orchestra.run.smithi038:osd.0> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:12:14.570 INFO:tasks.cephadm:Deploying osd.1 on smithi044 with /dev/vg_nvme/lv_4... 2024-09-21T06:12:14.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:12:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:12:15.258 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:15 smithi044 ceph-mon[34369]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:15.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:15 smithi174 ceph-mon[34815]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:15.453 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:15 smithi038 ceph-mon[31215]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:15.716 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:12:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:12:15.451+0000 7ff8a666a640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:12:16.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:16 smithi174 ceph-mon[34815]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:12:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:16 smithi044 ceph-mon[34369]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:12:16.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:16 smithi038 ceph-mon[31215]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:12:17.202 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:17 smithi044 ceph-mon[34369]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:17.202 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:17 smithi044 ceph-mon[34369]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:12:17.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:17 smithi044 ceph-mon[34369]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:12:17.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:17 smithi044 ceph-mon[34369]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:12:17.203 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:17.205 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:12:17.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-09-21T06:12:17.234 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:17 smithi038 ceph-mon[31215]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:17.234 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:17 smithi038 ceph-mon[31215]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:12:17.234 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:17 smithi038 ceph-mon[31215]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:12:17.234 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:17 smithi038 ceph-mon[31215]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:12:17.234 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:17.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:17 smithi174 ceph-mon[34815]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:17 smithi174 ceph-mon[34815]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:12:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:17 smithi174 ceph-mon[34815]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:12:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:17 smithi174 ceph-mon[34815]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:12:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:17.479 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 -- 172.21.15.44:0/301179777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c103b60 msgr2=0x7f824c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 --2- 172.21.15.44:0/301179777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c103b60 0x7f824c103f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f823c009ca0 tx=0x7f823c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 -- 172.21.15.44:0/301179777 shutdown_connections 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 --2- 172.21.15.44:0/301179777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c109df0 0x7f824c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 --2- 172.21.15.44:0/301179777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 --2- 172.21.15.44:0/301179777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c103b60 0x7f824c103f70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 -- 172.21.15.44:0/301179777 >> 172.21.15.44:0/301179777 conn(0x7f824c07b850 msgr2=0x7f824c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 -- 172.21.15.44:0/301179777 shutdown_connections 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.948+0000 7f8250a87640 1 -- 172.21.15.44:0/301179777 wait complete. 2024-09-21T06:12:17.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.949+0000 7f8250a87640 1 Processor -- start 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.949+0000 7f8250a87640 1 -- start start 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c103b60 0x7f824c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f824c113bf0 con 0x7f824c1094a0 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f824c113a70 con 0x7f824c109df0 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f824c113d70 con 0x7f824c103b60 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52908/0 (socket says 172.21.15.44:52908) 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 -- 172.21.15.44:0/1895498000 learned_addr learned my addr 172.21.15.44:0/1895498000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8249d9b640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824a59c640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c103b60 0x7f824c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:17.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 -- 172.21.15.44:0/1895498000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c103b60 msgr2=0x7f824c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c103b60 0x7f824c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 -- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 msgr2=0x7f824c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 -- 172.21.15.44:0/1895498000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c1a04f0 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8249d9b640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f824ad9d640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f824400d750 tx=0x7f824400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244017070 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c1a07e0 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82440054f0 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.950+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244004cd0 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.951+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c1a6f40 con 0x7f824c109df0 2024-09-21T06:12:17.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.951+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824c103f70 con 0x7f824c109df0 2024-09-21T06:12:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.954+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f8244009bd0 con 0x7f824c109df0 2024-09-21T06:12:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.954+0000 7f82437fe640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 0x7f82380b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.954+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f82440e5680 con 0x7f824c109df0 2024-09-21T06:12:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.954+0000 7f824a59c640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 0x7f82380b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:17.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.955+0000 7f824a59c640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 0x7f82380b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f823c005e30 tx=0x7f823c009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:17.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:17.957+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82440b1da0 con 0x7f824c109df0 2024-09-21T06:12:18.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:18.157+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f824c063800 con 0x7f82380b64d0 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi038 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi038 to 17092M 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:18.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:18.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:18 smithi174 ceph-mon[34815]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi038 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:18.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi038 to 17092M 2024-09-21T06:12:18.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:18.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:18.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:18 smithi044 ceph-mon[34369]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' 2024-09-21T06:12:18.486 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:12:18.100+0000 7ff8a2e01640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:12:18.487 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:12:18.112+0000 7ff89a3e2640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi038 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:18.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi038 to 17092M 2024-09-21T06:12:18.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:18.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:18.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:18.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:18 smithi038 ceph-mon[31215]: from='osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999]' entity='osd.0' 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] boot 2024-09-21T06:12:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:12:19.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] boot 2024-09-21T06:12:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:12:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: osd.0 [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] boot 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:12:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/703973126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"}]': finished 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/2285074741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/703973126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"}]': finished 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:12:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:21.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/2285074741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: pgmap v31: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/703973126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"} : dispatch 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3c3919-c745-4fab-9d95-d9a0671f12e5"}]': finished 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/2285074741' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:23 smithi044 ceph-mon[34369]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:23 smithi038 ceph-mon[31215]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:23.520 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:23 smithi174 ceph-mon[34815]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:25.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:25 smithi044 ceph-mon[34369]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:25 smithi038 ceph-mon[31215]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:25 smithi174 ceph-mon[34815]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:27.350 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:27 smithi044 ceph-mon[34369]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:27 smithi038 ceph-mon[31215]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:27 smithi174 ceph-mon[34815]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:29.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:29 smithi044 ceph-mon[34369]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:29.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:12:29.438 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:29 smithi038 ceph-mon[31215]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:12:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:29 smithi174 ceph-mon[34815]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:12:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:30.273 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:30 smithi044 ceph-mon[34369]: Deploying daemon osd.1 on smithi044 2024-09-21T06:12:30.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:30 smithi038 ceph-mon[31215]: Deploying daemon osd.1 on smithi044 2024-09-21T06:12:30.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:30 smithi174 ceph-mon[34815]: Deploying daemon osd.1 on smithi044 2024-09-21T06:12:31.447 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:31 smithi044 ceph-mon[34369]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:31 smithi038 ceph-mon[31215]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:31.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:31 smithi174 ceph-mon[34815]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:33 smithi174 ceph-mon[34815]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:33 smithi038 ceph-mon[31215]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:33 smithi044 ceph-mon[34369]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:35.310 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:35 smithi044 ceph-mon[34369]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:35 smithi038 ceph-mon[31215]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:35.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:35 smithi174 ceph-mon[34815]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:36.209 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:36.209 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:36.209 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:36.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:36.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:36.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:36.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:36.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:36.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:37.267 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:37 smithi044 ceph-mon[34369]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:37 smithi038 ceph-mon[31215]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:37 smithi174 ceph-mon[34815]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:39.312 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:39.313 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.313 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.313 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:39.313 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:39.313 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:39.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:39.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:39.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.970+0000 7f82437fe640 1 -- 172.21.15.44:0/1895498000 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f824c063800 con 0x7f82380b64d0 2024-09-21T06:12:39.972 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 1 on host 'smithi044' 2024-09-21T06:12:39.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.972+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 msgr2=0x7f82380b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.972+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 0x7f82380b89e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f823c005e30 tx=0x7f823c009360 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.972+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 msgr2=0x7f824c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.972+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f824400d750 tx=0x7f824400dc10 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 shutdown_connections 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82380b64d0 0x7f82380b89e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f824c109df0 0x7f824c19fdc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f824c1094a0 0x7f824c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 --2- 172.21.15.44:0/1895498000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824c103b60 0x7f824c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 >> 172.21.15.44:0/1895498000 conn(0x7f824c07b850 msgr2=0x7f824c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 shutdown_connections 2024-09-21T06:12:39.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:12:39.973+0000 7f8250a87640 1 -- 172.21.15.44:0/1895498000 wait complete. 2024-09-21T06:12:40.277 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:40.277 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.277 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:40.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:12:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:40.568 DEBUG:teuthology.orchestra.run.smithi044:osd.1> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:12:40.570 INFO:tasks.cephadm:Deploying osd.2 on smithi174 with /dev/vg_nvme/lv_4... 2024-09-21T06:12:40.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:12:40.822 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:12:41.303 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:41 smithi174 ceph-mon[34815]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:41.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:41 smithi044 ceph-mon[34369]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:41 smithi038 ceph-mon[31215]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:41.655 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:12:41 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:12:41.341+0000 7fdbcde67640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:12:42.186 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:42 smithi174 ceph-mon[34815]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:42.186 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:42 smithi174 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:42.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:42 smithi044 ceph-mon[34369]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:42.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:42 smithi044 ceph-mon[34369]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:42.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:42 smithi038 ceph-mon[31215]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:42.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:42 smithi038 ceph-mon[31215]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:12:43.207 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:12:43.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-09-21T06:12:43.244 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:43.245 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:12:43.245 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.245 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:12:43.245 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:43.245 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:43 smithi174 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.325 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:43.325 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:12:43.325 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.325 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:12:43.325 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:43.326 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-mon[34369]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.326 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:12:43.070+0000 7fdbc9de9640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:12:43.326 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:12:43 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:12:43.076+0000 7fdbc5be7640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:12:43.483 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:12:43.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:43.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:12:43.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: from='osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:12:43.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:43.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:43 smithi038 ceph-mon[31215]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:12:43.923 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 -- 172.21.15.174:0/1822133124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c109e10 msgr2=0x7f3b6c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/1822133124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c109e10 0x7f3b6c110640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009ca0 tx=0x7f3b6402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 -- 172.21.15.174:0/1822133124 shutdown_connections 2024-09-21T06:12:43.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/1822133124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c109e10 0x7f3b6c110640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/1822133124 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/1822133124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c103b80 0x7f3b6c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 -- 172.21.15.174:0/1822133124 >> 172.21.15.174:0/1822133124 conn(0x7f3b6c0ff5b0 msgr2=0x7f3b6c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 -- 172.21.15.174:0/1822133124 shutdown_connections 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.918+0000 7f3b70b3a640 1 -- 172.21.15.174:0/1822133124 wait complete. 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 Processor -- start 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 -- start start 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c109e10 0x7f3b6c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c113c70 con 0x7f3b6c109e10 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c113af0 con 0x7f3b6c1094c0 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b70b3a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c113df0 con 0x7f3b6c103b80 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:58604/0 (socket says 172.21.15.174:58604) 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 -- 172.21.15.174:0/3192571843 learned_addr learned my addr 172.21.15.174:0/3192571843 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6ad9d640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c109e10 0x7f3b6c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b63fff640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 -- 172.21.15.174:0/3192571843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 msgr2=0x7f3b6c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 -- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c109e10 msgr2=0x7f3b6c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c109e10 0x7f3b6c19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b6a59c640 1 -- 172.21.15.174:0/3192571843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c1a0440 con 0x7f3b6c103b80 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.919+0000 7f3b63fff640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b6a59c640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b4a0 tx=0x7f3b5c00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:43.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c014070 con 0x7f3b6c103b80 2024-09-21T06:12:43.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c1a0730 con 0x7f3b6c103b80 2024-09-21T06:12:43.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b5c010ae0 con 0x7f3b6c103b80 2024-09-21T06:12:43.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c017ce0 con 0x7f3b6c103b80 2024-09-21T06:12:43.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.920+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a6f50 con 0x7f3b6c103b80 2024-09-21T06:12:43.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.921+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6c104e00 con 0x7f3b6c103b80 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.923+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f3b5c017070 con 0x7f3b6c103b80 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.924+0000 7f3b637fe640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 0x7f3b580b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.924+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f3b5c0e51c0 con 0x7f3b6c103b80 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.924+0000 7f3b63fff640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 0x7f3b580b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.925+0000 7f3b63fff640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 0x7f3b580b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c102e00 tx=0x7f3b54005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:12:43.949 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:43.928+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b5c0ad2e0 con 0x7f3b6c103b80 2024-09-21T06:12:44.129 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:12:44.127+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3b6c063800 con 0x7f3b580b6500 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi044 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-21T06:12:44.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:44.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:44.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi044 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:44.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-21T06:12:44.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:44.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:44.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi044 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:12:44.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] boot 2024-09-21T06:12:45.346 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:12:45.347 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.347 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:45.347 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:45.347 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:45.347 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] boot 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:45.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:45.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:12:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: osd.1 [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] boot 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:12:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:46 smithi044 ceph-mon[34369]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:12:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/836298794' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:46 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:46 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"}]': finished 2024-09-21T06:12:46.684 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:46 smithi174 ceph-mon[34815]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:12:46.684 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/836298794' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.684 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:46 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.684 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:46 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"}]': finished 2024-09-21T06:12:46.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:46 smithi038 ceph-mon[31215]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:12:46.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/836298794' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:46 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"} : dispatch 2024-09-21T06:12:46.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:46 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6daee57-622c-4b39-95f3-2e013ae4c531"}]': finished 2024-09-21T06:12:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:47 smithi038 ceph-mon[31215]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:47 smithi038 ceph-mon[31215]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:12:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:47 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:12:47.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:47 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/4144898904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:47.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:47 smithi174 ceph-mon[34815]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:47.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:47 smithi174 ceph-mon[34815]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:12:47.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:47 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:12:47.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/4144898904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:47 smithi044 ceph-mon[34369]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:47 smithi044 ceph-mon[34369]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:12:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:47 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:12:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:47 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/4144898904' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:12:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:48 smithi038 ceph-mon[31215]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:48.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:48 smithi174 ceph-mon[34815]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:48.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:48 smithi044 ceph-mon[34369]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:50.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:50 smithi044 ceph-mon[34369]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:50.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:50 smithi038 ceph-mon[31215]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:51.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:50 smithi174 ceph-mon[34815]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:52.913 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:52 smithi174 ceph-mon[34815]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:52.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:52 smithi038 ceph-mon[31215]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:53.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:52 smithi044 ceph-mon[34369]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:54.858 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:54 smithi174 ceph-mon[34815]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:54.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:54 smithi044 ceph-mon[34369]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:54.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:54 smithi038 ceph-mon[31215]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:12:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:55 smithi174 ceph-mon[34815]: Deploying daemon osd.2 on smithi174 2024-09-21T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:55.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:55 smithi044 ceph-mon[34369]: Deploying daemon osd.2 on smithi174 2024-09-21T06:12:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:12:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:12:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:55 smithi038 ceph-mon[31215]: Deploying daemon osd.2 on smithi174 2024-09-21T06:12:56.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:56 smithi174 ceph-mon[34815]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:56.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:56 smithi038 ceph-mon[31215]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:57.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:56 smithi044 ceph-mon[34369]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:58.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:12:58 smithi038 ceph-mon[31215]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:59.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:12:58 smithi174 ceph-mon[34815]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:12:59.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:12:58 smithi044 ceph-mon[34369]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:00.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:00 smithi038 ceph-mon[31215]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:01.002 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:00 smithi174 ceph-mon[34815]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:00 smithi044 ceph-mon[34369]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:01.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:01.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:01.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:01.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:01.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:01.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:02.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:02.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:02.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:03 smithi038 ceph-mon[31215]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:03.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:03 smithi174 ceph-mon[34815]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:03 smithi044 ceph-mon[34369]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:05.138 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:05.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:05.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:05.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:05.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.482+0000 7f3b637fe640 1 -- 172.21.15.174:0/3192571843 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3b6c063800 con 0x7f3b580b6500 2024-09-21T06:13:05.485 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 2 on host 'smithi174' 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 msgr2=0x7f3b580b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 0x7f3b580b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c102e00 tx=0x7f3b54005d90 comp rx=0 tx=0).stop 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 msgr2=0x7f3b6c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b4a0 tx=0x7f3b5c00b960 comp rx=0 tx=0).stop 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 shutdown_connections 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3b580b6500 0x7f3b580b8a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:05.487 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b6c109e10 0x7f3b6c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:05.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b6c1094c0 0x7f3b6c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:05.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 --2- 172.21.15.174:0/3192571843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b6c103b80 0x7f3b6c19a590 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:05.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 >> 172.21.15.174:0/3192571843 conn(0x7f3b6c0ff5b0 msgr2=0x7f3b6c108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:05.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 shutdown_connections 2024-09-21T06:13:05.488 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:13:05.485+0000 7f3b70b3a640 1 -- 172.21.15.174:0/3192571843 wait complete. 2024-09-21T06:13:06.075 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:05 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:06.075 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:05 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.075 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:05 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.102 DEBUG:teuthology.orchestra.run.smithi174:osd.2> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:13:06.144 INFO:tasks.cephadm:Deploying osd.3 on smithi038 with /dev/vg_nvme/lv_3... 2024-09-21T06:13:06.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:13:06.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:05 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:06.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:05 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:05 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.173 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:05 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:06.173 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:05 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.173 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:05 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:07.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:06 smithi174 ceph-mon[34815]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:07.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:06 smithi044 ceph-mon[34369]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:07.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:06 smithi038 ceph-mon[31215]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:07.543 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:13:07.293+0000 7fb221215640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:13:08.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:07 smithi174 ceph-mon[34815]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:07 smithi174 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:07 smithi044 ceph-mon[34369]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:07 smithi044 ceph-mon[34369]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.186 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:07 smithi038 ceph-mon[31215]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.186 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:07 smithi038 ceph-mon[31215]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:13:08.948 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:13:08.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi038:vg_nvme/lv_3 2024-09-21T06:13:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:13:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:13:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:08 smithi174 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:08 smithi044 ceph-mon[34369]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:13:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: from='osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:13:09.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:09.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:08 smithi038 ceph-mon[31215]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:13:09.279 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:13:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1880339690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 msgr2=0x7f7a84110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1880339690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a84110310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009ca0 tx=0x7f7a7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1880339690 shutdown_connections 2024-09-21T06:13:09.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1880339690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a84110310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1880339690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1880339690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 0x7f7a84104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1880339690 >> 172.21.15.38:0/1880339690 conn(0x7f7a84079710 msgr2=0x7f7a84079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1880339690 shutdown_connections 2024-09-21T06:13:09.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.725+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1880339690 wait complete. 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.726+0000 7f7a8c3fc640 1 Processor -- start 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.726+0000 7f7a8c3fc640 1 -- start start 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.726+0000 7f7a8c3fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 0x7f7a8419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.726+0000 7f7a8c3fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8c3fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:09.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8c3fc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84113be0 con 0x7f7a8410de20 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8c3fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84113a60 con 0x7f7a841049c0 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8c3fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84113d60 con 0x7f7a84105310 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8a999640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8a999640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52456/0 (socket says 172.21.15.38:52456) 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47974/0 (socket says 172.21.15.38:47974) 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8a198640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 0x7f7a8419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8a999640 1 -- 172.21.15.38:0/1642668149 learned_addr learned my addr 172.21.15.38:0/1642668149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 -- 172.21.15.38:0/1642668149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 msgr2=0x7f7a8419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 0x7f7a8419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 -- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 msgr2=0x7f7a8419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:09.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 -- 172.21.15.38:0/1642668149 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a841a03a0 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a8a999640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a89997640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406b8f0 tx=0x7f7a7400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.727+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400ccc0 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.728+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a841a0690 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.728+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a74009e40 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.728+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74004a00 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.728+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a841a0b80 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.729+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8406c280 con 0x7f7a84105310 2024-09-21T06:13:09.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.731+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f7a74004ba0 con 0x7f7a84105310 2024-09-21T06:13:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.731+0000 7f7a7b7fe640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 0x7f7a700b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.732+0000 7f7a8a198640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 0x7f7a700b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:09.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.732+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f7a740e5cc0 con 0x7f7a84105310 2024-09-21T06:13:09.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.732+0000 7f7a8a198640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 0x7f7a700b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000abe0 tx=0x7f7a8000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:09.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.736+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a841a0b80 con 0x7f7a84105310 2024-09-21T06:13:09.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:09.934+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7a84107fc0 con 0x7f7a700b6500 2024-09-21T06:13:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi174 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:09.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:09 smithi038 ceph-mon[31215]: from='osd.2 ' entity='osd.2' 2024-09-21T06:13:10.145 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:13:09.735+0000 7fb21d197640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:13:10.145 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:13:09.924+0000 7fb214f8d640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:13:10.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:13:10.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi174 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:09 smithi174 ceph-mon[34815]: from='osd.2 ' entity='osd.2' 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi174 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:10.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:09 smithi044 ceph-mon[34369]: from='osd.2 ' entity='osd.2' 2024-09-21T06:13:10.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:13:10.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:10.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:11.980 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:11.980 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:11 smithi038 ceph-mon[31215]: osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] boot 2024-09-21T06:13:11.980 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:11 smithi038 ceph-mon[31215]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:13:11.980 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:12.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:12.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:11 smithi174 ceph-mon[34815]: osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] boot 2024-09-21T06:13:12.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:11 smithi174 ceph-mon[34815]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:13:12.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:12.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:12.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:11 smithi044 ceph-mon[34369]: osd.2 [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] boot 2024-09-21T06:13:12.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:11 smithi044 ceph-mon[34369]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:13:12.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"} : dispatch 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"}]': finished 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:13.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"} : dispatch 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"}]': finished 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:13.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:13.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:13:13.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:13:13.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:13.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"} : dispatch 2024-09-21T06:13:13.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:13.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/49030362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ac42b28-351a-4ee8-aad9-baa87d419cea"}]': finished 2024-09-21T06:13:13.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:13:13.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:13.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:13:14.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3218881949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:14.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:14.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 ceph-mon[34815]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:13:14.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3218881949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 ceph-mon[34369]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:13:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:14.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3218881949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:14.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:13:14.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 ceph-mon[31215]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:13:14.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42924]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42927]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.950 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42918]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:14.950 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42918]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42918]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42921]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42921]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.951 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42921]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52649]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:14.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52649]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52649]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52652]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:14.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52652]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52652]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52643]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52643]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52643]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52646]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:14.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52646]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:14.988 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:14.988 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:13:14 smithi038 sudo[52646]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.042 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43806]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:15.042 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43806]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:15.042 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:15.042 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43806]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.042 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43809]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:15.043 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43809]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:15.043 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:15.043 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43809]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43812]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43815]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43815]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:14 smithi174 sudo[43815]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.043 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:15 smithi174 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:14 smithi044 sudo[42927]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:15 smithi044 ceph-mon[34369]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:13:15.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:15 smithi038 ceph-mon[31215]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:13:16.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:16.061+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f7a740a9720 con 0x7f7a84105310 2024-09-21T06:13:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:16 smithi174 ceph-mon[34815]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:13:16.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:16 smithi044 ceph-mon[34369]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:13:16.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:16.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:16 smithi038 ceph-mon[31215]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:13:16.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:17 smithi174 ceph-mon[34815]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:17 smithi174 ceph-mon[34815]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:13:17.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:17 smithi044 ceph-mon[34369]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:17.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:17 smithi044 ceph-mon[34369]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:13:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:17 smithi038 ceph-mon[31215]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:17 smithi038 ceph-mon[31215]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:13:19.331 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:19 smithi038 ceph-mon[31215]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:19.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:19 smithi174 ceph-mon[34815]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:19 smithi044 ceph-mon[34369]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:21.150 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:21 smithi038 ceph-mon[31215]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:21 smithi174 ceph-mon[34815]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:21 smithi044 ceph-mon[34369]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:22.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:13:22.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:22.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:22 smithi038 ceph-mon[31215]: Deploying daemon osd.3 on smithi038 2024-09-21T06:13:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:13:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:22 smithi174 ceph-mon[34815]: Deploying daemon osd.3 on smithi038 2024-09-21T06:13:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:13:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:22 smithi044 ceph-mon[34369]: Deploying daemon osd.3 on smithi038 2024-09-21T06:13:23.106 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:23 smithi038 ceph-mon[31215]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:23.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:23 smithi174 ceph-mon[34815]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:23.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:23 smithi044 ceph-mon[34369]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:25.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:25 smithi174 ceph-mon[34815]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:25.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:25 smithi044 ceph-mon[34369]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:25.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:25 smithi038 ceph-mon[31215]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:27 smithi174 ceph-mon[34815]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:27.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:27 smithi044 ceph-mon[34369]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:27 smithi038 ceph-mon[31215]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:28.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:28.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:28.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:28.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:29.428 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:29 smithi038 ceph-mon[31215]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:29 smithi174 ceph-mon[34815]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:29.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:29 smithi044 ceph-mon[34369]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:30.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.895+0000 7f7a7b7fe640 1 -- 172.21.15.38:0/1642668149 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a84107fc0 con 0x7f7a700b6500 2024-09-21T06:13:30.897 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 3 on host 'smithi038' 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 msgr2=0x7f7a700b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 0x7f7a700b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000abe0 tx=0x7f7a8000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 msgr2=0x7f7a8419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7a8406b8f0 tx=0x7f7a7400ed90 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 shutdown_connections 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7a700b6500 0x7f7a700b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a8410de20 0x7f7a8419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a84105310 0x7f7a8419aa90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 --2- 172.21.15.38:0/1642668149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a841049c0 0x7f7a8419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:30.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 >> 172.21.15.38:0/1642668149 conn(0x7f7a84079710 msgr2=0x7f7a841078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 shutdown_connections 2024-09-21T06:13:30.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:13:30.897+0000 7f7a8c3fc640 1 -- 172.21.15.38:0/1642668149 wait complete. 2024-09-21T06:13:31.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:31.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:31.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:31.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:31.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:31.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:31.206 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.489 DEBUG:teuthology.orchestra.run.smithi038:osd.3> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T06:13:31.492 INFO:tasks.cephadm:Deploying osd.4 on smithi044 with /dev/vg_nvme/lv_3... 2024-09-21T06:13:31.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:13:31.752 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:13:31.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:31.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:31.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:32.117 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:32.117 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:32.117 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:32.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:32.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:32.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:33.108 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:32 smithi038 ceph-mon[31215]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:33.133 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:32 smithi044 ceph-mon[34369]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:32 smithi174 ceph-mon[34815]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:33.487 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:13:33 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:13:33.332+0000 7ff8f9556640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:13:34.151 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:33 smithi038 ceph-mon[31215]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.151 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:33 smithi038 ceph-mon[31215]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:33 smithi044 ceph-mon[34369]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:33 smithi044 ceph-mon[34369]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.164 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:13:34.191 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-09-21T06:13:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:33 smithi174 ceph-mon[34815]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:33 smithi174 ceph-mon[34815]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:13:34.442 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 -- 172.21.15.44:0/65957613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 msgr2=0x7f3278110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 --2- 172.21.15.44:0/65957613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f3278110630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3268009ca0 tx=0x7f326802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 -- 172.21.15.44:0/65957613 shutdown_connections 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 --2- 172.21.15.44:0/65957613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f3278110630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 --2- 172.21.15.44:0/65957613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32781094b0 0x7f32781098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 --2- 172.21.15.44:0/65957613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3278103bc0 0x7f3278103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 -- 172.21.15.44:0/65957613 >> 172.21.15.44:0/65957613 conn(0x7f327807b910 msgr2=0x7f327807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 -- 172.21.15.44:0/65957613 shutdown_connections 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.932+0000 7f327d693640 1 -- 172.21.15.44:0/65957613 wait complete. 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 Processor -- start 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 -- start start 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278103bc0 0x7f327819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 0x7f327819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3278113c00 con 0x7f3278103bc0 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3278113a80 con 0x7f3278109e00 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f327d693640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3278113d80 con 0x7f32781094b0 2024-09-21T06:13:34.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f32777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f32777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36032/0 (socket says 172.21.15.44:36032) 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f32777fe640 1 -- 172.21.15.44:0/4055412015 learned_addr learned my addr 172.21.15.44:0/4055412015 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.933+0000 7f3276ffd640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278103bc0 0x7f327819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 -- 172.21.15.44:0/4055412015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 msgr2=0x7f327819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32767fc640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 0x7f327819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 0x7f327819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 -- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278103bc0 msgr2=0x7f327819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278103bc0 0x7f327819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 -- 172.21.15.44:0/4055412015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32781a04c0 con 0x7f3278109e00 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32767fc640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 0x7f327819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f32777fe640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3268005e30 tx=0x7f3268003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268031650 con 0x7f3278109e00 2024-09-21T06:13:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f32680317f0 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32781a0750 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326802fac0 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.934+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32781a6f10 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.935+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3278103fd0 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.936+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f326802fc60 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.937+0000 7f326ffff640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 0x7f32640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.937+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3604+0+0 (secure 0 0 0) 0x7f3268107560 con 0x7f3278109e00 2024-09-21T06:13:34.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.937+0000 7f3276ffd640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 0x7f32640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:13:34.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.938+0000 7f3276ffd640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 0x7f32640b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3270009bd0 tx=0x7f3270005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:13:34.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:34.941+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32680cf050 con 0x7f3278109e00 2024-09-21T06:13:35.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:35.139+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3278063800 con 0x7f32640b6560 2024-09-21T06:13:35.141 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi038 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi038 to 8546M 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.142 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:35.143 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:35.143 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi038 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi038 to 8546M 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:35.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi038 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:13:35.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi038 to 8546M 2024-09-21T06:13:35.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:35.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:35.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:35.986 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:13:35.720+0000 7ff8f54d8640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:13:35.986 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:13:35.765+0000 7ff8ed2ce640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:35.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:35 smithi038 ceph-mon[31215]: from='osd.3 ' entity='osd.3' 2024-09-21T06:13:36.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:13:36.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:13:36.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:36.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:36.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:36.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:36.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:36.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:36.156 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:35 smithi044 ceph-mon[34369]: from='osd.3 ' entity='osd.3' 2024-09-21T06:13:36.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:35 smithi174 ceph-mon[34815]: from='osd.3 ' entity='osd.3' 2024-09-21T06:13:37.108 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:13:37.108 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] boot 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.109 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:36 smithi044 ceph-mon[34369]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:13:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:13:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:13:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:37.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] boot 2024-09-21T06:13:37.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:13:37.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:36 smithi038 ceph-mon[31215]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:13:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: osd.3 [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] boot 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:13:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:36 smithi174 ceph-mon[34815]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:13:38.095 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:37 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/55271704' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.095 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:37 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.095 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:37 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"}]': finished 2024-09-21T06:13:38.095 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:37 smithi044 ceph-mon[34369]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:13:38.095 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:37 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:13:38.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:37 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/55271704' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:37 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:37 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"}]': finished 2024-09-21T06:13:38.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:37 smithi038 ceph-mon[31215]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:13:38.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:37 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:13:38.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:37 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/55271704' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:37 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"} : dispatch 2024-09-21T06:13:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:37 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b694d72-2d22-4f2e-939e-1e8a56796bf5"}]': finished 2024-09-21T06:13:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:37 smithi174 ceph-mon[34815]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:13:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:37 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:13:39.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:38 smithi038 ceph-mon[31215]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:39.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:38 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/4259143511' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:38 smithi174 ceph-mon[34815]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:38 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/4259143511' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:39.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:38 smithi044 ceph-mon[34369]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:38 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/4259143511' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:13:41.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:40 smithi038 ceph-mon[31215]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:40 smithi174 ceph-mon[34815]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:41.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:40 smithi044 ceph-mon[34369]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:43.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:42 smithi038 ceph-mon[31215]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:13:43.304 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:42 smithi044 ceph-mon[34369]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:13:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:42 smithi174 ceph-mon[34815]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:13:44.985 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:44 smithi044 ceph-mon[34369]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:13:45.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:44 smithi038 ceph-mon[31215]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:13:45.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:44 smithi174 ceph-mon[34815]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:13:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:46 smithi038 ceph-mon[31215]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:13:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:13:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:46 smithi038 ceph-mon[31215]: Deploying daemon osd.4 on smithi044 2024-09-21T06:13:47.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:46 smithi174 ceph-mon[34815]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:13:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:13:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:46 smithi174 ceph-mon[34815]: Deploying daemon osd.4 on smithi044 2024-09-21T06:13:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:46 smithi044 ceph-mon[34369]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:13:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:13:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:46 smithi044 ceph-mon[34369]: Deploying daemon osd.4 on smithi044 2024-09-21T06:13:49.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:48 smithi038 ceph-mon[31215]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:13:49.237 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:48 smithi044 ceph-mon[34369]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:13:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:48 smithi174 ceph-mon[34815]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T06:13:51.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:50 smithi038 ceph-mon[31215]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:51.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:50 smithi174 ceph-mon[34815]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:50 smithi044 ceph-mon[34369]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:52 smithi038 ceph-mon[31215]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:53.260 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:52 smithi044 ceph-mon[34369]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:53.260 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:53.260 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:53.260 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:52 smithi174 ceph-mon[34815]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:13:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:55.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:54 smithi038 ceph-mon[31215]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:54 smithi174 ceph-mon[34815]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:55.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:54 smithi044 ceph-mon[34369]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:56.641 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.641 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.641 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:56.641 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:56.642 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.692 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 4 on host 'smithi044' 2024-09-21T06:13:56.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.689+0000 7f326ffff640 1 -- 172.21.15.44:0/4055412015 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3278063800 con 0x7f32640b6560 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 msgr2=0x7f32640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 0x7f32640b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3270009bd0 tx=0x7f3270005f90 comp rx=0 tx=0).stop 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 msgr2=0x7f327819fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3268005e30 tx=0x7f3268003d80 comp rx=0 tx=0).stop 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 shutdown_connections 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32640b6560 0x7f32640b8a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:56.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3278109e00 0x7f327819fd90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:56.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32781094b0 0x7f327819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:56.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 --2- 172.21.15.44:0/4055412015 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3278103bc0 0x7f327819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:13:56.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.691+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 >> 172.21.15.44:0/4055412015 conn(0x7f327807b910 msgr2=0x7f3278105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:13:56.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.692+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 shutdown_connections 2024-09-21T06:13:56.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:13:56.692+0000 7f327d693640 1 -- 172.21.15.44:0/4055412015 wait complete. 2024-09-21T06:13:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:56.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:13:56.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:13:56.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.335 DEBUG:teuthology.orchestra.run.smithi044:osd.4> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T06:13:57.338 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_3... 2024-09-21T06:13:57.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:13:57.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:57 smithi044 ceph-mon[34369]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:57.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:57.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.585 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.590 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:13:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:57 smithi174 ceph-mon[34815]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:57 smithi038 ceph-mon[31215]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:13:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:13:59.155 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:13:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:13:58.695+0000 7f733d7b9640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:13:59.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:59 smithi174 ceph-mon[34815]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:59.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:59 smithi174 ceph-mon[34815]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:13:59.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:13:59 smithi174 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:13:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:59 smithi044 ceph-mon[34369]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:59 smithi044 ceph-mon[34369]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:13:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:13:59 smithi044 ceph-mon[34369]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:13:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:59 smithi038 ceph-mon[31215]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:13:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:59 smithi038 ceph-mon[31215]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:13:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:13:59 smithi038 ceph-mon[31215]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:14:00.167 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:14:00.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-09-21T06:14:00.452 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:14:00.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:14:00.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:14:00.572 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.573 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.655 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:14:00.341+0000 7f733973b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:14:00.655 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:14:00.349+0000 7f7335539640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:14:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:14:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:14:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:14:00.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.738 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 -- 172.21.15.174:0/2628949966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 msgr2=0x7faa7c110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 --2- 172.21.15.174:0/2628949966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c110660 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faa74009cd0 tx=0x7faa7402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 -- 172.21.15.174:0/2628949966 shutdown_connections 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 --2- 172.21.15.174:0/2628949966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c110660 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 --2- 172.21.15.174:0/2628949966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c106280 0x7faa7c106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.942 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 --2- 172.21.15.174:0/2628949966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c102030 0x7faa7c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 -- 172.21.15.174:0/2628949966 >> 172.21.15.174:0/2628949966 conn(0x7faa7c077c60 msgr2=0x7faa7c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:00.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 -- 172.21.15.174:0/2628949966 shutdown_connections 2024-09-21T06:14:00.943 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.940+0000 7faa81d1c640 1 -- 172.21.15.174:0/2628949966 wait complete. 2024-09-21T06:14:00.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 Processor -- start 2024-09-21T06:14:00.944 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 -- start start 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 0x7faa7c102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 0x7faa7c103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c113c00 con 0x7faa7c106280 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c113a80 con 0x7faa7c102030 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa81d1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa7c113d80 con 0x7faa7c106bd0 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:44086/0 (socket says 172.21.15.174:44086) 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.941+0000 7faa7bfff640 1 -- 172.21.15.174:0/1680176403 learned_addr learned my addr 172.21.15.174:0/1680176403 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7b7fe640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 0x7faa7c102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa72ffd640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 0x7faa7c103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 -- 172.21.15.174:0/1680176403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 msgr2=0x7faa7c102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:00.945 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 0x7faa7c102fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 -- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 msgr2=0x7faa7c103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 0x7faa7c103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 -- 172.21.15.174:0/1680176403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c1a8830 con 0x7faa7c106bd0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7b7fe640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 0x7faa7c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa72ffd640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 0x7faa7c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa7bfff640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa74009df0 tx=0x7faa74003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74004240 con 0x7faa7c106bd0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7c1a8ac0 con 0x7faa7c106bd0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa740305a0 con 0x7faa7c106bd0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74045670 con 0x7faa7c106bd0 2024-09-21T06:14:00.946 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.942+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7c1a9000 con 0x7faa7c106bd0 2024-09-21T06:14:00.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.943+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7c102440 con 0x7faa7c106bd0 2024-09-21T06:14:00.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.945+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7faa74043020 con 0x7faa7c106bd0 2024-09-21T06:14:00.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.946+0000 7faa797fa640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 0x7faa680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:00.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.946+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7faa74106fc0 con 0x7faa7c106bd0 2024-09-21T06:14:00.947 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.946+0000 7faa7b7fe640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 0x7faa680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:00.948 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.946+0000 7faa7b7fe640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 0x7faa680b8a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:00.950 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:00.949+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa740ce990 con 0x7faa7c106bd0 2024-09-21T06:14:01.137 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:01.136+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faa7c107b20 con 0x7faa680b6560 2024-09-21T06:14:01.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:01.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi044 2024-09-21T06:14:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-21T06:14:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi044 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi044 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:02.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:14:02.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:14:02.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:02.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] boot 2024-09-21T06:14:02.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:14:02.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] boot 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:14:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:14:02.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:02.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: osd.4 [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] boot 2024-09-21T06:14:02.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:14:02.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:14:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:03 smithi174 ceph-mon[34815]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:03 smithi174 ceph-mon[34815]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:14:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:03 smithi044 ceph-mon[34369]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:03 smithi044 ceph-mon[34369]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:14:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:03 smithi038 ceph-mon[31215]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:14:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:03 smithi038 ceph-mon[31215]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/3489544937' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"}]': finished 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:04 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/4136203743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:04.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/3489544937' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"}]': finished 2024-09-21T06:14:04.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:14:04.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:04.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:04 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/4136203743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/3489544937' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"} : dispatch 2024-09-21T06:14:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2331d76-8457-48ed-98b7-21d8a7289ae5"}]': finished 2024-09-21T06:14:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:14:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:04.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:04 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/4136203743' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:05 smithi174 ceph-mon[34815]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:05.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:05 smithi044 ceph-mon[34369]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:05 smithi038 ceph-mon[31215]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:07 smithi174 ceph-mon[34815]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:07.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:07 smithi044 ceph-mon[34369]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:07 smithi038 ceph-mon[31215]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:09.505 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:09 smithi174 ceph-mon[34815]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:09.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:09 smithi044 ceph-mon[34369]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:09.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:09 smithi038 ceph-mon[31215]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:11 smithi044 ceph-mon[34369]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:11 smithi038 ceph-mon[31215]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:11.750 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:11 smithi174 ceph-mon[34815]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:12.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:14:12.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:14:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:14:12.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:13 smithi174 ceph-mon[34815]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:13 smithi174 ceph-mon[34815]: Deploying daemon osd.5 on smithi174 2024-09-21T06:14:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:13 smithi038 ceph-mon[31215]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:13 smithi038 ceph-mon[31215]: Deploying daemon osd.5 on smithi174 2024-09-21T06:14:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:13 smithi044 ceph-mon[34369]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:13 smithi044 ceph-mon[34369]: Deploying daemon osd.5 on smithi174 2024-09-21T06:14:15.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:15 smithi174 ceph-mon[34815]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:15.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:15 smithi038 ceph-mon[31215]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:15 smithi044 ceph-mon[34369]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:17.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:17 smithi174 ceph-mon[34815]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:17 smithi038 ceph-mon[31215]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:17.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:17 smithi044 ceph-mon[34369]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:18.692 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:18.692 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:18.692 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:18.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:18.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:18.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:19.713 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:19 smithi174 ceph-mon[34815]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:19.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:19 smithi038 ceph-mon[31215]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:19 smithi044 ceph-mon[34369]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:20.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:20 smithi174 ceph-mon[34815]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:20 smithi038 ceph-mon[31215]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:20.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:20 smithi044 ceph-mon[34369]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:21.896 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.894+0000 7faa797fa640 1 -- 172.21.15.174:0/1680176403 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa7c107b20 con 0x7faa680b6560 2024-09-21T06:14:21.896 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-09-21T06:14:21.898 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 msgr2=0x7faa680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 0x7faa680b8a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c005850 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 msgr2=0x7faa7c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa74009df0 tx=0x7faa74003ba0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 shutdown_connections 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa680b6560 0x7faa680b8a70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa7c106bd0 0x7faa7c103a50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa7c106280 0x7faa7c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 --2- 172.21.15.174:0/1680176403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7c102030 0x7faa7c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 >> 172.21.15.174:0/1680176403 conn(0x7faa7c077c60 msgr2=0x7faa7c107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 shutdown_connections 2024-09-21T06:14:21.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:14:21.896+0000 7faa81d1c640 1 -- 172.21.15.174:0/1680176403 wait complete. 2024-09-21T06:14:22.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:22.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:22.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:22.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:22.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:22.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:22.511 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T06:14:22.514 INFO:tasks.cephadm:Deploying osd.6 on smithi038 with /dev/vg_nvme/lv_2... 2024-09-21T06:14:22.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:14:22.783 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:23.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:22 smithi174 ceph-mon[34815]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:23.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:22 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:23.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:22 smithi044 ceph-mon[34369]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:23.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:23.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:23.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:22 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:23.218 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:22 smithi038 ceph-mon[31215]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:23.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:23.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:23.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:22 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:24.864 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:14:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:14:24.577+0000 7f773fa49640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:14:25.054 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:24 smithi038 ceph-mon[31215]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:25.054 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:24 smithi038 ceph-mon[31215]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.054 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:24 smithi038 ceph-mon[31215]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:24 smithi174 ceph-mon[34815]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:25.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:24 smithi174 ceph-mon[34815]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:24 smithi174 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:24 smithi044 ceph-mon[34369]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:24 smithi044 ceph-mon[34369]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:24 smithi044 ceph-mon[34369]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:14:25.526 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:14:25.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi038:vg_nvme/lv_2 2024-09-21T06:14:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:14:26.145 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:14:25.906+0000 7f773b9cb640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:14:26.145 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:14:25.917+0000 7f77377c9640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi174 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:26.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi174 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:26.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 -- 172.21.15.38:0/53713705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60103160 msgr2=0x7f3c60103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/53713705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60103160 0x7f3c60103570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009900 tx=0x7f3c4802a410 comp rx=0 tx=0).stop 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 -- 172.21.15.38:0/53713705 shutdown_connections 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/53713705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 0x7f3c6010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/53713705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60105170 0x7f3c60105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/53713705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60103160 0x7f3c60103570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 -- 172.21.15.38:0/53713705 >> 172.21.15.38:0/53713705 conn(0x7f3c60077c60 msgr2=0x7f3c600780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 -- 172.21.15.38:0/53713705 shutdown_connections 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.289+0000 7f3c64cbe640 1 -- 172.21.15.38:0/53713705 wait complete. 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.290+0000 7f3c64cbe640 1 Processor -- start 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.290+0000 7f3c64cbe640 1 -- start start 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60103160 0x7f3c601991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 0x7f3c60199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3c60112b00 con 0x7f3c60105170 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3c60112980 con 0x7f3c60105ac0 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c64cbe640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3c60112c80 con 0x7f3c60103160 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49208/0 (socket says 172.21.15.38:49208) 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 -- 172.21.15.38:0/3328481074 learned_addr learned my addr 172.21.15.38:0/3328481074 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5ed9d640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 0x7f3c60199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5e59c640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60103160 0x7f3c601991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 -- 172.21.15.38:0/3328481074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60103160 msgr2=0x7f3c601991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60103160 0x7f3c601991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 -- 172.21.15.38:0/3328481074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 msgr2=0x7f3c60199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 0x7f3c60199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:26.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 -- 172.21.15.38:0/3328481074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c601a8850 con 0x7f3c60105170 2024-09-21T06:14:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c5dd9b640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000e9c0 tx=0x7f3c5000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.291+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5000ccc0 con 0x7f3c60105170 2024-09-21T06:14:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.292+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c601a8b40 con 0x7f3c60105170 2024-09-21T06:14:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.292+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3c500054f0 con 0x7f3c60105170 2024-09-21T06:14:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.292+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50010430 con 0x7f3c60105170 2024-09-21T06:14:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.292+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c601a9080 con 0x7f3c60105170 2024-09-21T06:14:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.293+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c60103570 con 0x7f3c60105170 2024-09-21T06:14:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.294+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3c50005020 con 0x7f3c60105170 2024-09-21T06:14:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.295+0000 7f3c577fe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 0x7f3c4c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.295+0000 7f3c5e59c640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 0x7f3c4c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.295+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f3c500e6820 con 0x7f3c60105170 2024-09-21T06:14:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.296+0000 7f3c5e59c640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 0x7f3c4c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c60106350 tx=0x7f3c480058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:26.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.300+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c50005310 con 0x7f3c60105170 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi174 2024-09-21T06:14:26.343 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:26.344 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:26.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:26.501+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3c60063800 con 0x7f3c4c0b6560 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:27.204 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:27.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] boot 2024-09-21T06:14:27.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:14:27.205 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.327 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:27.327 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:14:27.327 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:14:27.327 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] boot 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:14:27.328 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: osd.5 [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] boot 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:14:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:14:28.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:27 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:14:28.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:27 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:14:28.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:27 smithi038 ceph-mon[31215]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:28.193 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:27 smithi038 ceph-mon[31215]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:14:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:27 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:14:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:27 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:14:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:27 smithi174 ceph-mon[34815]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:28.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:27 smithi174 ceph-mon[34815]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:14:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:27 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:14:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:27 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:14:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:27 smithi044 ceph-mon[34369]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:28.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:27 smithi044 ceph-mon[34369]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:14:29.226 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:28 smithi038 ceph-mon[31215]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:29.226 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:28 smithi038 ceph-mon[31215]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:14:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:28 smithi174 ceph-mon[34815]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:28 smithi174 ceph-mon[34815]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:14:29.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:28 smithi044 ceph-mon[34369]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:28 smithi044 ceph-mon[34369]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:14:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:30 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"} : dispatch 2024-09-21T06:14:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:30 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"}]': finished 2024-09-21T06:14:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:30 smithi174 ceph-mon[34815]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:14:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:30 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:30 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1125948426' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:30 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"} : dispatch 2024-09-21T06:14:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:30 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"}]': finished 2024-09-21T06:14:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:30 smithi044 ceph-mon[34369]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:14:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:30 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:30 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1125948426' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:30.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:30 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"} : dispatch 2024-09-21T06:14:30.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:30 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1123514259' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3"}]': finished 2024-09-21T06:14:30.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:30 smithi038 ceph-mon[31215]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:14:30.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:30 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:30.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:30 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1125948426' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:31.388 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:31 smithi038 ceph-mon[31215]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:31.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:31 smithi174 ceph-mon[34815]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:31.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:31 smithi044 ceph-mon[34369]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:33 smithi174 ceph-mon[34815]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T06:14:33.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:33 smithi044 ceph-mon[34369]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T06:14:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:33 smithi038 ceph-mon[31215]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T06:14:35.361 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:35 smithi038 ceph-mon[31215]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:14:35.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:35 smithi174 ceph-mon[34815]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:14:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:35 smithi044 ceph-mon[34369]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:14:37.348 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:37 smithi038 ceph-mon[31215]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:14:37.401 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:37 smithi044 ceph-mon[34369]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:14:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:37 smithi174 ceph-mon[34815]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:14:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:39 smithi038 ceph-mon[31215]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:14:39.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:14:39.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:39 smithi174 ceph-mon[34815]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:14:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:14:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:39 smithi044 ceph-mon[34369]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:14:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:14:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:40.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:40 smithi038 ceph-mon[31215]: Deploying daemon osd.6 on smithi038 2024-09-21T06:14:40.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:40 smithi174 ceph-mon[34815]: Deploying daemon osd.6 on smithi038 2024-09-21T06:14:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:40 smithi044 ceph-mon[34369]: Deploying daemon osd.6 on smithi038 2024-09-21T06:14:41.442 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:41 smithi038 ceph-mon[31215]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:14:41.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:41 smithi174 ceph-mon[34815]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:14:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:41 smithi044 ceph-mon[34369]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:14:43.418 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:43 smithi038 ceph-mon[31215]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:14:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:43 smithi174 ceph-mon[34815]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:14:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:43 smithi044 ceph-mon[34369]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:14:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:45 smithi038 ceph-mon[31215]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:45 smithi174 ceph-mon[34815]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:45 smithi044 ceph-mon[34369]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:47.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:47 smithi038 ceph-mon[31215]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:47.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.544+0000 7f3c577fe640 1 -- 172.21.15.38:0/3328481074 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c60063800 con 0x7f3c4c0b6560 2024-09-21T06:14:47.548 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 6 on host 'smithi038' 2024-09-21T06:14:47.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 msgr2=0x7f3c4c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:47.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 0x7f3c4c0b8a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c60106350 tx=0x7f3c480058d0 comp rx=0 tx=0).stop 2024-09-21T06:14:47.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 msgr2=0x7f3c601996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000e9c0 tx=0x7f3c5000ee80 comp rx=0 tx=0).stop 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 shutdown_connections 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c4c0b6560 0x7f3c4c0b8a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c60105ac0 0x7f3c60199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c60105170 0x7f3c601996e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 --2- 172.21.15.38:0/3328481074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c60103160 0x7f3c601991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 >> 172.21.15.38:0/3328481074 conn(0x7f3c60077c60 msgr2=0x7f3c60106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 shutdown_connections 2024-09-21T06:14:47.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:14:47.547+0000 7f3c64cbe640 1 -- 172.21.15.38:0/3328481074 wait complete. 2024-09-21T06:14:47.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:47 smithi174 ceph-mon[34815]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:47.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:47 smithi044 ceph-mon[34369]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:48.181 DEBUG:teuthology.orchestra.run.smithi038:osd.6> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T06:14:48.183 INFO:tasks.cephadm:Deploying osd.7 on smithi044 with /dev/vg_nvme/lv_2... 2024-09-21T06:14:48.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:14:48.446 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:14:48.828 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:48 smithi038 ceph-mon[31215]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:48.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.829 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:48 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:48 smithi044 ceph-mon[34369]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:48.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.834 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:48 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:48 smithi174 ceph-mon[34815]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:48 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:50.671 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:14:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:14:50.385+0000 7fd660f64640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:14:50.793 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:50 smithi044 ceph-mon[34369]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:50.793 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:50 smithi044 ceph-mon[34369]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:14:50.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:50 smithi038 ceph-mon[31215]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:50.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:50 smithi038 ceph-mon[31215]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:14:51.047 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:14:51.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-09-21T06:14:51.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:50 smithi174 ceph-mon[34815]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:51.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:50 smithi174 ceph-mon[34815]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:14:51.331 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi038 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.731 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi038 to 5697M 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:51.732 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:51 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/4269889793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf48105380 msgr2=0x7fcf4810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/4269889793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf48105380 0x7fcf4810d8d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009900 tx=0x7fcf3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/4269889793 shutdown_connections 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/4269889793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf4810de60 0x7fcf48110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/4269889793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf48105380 0x7fcf4810d8d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/4269889793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48104a30 0x7fcf48104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/4269889793 >> 172.21.15.44:0/4269889793 conn(0x7fcf480797b0 msgr2=0x7fcf48079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/4269889793 shutdown_connections 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.824+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/4269889793 wait complete. 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 Processor -- start 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 -- start start 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf48104a30 0x7fcf48102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48105380 0x7fcf48102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113bc0 con 0x7fcf48104a30 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113a40 con 0x7fcf4810de60 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4f6f8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48113d40 con 0x7fcf48105380 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4dc95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4dc95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49804/0 (socket says 172.21.15.44:49804) 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4dc95640 1 -- 172.21.15.44:0/1095716522 learned_addr learned my addr 172.21.15.44:0/1095716522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T06:14:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4d494640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf48104a30 0x7fcf48102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4cc93640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48105380 0x7fcf48102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4dc95640 1 -- 172.21.15.44:0/1095716522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48105380 msgr2=0x7fcf48102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.825+0000 7fcf4dc95640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48105380 0x7fcf48102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4dc95640 1 -- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf48104a30 msgr2=0x7fcf48102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4dc95640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf48104a30 0x7fcf48102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4dc95640 1 -- 172.21.15.44:0/1095716522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf481a8830 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4dc95640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800eb10 tx=0x7fcf3800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38004b20 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf481a8b20 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf38004cc0 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38010720 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.826+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a9010 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.827+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf48104e40 con 0x7fcf4810de60 2024-09-21T06:14:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.828+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcf380108c0 con 0x7fcf4810de60 2024-09-21T06:14:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.829+0000 7fcf467fc640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 0x7fcf300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:14:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.829+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7fcf380e6e60 con 0x7fcf4810de60 2024-09-21T06:14:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.829+0000 7fcf4d494640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 0x7fcf300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:14:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.830+0000 7fcf4d494640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 0x7fcf300b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf400058c0 tx=0x7fcf4000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:14:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:51.832+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf38056710 con 0x7fcf4810de60 2024-09-21T06:14:51.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi038 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi038 to 5697M 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:51.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:51.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:51.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:51.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:51.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:51 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:14:52.027+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcf481080a0 con 0x7fcf300b6560 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi038 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi038 to 5697M 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:14:52.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:51 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:14:52.986 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:14:52.523+0000 7fd65cee6640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:14:52.987 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:14:52.553+0000 7fd654cdc640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:52.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:52.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' 2024-09-21T06:14:52.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:52 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:53.046 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:53.047 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:53.047 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:53.047 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' 2024-09-21T06:14:53.047 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:52 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.078 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:53.078 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:14:53.078 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316]' entity='osd.6' 2024-09-21T06:14:53.079 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:52 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:53 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:14:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:53 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:14:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:53 smithi044 ceph-mon[34369]: osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] boot 2024-09-21T06:14:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:53 smithi044 ceph-mon[34369]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:14:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:53.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:53 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:14:53.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:53 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:14:53.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:53 smithi038 ceph-mon[31215]: osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] boot 2024-09-21T06:14:53.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:53 smithi038 ceph-mon[31215]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:14:53.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:54.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:53 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:14:54.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:53 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:14:54.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:53 smithi174 ceph-mon[34815]: osd.6 [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] boot 2024-09-21T06:14:54.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:53 smithi174 ceph-mon[34815]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:14:54.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/73269102' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"}]': finished 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:14:54.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:54 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:14:54.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:54.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/73269102' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:54.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:54.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"}]': finished 2024-09-21T06:14:54.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:14:54.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:54 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:14:55.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:14:55.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/73269102' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:55.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"} : dispatch 2024-09-21T06:14:55.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326d922e-492f-4a69-93b0-f2861433f48d"}]': finished 2024-09-21T06:14:55.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T06:14:55.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:54 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:14:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/4219536916' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:56.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/4219536916' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:56.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/4219536916' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:14:56.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:56 smithi038 ceph-mon[31215]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:14:57.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:56 smithi174 ceph-mon[34815]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:14:57.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:56 smithi044 ceph-mon[34369]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:14:59.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:14:58 smithi174 ceph-mon[34815]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:14:59.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:14:58 smithi044 ceph-mon[34369]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:14:59.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:14:58 smithi038 ceph-mon[31215]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:01.081 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:00 smithi044 ceph-mon[34369]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:01.138 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:00 smithi038 ceph-mon[31215]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:01.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:00 smithi174 ceph-mon[34815]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:03.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:02 smithi044 ceph-mon[34369]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:03.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:02 smithi174 ceph-mon[34815]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:03.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:02 smithi038 ceph-mon[31215]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:03.836 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:03 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:15:03.836 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:03 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:03.836 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:03 smithi044 ceph-mon[34369]: Deploying daemon osd.7 on smithi044 2024-09-21T06:15:04.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:03 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:15:04.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:03 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:04.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:03 smithi174 ceph-mon[34815]: Deploying daemon osd.7 on smithi044 2024-09-21T06:15:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:03 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:15:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:03 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:03 smithi038 ceph-mon[31215]: Deploying daemon osd.7 on smithi044 2024-09-21T06:15:05.009 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:04 smithi044 ceph-mon[34369]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:05.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:04 smithi174 ceph-mon[34815]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:04 smithi038 ceph-mon[31215]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:06.803 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:06 smithi044 ceph-mon[34369]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:07.146 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:06 smithi174 ceph-mon[34815]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:07.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:06 smithi038 ceph-mon[31215]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:08.873 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:08 smithi044 ceph-mon[34369]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:08 smithi174 ceph-mon[34815]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:08 smithi038 ceph-mon[31215]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:09.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:10.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:10.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:10.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:10.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:10.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:10.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:11.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:11 smithi174 ceph-mon[34815]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:11.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:11 smithi044 ceph-mon[34369]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:11.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:11 smithi038 ceph-mon[31215]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:12 smithi038 ceph-mon[31215]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:12.800 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.801 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:12 smithi044 ceph-mon[34369]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:12.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.843+0000 7fcf467fc640 1 -- 172.21.15.44:0/1095716522 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf481080a0 con 0x7fcf300b6560 2024-09-21T06:15:12.847 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 7 on host 'smithi044' 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 msgr2=0x7fcf300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 0x7fcf300b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf400058c0 tx=0x7fcf4000a250 comp rx=0 tx=0).stop 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 msgr2=0x7fcf481031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800eb10 tx=0x7fcf3800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 shutdown_connections 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcf300b6560 0x7fcf300b8a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf4810de60 0x7fcf481031f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf48105380 0x7fcf48102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:12.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 --2- 172.21.15.44:0/1095716522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcf48104a30 0x7fcf48102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:12.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 >> 172.21.15.44:0/1095716522 conn(0x7fcf480797b0 msgr2=0x7fcf48107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:12.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 shutdown_connections 2024-09-21T06:15:12.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:15:12.846+0000 7fcf4f6f8640 1 -- 172.21.15.44:0/1095716522 wait complete. 2024-09-21T06:15:12.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:12.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:12 smithi174 ceph-mon[34815]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:13.497 DEBUG:teuthology.orchestra.run.smithi044:osd.7> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T06:15:13.500 INFO:tasks.cephadm:Deploying osd.8 on smithi174 with /dev/vg_nvme/lv_2... 2024-09-21T06:15:13.500 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:15:13.756 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:15:13.780 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:13.780 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:13.780 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:13.876 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:13.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:13.877 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:13.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:13.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:13.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:14.602 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:14 smithi044 ceph-mon[34369]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:14.892 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:14 smithi174 ceph-mon[34815]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:14.899 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:15:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:15:14.690+0000 7f1c01a65640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:15:14.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:14 smithi038 ceph-mon[31215]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:15.503 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:15 smithi174 ceph-mon[34815]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:15.503 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:15 smithi174 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:15 smithi044 ceph-mon[34369]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:15 smithi044 ceph-mon[34369]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:15.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:15 smithi038 ceph-mon[31215]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:15.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:15 smithi038 ceph-mon[31215]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:15:16.252 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:15:16.278 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi044 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.523 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:16.524 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:16 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.530 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:15:16.776 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:15:16.776 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.776 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:15:16.776 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:16.776 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi044 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:16.777 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:16 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi044 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-21T06:15:16.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:16.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:16.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:16.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:16 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:17.002 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3825918038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 msgr2=0x7f0ef410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3825918038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef410d850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009900 tx=0x7f0ef002a410 comp rx=0 tx=0).stop 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3825918038 shutdown_connections 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3825918038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 0x7f0ef4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3825918038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef410d850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3825918038 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3825918038 >> 172.21.15.174:0/3825918038 conn(0x7f0ef4079730 msgr2=0x7f0ef4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3825918038 shutdown_connections 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.998+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3825918038 wait complete. 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 Processor -- start 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 -- start start 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 0x7f0ef419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:17.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4113b90 con 0x7f0ef41049b0 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4113a10 con 0x7f0ef410de10 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efc2e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4113d10 con 0x7f0ef4105300 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0ef987c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0ef987c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:51688/0 (socket says 172.21.15.174:51688) 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0ef987c640 1 -- 172.21.15.174:0/3661661971 learned_addr learned my addr 172.21.15.174:0/3661661971 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:16.999+0000 7f0efa87e640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 0x7f0ef419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0efa07d640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 -- 172.21.15.174:0/3661661971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 msgr2=0x7f0ef419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 0x7f0ef419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 -- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 msgr2=0x7f0ef419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 -- 172.21.15.174:0/3661661971 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef41a0510 con 0x7f0ef4105300 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0efa07d640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:15:17.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ef987c640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005940 tx=0x7f0ef00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef003f030 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ef0031910 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef41a07a0 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0035070 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.000+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef41025d0 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.001+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef406b560 con 0x7f0ef4105300 2024-09-21T06:15:17.005 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.004+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f0ef0042030 con 0x7f0ef4105300 2024-09-21T06:15:17.006 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.005+0000 7f0ee77fe640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 0x7f0ee00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:17.006 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.005+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5365+0+0 (secure 0 0 0) 0x7f0ef0106ee0 con 0x7f0ef4105300 2024-09-21T06:15:17.007 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.005+0000 7f0efa07d640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 0x7f0ee00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:17.007 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.006+0000 7f0efa07d640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 0x7f0ee00b8af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058c0 tx=0x7f0ee8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:17.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.007+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ef00ce2f0 con 0x7f0ef4105300 2024-09-21T06:15:17.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:17.197+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0ef4106f30 con 0x7f0ee00b65e0 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:17.781 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:17 smithi174 ceph-mon[34815]: from='osd.7 ' entity='osd.7' 2024-09-21T06:15:17.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:15:17.417+0000 7f1bfd9e7640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:15:17.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:15:17.552+0000 7f1bf57dd640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:17.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:17.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:17.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:17.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:17 smithi044 ceph-mon[34369]: from='osd.7 ' entity='osd.7' 2024-09-21T06:15:17.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:15:17.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:15:17.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:17.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:17 smithi038 ceph-mon[31215]: from='osd.7 ' entity='osd.7' 2024-09-21T06:15:18.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:15:18.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:15:18.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:18.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:18.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] boot 2024-09-21T06:15:18.797 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:15:18.797 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] boot 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:15:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:18.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:15:18.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:15:18.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:18.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: pgmap v157: 1 pgs: 1 remapped+peering; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:15:18.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: osd.7 [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] boot 2024-09-21T06:15:18.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:15:18.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:15:20.119 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:15:20.119 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/2388257501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.119 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.120 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"}]': finished 2024-09-21T06:15:20.120 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:15:20.120 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:19 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:20.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:15:20.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/2388257501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"}]': finished 2024-09-21T06:15:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:15:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:19 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/2388257501' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"} : dispatch 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5cfb5b9-32ed-4457-8ba7-20cc22188450"}]': finished 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:15:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:19 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:21.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:20 smithi038 ceph-mon[31215]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:21.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:20 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/257686629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:20 smithi174 ceph-mon[34815]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:20 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/257686629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:20 smithi044 ceph-mon[34369]: pgmap v161: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:20 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/257686629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:23.196 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:22 smithi174 ceph-mon[34815]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:23.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:22 smithi038 ceph-mon[31215]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:22 smithi044 ceph-mon[34369]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:25.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:24 smithi038 ceph-mon[31215]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T06:15:25.310 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:24 smithi174 ceph-mon[34815]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T06:15:25.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:24 smithi044 ceph-mon[34369]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-09-21T06:15:26.959 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:26 smithi174 ceph-mon[34815]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T06:15:27.207 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:26 smithi044 ceph-mon[34369]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T06:15:27.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:26 smithi038 ceph-mon[31215]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-09-21T06:15:29.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:28 smithi038 ceph-mon[31215]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-21T06:15:29.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:15:29.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:29.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:28 smithi038 ceph-mon[31215]: Deploying daemon osd.8 on smithi174 2024-09-21T06:15:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:28 smithi174 ceph-mon[34815]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-21T06:15:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:15:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:29.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:28 smithi174 ceph-mon[34815]: Deploying daemon osd.8 on smithi174 2024-09-21T06:15:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:28 smithi044 ceph-mon[34369]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-21T06:15:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:15:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:28 smithi044 ceph-mon[34369]: Deploying daemon osd.8 on smithi174 2024-09-21T06:15:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:30 smithi038 ceph-mon[31215]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-21T06:15:31.358 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:30 smithi174 ceph-mon[34815]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-21T06:15:31.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:30 smithi044 ceph-mon[34369]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-21T06:15:33.047 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:32 smithi174 ceph-mon[34815]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:33.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:32 smithi038 ceph-mon[31215]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:32 smithi044 ceph-mon[34369]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:34.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:34 smithi174 ceph-mon[34815]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:34.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:34.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:34.976 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:34 smithi038 ceph-mon[31215]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:34 smithi044 ceph-mon[34369]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:37.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:36 smithi174 ceph-mon[34815]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:36 smithi038 ceph-mon[31215]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:36 smithi044 ceph-mon[34369]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:38.164 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.162+0000 7f0ee77fe640 1 -- 172.21.15.174:0/3661661971 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0ef4106f30 con 0x7f0ee00b65e0 2024-09-21T06:15:38.165 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 8 on host 'smithi174' 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 msgr2=0x7f0ee00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 0x7f0ee00b8af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80058c0 tx=0x7f0ee8005850 comp rx=0 tx=0).stop 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 msgr2=0x7f0ef419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0005940 tx=0x7f0ef00042f0 comp rx=0 tx=0).stop 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 shutdown_connections 2024-09-21T06:15:38.167 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ee00b65e0 0x7f0ee00b8af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ef410de10 0x7f0ef419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ef4105300 0x7f0ef419ab40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 --2- 172.21.15.174:0/3661661971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ef41049b0 0x7f0ef419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 >> 172.21.15.174:0/3661661971 conn(0x7f0ef4079730 msgr2=0x7f0ef4106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 shutdown_connections 2024-09-21T06:15:38.168 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:15:38.164+0000 7f0efc2e1640 1 -- 172.21.15.174:0/3661661971 wait complete. 2024-09-21T06:15:38.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:38 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:38 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:38.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:38.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:38.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:38.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:38 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:15:38.799 DEBUG:teuthology.orchestra.run.smithi174:osd.8> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T06:15:38.801 INFO:tasks.cephadm:Deploying osd.9 on smithi038 with /dev/vg_nvme/lv_1... 2024-09-21T06:15:38.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:15:39.071 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:39 smithi174 ceph-mon[34815]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:39.416 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:39 smithi038 ceph-mon[31215]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:39.416 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:39.416 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:39 smithi044 ceph-mon[34369]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:40.249 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:40 smithi174 ceph-mon[34815]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:40.249 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:40 smithi174 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:40.249 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:15:40 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:15:40.135+0000 7fd8b395c640 -1 osd.8 0 log_to_monitors true 2024-09-21T06:15:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:40 smithi038 ceph-mon[31215]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:40 smithi038 ceph-mon[31215]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:40 smithi044 ceph-mon[34369]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:40 smithi044 ceph-mon[34369]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:15:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:15:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:15:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:41 smithi174 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:41.417 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:41 smithi038 ceph-mon[31215]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: from='osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:41 smithi044 ceph-mon[34369]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:15:41.797 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:15:41.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi038:vg_nvme/lv_1 2024-09-21T06:15:42.091 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:15:42.180 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:15:42.077+0000 7fd8af8de640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.462 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:42 smithi038 ceph-mon[31215]: from='osd.8 ' entity='osd.8' 2024-09-21T06:15:42.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 -- 172.21.15.38:0/2242567666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58901083a0 msgr2=0x7f58901087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 --2- 172.21.15.38:0/2242567666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58901083a0 0x7f58901087b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5884009900 tx=0x7f588402a410 comp rx=0 tx=0).stop 2024-09-21T06:15:42.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 -- 172.21.15.38:0/2242567666 shutdown_connections 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 --2- 172.21.15.38:0/2242567666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890108cf0 0x7f589010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 --2- 172.21.15.38:0/2242567666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f58901083a0 0x7f58901087b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 --2- 172.21.15.38:0/2242567666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890102a60 0x7f5890102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 -- 172.21.15.38:0/2242567666 >> 172.21.15.38:0/2242567666 conn(0x7f5890079730 msgr2=0x7f5890079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 -- 172.21.15.38:0/2242567666 shutdown_connections 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.583+0000 7f5896fcc640 1 -- 172.21.15.38:0/2242567666 wait complete. 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 Processor -- start 2024-09-21T06:15:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 -- start start 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890102a60 0x7f589019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901083a0 0x7f589019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112a80 con 0x7f5890108cf0 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112900 con 0x7f5890102a60 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5896fcc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112c00 con 0x7f58901083a0 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5895569640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5895569640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46708/0 (socket says 172.21.15.38:46708) 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.584+0000 7f5895569640 1 -- 172.21.15.38:0/1122825596 learned_addr learned my addr 172.21.15.38:0/1122825596 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5894d68640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890102a60 0x7f589019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f588ffff640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901083a0 0x7f589019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 -- 172.21.15.38:0/1122825596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901083a0 msgr2=0x7f589019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901083a0 0x7f589019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 -- 172.21.15.38:0/1122825596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890102a60 msgr2=0x7f589019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890102a60 0x7f589019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 -- 172.21.15.38:0/1122825596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58901a04d0 con 0x7f5890108cf0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5895569640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f588800eaa0 tx=0x7f588800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588800cdb0 con 0x7f5890108cf0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5888005020 con 0x7f5890108cf0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58901a07c0 con 0x7f5890108cf0 2024-09-21T06:15:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.585+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880116d0 con 0x7f5890108cf0 2024-09-21T06:15:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.586+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901a6f20 con 0x7f5890108cf0 2024-09-21T06:15:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.587+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5890102e70 con 0x7f5890108cf0 2024-09-21T06:15:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.588+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f58880051d0 con 0x7f5890108cf0 2024-09-21T06:15:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.589+0000 7f588dffb640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 0x7f58780b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:15:42.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.589+0000 7f5894d68640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 0x7f58780b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:15:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.589+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5797+0+0 (secure 0 0 0) 0x7f58880e6b40 con 0x7f5890108cf0 2024-09-21T06:15:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.589+0000 7f5894d68640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 0x7f58780b8af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5880005fd0 tx=0x7f588000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:15:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.593+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5888016030 con 0x7f5890108cf0 2024-09-21T06:15:42.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:15:42.195+0000 7fd8a76d4640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:42.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:42.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:42 smithi174 ceph-mon[34815]: from='osd.8 ' entity='osd.8' 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:15:42.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:42 smithi044 ceph-mon[34369]: from='osd.8 ' entity='osd.8' 2024-09-21T06:15:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:15:42.793+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5890063800 con 0x7f58780b65e0 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi174 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:43.476 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:43.477 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:43.477 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] boot 2024-09-21T06:15:43.477 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:15:43.477 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi174 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] boot 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:15:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi174 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: osd.8 [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] boot 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:15:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:15:44.411 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:44 smithi038 ceph-mon[31215]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:44.411 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:44 smithi038 ceph-mon[31215]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:15:44.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:44 smithi174 ceph-mon[34815]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:44.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:44 smithi174 ceph-mon[34815]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:15:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:44 smithi044 ceph-mon[34369]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:15:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:44 smithi044 ceph-mon[34369]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:15:45.454 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:45 smithi038 ceph-mon[31215]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:45.454 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:45 smithi038 ceph-mon[31215]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:15:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:45 smithi174 ceph-mon[34815]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:45 smithi174 ceph-mon[34815]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:15:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:45 smithi044 ceph-mon[34369]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:45 smithi044 ceph-mon[34369]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:15:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"} : dispatch 2024-09-21T06:15:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"}]': finished 2024-09-21T06:15:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:46 smithi044 ceph-mon[34369]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:15:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:15:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3591877021' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:46.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"} : dispatch 2024-09-21T06:15:46.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"}]': finished 2024-09-21T06:15:46.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:46 smithi038 ceph-mon[31215]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:15:46.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:15:46.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3591877021' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:46.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"} : dispatch 2024-09-21T06:15:46.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/645150671' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df485a7b-dc9a-4ee0-8c81-8f5aaed79c30"}]': finished 2024-09-21T06:15:46.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:46 smithi174 ceph-mon[34815]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:15:46.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:15:46.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3591877021' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:15:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:47 smithi038 ceph-mon[31215]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:47.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:47 smithi174 ceph-mon[34815]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:47 smithi044 ceph-mon[34369]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:49 smithi038 ceph-mon[31215]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:49.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:49 smithi174 ceph-mon[34815]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:49.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:49 smithi044 ceph-mon[34369]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 668 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:15:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:51 smithi038 ceph-mon[31215]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:51.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:51 smithi174 ceph-mon[34815]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:51.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:51 smithi044 ceph-mon[34369]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:15:53.731 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:53 smithi038 ceph-mon[31215]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:15:53.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:53 smithi174 ceph-mon[34815]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:15:54.221 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:53 smithi044 ceph-mon[34369]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T06:15:54.735 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:54 smithi038 ceph-mon[31215]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:15:54.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:54 smithi174 ceph-mon[34815]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:15:54.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:54 smithi044 ceph-mon[34369]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T06:15:55.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:15:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:55 smithi174 ceph-mon[34815]: Deploying daemon osd.9 on smithi038 2024-09-21T06:15:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:15:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:55 smithi044 ceph-mon[34369]: Deploying daemon osd.9 on smithi038 2024-09-21T06:15:55.983 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:15:55.983 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:15:55.983 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:55 smithi038 ceph-mon[31215]: Deploying daemon osd.9 on smithi038 2024-09-21T06:15:56.558 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:56 smithi038 ceph-mon[31215]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T06:15:56.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:56 smithi174 ceph-mon[34815]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T06:15:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:56 smithi044 ceph-mon[34369]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T06:15:58.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:15:58 smithi038 ceph-mon[31215]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:15:59.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:15:58 smithi174 ceph-mon[34815]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:15:59.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:15:58 smithi044 ceph-mon[34369]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:00.946 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:00 smithi038 ceph-mon[31215]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:00.946 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:00.946 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:00.946 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:01.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:00 smithi174 ceph-mon[34815]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:01.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:01.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:01.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:00 smithi044 ceph-mon[34369]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:01.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:02.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:02 smithi038 ceph-mon[31215]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:03.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:02 smithi174 ceph-mon[34815]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:03.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:02 smithi044 ceph-mon[34369]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:03.340 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 9 on host 'smithi038' 2024-09-21T06:16:03.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.338+0000 7f588dffb640 1 -- 172.21.15.38:0/1122825596 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5890063800 con 0x7f58780b65e0 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 msgr2=0x7f58780b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 0x7f58780b8af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5880005fd0 tx=0x7f588000b390 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 msgr2=0x7f589019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f588800eaa0 tx=0x7f588800ef60 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 shutdown_connections 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b65e0 0x7f58780b8af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890108cf0 0x7f589019fda0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901083a0 0x7f589019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 --2- 172.21.15.38:0/1122825596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890102a60 0x7f589019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 >> 172.21.15.38:0/1122825596 conn(0x7f5890079730 msgr2=0x7f589006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 shutdown_connections 2024-09-21T06:16:03.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:03.341+0000 7f5896fcc640 1 -- 172.21.15.38:0/1122825596 wait complete. 2024-09-21T06:16:03.969 DEBUG:teuthology.orchestra.run.smithi038:osd.9> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T06:16:03.972 INFO:tasks.cephadm:Deploying osd.10 on smithi044 with /dev/vg_nvme/lv_1... 2024-09-21T06:16:03.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:16:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:16:04.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.595 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:04 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:04 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:04 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:05.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:05 smithi038 ceph-mon[31215]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:05 smithi174 ceph-mon[34815]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:05 smithi044 ceph-mon[34369]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:06.615 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:16:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:16:06.359+0000 7f78753d1640 -1 osd.9 0 log_to_monitors true 2024-09-21T06:16:07.058 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-21T06:16:07.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-09-21T06:16:07.335 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:07.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:07 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:07 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:16:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:07.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:07 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 -- 172.21.15.44:0/498007663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c10de10 msgr2=0x7f032c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 --2- 172.21.15.44:0/498007663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c10de10 0x7f032c110320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0324009ca0 tx=0x7f032402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 -- 172.21.15.44:0/498007663 shutdown_connections 2024-09-21T06:16:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 --2- 172.21.15.44:0/498007663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c10de10 0x7f032c110320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 --2- 172.21.15.44:0/498007663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c105290 0x7f032c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 --2- 172.21.15.44:0/498007663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c104860 0x7f032c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 -- 172.21.15.44:0/498007663 >> 172.21.15.44:0/498007663 conn(0x7f032c079740 msgr2=0x7f032c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 -- 172.21.15.44:0/498007663 shutdown_connections 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.818+0000 7f0331e3f640 1 -- 172.21.15.44:0/498007663 wait complete. 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 Processor -- start 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 -- start start 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c105290 0x7f032c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c10de10 0x7f032c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f032c113bf0 con 0x7f032c105290 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f032c113a70 con 0x7f032c104860 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f0331e3f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f032c113d70 con 0x7f032c10de10 2024-09-21T06:16:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f032b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f032b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46616/0 (socket says 172.21.15.44:46616) 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f032b7fe640 1 -- 172.21.15.44:0/1838809994 learned_addr learned my addr 172.21.15.44:0/1838809994 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f032affd640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c105290 0x7f032c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.819+0000 7f032bfff640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c10de10 0x7f032c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 -- 172.21.15.44:0/1838809994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c10de10 msgr2=0x7f032c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c10de10 0x7f032c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 -- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c105290 msgr2=0x7f032c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c105290 0x7f032c102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 -- 172.21.15.44:0/1838809994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c1a8880 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f032b7fe640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9c0 tx=0x7f031c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c00cd80 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c1a8b70 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f031c0035f0 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c010690 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.820+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c1a90b0 con 0x7f032c104860 2024-09-21T06:16:07.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.821+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c06c1e0 con 0x7f032c104860 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.823+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f031c0037a0 con 0x7f032c104860 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.823+0000 7f0328ff9640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 0x7f03140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.823+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6180+0+0 (secure 0 0 0) 0x7f031c0e6f90 con 0x7f032c104860 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.824+0000 7f032affd640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 0x7f03140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.824+0000 7f032affd640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 0x7f03140b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f032c10fad0 tx=0x7f032000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:07.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:07.827+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f031c0ae100 con 0x7f032c104860 2024-09-21T06:16:08.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:08.024+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f032c106a00 con 0x7f03140b6560 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi038 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:08.618 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:08.619 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:08.619 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:08.619 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:08.619 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:08.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi038 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi038 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi038 to 4273M 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]} : dispatch 2024-09-21T06:16:08.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:08.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:09 smithi044 ceph-mon[34369]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' 2024-09-21T06:16:09.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:16:09.210+0000 7f7871353640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T06:16:09.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:16:09.243+0000 7f7869149640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:09 smithi038 ceph-mon[31215]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:09 smithi174 ceph-mon[34815]: from='osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106]' entity='osd.9' 2024-09-21T06:16:10.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:10.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:10 smithi174 ceph-mon[34815]: osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] boot 2024-09-21T06:16:10.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:10 smithi174 ceph-mon[34815]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:16:10.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:10 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:10.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:10.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:10 smithi044 ceph-mon[34369]: osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] boot 2024-09-21T06:16:10.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:10 smithi044 ceph-mon[34369]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:16:10.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:10 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:10.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:10.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:10 smithi038 ceph-mon[31215]: osd.9 [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] boot 2024-09-21T06:16:10.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:10 smithi038 ceph-mon[31215]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:16:10.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:10 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/3245743202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"}]': finished 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:11 smithi174 ceph-mon[34815]: from='client.? 172.21.15.44:0/2231835135' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/3245743202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"}]': finished 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:11 smithi044 ceph-mon[34369]: from='client.? 172.21.15.44:0/2231835135' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:16:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/3245743202' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"} : dispatch 2024-09-21T06:16:11.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65ea74b8-1f22-4471-82bc-46af8862d7ba"}]': finished 2024-09-21T06:16:11.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:16:11.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:11.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:11 smithi038 ceph-mon[31215]: from='client.? 172.21.15.44:0/2231835135' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:13 smithi044 ceph-mon[34369]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:13 smithi038 ceph-mon[31215]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:13 smithi174 ceph-mon[34815]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:15 smithi044 ceph-mon[34369]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:15.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:15 smithi038 ceph-mon[31215]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:15.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:15 smithi174 ceph-mon[34815]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:17 smithi044 ceph-mon[34369]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:17 smithi038 ceph-mon[31215]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:17.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:17 smithi174 ceph-mon[34815]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:19.596 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:19 smithi044 ceph-mon[34369]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:19.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:19 smithi038 ceph-mon[31215]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:19.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:19 smithi174 ceph-mon[34815]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:16:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:16:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:20.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:16:20.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:21.530 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:21 smithi044 ceph-mon[34369]: Deploying daemon osd.10 on smithi044 2024-09-21T06:16:21.530 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:21 smithi044 ceph-mon[34369]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:21 smithi038 ceph-mon[31215]: Deploying daemon osd.10 on smithi044 2024-09-21T06:16:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:21 smithi038 ceph-mon[31215]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:21.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:21 smithi174 ceph-mon[34815]: Deploying daemon osd.10 on smithi044 2024-09-21T06:16:21.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:21 smithi174 ceph-mon[34815]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:23 smithi044 ceph-mon[34369]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:23.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:23 smithi174 ceph-mon[34815]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:23.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:23 smithi038 ceph-mon[31215]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:25 smithi044 ceph-mon[34369]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:25 smithi038 ceph-mon[31215]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:25 smithi174 ceph-mon[34815]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:25.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:25.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:27.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:27 smithi038 ceph-mon[31215]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:27.817 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:27 smithi044 ceph-mon[34369]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:27.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:27 smithi174 ceph-mon[34815]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:28.891 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 10 on host 'smithi044' 2024-09-21T06:16:28.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.889+0000 7f0328ff9640 1 -- 172.21.15.44:0/1838809994 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f032c106a00 con 0x7f03140b6560 2024-09-21T06:16:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 msgr2=0x7f03140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 0x7f03140b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f032c10fad0 tx=0x7f032000b390 comp rx=0 tx=0).stop 2024-09-21T06:16:28.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 msgr2=0x7f032c102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e9c0 tx=0x7f031c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 shutdown_connections 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f03140b6560 0x7f03140b8a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f032c10de10 0x7f032c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f032c105290 0x7f032c102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 --2- 172.21.15.44:0/1838809994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f032c104860 0x7f032c102770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 >> 172.21.15.44:0/1838809994 conn(0x7f032c079740 msgr2=0x7f032c1062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 shutdown_connections 2024-09-21T06:16:28.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-21T06:16:28.892+0000 7f0331e3f640 1 -- 172.21.15.44:0/1838809994 wait complete. 2024-09-21T06:16:29.436 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.437 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:29 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:29 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:29 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:29.654 DEBUG:teuthology.orchestra.run.smithi044:osd.10> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T06:16:29.657 INFO:tasks.cephadm:Deploying osd.11 on smithi174 with /dev/vg_nvme/lv_1... 2024-09-21T06:16:29.657 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:16:29.910 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:16:31.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:31 smithi174 ceph-mon[34815]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:31.435 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:31 smithi044 ceph-mon[34369]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:31.436 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:16:31 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:16:31.212+0000 7f96f8d5d640 -1 osd.10 0 log_to_monitors true 2024-09-21T06:16:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:31 smithi038 ceph-mon[31215]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:32.333 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:32 smithi174 ceph-mon[34815]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.333 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:32 smithi174 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:32 smithi038 ceph-mon[31215]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:32 smithi038 ceph-mon[31215]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.522 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:32 smithi044 ceph-mon[34369]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.522 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:32 smithi044 ceph-mon[34369]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:16:32.652 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T06:16:32.678 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_1 2024-09-21T06:16:32.922 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.370 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:33.371 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 -- 172.21.15.174:0/2884763423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 msgr2=0x7fa5dc107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/2884763423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc107f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009900 tx=0x7fa5d002a410 comp rx=0 tx=0).stop 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 -- 172.21.15.174:0/2884763423 shutdown_connections 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/2884763423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc108480 0x7fa5dc10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/2884763423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc107f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/2884763423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc1021f0 0x7fa5dc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 -- 172.21.15.174:0/2884763423 >> 172.21.15.174:0/2884763423 conn(0x7fa5dc077c60 msgr2=0x7fa5dc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 -- 172.21.15.174:0/2884763423 shutdown_connections 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.369+0000 7fa5e2a88640 1 -- 172.21.15.174:0/2884763423 wait complete. 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 Processor -- start 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 -- start start 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc1021f0 0x7fa5dc19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 0x7fa5dc1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc113bc0 con 0x7fa5dc108480 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc113a40 con 0x7fa5dc1021f0 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e2a88640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc113d40 con 0x7fa5dc107b30 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5dbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5dbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:49820/0 (socket says 172.21.15.174:49820) 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5dbfff640 1 -- 172.21.15.174:0/3538020871 learned_addr learned my addr 172.21.15.174:0/3538020871 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T06:16:33.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.370+0000 7fa5e0824640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc1021f0 0x7fa5dc19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5e1025640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 0x7fa5dc1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 -- 172.21.15.174:0/3538020871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc1021f0 msgr2=0x7fa5dc19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc1021f0 0x7fa5dc19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 -- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 msgr2=0x7fa5dc1a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 0x7fa5dc1a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 -- 172.21.15.174:0/3538020871 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc1a2640 con 0x7fa5dc107b30 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5e1025640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 0x7fa5dc1a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5dbfff640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005940 tx=0x7fa5d00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d003f030 con 0x7fa5dc107b30 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5d00318f0 con 0x7fa5dc107b30 2024-09-21T06:16:33.375 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc1a28d0 con 0x7fa5dc107b30 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0035070 con 0x7fa5dc107b30 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.371+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc1a2db0 con 0x7fa5dc107b30 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.372+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc102600 con 0x7fa5dc107b30 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.374+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa5d0042030 con 0x7fa5dc107b30 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.375+0000 7fa5d9ffb640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 0x7fa5c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:33.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.375+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7fa5d01073c0 con 0x7fa5dc107b30 2024-09-21T06:16:33.377 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.375+0000 7fa5e0824640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 0x7fa5c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:33.377 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.375+0000 7fa5e0824640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 0x7fa5c40b8aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00abe0 tx=0x7fa5cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:33.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.378+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5d00ce2e0 con 0x7fa5dc107b30 2024-09-21T06:16:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:33.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:33.488 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.567 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:33.565+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa5dc106050 con 0x7fa5c40b6590 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:33.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:33.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:33.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:33.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:34.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:16:34.114+0000 7f96f4cdf640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T06:16:34.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:16:34.239+0000 7f96ecad5640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:16:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi044 2024-09-21T06:16:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-21T06:16:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:34.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:34 smithi044 ceph-mon[34369]: from='osd.10 ' entity='osd.10' 2024-09-21T06:16:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi044 2024-09-21T06:16:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-21T06:16:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:16:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:34.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:34 smithi038 ceph-mon[31215]: from='osd.10 ' entity='osd.10' 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi044 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:34.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:34 smithi174 ceph-mon[34815]: from='osd.10 ' entity='osd.10' 2024-09-21T06:16:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:35 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.513 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:35 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:35 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:36.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] boot 2024-09-21T06:16:36.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/3789541682' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"}]': finished 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:16:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:36.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] boot 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/3789541682' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"}]': finished 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:16:36.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: osd.10 [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] boot 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/3789541682' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"} : dispatch 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f96a5ad-c4d1-4a79-9d09-c302e723251d"}]': finished 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:16:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:37 smithi038 ceph-mon[31215]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:37 smithi038 ceph-mon[31215]: from='client.? 172.21.15.174:0/2109971629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:37 smithi038 ceph-mon[31215]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:16:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:37 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:37.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:37 smithi174 ceph-mon[34815]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:37.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:37 smithi174 ceph-mon[34815]: from='client.? 172.21.15.174:0/2109971629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:37.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:37 smithi174 ceph-mon[34815]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:16:37.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:37 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:37 smithi044 ceph-mon[34369]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:16:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:37 smithi044 ceph-mon[34369]: from='client.? 172.21.15.174:0/2109971629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:16:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:37 smithi044 ceph-mon[34369]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:16:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:37 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:39 smithi038 ceph-mon[31215]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:39.501 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:39 smithi044 ceph-mon[34369]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:39 smithi174 ceph-mon[34815]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:41 smithi174 ceph-mon[34815]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:16:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:41 smithi038 ceph-mon[31215]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:16:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:41 smithi044 ceph-mon[34369]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:16:43.305 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:43 smithi174 ceph-mon[34815]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:16:43.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:43 smithi038 ceph-mon[31215]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:16:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:43 smithi044 ceph-mon[34369]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:16:45.320 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:45 smithi174 ceph-mon[34815]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:16:45.321 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:16:45.321 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:45 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:45.321 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:45 smithi174 ceph-mon[34815]: Deploying daemon osd.11 on smithi174 2024-09-21T06:16:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:45 smithi044 ceph-mon[34369]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:16:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:16:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:45 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:45 smithi044 ceph-mon[34369]: Deploying daemon osd.11 on smithi174 2024-09-21T06:16:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:45 smithi038 ceph-mon[31215]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:16:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:16:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:45 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:45 smithi038 ceph-mon[31215]: Deploying daemon osd.11 on smithi174 2024-09-21T06:16:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:47 smithi174 ceph-mon[34815]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T06:16:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:47 smithi044 ceph-mon[34369]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T06:16:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:47 smithi038 ceph-mon[31215]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T06:16:49.610 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:49 smithi174 ceph-mon[34815]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:16:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:49 smithi044 ceph-mon[34369]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:16:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:49 smithi038 ceph-mon[31215]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:16:50.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:50 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:50.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:50 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:50.580 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:50 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:50 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:50 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:50 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:50.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:50 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:50.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:50 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:50.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:50 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:51.536 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:51 smithi174 ceph-mon[34815]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:51.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:51 smithi044 ceph-mon[34369]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:51 smithi038 ceph-mon[31215]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:16:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:53.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:53.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:53.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:53.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.817+0000 7fa5d9ffb640 1 -- 172.21.15.174:0/3538020871 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa5dc106050 con 0x7fa5c40b6590 2024-09-21T06:16:53.819 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 11 on host 'smithi174' 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 msgr2=0x7fa5c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 0x7fa5c40b8aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00abe0 tx=0x7fa5cc00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 msgr2=0x7fa5dc19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005940 tx=0x7fa5d00042f0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 shutdown_connections 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5c40b6590 0x7fa5c40b8aa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5dc108480 0x7fa5dc1a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5dc107b30 0x7fa5dc19cd30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 --2- 172.21.15.174:0/3538020871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5dc1021f0 0x7fa5dc19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 >> 172.21.15.174:0/3538020871 conn(0x7fa5dc077c60 msgr2=0x7fa5dc105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:53.822 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 shutdown_connections 2024-09-21T06:16:53.823 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:16:53.820+0000 7fa5e2a88640 1 -- 172.21.15.174:0/3538020871 wait complete. 2024-09-21T06:16:54.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:54 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:54.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:54 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:54.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:54 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:54.444 DEBUG:teuthology.orchestra.run.smithi174:osd.11> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T06:16:54.446 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T06:16:54.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:16:54.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:54 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:54.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:54 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:54.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:54 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:54.717 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:16:54.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:54 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:16:54.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:54 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:54.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:54 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 -- 172.21.15.38:0/2694385431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 msgr2=0x7f521c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 --2- 172.21.15.38:0/2694385431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c104e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5218009900 tx=0x7f521802a410 comp rx=0 tx=0).stop 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 -- 172.21.15.38:0/2694385431 shutdown_connections 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 --2- 172.21.15.38:0/2694385431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 0x7f521c110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 --2- 172.21.15.38:0/2694385431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 --2- 172.21.15.38:0/2694385431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c104e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 -- 172.21.15.38:0/2694385431 >> 172.21.15.38:0/2694385431 conn(0x7f521c079770 msgr2=0x7f521c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 -- 172.21.15.38:0/2694385431 shutdown_connections 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.173+0000 7f5224551640 1 -- 172.21.15.38:0/2694385431 wait complete. 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.174+0000 7f5224551640 1 Processor -- start 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.174+0000 7f5224551640 1 -- start start 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.174+0000 7f5224551640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 0x7f521c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f521c113c50 con 0x7f521c104a30 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f521c113ad0 con 0x7f521c105380 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f521c113dd0 con 0x7f521c10de90 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53308/0 (socket says 172.21.15.38:53308) 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 -- 172.21.15.38:0/1864222456 learned_addr learned my addr 172.21.15.38:0/1864222456 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:16:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5222aee640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 0x7f521c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5221aec640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 -- 172.21.15.38:0/1864222456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 msgr2=0x7f521c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 0x7f521c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 -- 172.21.15.38:0/1864222456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 msgr2=0x7f521c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 -- 172.21.15.38:0/1864222456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c1a0570 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5221aec640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52222ed640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5218005ab0 tx=0x7f52180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521803f030 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5218003cd0 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a0800 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218035070 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.175+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a6fc0 con 0x7f521c104a30 2024-09-21T06:16:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.176+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c06c260 con 0x7f521c104a30 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.178+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5218042030 con 0x7f521c104a30 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.179+0000 7f52137fe640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 0x7f52080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.179+0000 7f5221aec640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 0x7f52080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.179+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f5218107930 con 0x7f521c104a30 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.180+0000 7f5221aec640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 0x7f52080b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f521c107590 tx=0x7f520c005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.182+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52180ce6d0 con 0x7f521c104a30 2024-09-21T06:16:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.372+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f521c1a7190 con 0x7f521c104a30 2024-09-21T06:16:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.372+0000 7f52137fe640 1 -- 172.21.15.38:0/1864222456 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f52180d2ab0 con 0x7f521c104a30 2024-09-21T06:16:55.374 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 msgr2=0x7f52080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 0x7f52080b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f521c107590 tx=0x7f520c005e50 comp rx=0 tx=0).stop 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 msgr2=0x7f521c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5218005ab0 tx=0x7f52180042f0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 shutdown_connections 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52080b6560 0x7f52080b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f521c10de90 0x7f521c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f521c105380 0x7f521c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 --2- 172.21.15.38:0/1864222456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f521c104a30 0x7f521c19a600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:55.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 >> 172.21.15.38:0/1864222456 conn(0x7f521c079770 msgr2=0x7f521c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:55.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 shutdown_connections 2024-09-21T06:16:55.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:55.375+0000 7f5224551640 1 -- 172.21.15.38:0/1864222456 wait complete. 2024-09-21T06:16:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:55 smithi038 ceph-mon[31215]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:55.623 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:55 smithi174 ceph-mon[34815]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:55 smithi044 ceph-mon[34369]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:56.067 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726899395,"num_in_osds":12,"osd_in_since":1726899395,"num_remapped_pgs":0} 2024-09-21T06:16:56.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:56 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1864222456' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:56 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1864222456' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:56 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1864222456' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:56.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:16:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:16:56.510+0000 7f95c44cf640 -1 osd.11 0 log_to_monitors true 2024-09-21T06:16:57.069 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:16:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:16:57.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:57 smithi174 ceph-mon[34815]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:57.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:57 smithi174 ceph-mon[34815]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:57 smithi174 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:57 smithi038 ceph-mon[31215]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:57.461 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:57 smithi038 ceph-mon[31215]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.461 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:57 smithi038 ceph-mon[31215]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:57 smithi044 ceph-mon[34369]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:57 smithi044 ceph-mon[34369]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:57 smithi044 ceph-mon[34369]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:16:57.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 -- 172.21.15.38:0/941838013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a41083d0 msgr2=0x7f53a41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:57.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 --2- 172.21.15.38:0/941838013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a41083d0 0x7f53a41087e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5398009900 tx=0x7f539802a410 comp rx=0 tx=0).stop 2024-09-21T06:16:57.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 -- 172.21.15.38:0/941838013 shutdown_connections 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 --2- 172.21.15.38:0/941838013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a4108d20 0x7f53a410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 --2- 172.21.15.38:0/941838013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a41083d0 0x7f53a41087e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 --2- 172.21.15.38:0/941838013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4102ae0 0x7f53a4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 -- 172.21.15.38:0/941838013 >> 172.21.15.38:0/941838013 conn(0x7f53a40797b0 msgr2=0x7f53a4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 -- 172.21.15.38:0/941838013 shutdown_connections 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.846+0000 7f53a9025640 1 -- 172.21.15.38:0/941838013 wait complete. 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 Processor -- start 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 -- start start 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a41083d0 0x7f53a4199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 0x7f53a419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112b00 con 0x7f53a4102ae0 2024-09-21T06:16:57.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112980 con 0x7f53a4108d20 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.847+0000 7f53a9025640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112c80 con 0x7f53a41083d0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53332/0 (socket says 172.21.15.38:53332) 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 -- 172.21.15.38:0/1529742105 learned_addr learned my addr 172.21.15.38:0/1529742105 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a359e640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 0x7f53a419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a259c640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a41083d0 0x7f53a4199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 -- 172.21.15.38:0/1529742105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a41083d0 msgr2=0x7f53a4199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a41083d0 0x7f53a4199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 -- 172.21.15.38:0/1529742105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 msgr2=0x7f53a419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 0x7f53a419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 -- 172.21.15.38:0/1529742105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a419f3e0 con 0x7f53a4102ae0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a359e640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 0x7f53a419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a2d9d640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f539400d950 tx=0x7f539400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394017030 con 0x7f53a4102ae0 2024-09-21T06:16:57.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5394004020 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a419f6d0 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53940047a0 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.848+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41a5e30 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.849+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a4102ef0 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.851+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f53940041d0 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.852+0000 7f538bfff640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 0x7f538c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.852+0000 7f53a259c640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 0x7f538c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.852+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7046+0+0 (secure 0 0 0) 0x7f53940e6f90 con 0x7f53a4102ae0 2024-09-21T06:16:57.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.852+0000 7f53a259c640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 0x7f538c0b8af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5398009230 tx=0x7f5398032b90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:16:57.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:57.855+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53940add90 con 0x7f53a4102ae0 2024-09-21T06:16:58.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.043+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f53a419a5a0 con 0x7f53a4102ae0 2024-09-21T06:16:58.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.043+0000 7f538bfff640 1 -- 172.21.15.38:0/1529742105 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f53940b2170 con 0x7f53a4102ae0 2024-09-21T06:16:58.045 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:16:58.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 msgr2=0x7f538c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:58.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 0x7f538c0b8af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5398009230 tx=0x7f5398032b90 comp rx=0 tx=0).stop 2024-09-21T06:16:58.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 msgr2=0x7f53a4199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f539400d950 tx=0x7f539400de10 comp rx=0 tx=0).stop 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 shutdown_connections 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f538c0b65e0 0x7f538c0b8af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53a4108d20 0x7f53a419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53a41083d0 0x7f53a4199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 --2- 172.21.15.38:0/1529742105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53a4102ae0 0x7f53a4199470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 >> 172.21.15.38:0/1529742105 conn(0x7f53a40797b0 msgr2=0x7f53a4106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 shutdown_connections 2024-09-21T06:16:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:16:58.046+0000 7f53a9025640 1 -- 172.21.15.38:0/1529742105 wait complete. 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: Detected new or changed devices on smithi174 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:58 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1529742105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: Detected new or changed devices on smithi174 2024-09-21T06:16:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:58 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1529742105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:58.693 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: Detected new or changed devices on smithi174 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:16:58.695 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:16:58.695 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:16:58.695 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:58 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1529742105' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:16:58.723 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726899395,"num_in_osds":12,"osd_in_since":1726899395,"num_remapped_pgs":0} 2024-09-21T06:16:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:16:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:16:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-mon[34815]: from='osd.11 ' entity='osd.11' 2024-09-21T06:16:59.645 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:16:59.240+0000 7f95c0c66640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T06:16:59.645 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:16:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:16:59.369+0000 7f95b8247640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:16:59 smithi044 ceph-mon[34369]: from='osd.11 ' entity='osd.11' 2024-09-21T06:16:59.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:16:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:16:59 smithi038 ceph-mon[31215]: from='osd.11 ' entity='osd.11' 2024-09-21T06:16:59.994 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:00.368 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:00 smithi038 ceph-mon[31215]: purged_snaps scrub starts 2024-09-21T06:17:00.368 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:00 smithi038 ceph-mon[31215]: purged_snaps scrub ok 2024-09-21T06:17:00.368 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3358413174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 msgr2=0x7f6d401098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3358413174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d401098d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009900 tx=0x7f6d3402a410 comp rx=0 tx=0).stop 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3358413174 shutdown_connections 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3358413174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40109e10 0x7f6d40110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3358413174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d401098d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3358413174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40103b80 0x7f6d40103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3358413174 >> 172.21.15.38:0/3358413174 conn(0x7f6d400ff5d0 msgr2=0x7f6d40101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3358413174 shutdown_connections 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.453+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3358413174 wait complete. 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 Processor -- start 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 -- start start 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40103b80 0x7f6d4019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40109e10 0x7f6d4019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40113bf0 con 0x7f6d401094c0 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40113a70 con 0x7f6d40109e10 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d44cf8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40113d70 con 0x7f6d40103b80 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:00.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3dd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41832/0 (socket says 172.21.15.38:41832) 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3dd9b640 1 -- 172.21.15.38:0/3163119740 learned_addr learned my addr 172.21.15.38:0/3163119740 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3ed9d640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40109e10 0x7f6d4019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3e59c640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40103b80 0x7f6d4019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3dd9b640 1 -- 172.21.15.38:0/3163119740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40103b80 msgr2=0x7f6d4019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.454+0000 7f6d3dd9b640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40103b80 0x7f6d4019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d3dd9b640 1 -- 172.21.15.38:0/3163119740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40109e10 msgr2=0x7f6d4019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d3dd9b640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40109e10 0x7f6d4019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d3dd9b640 1 -- 172.21.15.38:0/3163119740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d401a04f0 con 0x7f6d401094c0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d3dd9b640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005940 tx=0x7f6d340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3403f030 con 0x7f6d401094c0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d401a0780 con 0x7f6d401094c0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6d34031910 con 0x7f6d401094c0 2024-09-21T06:17:00.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34035070 con 0x7f6d401094c0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.455+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d401a6f40 con 0x7f6d401094c0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.456+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d40104e00 con 0x7f6d401094c0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.458+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6d34042030 con 0x7f6d401094c0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.458+0000 7f6d2f7fe640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 0x7f6d280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.458+0000 7f6d3e59c640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 0x7f6d280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.459+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f6d341076a0 con 0x7f6d401094c0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.459+0000 7f6d3e59c640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 0x7f6d280b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:00.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.462+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d340ce300 con 0x7f6d401094c0 2024-09-21T06:17:00.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:00 smithi174 ceph-mon[34815]: purged_snaps scrub starts 2024-09-21T06:17:00.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:00 smithi174 ceph-mon[34815]: purged_snaps scrub ok 2024-09-21T06:17:00.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.650+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6d4010bbe0 con 0x7f6d401094c0 2024-09-21T06:17:00.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.650+0000 7f6d2f7fe640 1 -- 172.21.15.38:0/3163119740 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f6d340d26e0 con 0x7f6d401094c0 2024-09-21T06:17:00.652 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.652+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 msgr2=0x7f6d280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.652+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 0x7f6d280b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.652+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 msgr2=0x7f6d4019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005940 tx=0x7f6d340042f0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 shutdown_connections 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6d280b6560 0x7f6d280b8a70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d40109e10 0x7f6d4019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6d401094c0 0x7f6d4019ab20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 --2- 172.21.15.38:0/3163119740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d40103b80 0x7f6d4019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 >> 172.21.15.38:0/3163119740 conn(0x7f6d400ff5d0 msgr2=0x7f6d401019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 shutdown_connections 2024-09-21T06:17:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:00.653+0000 7f6d44cf8640 1 -- 172.21.15.38:0/3163119740 wait complete. 2024-09-21T06:17:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:00 smithi044 ceph-mon[34369]: purged_snaps scrub starts 2024-09-21T06:17:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:00 smithi044 ceph-mon[34369]: purged_snaps scrub ok 2024-09-21T06:17:00.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.409 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:17:01.410 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.410 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] boot 2024-09-21T06:17:01.410 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:17:01.410 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.410 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:01 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3163119740' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:17:01.441 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726899420,"num_in_osds":12,"osd_in_since":1726899395,"num_remapped_pgs":0} 2024-09-21T06:17:01.442 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:17:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:17:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] boot 2024-09-21T06:17:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:17:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:01 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3163119740' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:17:01.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:17:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: osd.11 [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] boot 2024-09-21T06:17:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:17:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:17:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:01 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3163119740' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:17:01.739 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:02.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- 172.21.15.38:0/592762499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1538105380 msgr2=0x7f153810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:02.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 --2- 172.21.15.38:0/592762499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1538105380 0x7f153810d8d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f152002a410 comp rx=0 tx=0).stop 2024-09-21T06:17:02.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- 172.21.15.38:0/592762499 shutdown_connections 2024-09-21T06:17:02.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 --2- 172.21.15.38:0/592762499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f153810de90 0x7f1538110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 --2- 172.21.15.38:0/592762499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1538105380 0x7f153810d8d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 --2- 172.21.15.38:0/592762499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538104a30 0x7f1538104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- 172.21.15.38:0/592762499 >> 172.21.15.38:0/592762499 conn(0x7f1538079770 msgr2=0x7f1538079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- 172.21.15.38:0/592762499 shutdown_connections 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- 172.21.15.38:0/592762499 wait complete. 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 Processor -- start 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.213+0000 7f153db38640 1 -- start start 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104a30 0x7f1538102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538105380 0x7f1538102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1538113c10 con 0x7f153810de90 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1538113a90 con 0x7f1538104a30 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f153db38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1538113d90 con 0x7f1538105380 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:02.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41844/0 (socket says 172.21.15.38:41844) 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 -- 172.21.15.38:0/615088161 learned_addr learned my addr 172.21.15.38:0/615088161 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f152effd640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538105380 0x7f1538102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f15377fe640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104a30 0x7f1538102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 -- 172.21.15.38:0/615088161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538105380 msgr2=0x7f1538102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538105380 0x7f1538102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 -- 172.21.15.38:0/615088161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104a30 msgr2=0x7f1538102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104a30 0x7f1538102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.214+0000 7f1537fff640 1 -- 172.21.15.38:0/615088161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15381a8920 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f1537fff640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f153000eaa0 tx=0x7f153000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153000cdb0 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1530005020 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15381a8c10 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300116d0 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.215+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381a90d0 con 0x7f153810de90 2024-09-21T06:17:02.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.216+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153806c260 con 0x7f153810de90 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.217+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f15300051d0 con 0x7f153810de90 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.219+0000 7f15357fa640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 0x7f15240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.219+0000 7f15377fe640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 0x7f15240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.219+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f15300e74a0 con 0x7f153810de90 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.219+0000 7f15377fe640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 0x7f15240b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15381041c0 tx=0x7f152800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:02.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.222+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1530016030 con 0x7f153810de90 2024-09-21T06:17:02.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.413+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1538103a70 con 0x7f153810de90 2024-09-21T06:17:02.415 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:02 smithi038 ceph-mon[31215]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:17:02.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.414+0000 7f15357fa640 1 -- 172.21.15.38:0/615088161 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18770 (secure 0 0 0) 0x7f1538103a70 con 0x7f153810de90 2024-09-21T06:17:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:02.416 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":70,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:17:01.332394+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 msgr2=0x7f15240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 0x7f15240b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f15381041c0 tx=0x7f152800b390 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 msgr2=0x7f15381031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f153000eaa0 tx=0x7f153000ef60 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 shutdown_connections 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f15240b6560 0x7f15240b8a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f153810de90 0x7f15381031f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1538105380 0x7f1538102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 --2- 172.21.15.38:0/615088161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104a30 0x7f1538102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 >> 172.21.15.38:0/615088161 conn(0x7f1538079770 msgr2=0x7f1538100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 shutdown_connections 2024-09-21T06:17:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:02.417+0000 7f153db38640 1 -- 172.21.15.38:0/615088161 wait complete. 2024-09-21T06:17:02.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:02 smithi174 ceph-mon[34815]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:17:02.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:02 smithi044 ceph-mon[34369]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:17:03.156 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:13:12.045212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:17:03.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T06:17:03.417 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:03 smithi038 ceph-mon[31215]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:03 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/615088161' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:03 smithi174 ceph-mon[34815]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:03 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/615088161' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:03 smithi044 ceph-mon[34369]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:03 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/615088161' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.899+0000 7fb9dc870640 1 -- 172.21.15.38:0/2193121823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 msgr2=0x7fb9d8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.899+0000 7fb9dc870640 1 --2- 172.21.15.38:0/2193121823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8102ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009900 tx=0x7fb9c802a410 comp rx=0 tx=0).stop 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 -- 172.21.15.38:0/2193121823 shutdown_connections 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 --2- 172.21.15.38:0/2193121823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d8108d20 0x7fb9d810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 --2- 172.21.15.38:0/2193121823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d81083d0 0x7fb9d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 --2- 172.21.15.38:0/2193121823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8102ef0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 -- 172.21.15.38:0/2193121823 >> 172.21.15.38:0/2193121823 conn(0x7fb9d8079760 msgr2=0x7fb9d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 -- 172.21.15.38:0/2193121823 shutdown_connections 2024-09-21T06:17:03.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 -- 172.21.15.38:0/2193121823 wait complete. 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.900+0000 7fb9dc870640 1 Processor -- start 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 -- start start 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d81083d0 0x7fb9d8199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d8108d20 0x7fb9d819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8112ad0 con 0x7fb9d8102ae0 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8112950 con 0x7fb9d8108d20 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9dc870640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8112c50 con 0x7fb9d81083d0 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41866/0 (socket says 172.21.15.38:41866) 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 -- 172.21.15.38:0/316199151 learned_addr learned my addr 172.21.15.38:0/316199151 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d6d9d640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d8108d20 0x7fb9d819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d5d9b640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d81083d0 0x7fb9d8199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 -- 172.21.15.38:0/316199151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d81083d0 msgr2=0x7fb9d8199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d81083d0 0x7fb9d8199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 -- 172.21.15.38:0/316199151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d8108d20 msgr2=0x7fb9d819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d8108d20 0x7fb9d819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.901+0000 7fb9d659c640 1 -- 172.21.15.38:0/316199151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d819f3d0 con 0x7fb9d8102ae0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9d659c640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8005ab0 tx=0x7fb9c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c803f030 con 0x7fb9d8102ae0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d819f660 con 0x7fb9d8102ae0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9c8003cd0 con 0x7fb9d8102ae0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8035070 con 0x7fb9d8102ae0 2024-09-21T06:17:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.902+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d806bb40 con 0x7fb9d8102ae0 2024-09-21T06:17:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.903+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d8103d10 con 0x7fb9d8102ae0 2024-09-21T06:17:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.904+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb9c8042030 con 0x7fb9d8102ae0 2024-09-21T06:17:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.905+0000 7fb9c77fe640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 0x7fb9c00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.905+0000 7fb9d5d9b640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 0x7fb9c00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.905+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb9c81074c0 con 0x7fb9d8102ae0 2024-09-21T06:17:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.906+0000 7fb9d5d9b640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 0x7fb9c00b8a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8100cc0 tx=0x7fb9cc009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:03.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:03.910+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9c80d2460 con 0x7fb9d8102ae0 2024-09-21T06:17:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.095+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9d806c620 con 0x7fb9d8102ae0 2024-09-21T06:17:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.096+0000 7fb9c77fe640 1 -- 172.21.15.38:0/316199151 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fb9c80d73a0 con 0x7fb9d8102ae0 2024-09-21T06:17:04.098 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 msgr2=0x7fb9c00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 0x7fb9c00b8a70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8100cc0 tx=0x7fb9cc009680 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 msgr2=0x7fb9d8199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8005ab0 tx=0x7fb9c80042f0 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 shutdown_connections 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9c00b6560 0x7fb9c00b8a70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d8108d20 0x7fb9d819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb9d81083d0 0x7fb9d8199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 --2- 172.21.15.38:0/316199151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb9d8102ae0 0x7fb9d8199460 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 >> 172.21.15.38:0/316199151 conn(0x7fb9d8079760 msgr2=0x7fb9d8101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 shutdown_connections 2024-09-21T06:17:04.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:04.098+0000 7fb9dc870640 1 -- 172.21.15.38:0/316199151 wait complete. 2024-09-21T06:17:04.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:04 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/316199151' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:17:04.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:04 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/316199151' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:17:04.708 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:04 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/316199151' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:17:04.736 INFO:tasks.cephadm:Adding mds.a on smithi038 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.d on smithi038 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.g on smithi038 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.j on smithi038 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.b on smithi044 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.e on smithi044 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.h on smithi044 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.k on smithi044 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.c on smithi174 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.f on smithi174 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.i on smithi174 2024-09-21T06:17:04.737 INFO:tasks.cephadm:Adding mds.l on smithi174 2024-09-21T06:17:04.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l' 2024-09-21T06:17:04.996 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:17:05.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:05 smithi174 ceph-mon[34815]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:05.458 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 -- 172.21.15.174:0/1411794835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 msgr2=0x7f4ca4109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:05.458 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/1411794835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca4109900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009900 tx=0x7f4c9802a410 comp rx=0 tx=0).stop 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 -- 172.21.15.174:0/1411794835 shutdown_connections 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/1411794835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4109e40 0x7f4ca4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/1411794835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca4109900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/1411794835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4103bb0 0x7f4ca4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 -- 172.21.15.174:0/1411794835 >> 172.21.15.174:0/1411794835 conn(0x7f4ca40ff600 msgr2=0x7f4ca4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 -- 172.21.15.174:0/1411794835 shutdown_connections 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 -- 172.21.15.174:0/1411794835 wait complete. 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.452+0000 7f4ca9c52640 1 Processor -- start 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 -- start start 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4103bb0 0x7f4ca419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:05.459 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 0x7f4ca419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4113c60 con 0x7f4ca4103bb0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4113ae0 con 0x7f4ca4109e40 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca9c52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4113de0 con 0x7f4ca41094f0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42084/0 (socket says 172.21.15.174:42084) 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 -- 172.21.15.174:0/3950036206 learned_addr learned my addr 172.21.15.174:0/3950036206 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca3fff640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 0x7f4ca419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 -- 172.21.15.174:0/3950036206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 msgr2=0x7f4ca419fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 0x7f4ca419fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca37fe640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4103bb0 0x7f4ca419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 -- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4103bb0 msgr2=0x7f4ca419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4103bb0 0x7f4ca419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca2ffd640 1 -- 172.21.15.174:0/3950036206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca41a0580 con 0x7f4ca41094f0 2024-09-21T06:17:05.460 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.453+0000 7f4ca3fff640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 0x7f4ca419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca2ffd640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005940 tx=0x7f4c980042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9803f030 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c98031910 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98035070 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca41a0810 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.454+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca41a6fd0 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.455+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca4103fc0 con 0x7f4ca41094f0 2024-09-21T06:17:05.461 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.457+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4c98042030 con 0x7f4ca41094f0 2024-09-21T06:17:05.462 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.457+0000 7f4ca0ff9640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 0x7f4c8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:05.462 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.457+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f4c981077c0 con 0x7f4ca41094f0 2024-09-21T06:17:05.462 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.458+0000 7f4ca37fe640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 0x7f4c8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:05.462 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.458+0000 7f4ca37fe640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 0x7f4c8c0b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:05.462 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.460+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c980ce420 con 0x7f4ca41094f0 2024-09-21T06:17:05.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.647+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}) -- 0x7f4ca4063800 con 0x7f4c8c0b6560 2024-09-21T06:17:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:05 smithi044 ceph-mon[34369]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:05.659 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.657+0000 7f4ca0ff9640 1 -- 172.21.15.174:0/3950036206 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f4ca4063800 con 0x7f4c8c0b6560 2024-09-21T06:17:05.659 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mds.all update... 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 msgr2=0x7f4c8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 0x7f4c8c0b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94005850 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 msgr2=0x7f4ca419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005940 tx=0x7f4c980042f0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 shutdown_connections 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c8c0b6560 0x7f4c8c0b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ca4109e40 0x7f4ca419fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ca41094f0 0x7f4ca419abb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 --2- 172.21.15.174:0/3950036206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ca4103bb0 0x7f4ca419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 >> 172.21.15.174:0/3950036206 conn(0x7f4ca40ff600 msgr2=0x7f4ca4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:05.662 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 shutdown_connections 2024-09-21T06:17:05.663 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T06:17:05.660+0000 7f4ca9c52640 1 -- 172.21.15.174:0/3950036206 wait complete. 2024-09-21T06:17:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:05 smithi038 ceph-mon[31215]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:06.357 DEBUG:teuthology.orchestra.run.smithi038:mds.a> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T06:17:06.360 DEBUG:teuthology.orchestra.run.smithi038:mds.d> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T06:17:06.402 DEBUG:teuthology.orchestra.run.smithi038:mds.g> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T06:17:06.445 DEBUG:teuthology.orchestra.run.smithi038:mds.j> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T06:17:06.488 DEBUG:teuthology.orchestra.run.smithi044:mds.b> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T06:17:06.491 DEBUG:teuthology.orchestra.run.smithi044:mds.e> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T06:17:06.533 DEBUG:teuthology.orchestra.run.smithi044:mds.h> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T06:17:06.576 DEBUG:teuthology.orchestra.run.smithi044:mds.k> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T06:17:06.619 DEBUG:teuthology.orchestra.run.smithi174:mds.c> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T06:17:06.621 DEBUG:teuthology.orchestra.run.smithi174:mds.f> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T06:17:06.664 DEBUG:teuthology.orchestra.run.smithi174:mds.i> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T06:17:06.707 DEBUG:teuthology.orchestra.run.smithi174:mds.l> sudo journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T06:17:06.750 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T06:17:06.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:06.769 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.770 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:06 smithi174 ceph-mon[34815]: Deploying daemon mds.l on smithi174 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:06.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:06.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:06 smithi044 ceph-mon[34369]: Deploying daemon mds.l on smithi174 2024-09-21T06:17:06.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:06.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:17:06.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: Saving service mds.all spec with placement smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T06:17:06.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:06.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:06 smithi038 ceph-mon[31215]: Deploying daemon mds.l on smithi174 2024-09-21T06:17:07.008 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 -- 172.21.15.38:0/2256302886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3518102a80 msgr2=0x7f3518102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 --2- 172.21.15.38:0/2256302886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3518102a80 0x7f3518102e90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3508009900 tx=0x7f350802a410 comp rx=0 tx=0).stop 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 -- 172.21.15.38:0/2256302886 shutdown_connections 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 --2- 172.21.15.38:0/2256302886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518108d10 0x7f351810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 --2- 172.21.15.38:0/2256302886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35181083c0 0x7f35181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 --2- 172.21.15.38:0/2256302886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3518102a80 0x7f3518102e90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 -- 172.21.15.38:0/2256302886 >> 172.21.15.38:0/2256302886 conn(0x7f3518079740 msgr2=0x7f3518079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 -- 172.21.15.38:0/2256302886 shutdown_connections 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.460+0000 7f351da80640 1 -- 172.21.15.38:0/2256302886 wait complete. 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 Processor -- start 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 -- start start 2024-09-21T06:17:07.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 0x7f351819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3518108d10 0x7f351819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3518113bd0 con 0x7f35181083c0 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3518113a50 con 0x7f3518102a80 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f351da80640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3518113d50 con 0x7f3518108d10 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f3516ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41884/0 (socket says 172.21.15.38:41884) 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.461+0000 7f3516ffd640 1 -- 172.21.15.38:0/3509853034 learned_addr learned my addr 172.21.15.38:0/3509853034 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f35177fe640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 0x7f351819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3517fff640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3518108d10 0x7f351819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 -- 172.21.15.38:0/3509853034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3518108d10 msgr2=0x7f351819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3518108d10 0x7f351819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 -- 172.21.15.38:0/3509853034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 msgr2=0x7f351819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:07.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 0x7f351819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 -- 172.21.15.38:0/3509853034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35181a0510 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f35177fe640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 0x7f351819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3516ffd640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f350c00d740 tx=0x7f350c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c017070 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f350c00de50 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35181a0800 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c004d90 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.462+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35181a6f60 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.463+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3518103d00 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.465+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f350c004f30 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.466+0000 7f3514ff9640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 0x7f35000b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.466+0000 7f35177fe640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 0x7f35000b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.466+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f350c0e6df0 con 0x7f35181083c0 2024-09-21T06:17:07.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.466+0000 7f35177fe640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 0x7f35000b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3508005ab0 tx=0x7f3508005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:07.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.470+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f350c0ada30 con 0x7f35181083c0 2024-09-21T06:17:07.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.696+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3518102e90 con 0x7f35181083c0 2024-09-21T06:17:07.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.697+0000 7f3514ff9640 1 -- 172.21.15.38:0/3509853034 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3518102e90 con 0x7f35181083c0 2024-09-21T06:17:07.699 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:07.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":1,"btime":"2024-09-21T06:09:10:509012+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T06:17:07.699 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 1 2024-09-21T06:17:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 msgr2=0x7f35000b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 0x7f35000b8af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3508005ab0 tx=0x7f3508005a20 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 msgr2=0x7f351819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f350c00d740 tx=0x7f350c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 shutdown_connections 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f35000b65e0 0x7f35000b8af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3518108d10 0x7f351819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35181083c0 0x7f351819ab40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 --2- 172.21.15.38:0/3509853034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3518102a80 0x7f351819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 >> 172.21.15.38:0/3509853034 conn(0x7f3518079740 msgr2=0x7f3518101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 shutdown_connections 2024-09-21T06:17:07.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:07.699+0000 7f351da80640 1 -- 172.21.15.38:0/3509853034 wait complete. 2024-09-21T06:17:08.094 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:07 smithi174 systemd[1]: Starting Ceph mds.l for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:08.367 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 podman[63183]: 2024-09-21 06:17:07.99545686 +0000 UTC m=+0.015704547 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:08.368 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 podman[63183]: 2024-09-21 06:17:08.095394808 +0000 UTC m=+0.115642524 container create bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:17:08.368 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 podman[63183]: 2024-09-21 06:17:08.331131435 +0000 UTC m=+0.351379109 container init bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:17:08.368 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 podman[63183]: 2024-09-21 06:17:08.334001803 +0000 UTC m=+0.354249487 container start bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:17:08.644 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mds[63202]: -- 172.21.15.174:0/1432869278 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610079a3860 con 0x56100bb4ba80 2024-09-21T06:17:08.645 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l[63198]: starting mds.l at 2024-09-21T06:17:08.645 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 bash[63183]: bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 2024-09-21T06:17:08.645 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:17:08 smithi174 systemd[1]: Started Ceph mds.l for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:08.922 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3509853034' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6832/2480120484,v1:172.21.15.174:6833/2480120484] up:boot 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: fsmap 1 up:standby 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:08.923 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:08 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3509853034' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6832/2480120484,v1:172.21.15.174:6833/2480120484] up:boot 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: fsmap 1 up:standby 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:08.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:08.988 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:08 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3509853034' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6832/2480120484,v1:172.21.15.174:6833/2480120484] up:boot 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: fsmap 1 up:standby 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:08 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:09.925 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:09 smithi044 ceph-mon[34369]: Deploying daemon mds.k on smithi044 2024-09-21T06:17:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:09 smithi038 ceph-mon[31215]: Deploying daemon mds.k on smithi044 2024-09-21T06:17:10.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:09 smithi174 ceph-mon[34815]: Deploying daemon mds.k on smithi044 2024-09-21T06:17:10.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:10.598 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:10.655 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:10 smithi044 systemd[1]: Starting Ceph mds.k for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:10.985 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:10 smithi038 ceph-mon[31215]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:10.991 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:10 smithi044 ceph-mon[34369]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:10.992 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:10 smithi044 podman[62394]: 2024-09-21 06:17:10.628689264 +0000 UTC m=+0.015939383 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:10.992 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:10 smithi044 podman[62394]: 2024-09-21 06:17:10.738019491 +0000 UTC m=+0.125269606 container create 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:17:10.992 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:10 smithi044 podman[62394]: 2024-09-21 06:17:10.990672435 +0000 UTC m=+0.377922550 container init 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:17:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 -- 172.21.15.38:0/2544977294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 msgr2=0x7f2a401087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 --2- 172.21.15.38:0/2544977294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a401087b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009900 tx=0x7f2a3402a410 comp rx=0 tx=0).stop 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 -- 172.21.15.38:0/2544977294 shutdown_connections 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 --2- 172.21.15.38:0/2544977294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 0x7f2a4010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 --2- 172.21.15.38:0/2544977294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a401087b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 --2- 172.21.15.38:0/2544977294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 0x7f2a40102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 -- 172.21.15.38:0/2544977294 >> 172.21.15.38:0/2544977294 conn(0x7f2a40079730 msgr2=0x7f2a40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 -- 172.21.15.38:0/2544977294 shutdown_connections 2024-09-21T06:17:11.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.001+0000 7f2a4593e640 1 -- 172.21.15.38:0/2544977294 wait complete. 2024-09-21T06:17:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 Processor -- start 2024-09-21T06:17:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 -- start start 2024-09-21T06:17:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 0x7f2a4019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 0x7f2a4019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.002+0000 7f2a4593e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2a40112a80 con 0x7f2a401083a0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4593e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a40112900 con 0x7f2a40108cf0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4593e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a40112c00 con 0x7f2a40102a60 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52902/0 (socket says 172.21.15.38:52902) 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 -- 172.21.15.38:0/4128916455 learned_addr learned my addr 172.21.15.38:0/4128916455 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3f7fe640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 0x7f2a4019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3effd640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 0x7f2a4019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 -- 172.21.15.38:0/4128916455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 msgr2=0x7f2a4019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 0x7f2a4019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 -- 172.21.15.38:0/4128916455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 msgr2=0x7f2a4019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 0x7f2a4019be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 -- 172.21.15.38:0/4128916455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a401a6610 con 0x7f2a401083a0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a3e7fc640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005940 tx=0x7f2a340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3403f030 con 0x7f2a401083a0 2024-09-21T06:17:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a401a68a0 con 0x7f2a401083a0 2024-09-21T06:17:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a340318f0 con 0x7f2a401083a0 2024-09-21T06:17:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34035070 con 0x7f2a401083a0 2024-09-21T06:17:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.003+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a401a6dd0 con 0x7f2a401083a0 2024-09-21T06:17:11.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.004+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a40102e70 con 0x7f2a401083a0 2024-09-21T06:17:11.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.006+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2a34042030 con 0x7f2a401083a0 2024-09-21T06:17:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.007+0000 7f2a4493c640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 0x7f2a280b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.007+0000 7f2a3effd640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 0x7f2a280b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.007+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f2a34107780 con 0x7f2a401083a0 2024-09-21T06:17:11.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.008+0000 7f2a3effd640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 0x7f2a280b8b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005e10 tx=0x7f2a30005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:11.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.010+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a340ce3e0 con 0x7f2a401083a0 2024-09-21T06:17:11.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:10 smithi174 ceph-mon[34815]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:11.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.249+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a4006b270 con 0x7f2a401083a0 2024-09-21T06:17:11.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.250+0000 7f2a4493c640 1 -- 172.21.15.38:0/4128916455 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f2a340d27c0 con 0x7f2a401083a0 2024-09-21T06:17:11.252 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:11.252 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":2,"btime":"2024-09-21T06:17:08:372299+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:17:11.252 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 2 2024-09-21T06:17:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 msgr2=0x7f2a280b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 0x7f2a280b8b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005e10 tx=0x7f2a30005da0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 msgr2=0x7f2a4019b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005940 tx=0x7f2a340042f0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 shutdown_connections 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a280b6610 0x7f2a280b8b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a40108cf0 0x7f2a4019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.252+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a401083a0 0x7f2a4019b950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.253+0000 7f2a4593e640 1 --2- 172.21.15.38:0/4128916455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a40102a60 0x7f2a4019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.253+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 >> 172.21.15.38:0/4128916455 conn(0x7f2a40079730 msgr2=0x7f2a40104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.253+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 shutdown_connections 2024-09-21T06:17:11.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:11.253+0000 7f2a4593e640 1 -- 172.21.15.38:0/4128916455 wait complete. 2024-09-21T06:17:11.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:10 smithi044 podman[62394]: 2024-09-21 06:17:10.993661888 +0000 UTC m=+0.380912009 container start 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:17:11.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:11 smithi044 ceph-mds[62413]: -- 172.21.15.44:0/3798449187 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577a9b91860 con 0x5577add39a80 2024-09-21T06:17:11.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: starting mds.k at 2024-09-21T06:17:11.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:11 smithi044 bash[62394]: 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 2024-09-21T06:17:11.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:17:11 smithi044 systemd[1]: Started Ceph mds.k for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:12.368 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: Deploying daemon mds.j on smithi038 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4128916455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6832/3742968843,v1:172.21.15.44:6833/3742968843] up:boot 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: fsmap 2 up:standby 2024-09-21T06:17:12.369 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: Deploying daemon mds.j on smithi038 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4128916455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6832/3742968843,v1:172.21.15.44:6833/3742968843] up:boot 2024-09-21T06:17:12.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: fsmap 2 up:standby 2024-09-21T06:17:12.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: Deploying daemon mds.j on smithi038 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4128916455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6832/3742968843,v1:172.21.15.44:6833/3742968843] up:boot 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: fsmap 2 up:standby 2024-09-21T06:17:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:17:13.276 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:13 smithi038 ceph-mon[31215]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:13 smithi174 ceph-mon[34815]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:13 smithi044 ceph-mon[34369]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:13.704 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 systemd[1]: Starting Ceph mds.j for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:13.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:13.956 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 podman[72439]: 2024-09-21 06:17:13.606350501 +0000 UTC m=+0.016637668 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:13.956 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 podman[72439]: 2024-09-21 06:17:13.723818866 +0000 UTC m=+0.134106009 container create 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:17:13.956 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 podman[72439]: 2024-09-21 06:17:13.917792565 +0000 UTC m=+0.328079711 container init 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:17:13.956 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 podman[72439]: 2024-09-21 06:17:13.920688369 +0000 UTC m=+0.330975512 container start 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:17:14.194 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:14.236 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 ceph-mds[72458]: -- 172.21.15.38:0/302718101 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607b7279c20 con 0x5607bb421a80 2024-09-21T06:17:14.236 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j[72454]: starting mds.j at 2024-09-21T06:17:14.236 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:14 smithi038 bash[72439]: 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 2024-09-21T06:17:14.236 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:17:14 smithi038 systemd[1]: Started Ceph mds.j for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 -- 172.21.15.38:0/3804416437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 msgr2=0x7f3d0c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 --2- 172.21.15.38:0/3804416437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c103f90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009900 tx=0x7f3cfc02a410 comp rx=0 tx=0).stop 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 -- 172.21.15.38:0/3804416437 shutdown_connections 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 --2- 172.21.15.38:0/3804416437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c109e10 0x7f3d0c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 --2- 172.21.15.38:0/3804416437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 --2- 172.21.15.38:0/3804416437 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c103f90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 -- 172.21.15.38:0/3804416437 >> 172.21.15.38:0/3804416437 conn(0x7f3d0c0ff610 msgr2=0x7f3d0c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 -- 172.21.15.38:0/3804416437 shutdown_connections 2024-09-21T06:17:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.666+0000 7f3d12946640 1 -- 172.21.15.38:0/3804416437 wait complete. 2024-09-21T06:17:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.667+0000 7f3d12946640 1 Processor -- start 2024-09-21T06:17:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.667+0000 7f3d12946640 1 -- start start 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c109e10 0x7f3d0c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c113c10 con 0x7f3d0c103b80 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c113a90 con 0x7f3d0c1094c0 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d12946640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c113d90 con 0x7f3d0c109e10 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52940/0 (socket says 172.21.15.38:52940) 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0bfff640 1 -- 172.21.15.38:0/3678061997 learned_addr learned my addr 172.21.15.38:0/3678061997 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d10ee3640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c109e10 0x7f3d0c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 -- 172.21.15.38:0/3678061997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c109e10 msgr2=0x7f3d0c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c109e10 0x7f3d0c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 -- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 msgr2=0x7f3d0c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0b7fe640 1 -- 172.21.15.38:0/3678061997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c1a0510 con 0x7f3d0c1094c0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.668+0000 7f3d0bfff640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d0b7fe640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c19ab40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06c970 tx=0x7f3cf400dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4017070 con 0x7f3d0c1094c0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c1a0800 con 0x7f3d0c1094c0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cf40099a0 con 0x7f3d0c1094c0 2024-09-21T06:17:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40047a0 con 0x7f3d0c1094c0 2024-09-21T06:17:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.669+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c0755f0 con 0x7f3d0c1094c0 2024-09-21T06:17:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.670+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d0c104e00 con 0x7f3d0c1094c0 2024-09-21T06:17:14.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.672+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3cf4009b50 con 0x7f3d0c1094c0 2024-09-21T06:17:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.673+0000 7f3d097fa640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 0x7f3cf80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.673+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f3cf40e6fe0 con 0x7f3d0c1094c0 2024-09-21T06:17:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.673+0000 7f3d0bfff640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 0x7f3cf80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.674+0000 7f3d0bfff640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 0x7f3cf80b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0096c0 tx=0x7f3cfc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.676+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3cf4020020 con 0x7f3d0c1094c0 2024-09-21T06:17:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.922+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d0c10bc40 con 0x7f3d0c1094c0 2024-09-21T06:17:14.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.923+0000 7f3d097fa640 1 -- 172.21.15.38:0/3678061997 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f3cf40adc00 con 0x7f3d0c1094c0 2024-09-21T06:17:14.925 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:14.925 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":4,"btime":"2024-09-21T06:17:14:199715+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T06:17:14.925 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 4 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 msgr2=0x7f3cf80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 0x7f3cf80b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0096c0 tx=0x7f3cfc005a20 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 msgr2=0x7f3d0c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c19ab40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06c970 tx=0x7f3cf400dbb0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 shutdown_connections 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cf80b6560 0x7f3cf80b8a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d0c109e10 0x7f3d0c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d0c1094c0 0x7f3d0c19ab40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 --2- 172.21.15.38:0/3678061997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d0c103b80 0x7f3d0c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 >> 172.21.15.38:0/3678061997 conn(0x7f3d0c0ff610 msgr2=0x7f3d0c108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 shutdown_connections 2024-09-21T06:17:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:14.926+0000 7f3d12946640 1 -- 172.21.15.38:0/3678061997 wait complete. 2024-09-21T06:17:15.226 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:15.226 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.226 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: Deploying daemon mds.d on smithi038 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.38:6834/1987897049,v1:172.21.15.38:6835/1987897049] up:boot 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: fsmap 3 up:standby 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:17:15.227 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:15 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3678061997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: Deploying daemon mds.d on smithi038 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.38:6834/1987897049,v1:172.21.15.38:6835/1987897049] up:boot 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: fsmap 3 up:standby 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:17:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:15 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3678061997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: Deploying daemon mds.d on smithi038 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.38:6834/1987897049,v1:172.21.15.38:6835/1987897049] up:boot 2024-09-21T06:17:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: fsmap 3 up:standby 2024-09-21T06:17:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:17:15.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:15 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3678061997' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:16.633 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:16 smithi038 systemd[1]: Starting Ceph mds.d for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:16.986 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:16 smithi038 podman[72823]: 2024-09-21 06:17:16.750902302 +0000 UTC m=+0.016393255 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:16.987 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:16 smithi038 podman[72823]: 2024-09-21 06:17:16.860127413 +0000 UTC m=+0.125618414 container create 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:17 smithi038 ceph-mon[31215]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 podman[72823]: 2024-09-21 06:17:17.16018729 +0000 UTC m=+0.425678243 container init 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 podman[72823]: 2024-09-21 06:17:17.163298068 +0000 UTC m=+0.428789021 container start 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 ceph-mds[72841]: -- 172.21.15.38:0/1306204373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8f110fc20 con 0x55f8f52b7180 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d[72837]: starting mds.d at 2024-09-21T06:17:17.243 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 bash[72823]: 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 2024-09-21T06:17:17.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:17 smithi174 ceph-mon[34815]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:17.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:17 smithi044 ceph-mon[34369]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:17.736 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:17:17 smithi038 systemd[1]: Started Ceph mds.d for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:18.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: Deploying daemon mds.e on smithi044 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.38:6836/2771020933,v1:172.21.15.38:6837/2771020933] up:boot 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: fsmap 4 up:standby 2024-09-21T06:17:18.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:18 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:17:18.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: Deploying daemon mds.e on smithi044 2024-09-21T06:17:18.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.38:6836/2771020933,v1:172.21.15.38:6837/2771020933] up:boot 2024-09-21T06:17:18.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: fsmap 4 up:standby 2024-09-21T06:17:18.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:18 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:17:18.679 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.679 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: Deploying daemon mds.e on smithi044 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.38:6836/2771020933,v1:172.21.15.38:6837/2771020933] up:boot 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: fsmap 4 up:standby 2024-09-21T06:17:18.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:18 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:17:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 -- 172.21.15.38:0/220045308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c1083a0 msgr2=0x7fd79c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/220045308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c1083a0 0x7fd79c1087b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd784009900 tx=0x7fd78402a410 comp rx=0 tx=0).stop 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 -- 172.21.15.38:0/220045308 shutdown_connections 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/220045308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c108cf0 0x7fd79c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/220045308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c1083a0 0x7fd79c1087b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/220045308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 0x7fd79c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 -- 172.21.15.38:0/220045308 >> 172.21.15.38:0/220045308 conn(0x7fd79c079730 msgr2=0x7fd79c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 -- 172.21.15.38:0/220045308 shutdown_connections 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.394+0000 7fd7a31b6640 1 -- 172.21.15.38:0/220045308 wait complete. 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.395+0000 7fd7a31b6640 1 Processor -- start 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.395+0000 7fd7a31b6640 1 -- start start 2024-09-21T06:17:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 0x7fd79c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c1083a0 0x7fd79c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c113bd0 con 0x7fd79c108cf0 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c113a50 con 0x7fd79c102a60 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a31b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c113d50 con 0x7fd79c1083a0 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40090/0 (socket says 172.21.15.38:40090) 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 -- 172.21.15.38:0/200231389 learned_addr learned my addr 172.21.15.38:0/200231389 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd79bfff640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c1083a0 0x7fd79c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a0f52640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 0x7fd79c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 -- 172.21.15.38:0/200231389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c1083a0 msgr2=0x7fd79c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c1083a0 0x7fd79c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 -- 172.21.15.38:0/200231389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 msgr2=0x7fd79c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 0x7fd79c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 -- 172.21.15.38:0/200231389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c1a0550 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.396+0000 7fd7a1753640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd79400eaa0 tx=0x7fd79400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.397+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cdb0 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.397+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd794005020 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.397+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c1a0840 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.397+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7940116d0 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.397+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c1a6fa0 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.398+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79c102e70 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.399+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fd7940051d0 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.400+0000 7fd799ffb640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 0x7fd7880b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.400+0000 7fd7a0f52640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 0x7fd7880b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.400+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fd7940e7500 con 0x7fd79c108cf0 2024-09-21T06:17:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.401+0000 7fd7a0f52640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 0x7fd7880b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009bd0 tx=0x7fd78c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:19 smithi044 ceph-mon[34369]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.403+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd794016030 con 0x7fd79c108cf0 2024-09-21T06:17:19.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.630+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd79c19b710 con 0x7fd79c108cf0 2024-09-21T06:17:19.632 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:19 smithi038 ceph-mon[31215]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:19.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.631+0000 7fd799ffb640 1 -- 172.21.15.38:0/200231389 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fd79c19b710 con 0x7fd79c108cf0 2024-09-21T06:17:19.633 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:19.633 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"btime":"2024-09-21T06:17:18:068287+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T06:17:19.633 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 5 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 msgr2=0x7fd7880b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 0x7fd7880b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009bd0 tx=0x7fd78c005f90 comp rx=0 tx=0).stop 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 msgr2=0x7fd79c19fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd79400eaa0 tx=0x7fd79400ef60 comp rx=0 tx=0).stop 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 shutdown_connections 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7880b6560 0x7fd7880b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd79c108cf0 0x7fd79c19fe20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c1083a0 0x7fd79c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 --2- 172.21.15.38:0/200231389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79c102a60 0x7fd79c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.633+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 >> 172.21.15.38:0/200231389 conn(0x7fd79c079730 msgr2=0x7fd79c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.634+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 shutdown_connections 2024-09-21T06:17:19.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:19.634+0000 7fd7a31b6640 1 -- 172.21.15.38:0/200231389 wait complete. 2024-09-21T06:17:19.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:19 smithi174 ceph-mon[34815]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:19.732 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 podman[62675]: 2024-09-21 06:17:19.727842137 +0000 UTC m=+0.360665192 container init f38fd373386fe497a81f2939170f46dd5b36e41e9d14fbcbc7398832ebea4433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T06:17:19.732 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 podman[62675]: 2024-09-21 06:17:19.731081704 +0000 UTC m=+0.363904757 container start f38fd373386fe497a81f2939170f46dd5b36e41e9d14fbcbc7398832ebea4433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T06:17:20.155 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 ceph-mds[62695]: -- 172.21.15.44:0/3449031 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629304c1860 con 0x562934669180 2024-09-21T06:17:20.155 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: starting mds.e at 2024-09-21T06:17:20.155 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 bash[62675]: f38fd373386fe497a81f2939170f46dd5b36e41e9d14fbcbc7398832ebea4433 2024-09-21T06:17:20.155 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:17:19 smithi044 systemd[1]: Started Ceph mds.e for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/200231389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:20.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:20 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/200231389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:20.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:20 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/200231389' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:20.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:20.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:20 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:21 smithi174 ceph-mon[34815]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:21 smithi174 ceph-mon[34815]: Deploying daemon mds.f on smithi174 2024-09-21T06:17:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:21 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6834/3535582137,v1:172.21.15.44:6835/3535582137] up:boot 2024-09-21T06:17:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:21 smithi174 ceph-mon[34815]: fsmap 5 up:standby 2024-09-21T06:17:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:21 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:17:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:21 smithi044 ceph-mon[34369]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:21 smithi044 ceph-mon[34369]: Deploying daemon mds.f on smithi174 2024-09-21T06:17:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:21 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6834/3535582137,v1:172.21.15.44:6835/3535582137] up:boot 2024-09-21T06:17:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:21 smithi044 ceph-mon[34369]: fsmap 5 up:standby 2024-09-21T06:17:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:21 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:17:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:21 smithi038 ceph-mon[31215]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:21 smithi038 ceph-mon[31215]: Deploying daemon mds.f on smithi174 2024-09-21T06:17:21.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:21 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6834/3535582137,v1:172.21.15.44:6835/3535582137] up:boot 2024-09-21T06:17:21.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:21 smithi038 ceph-mon[31215]: fsmap 5 up:standby 2024-09-21T06:17:21.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:21 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:17:22.080 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:21 smithi174 systemd[1]: Starting Ceph mds.f for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:22.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:22.366 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 podman[63450]: 2024-09-21 06:17:21.981412186 +0000 UTC m=+0.015901400 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:22.366 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 podman[63450]: 2024-09-21 06:17:22.104137127 +0000 UTC m=+0.138626328 container create 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:17:22.366 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 podman[63450]: 2024-09-21 06:17:22.36509012 +0000 UTC m=+0.399579321 container init 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:17:22.592 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:22.644 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 podman[63450]: 2024-09-21 06:17:22.36792912 +0000 UTC m=+0.402418321 container start 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T06:17:22.645 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 ceph-mds[63469]: -- 172.21.15.174:0/1453712801 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e5fd47860 con 0x563e63eef600 2024-09-21T06:17:22.645 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f[63465]: starting mds.f at 2024-09-21T06:17:22.645 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 bash[63450]: 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b 2024-09-21T06:17:22.645 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:17:22 smithi174 systemd[1]: Started Ceph mds.f for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 -- 172.21.15.38:0/3474980457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 msgr2=0x7f811c112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 --2- 172.21.15.38:0/3474980457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c112620 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8114009ca0 tx=0x7f811402a950 comp rx=0 tx=0).stop 2024-09-21T06:17:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 -- 172.21.15.38:0/3474980457 shutdown_connections 2024-09-21T06:17:23.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 --2- 172.21.15.38:0/3474980457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c112620 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 --2- 172.21.15.38:0/3474980457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 --2- 172.21.15.38:0/3474980457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 0x7f811c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 -- 172.21.15.38:0/3474980457 >> 172.21.15.38:0/3474980457 conn(0x7f811c079760 msgr2=0x7f811c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.077+0000 7f8123c92640 1 -- 172.21.15.38:0/3474980457 shutdown_connections 2024-09-21T06:17:23.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.078+0000 7f8123c92640 1 -- 172.21.15.38:0/3474980457 wait complete. 2024-09-21T06:17:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 Processor -- start 2024-09-21T06:17:23.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 -- start start 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 0x7f811c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f811c115e10 con 0x7f811c110200 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f811c115c90 con 0x7f811c102fa0 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8123c92640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f811c115f90 con 0x7f811c102650 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f812222f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f812222f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40108/0 (socket says 172.21.15.38:40108) 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f812222f640 1 -- 172.21.15.38:0/3888035300 learned_addr learned my addr 172.21.15.38:0/3888035300 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f8121a2e640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 0x7f811c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.079+0000 7f812122d640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 -- 172.21.15.38:0/3888035300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 msgr2=0x7f811c19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:23.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 0x7f811c19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 -- 172.21.15.38:0/3888035300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 msgr2=0x7f811c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 -- 172.21.15.38:0/3888035300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c1a2630 con 0x7f811c110200 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812122d640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f812222f640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8114009dc0 tx=0x7f8114003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114034040 con 0x7f811c110200 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f811402fdf0 con 0x7f811c110200 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1a28c0 con 0x7f811c110200 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114004830 con 0x7f811c110200 2024-09-21T06:17:23.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.080+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1a9080 con 0x7f811c110200 2024-09-21T06:17:23.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.081+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c06c1f0 con 0x7f811c110200 2024-09-21T06:17:23.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.083+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8114037020 con 0x7f811c110200 2024-09-21T06:17:23.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.084+0000 7f8112ffd640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 0x7f81080b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:23.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.084+0000 7f8121a2e640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 0x7f81080b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:23.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.084+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f8114107e10 con 0x7f811c110200 2024-09-21T06:17:23.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.085+0000 7f8121a2e640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 0x7f81080b8af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f811800bbe0 tx=0x7f811800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:23.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.087+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81140cea70 con 0x7f811c110200 2024-09-21T06:17:23.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.317+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f811c102a60 con 0x7f811c110200 2024-09-21T06:17:23.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.317+0000 7f8112ffd640 1 -- 172.21.15.38:0/3888035300 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f81140d2e50 con 0x7f811c110200 2024-09-21T06:17:23.319 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:23.319 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"btime":"2024-09-21T06:17:20:309201+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T06:17:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-09-21T06:17:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 msgr2=0x7f81080b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 0x7f81080b8af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f811800bbe0 tx=0x7f811800b390 comp rx=0 tx=0).stop 2024-09-21T06:17:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 msgr2=0x7f811c1a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8114009dc0 tx=0x7f8114003f10 comp rx=0 tx=0).stop 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 shutdown_connections 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81080b65e0 0x7f81080b8af0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c110200 0x7f811c1a1f00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c102fa0 0x7f811c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 --2- 172.21.15.38:0/3888035300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c102650 0x7f811c19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 >> 172.21.15.38:0/3888035300 conn(0x7f811c079760 msgr2=0x7f811c1114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 shutdown_connections 2024-09-21T06:17:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:23.320+0000 7f8123c92640 1 -- 172.21.15.38:0/3888035300 wait complete. 2024-09-21T06:17:23.598 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:23.598 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.598 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.598 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:23.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:23.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:23 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:23.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:23 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:23 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:24.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mon[34815]: Deploying daemon mds.c on smithi174 2024-09-21T06:17:24.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3888035300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:24.593 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6834/1766511458,v1:172.21.15.174:6835/1766511458] up:boot 2024-09-21T06:17:24.593 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mon[34815]: fsmap 6 up:standby 2024-09-21T06:17:24.593 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:17:24.593 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 systemd[1]: Starting Ceph mds.c for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:24.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:24 smithi044 ceph-mon[34369]: Deploying daemon mds.c on smithi174 2024-09-21T06:17:24.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:24 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3888035300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:24.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:24 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6834/1766511458,v1:172.21.15.174:6835/1766511458] up:boot 2024-09-21T06:17:24.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:24 smithi044 ceph-mon[34369]: fsmap 6 up:standby 2024-09-21T06:17:24.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:24 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:17:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:24 smithi038 ceph-mon[31215]: Deploying daemon mds.c on smithi174 2024-09-21T06:17:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:24 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3888035300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:24 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6834/1766511458,v1:172.21.15.174:6835/1766511458] up:boot 2024-09-21T06:17:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:24 smithi038 ceph-mon[31215]: fsmap 6 up:standby 2024-09-21T06:17:24.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:24 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:17:24.871 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 podman[63722]: 2024-09-21 06:17:24.493823508 +0000 UTC m=+0.015426733 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:24.871 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 podman[63722]: 2024-09-21 06:17:24.615991484 +0000 UTC m=+0.137594749 container create 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:17:24.872 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 podman[63722]: 2024-09-21 06:17:24.87050984 +0000 UTC m=+0.392113064 container init 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:17:25.144 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 podman[63722]: 2024-09-21 06:17:24.874126789 +0000 UTC m=+0.395730009 container start 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T06:17:25.145 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-mds[63741]: -- 172.21.15.174:0/433812418 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb72aed860 con 0x55fb76c95600 2024-09-21T06:17:25.145 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: starting mds.c at 2024-09-21T06:17:25.145 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 bash[63722]: 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 2024-09-21T06:17:25.145 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:17:24 smithi174 systemd[1]: Started Ceph mds.c for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:25 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:25.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:25.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.649 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:25.650 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:25.650 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:25 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:25.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:25 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:25.928 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:26.196 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:26.592 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:26 smithi038 ceph-mon[31215]: Deploying daemon mds.h on smithi044 2024-09-21T06:17:26.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:26 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6836/2784474374,v1:172.21.15.174:6837/2784474374] up:boot 2024-09-21T06:17:26.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:26 smithi038 ceph-mon[31215]: fsmap 7 up:standby 2024-09-21T06:17:26.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:26 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:17:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:26 smithi174 ceph-mon[34815]: Deploying daemon mds.h on smithi044 2024-09-21T06:17:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:26 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6836/2784474374,v1:172.21.15.174:6837/2784474374] up:boot 2024-09-21T06:17:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:26 smithi174 ceph-mon[34815]: fsmap 7 up:standby 2024-09-21T06:17:26.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:26 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:17:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:26 smithi044 ceph-mon[34369]: Deploying daemon mds.h on smithi044 2024-09-21T06:17:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:26 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6836/2784474374,v1:172.21.15.174:6837/2784474374] up:boot 2024-09-21T06:17:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:26 smithi044 ceph-mon[34369]: fsmap 7 up:standby 2024-09-21T06:17:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:26 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.682+0000 7f82626dd640 1 -- 172.21.15.38:0/3504252814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 msgr2=0x7f825c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 --2- 172.21.15.38:0/3504252814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c104de0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f824c009900 tx=0x7f824c02a410 comp rx=0 tx=0).stop 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 -- 172.21.15.38:0/3504252814 shutdown_connections 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 --2- 172.21.15.38:0/3504252814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 0x7f825c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 --2- 172.21.15.38:0/3504252814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 0x7f825c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 --2- 172.21.15.38:0/3504252814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c104de0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 -- 172.21.15.38:0/3504252814 >> 172.21.15.38:0/3504252814 conn(0x7f825c079740 msgr2=0x7f825c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 -- 172.21.15.38:0/3504252814 shutdown_connections 2024-09-21T06:17:26.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 -- 172.21.15.38:0/3504252814 wait complete. 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 Processor -- start 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.683+0000 7f82626dd640 1 -- start start 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 0x7f825c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 0x7f825c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f825c113bd0 con 0x7f825c1049d0 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f825c113a50 con 0x7f825c105320 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f82626dd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f825c113d50 con 0x7f825c10de30 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40116/0 (socket says 172.21.15.38:40116) 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 -- 172.21.15.38:0/566212636 learned_addr learned my addr 172.21.15.38:0/566212636 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:26.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825b7fe640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 0x7f825c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f8260c7a640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 0x7f825c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 -- 172.21.15.38:0/566212636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 msgr2=0x7f825c103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 0x7f825c103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 -- 172.21.15.38:0/566212636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 msgr2=0x7f825c102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 0x7f825c102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.684+0000 7f825bfff640 1 -- 172.21.15.38:0/566212636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c1a8980 con 0x7f825c1049d0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f825bfff640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824c005940 tx=0x7f824c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c03f030 con 0x7f825c1049d0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c1a8c10 con 0x7f825c1049d0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f824c031910 con 0x7f825c1049d0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c035070 con 0x7f825c1049d0 2024-09-21T06:17:26.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.685+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c1a9140 con 0x7f825c1049d0 2024-09-21T06:17:26.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.686+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825c104de0 con 0x7f825c1049d0 2024-09-21T06:17:26.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.689+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f824c042030 con 0x7f825c1049d0 2024-09-21T06:17:26.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.690+0000 7f82597fa640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 0x7f82440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:26.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.690+0000 7f825b7fe640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 0x7f82440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:26.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.690+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f824c1078c0 con 0x7f825c1049d0 2024-09-21T06:17:26.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.690+0000 7f825b7fe640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 0x7f82440b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f825c10fae0 tx=0x7f825000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:26.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.692+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f824c0d2860 con 0x7f825c1049d0 2024-09-21T06:17:26.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.920+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f825c103a10 con 0x7f825c1049d0 2024-09-21T06:17:26.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.921+0000 7f82597fa640 1 -- 172.21.15.38:0/566212636 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f824c0d77a0 con 0x7f825c1049d0 2024-09-21T06:17:26.924 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:26.924 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":8,"btime":"2024-09-21T06:17:25:327708+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T06:17:26.924 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 8 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 msgr2=0x7f82440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 0x7f82440b8a70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f825c10fae0 tx=0x7f825000b410 comp rx=0 tx=0).stop 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 msgr2=0x7f825c102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f824c005940 tx=0x7f824c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 shutdown_connections 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82440b6560 0x7f82440b8a70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f825c10de30 0x7f825c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f825c105320 0x7f825c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 --2- 172.21.15.38:0/566212636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f825c1049d0 0x7f825c102710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:26.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.923+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 >> 172.21.15.38:0/566212636 conn(0x7f825c079740 msgr2=0x7f825c1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:26.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.924+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 shutdown_connections 2024-09-21T06:17:26.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:26.924+0000 7f82626dd640 1 -- 172.21.15.38:0/566212636 wait complete. 2024-09-21T06:17:27.117 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:26 smithi044 systemd[1]: Starting Ceph mds.h for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:27.385 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:27 smithi044 ceph-mon[34369]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:27.385 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:27 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/566212636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:27.386 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 podman[62946]: 2024-09-21 06:17:27.018371266 +0000 UTC m=+0.015897019 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:27.386 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 podman[62946]: 2024-09-21 06:17:27.129282051 +0000 UTC m=+0.126807830 container create ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T06:17:27.386 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 podman[62946]: 2024-09-21 06:17:27.348158829 +0000 UTC m=+0.345684570 container init ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:17:27.386 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 podman[62946]: 2024-09-21 06:17:27.351178675 +0000 UTC m=+0.348704424 container start ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:17:27.386 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 ceph-mds[62965]: -- 172.21.15.44:0/1399145499 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8cbe71860 con 0x55c8d0019600 2024-09-21T06:17:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:27 smithi038 ceph-mon[31215]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:27.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:27 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/566212636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:27 smithi174 ceph-mon[34815]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:27 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/566212636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:27.654 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: starting mds.h at 2024-09-21T06:17:27.655 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 bash[62946]: ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f 2024-09-21T06:17:27.655 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:17:27 smithi044 systemd[1]: Started Ceph mds.h for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: Deploying daemon mds.i on smithi174 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:boot 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: fsmap 8 up:standby 2024-09-21T06:17:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:28 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:28.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: Deploying daemon mds.i on smithi174 2024-09-21T06:17:28.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:28.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:boot 2024-09-21T06:17:28.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: fsmap 8 up:standby 2024-09-21T06:17:28.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:28 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:17:28.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:28.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: Deploying daemon mds.i on smithi174 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:boot 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: fsmap 8 up:standby 2024-09-21T06:17:28.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:28 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:17:29.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:29.603 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 systemd[1]: Starting Ceph mds.i for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:29.844 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:29.882 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 podman[64009]: 2024-09-21 06:17:29.504823697 +0000 UTC m=+0.015719588 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:29.882 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 podman[64009]: 2024-09-21 06:17:29.628845097 +0000 UTC m=+0.139740996 container create f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T06:17:29.882 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 podman[64009]: 2024-09-21 06:17:29.881335492 +0000 UTC m=+0.392231383 container init f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:17:30.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 podman[64009]: 2024-09-21 06:17:29.884430524 +0000 UTC m=+0.395326424 container start f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T06:17:30.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 ceph-mds[64029]: -- 172.21.15.174:0/1968857054 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f5ff55860 con 0x563f640fda80 2024-09-21T06:17:30.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: starting mds.i at 2024-09-21T06:17:30.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 bash[64009]: f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 2024-09-21T06:17:30.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:17:29 smithi174 systemd[1]: Started Ceph mds.i for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 -- 172.21.15.38:0/2948763466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc108cf0 msgr2=0x7f79dc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 --2- 172.21.15.38:0/2948763466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc108cf0 0x7f79dc10f520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009ca0 tx=0x7f79d402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 -- 172.21.15.38:0/2948763466 shutdown_connections 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 --2- 172.21.15.38:0/2948763466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc108cf0 0x7f79dc10f520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 --2- 172.21.15.38:0/2948763466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc1083a0 0x7f79dc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 --2- 172.21.15.38:0/2948763466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc102a60 0x7f79dc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 -- 172.21.15.38:0/2948763466 >> 172.21.15.38:0/2948763466 conn(0x7f79dc079730 msgr2=0x7f79dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 -- 172.21.15.38:0/2948763466 shutdown_connections 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.325+0000 7f79e319a640 1 -- 172.21.15.38:0/2948763466 wait complete. 2024-09-21T06:17:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 Processor -- start 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 -- start start 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc1083a0 0x7f79dc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc108cf0 0x7f79dc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc112aa0 con 0x7f79dc102a60 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc112920 con 0x7f79dc108cf0 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e319a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc112c20 con 0x7f79dc1083a0 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.326+0000 7f79e0f36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58020/0 (socket says 172.21.15.38:58020) 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 -- 172.21.15.38:0/2071143336 learned_addr learned my addr 172.21.15.38:0/2071143336 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e1737640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc108cf0 0x7f79dc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79dbfff640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc1083a0 0x7f79dc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 -- 172.21.15.38:0/2071143336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc1083a0 msgr2=0x7f79dc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc1083a0 0x7f79dc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 -- 172.21.15.38:0/2071143336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc108cf0 msgr2=0x7f79dc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc108cf0 0x7f79dc19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 -- 172.21.15.38:0/2071143336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc1a04d0 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e0f36640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9f0 tx=0x7f79cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00cd80 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79cc0054f0 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc1a07c0 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.327+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc010690 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.328+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc1a6f20 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.328+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79dc102e70 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.330+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f79cc0046c0 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.331+0000 7f79d9ffb640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 0x7f79c40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.331+0000 7f79dbfff640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 0x7f79c40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.331+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f79cc0e7470 con 0x7f79dc102a60 2024-09-21T06:17:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.331+0000 7f79dbfff640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 0x7f79c40b8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79dc079b80 tx=0x7f79d0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.334+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79cc0ae0d0 con 0x7f79dc102a60 2024-09-21T06:17:30.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.574+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79dc19b690 con 0x7f79dc102a60 2024-09-21T06:17:30.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.574+0000 7f79d9ffb640 1 -- 172.21.15.38:0/2071143336 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7f79cc0b24b0 con 0x7f79dc102a60 2024-09-21T06:17:30.577 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:30.577 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":9,"btime":"2024-09-21T06:17:28:344968+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T06:17:30.577 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 9 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 msgr2=0x7f79c40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 0x7f79c40b8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79dc079b80 tx=0x7f79d0005f90 comp rx=0 tx=0).stop 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 msgr2=0x7f79dc19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e9f0 tx=0x7f79cc00edf0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 shutdown_connections 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79c40b65e0 0x7f79c40b8af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79dc108cf0 0x7f79dc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.576+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79dc1083a0 0x7f79dc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.577+0000 7f79e319a640 1 --2- 172.21.15.38:0/2071143336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79dc102a60 0x7f79dc19a560 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:30.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.577+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 >> 172.21.15.38:0/2071143336 conn(0x7f79dc079730 msgr2=0x7f79dc1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:30.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.577+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 shutdown_connections 2024-09-21T06:17:30.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:30.577+0000 7f79e319a640 1 -- 172.21.15.38:0/2071143336 wait complete. 2024-09-21T06:17:31.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:31.233 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.233 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: Deploying daemon mds.g on smithi038 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2071143336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:boot 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: fsmap 9 up:standby 2024-09-21T06:17:31.234 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:31 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: Deploying daemon mds.g on smithi038 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2071143336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:boot 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: fsmap 9 up:standby 2024-09-21T06:17:31.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:31 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: Deploying daemon mds.g on smithi038 2024-09-21T06:17:31.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2071143336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:31.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:boot 2024-09-21T06:17:31.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: fsmap 9 up:standby 2024-09-21T06:17:31.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:31 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:17:32.236 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 systemd[1]: Starting Ceph mds.g for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:32.556 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 podman[73556]: 2024-09-21 06:17:32.431652725 +0000 UTC m=+0.016015823 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:32.556 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 podman[73556]: 2024-09-21 06:17:32.554992177 +0000 UTC m=+0.139355302 container create fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:17:32.829 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 podman[73556]: 2024-09-21 06:17:32.790555242 +0000 UTC m=+0.374918332 container init fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:17:32.829 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 podman[73556]: 2024-09-21 06:17:32.793827376 +0000 UTC m=+0.378190455 container start fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:17:33.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:33 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 ceph-mds[73575]: -- 172.21.15.38:0/2255301810 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644dd695c20 con 0x5644e183da80 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g[73571]: starting mds.g at 2024-09-21T06:17:33.237 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 bash[73556]: fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 2024-09-21T06:17:33.238 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:17:32 smithi038 systemd[1]: Started Ceph mds.g for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:33.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:33 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:33 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:34.282 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:34 smithi038 ceph-mon[31215]: Deploying daemon mds.a on smithi038 2024-09-21T06:17:34.282 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:34 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.38:6838/3257072539,v1:172.21.15.38:6839/3257072539] up:boot 2024-09-21T06:17:34.282 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:34 smithi038 ceph-mon[31215]: fsmap 10 up:standby 2024-09-21T06:17:34.282 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:34 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:17:34.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:34.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:34 smithi174 ceph-mon[34815]: Deploying daemon mds.a on smithi038 2024-09-21T06:17:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:34 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.38:6838/3257072539,v1:172.21.15.38:6839/3257072539] up:boot 2024-09-21T06:17:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:34 smithi174 ceph-mon[34815]: fsmap 10 up:standby 2024-09-21T06:17:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:34 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:17:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:34 smithi044 ceph-mon[34369]: Deploying daemon mds.a on smithi038 2024-09-21T06:17:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:34 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.38:6838/3257072539,v1:172.21.15.38:6839/3257072539] up:boot 2024-09-21T06:17:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:34 smithi044 ceph-mon[34369]: fsmap 10 up:standby 2024-09-21T06:17:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:34 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:17:34.600 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 -- 172.21.15.38:0/3063638891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 msgr2=0x7f532810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3063638891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532810f5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5320009ca0 tx=0x7f532002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 -- 172.21.15.38:0/3063638891 shutdown_connections 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3063638891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532810f5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3063638891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281051c0 0x7f53281055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3063638891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281031f0 0x7f5328103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 -- 172.21.15.38:0/3063638891 >> 172.21.15.38:0/3063638891 conn(0x7f5328079e40 msgr2=0x7f532807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 -- 172.21.15.38:0/3063638891 shutdown_connections 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.113+0000 7f532ff8e640 1 -- 172.21.15.38:0/3063638891 wait complete. 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 Processor -- start 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 -- start start 2024-09-21T06:17:35.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 0x7f5328199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281051c0 0x7f5328199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5328112b40 con 0x7f5328105b10 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53281129c0 con 0x7f53281031f0 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532ff8e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5328112cc0 con 0x7f53281051c0 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532e52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532e52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58060/0 (socket says 172.21.15.38:58060) 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532e52b640 1 -- 172.21.15.38:0/3891409249 learned_addr learned my addr 172.21.15.38:0/3891409249 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532d529640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281051c0 0x7f5328199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:35.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.114+0000 7f532dd2a640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 0x7f5328199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 -- 172.21.15.38:0/3891409249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281051c0 msgr2=0x7f5328199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281051c0 0x7f5328199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 -- 172.21.15.38:0/3891409249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 msgr2=0x7f5328199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 0x7f5328199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 -- 172.21.15.38:0/3891409249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532819f400 con 0x7f5328105b10 2024-09-21T06:17:35.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532dd2a640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 0x7f5328199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532e52b640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5320005cc0 tx=0x7f5320003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320031650 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f53200317f0 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532819f690 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532002fb20 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.115+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53281a5e50 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.116+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5328103600 con 0x7f5328105b10 2024-09-21T06:17:35.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.118+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f532002fce0 con 0x7f5328105b10 2024-09-21T06:17:35.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.119+0000 7f531effd640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 0x7f53140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.119+0000 7f532dd2a640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 0x7f53140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.119+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f5320108490 con 0x7f5328105b10 2024-09-21T06:17:35.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.120+0000 7f532dd2a640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 0x7f53140b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53240058c0 tx=0x7f5324005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:35.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.122+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53200cf0f0 con 0x7f5328105b10 2024-09-21T06:17:35.221 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:35 smithi038 ceph-mon[31215]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:35.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.352+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f532810ac30 con 0x7f5328105b10 2024-09-21T06:17:35.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.353+0000 7f531effd640 1 -- 172.21.15.38:0/3891409249 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f53200d34d0 con 0x7f5328105b10 2024-09-21T06:17:35.356 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:35.356 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":11,"btime":"2024-09-21T06:17:33:047780+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T06:17:35.356 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 11 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 msgr2=0x7f53140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 0x7f53140b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53240058c0 tx=0x7f5324005850 comp rx=0 tx=0).stop 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 msgr2=0x7f532819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5320005cc0 tx=0x7f5320003d60 comp rx=0 tx=0).stop 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 shutdown_connections 2024-09-21T06:17:35.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f53140b6560 0x7f53140b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5328105b10 0x7f532819ecd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53281051c0 0x7f5328199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 --2- 172.21.15.38:0/3891409249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53281031f0 0x7f5328199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 >> 172.21.15.38:0/3891409249 conn(0x7f5328079e40 msgr2=0x7f53281063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 shutdown_connections 2024-09-21T06:17:35.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:35.355+0000 7f532ff8e640 1 -- 172.21.15.38:0/3891409249 wait complete. 2024-09-21T06:17:35.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:35 smithi174 ceph-mon[34815]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:35.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:35 smithi044 ceph-mon[34369]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3891409249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:36.156 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:36 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:36.336 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3891409249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:36.336 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.336 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.336 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.336 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:36.337 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:36.337 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:36 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3891409249' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:17:36.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:36 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:37 smithi174 ceph-mon[34815]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:37 smithi174 ceph-mon[34815]: Deploying daemon mds.b on smithi044 2024-09-21T06:17:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:37 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.38:6840/959334651,v1:172.21.15.38:6841/959334651] up:boot 2024-09-21T06:17:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:37 smithi174 ceph-mon[34815]: fsmap 11 up:standby 2024-09-21T06:17:37.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:37 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:17:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:37 smithi044 ceph-mon[34369]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:37 smithi044 ceph-mon[34369]: Deploying daemon mds.b on smithi044 2024-09-21T06:17:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:37 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.38:6840/959334651,v1:172.21.15.38:6841/959334651] up:boot 2024-09-21T06:17:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:37 smithi044 ceph-mon[34369]: fsmap 11 up:standby 2024-09-21T06:17:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:37 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:17:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:37 smithi038 ceph-mon[31215]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:37 smithi038 ceph-mon[31215]: Deploying daemon mds.b on smithi044 2024-09-21T06:17:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:37 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.38:6840/959334651,v1:172.21.15.38:6841/959334651] up:boot 2024-09-21T06:17:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:37 smithi038 ceph-mon[31215]: fsmap 11 up:standby 2024-09-21T06:17:37.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:37 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:17:37.883 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:37 smithi044 systemd[1]: Starting Ceph mds.b for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:17:38.155 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:37 smithi044 podman[63230]: 2024-09-21 06:17:37.784609066 +0000 UTC m=+0.016520212 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:17:38.155 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:37 smithi044 podman[63230]: 2024-09-21 06:17:37.908007022 +0000 UTC m=+0.139918197 container create fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:17:38.155 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 podman[63230]: 2024-09-21 06:17:38.11860019 +0000 UTC m=+0.350511317 container init fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T06:17:38.155 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 podman[63230]: 2024-09-21 06:17:38.121478958 +0000 UTC m=+0.353390093 container start fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:17:38.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:17:38.441 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:38.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 ceph-mds[63249]: -- 172.21.15.44:0/561626355 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a4c767860 con 0x556a5090f180 2024-09-21T06:17:38.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: starting mds.b at 2024-09-21T06:17:38.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 bash[63230]: fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 2024-09-21T06:17:38.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:38 smithi044 systemd[1]: Started Ceph mds.b for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 -- 172.21.15.38:0/35107661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 msgr2=0x7f671c112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 --2- 172.21.15.38:0/35107661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c112600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6714009ca0 tx=0x7f671402a950 comp rx=0 tx=0).stop 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 -- 172.21.15.38:0/35107661 shutdown_connections 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 --2- 172.21.15.38:0/35107661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c112600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 --2- 172.21.15.38:0/35107661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 0x7f671c10fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 --2- 172.21.15.38:0/35107661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 -- 172.21.15.38:0/35107661 >> 172.21.15.38:0/35107661 conn(0x7f671c079730 msgr2=0x7f671c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 -- 172.21.15.38:0/35107661 shutdown_connections 2024-09-21T06:17:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.958+0000 7f672257a640 1 -- 172.21.15.38:0/35107661 wait complete. 2024-09-21T06:17:38.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.959+0000 7f672257a640 1 Processor -- start 2024-09-21T06:17:38.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.959+0000 7f672257a640 1 -- start start 2024-09-21T06:17:38.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 0x7f671c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f671c115dc0 con 0x7f671c1101e0 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f671c115c40 con 0x7f671c102f80 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f672257a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f671c115f40 con 0x7f671c102630 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f671bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f671bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:33598/0 (socket says 172.21.15.38:33598) 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f671bfff640 1 -- 172.21.15.38:0/1553473334 learned_addr learned my addr 172.21.15.38:0/1553473334 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:38.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f67137fe640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 0x7f671c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 -- 172.21.15.38:0/1553473334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 msgr2=0x7f671c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 -- 172.21.15.38:0/1553473334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 msgr2=0x7f671c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 0x7f671c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 -- 172.21.15.38:0/1553473334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c1a2640 con 0x7f671c1101e0 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.960+0000 7f6720b17640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c1a1f10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6714005e30 tx=0x7f6714003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.961+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714034040 con 0x7f671c1101e0 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.961+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c1a28d0 con 0x7f671c1101e0 2024-09-21T06:17:38.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.961+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c1a9090 con 0x7f671c1101e0 2024-09-21T06:17:38.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.961+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f671402fdf0 con 0x7f671c1101e0 2024-09-21T06:17:38.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.961+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140046b0 con 0x7f671c1101e0 2024-09-21T06:17:38.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.962+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc0052c0 con 0x7f671c1101e0 2024-09-21T06:17:38.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.964+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6714037020 con 0x7f671c1101e0 2024-09-21T06:17:38.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.965+0000 7f6719ffb640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 0x7f67080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:38.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.965+0000 7f671bfff640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 0x7f67080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:38.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.965+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f6714107b20 con 0x7f671c1101e0 2024-09-21T06:17:38.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.966+0000 7f671bfff640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 0x7f67080b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f670c005fd0 tx=0x7f670c00b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:38.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:38.969+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67140ce760 con 0x7f671c1101e0 2024-09-21T06:17:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.206+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66fc0055b0 con 0x7f671c1101e0 2024-09-21T06:17:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.207+0000 7f6719ffb640 1 -- 172.21.15.38:0/1553473334 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7f6714004040 con 0x7f671c1101e0 2024-09-21T06:17:39.208 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:39.209 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":13,"btime":"2024-09-21T06:17:39:094920+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24641,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24665,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24695,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24728,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T06:17:39.209 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 13 2024-09-21T06:17:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 msgr2=0x7f67080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 0x7f67080b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f670c005fd0 tx=0x7f670c00b4a0 comp rx=0 tx=0).stop 2024-09-21T06:17:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 msgr2=0x7f671c1a1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c1a1f10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6714005e30 tx=0x7f6714003c10 comp rx=0 tx=0).stop 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 shutdown_connections 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f67080b6560 0x7f67080b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f671c1101e0 0x7f671c1a1f10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f671c102f80 0x7f671c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 --2- 172.21.15.38:0/1553473334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f671c102630 0x7f671c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 >> 172.21.15.38:0/1553473334 conn(0x7f671c079730 msgr2=0x7f671c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 shutdown_connections 2024-09-21T06:17:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:39.209+0000 7f672257a640 1 -- 172.21.15.38:0/1553473334 wait complete. 2024-09-21T06:17:39.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:39.472 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:boot 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: fsmap 12 up:standby 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:17:39.473 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:39 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1553473334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:boot 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: fsmap 12 up:standby 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:17:39.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:39 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1553473334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:boot 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: fsmap 12 up:standby 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:17:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:39 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1553473334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:17:40.342 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T06:17:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:40.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:40 smithi038 ceph-mon[31215]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:40.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:40.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:40.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:40.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:40 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 -- 172.21.15.38:0/4128802423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c1094a0 msgr2=0x7f811c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:41.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 --2- 172.21.15.38:0/4128802423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c1094a0 0x7f811c1098b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8110009900 tx=0x7f811002a410 comp rx=0 tx=0).stop 2024-09-21T06:17:41.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 -- 172.21.15.38:0/4128802423 shutdown_connections 2024-09-21T06:17:41.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 --2- 172.21.15.38:0/4128802423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c109df0 0x7f811c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 --2- 172.21.15.38:0/4128802423 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c1094a0 0x7f811c1098b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 --2- 172.21.15.38:0/4128802423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 0x7f811c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 -- 172.21.15.38:0/4128802423 >> 172.21.15.38:0/4128802423 conn(0x7f811c07b850 msgr2=0x7f811c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 -- 172.21.15.38:0/4128802423 shutdown_connections 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.104+0000 7f8121706640 1 -- 172.21.15.38:0/4128802423 wait complete. 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 Processor -- start 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 -- start start 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 0x7f811c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c1094a0 0x7f811c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f811c113bd0 con 0x7f811c109df0 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f811c113a50 con 0x7f811c103b60 2024-09-21T06:17:41.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f8121706640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f811c113d50 con 0x7f811c1094a0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f811b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f811b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44882/0 (socket says 172.21.15.38:44882) 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.105+0000 7f811b7fe640 1 -- 172.21.15.38:0/1715603918 learned_addr learned my addr 172.21.15.38:0/1715603918 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811affd640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 0x7f811c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811a7fc640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c1094a0 0x7f811c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 -- 172.21.15.38:0/1715603918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c1094a0 msgr2=0x7f811c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c1094a0 0x7f811c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 -- 172.21.15.38:0/1715603918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 msgr2=0x7f811c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 0x7f811c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 -- 172.21.15.38:0/1715603918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c1a0570 con 0x7f811c109df0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f811b7fe640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fd0 tx=0x7f811400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114017070 con 0x7f811c109df0 2024-09-21T06:17:41.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8114003e40 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114004820 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c1a0860 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.106+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1a6fc0 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.107+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c103f70 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.109+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f8114003970 con 0x7f811c109df0 2024-09-21T06:17:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.109+0000 7f8103fff640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 0x7f81040b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:41.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.110+0000 7f811affd640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 0x7f81040b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:41.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.110+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f81140e6df0 con 0x7f811c109df0 2024-09-21T06:17:41.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.110+0000 7f811affd640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 0x7f81040b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f810c0058c0 tx=0x7f810c00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:41.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.114+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8114003c60 con 0x7f811c109df0 2024-09-21T06:17:41.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:40 smithi174 ceph-mon[34815]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:41.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:40 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:40 smithi044 ceph-mon[34369]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:41.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:40 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.313+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f811c10bbc0 con 0x7f811c109df0 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.313+0000 7f8103fff640 1 -- 172.21.15.38:0/1715603918 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f81140b6020 con 0x7f811c109df0 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:17:41.315 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2024-09-21T06:17:41.316 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2024-09-21T06:17:41.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:17:41.316 INFO:teuthology.orchestra.run.smithi038.stdout:] 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 msgr2=0x7f81040b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 0x7f81040b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f810c0058c0 tx=0x7f810c00a4c0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 msgr2=0x7f811c19fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fd0 tx=0x7f811400b260 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 shutdown_connections 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81040b65e0 0x7f81040b8af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f811c109df0 0x7f811c19fe40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f811c1094a0 0x7f811c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 --2- 172.21.15.38:0/1715603918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f811c103b60 0x7f811c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 >> 172.21.15.38:0/1715603918 conn(0x7f811c07b850 msgr2=0x7f811c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 shutdown_connections 2024-09-21T06:17:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:41.316+0000 7f8121706640 1 -- 172.21.15.38:0/1715603918 wait complete. 2024-09-21T06:17:41.965 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:17:41.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:17:42.198 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.198 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1715603918' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:42.199 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:42 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.438 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.438 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1715603918' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:42.439 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:42 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1715603918' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:17:42.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:42 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:43.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:43 smithi038 ceph-mon[31215]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:43.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.191 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:43 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 -- 172.21.15.38:0/1109236117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97241094a0 msgr2=0x7f97241098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 --2- 172.21.15.38:0/1109236117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97241094a0 0x7f97241098b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9718009900 tx=0x7f971802a410 comp rx=0 tx=0).stop 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 -- 172.21.15.38:0/1109236117 shutdown_connections 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 --2- 172.21.15.38:0/1109236117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9724109df0 0x7f9724110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 --2- 172.21.15.38:0/1109236117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f97241094a0 0x7f97241098b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 --2- 172.21.15.38:0/1109236117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 0x7f9724103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 -- 172.21.15.38:0/1109236117 >> 172.21.15.38:0/1109236117 conn(0x7f972407b850 msgr2=0x7f972407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 -- 172.21.15.38:0/1109236117 shutdown_connections 2024-09-21T06:17:43.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.266+0000 7f9728a71640 1 -- 172.21.15.38:0/1109236117 wait complete. 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 Processor -- start 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 -- start start 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 0x7f9724075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 0x7f9724075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9724113bd0 con 0x7f9724109df0 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9724113a50 con 0x7f97241094a0 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9728a71640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9724113d50 con 0x7f9724103b60 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9722d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9722d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44896/0 (socket says 172.21.15.38:44896) 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f9722d9d640 1 -- 172.21.15.38:0/2286945380 learned_addr learned my addr 172.21.15.38:0/2286945380 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.267+0000 7f972259c640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 0x7f9724075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9721d9b640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 0x7f9724075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:43.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 -- 172.21.15.38:0/2286945380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 msgr2=0x7f9724075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 0x7f9724075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 -- 172.21.15.38:0/2286945380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 msgr2=0x7f9724075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 0x7f9724075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 -- 172.21.15.38:0/2286945380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97241a88c0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9721d9b640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 0x7f9724075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9722d9d640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f971c00eaa0 tx=0x7f971c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c00cdb0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f971c005020 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97241a8bb0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971c0116d0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.268+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97241a90c0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.269+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9724103f70 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.271+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f971c0051d0 con 0x7f9724109df0 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.272+0000 7f97137fe640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 0x7f970c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:43.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.272+0000 7f972259c640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 0x7f970c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:43.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.272+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f971c0e74d0 con 0x7f9724109df0 2024-09-21T06:17:43.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.273+0000 7f972259c640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 0x7f970c0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9724077160 tx=0x7f971400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:43.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.275+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f971c016030 con 0x7f9724109df0 2024-09-21T06:17:43.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:43.488+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f972402e640 con 0x7f9724109df0 2024-09-21T06:17:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:43 smithi174 ceph-mon[34815]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:43 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:43 smithi044 ceph-mon[34369]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:43 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.197+0000 7f97137fe640 1 -- 172.21.15.38:0/2286945380 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f971c0a9030 con 0x7f9724109df0 2024-09-21T06:17:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 msgr2=0x7f970c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 0x7f970c0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9724077160 tx=0x7f971400b410 comp rx=0 tx=0).stop 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 msgr2=0x7f9724076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f971c00eaa0 tx=0x7f971c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 shutdown_connections 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f970c0b65e0 0x7f970c0b8af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:44.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9724109df0 0x7f9724076190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:44.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97241094a0 0x7f9724075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:44.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 --2- 172.21.15.38:0/2286945380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9724103b60 0x7f9724075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:44.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 >> 172.21.15.38:0/2286945380 conn(0x7f972407b850 msgr2=0x7f9724107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:44.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.199+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 shutdown_connections 2024-09-21T06:17:44.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:44.200+0000 7f9728a71640 1 -- 172.21.15.38:0/2286945380 wait complete. 2024-09-21T06:17:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:17:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:44.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:17:44.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:17:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:17:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:17:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:17:44.829 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:17:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:45 smithi038 ceph-mon[31215]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:45 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:17:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:45 smithi038 ceph-mon[31215]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:17:45.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.620+0000 7fcc35867640 1 -- 172.21.15.38:0/4194917692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 msgr2=0x7fcc301087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.620+0000 7fcc35867640 1 --2- 172.21.15.38:0/4194917692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc301087e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009900 tx=0x7fcc2402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.620+0000 7fcc35867640 1 -- 172.21.15.38:0/4194917692 shutdown_connections 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.620+0000 7fcc35867640 1 --2- 172.21.15.38:0/4194917692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30108d20 0x7fcc3010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 --2- 172.21.15.38:0/4194917692 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc301087e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 --2- 172.21.15.38:0/4194917692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30102ae0 0x7fcc30102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 -- 172.21.15.38:0/4194917692 >> 172.21.15.38:0/4194917692 conn(0x7fcc30079760 msgr2=0x7fcc30079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 -- 172.21.15.38:0/4194917692 shutdown_connections 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 -- 172.21.15.38:0/4194917692 wait complete. 2024-09-21T06:17:45.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 Processor -- start 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.621+0000 7fcc35867640 1 -- start start 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30102ae0 0x7fcc3019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30108d20 0x7fcc3019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30113c00 con 0x7fcc301083d0 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30113a80 con 0x7fcc30108d20 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc35867640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30113d80 con 0x7fcc30102ae0 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44920/0 (socket says 172.21.15.38:44920) 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 -- 172.21.15.38:0/2877566344 learned_addr learned my addr 172.21.15.38:0/2877566344 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2f7fe640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30108d20 0x7fcc3019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:45.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2effd640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30102ae0 0x7fcc3019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 -- 172.21.15.38:0/2877566344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30102ae0 msgr2=0x7fcc3019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30102ae0 0x7fcc3019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 -- 172.21.15.38:0/2877566344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30108d20 msgr2=0x7fcc3019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30108d20 0x7fcc3019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.622+0000 7fcc2e7fc640 1 -- 172.21.15.38:0/2877566344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc301a0400 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc2e7fc640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc2402a9e0 tx=0x7fcc24003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2403f070 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcc24031be0 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc301a0690 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24035030 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.623+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc301a0b70 con 0x7fcc301083d0 2024-09-21T06:17:45.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.624+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc30103d10 con 0x7fcc301083d0 2024-09-21T06:17:45.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.626+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcc24042070 con 0x7fcc301083d0 2024-09-21T06:17:45.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.626+0000 7fcc34865640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 0x7fcc180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:45.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.626+0000 7fcc2effd640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 0x7fcc180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:45.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.627+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7fcc24107e80 con 0x7fcc301083d0 2024-09-21T06:17:45.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.627+0000 7fcc2effd640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 0x7fcc180b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000abe0 tx=0x7fcc2000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.630+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc240ce970 con 0x7fcc301083d0 2024-09-21T06:17:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:45 smithi174 ceph-mon[34815]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:45 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:17:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:45 smithi174 ceph-mon[34815]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:17:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:45 smithi044 ceph-mon[34369]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:45 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2286945380' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:17:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:45 smithi044 ceph-mon[34369]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:17:45.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:45.819+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcc3010ab10 con 0x7fcc301083d0 2024-09-21T06:17:46.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.213+0000 7fcc34865640 1 -- 172.21.15.38:0/2877566344 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fcc240d2d50 con 0x7fcc301083d0 2024-09-21T06:17:46.214 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 msgr2=0x7fcc180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 0x7fcc180b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000abe0 tx=0x7fcc2000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 msgr2=0x7fcc3019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc2402a9e0 tx=0x7fcc24003b90 comp rx=0 tx=0).stop 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 shutdown_connections 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcc180b6590 0x7fcc180b8aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc30108d20 0x7fcc3019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:46.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc301083d0 0x7fcc3019aaf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:46.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 --2- 172.21.15.38:0/2877566344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc30102ae0 0x7fcc3019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:46.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 >> 172.21.15.38:0/2877566344 conn(0x7fcc30079760 msgr2=0x7fcc30104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:46.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 shutdown_connections 2024-09-21T06:17:46.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:46.215+0000 7fcc35867640 1 -- 172.21.15.38:0/2877566344 wait complete. 2024-09-21T06:17:46.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:46 smithi038 ceph-mon[31215]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:17:46.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:17:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:46 smithi174 ceph-mon[34815]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:17:46.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:17:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:46 smithi044 ceph-mon[34369]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:17:46.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:17:46.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:17:47.075 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:47.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:47 smithi038 ceph-mon[31215]: pgmap v257: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:47.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:47 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:17:47.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:47 smithi038 ceph-mon[31215]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:17:47.447 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:47 smithi038 ceph-mon[31215]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:17:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 -- 172.21.15.38:0/474094450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac103b60 msgr2=0x7faaac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 --2- 172.21.15.38:0/474094450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac103b60 0x7faaac103f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009ca0 tx=0x7faa9c02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 -- 172.21.15.38:0/474094450 shutdown_connections 2024-09-21T06:17:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 --2- 172.21.15.38:0/474094450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac109df0 0x7faaac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 --2- 172.21.15.38:0/474094450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac1094a0 0x7faaac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.536+0000 7faab1811640 1 --2- 172.21.15.38:0/474094450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac103b60 0x7faaac103f70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.537+0000 7faab1811640 1 -- 172.21.15.38:0/474094450 >> 172.21.15.38:0/474094450 conn(0x7faaac07b850 msgr2=0x7faaac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.537+0000 7faab1811640 1 -- 172.21.15.38:0/474094450 shutdown_connections 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.537+0000 7faab1811640 1 -- 172.21.15.38:0/474094450 wait complete. 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.537+0000 7faab1811640 1 Processor -- start 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.537+0000 7faab1811640 1 -- start start 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac103b60 0x7faaac19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac1094a0 0x7faaac19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faaac113c60 con 0x7faaac109df0 2024-09-21T06:17:47.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faaac113ae0 con 0x7faaac1094a0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faab1811640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faaac113de0 con 0x7faaac103b60 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44932/0 (socket says 172.21.15.38:44932) 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 -- 172.21.15.38:0/2286323972 learned_addr learned my addr 172.21.15.38:0/2286323972 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaaaffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac103b60 0x7faaac19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaaa7fc640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac1094a0 0x7faaac19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 -- 172.21.15.38:0/2286323972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac103b60 msgr2=0x7faaac19c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac103b60 0x7faaac19c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 -- 172.21.15.38:0/2286323972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac1094a0 msgr2=0x7faaac19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac1094a0 0x7faaac19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 -- 172.21.15.38:0/2286323972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac1a28e0 con 0x7faaac109df0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.538+0000 7faaab7fe640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009fd0 tx=0x7faaa400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.539+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4015020 con 0x7faaac109df0 2024-09-21T06:17:47.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.539+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faaa4011d00 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.539+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac1a2bd0 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.539+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4010e20 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.539+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac1a9330 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.540+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac103ff0 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.542+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7faaa4018020 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.542+0000 7faab080f640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 0x7faa980b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.543+0000 7faaaaffd640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 0x7faa980b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.543+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7faaa40e6ea0 con 0x7faaac109df0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.543+0000 7faaaaffd640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 0x7faa980b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009a60 tx=0x7faa9c031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:47.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.546+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faaa401f020 con 0x7faaac109df0 2024-09-21T06:17:47.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:47 smithi174 ceph-mon[34815]: pgmap v257: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:47.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:17:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:47 smithi174 ceph-mon[34815]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:17:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:47 smithi174 ceph-mon[34815]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:17:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:47 smithi044 ceph-mon[34369]: pgmap v257: 33 pgs: 1 creating+peering, 28 unknown, 4 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:47 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2877566344' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:17:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:47 smithi044 ceph-mon[34369]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:17:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:47 smithi044 ceph-mon[34369]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:17:47.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:47.781+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faaac19daa0 con 0x7faaac109df0 2024-09-21T06:17:48.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.247+0000 7faab080f640 1 -- 172.21.15.38:0/2286323972 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7faaac19daa0 con 0x7faaac109df0 2024-09-21T06:17:48.249 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:17:48.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 msgr2=0x7faa980b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:48.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 0x7faa980b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009a60 tx=0x7faa9c031000 comp rx=0 tx=0).stop 2024-09-21T06:17:48.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 msgr2=0x7faaac1a21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009fd0 tx=0x7faaa400b820 comp rx=0 tx=0).stop 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 shutdown_connections 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa980b65e0 0x7faa980b8af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faaac109df0 0x7faaac1a21b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaac1094a0 0x7faaac19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:48.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 --2- 172.21.15.38:0/2286323972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faaac103b60 0x7faaac19c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:48.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 >> 172.21.15.38:0/2286323972 conn(0x7faaac07b850 msgr2=0x7faaac1073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:48.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 shutdown_connections 2024-09-21T06:17:48.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:48.250+0000 7faab1811640 1 -- 172.21.15.38:0/2286323972 wait complete. 2024-09-21T06:17:48.631 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:48 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:17:48.631 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:48 smithi038 ceph-mon[31215]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:17:48.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:48 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:17:48.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:48 smithi174 ceph-mon[34815]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:17:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:48 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:17:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:48 smithi044 ceph-mon[34369]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:17:49.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:17:49.287 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:49.521 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:49 smithi038 ceph-mon[31215]: pgmap v260: 97 pgs: 25 creating+peering, 50 unknown, 22 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:49.522 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:49 smithi038 ceph-mon[31215]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:17:49.522 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:49 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:17:49.522 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:49 smithi038 ceph-mon[31215]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:17:49.522 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:49 smithi038 ceph-mon[31215]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:17:49.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:49 smithi174 ceph-mon[34815]: pgmap v260: 97 pgs: 25 creating+peering, 50 unknown, 22 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:49.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:49 smithi174 ceph-mon[34815]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:17:49.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:49 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:17:49.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:49 smithi174 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:17:49.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:49 smithi174 ceph-mon[34815]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:17:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:49 smithi044 ceph-mon[34369]: pgmap v260: 97 pgs: 25 creating+peering, 50 unknown, 22 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:17:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:49 smithi044 ceph-mon[34369]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:17:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:49 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2286323972' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:17:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:49 smithi044 ceph-mon[34369]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:17:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:49 smithi044 ceph-mon[34369]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:17:49.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 -- 172.21.15.38:0/1984661077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f247810ddf0 msgr2=0x7f2478110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:49.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 --2- 172.21.15.38:0/1984661077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f247810ddf0 0x7f2478110300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2470009900 tx=0x7f247002a410 comp rx=0 tx=0).stop 2024-09-21T06:17:49.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 -- 172.21.15.38:0/1984661077 shutdown_connections 2024-09-21T06:17:49.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 --2- 172.21.15.38:0/1984661077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f247810ddf0 0x7f2478110300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 --2- 172.21.15.38:0/1984661077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f247810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 --2- 172.21.15.38:0/1984661077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2478104840 0x7f2478104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.734+0000 7f247c8f9640 1 -- 172.21.15.38:0/1984661077 >> 172.21.15.38:0/1984661077 conn(0x7f2478079730 msgr2=0x7f2478079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:49.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.735+0000 7f247c8f9640 1 -- 172.21.15.38:0/1984661077 shutdown_connections 2024-09-21T06:17:49.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.735+0000 7f247c8f9640 1 -- 172.21.15.38:0/1984661077 wait complete. 2024-09-21T06:17:49.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.735+0000 7f247c8f9640 1 Processor -- start 2024-09-21T06:17:49.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.735+0000 7f247c8f9640 1 -- start start 2024-09-21T06:17:49.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f2478102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f247810ddf0 0x7f24781031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2478113bd0 con 0x7f2478104840 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2478113a50 con 0x7f247810ddf0 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247c8f9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2478113d50 con 0x7f2478105270 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55242/0 (socket says 172.21.15.38:55242) 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 -- 172.21.15.38:0/478605612 learned_addr learned my addr 172.21.15.38:0/478605612 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f2476d9d640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f247810ddf0 0x7f24781031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f2475d9b640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f2478102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 -- 172.21.15.38:0/478605612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 msgr2=0x7f2478102c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f2478102c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 -- 172.21.15.38:0/478605612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f247810ddf0 msgr2=0x7f24781031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:49.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f247810ddf0 0x7f24781031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 -- 172.21.15.38:0/478605612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24781a88a0 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f2475d9b640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f2478102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.736+0000 7f247659c640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f246800ebc0 tx=0x7f246800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.737+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468003b70 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.737+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2468003d10 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.737+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24781a8b90 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.737+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468019850 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.737+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24781a90d0 con 0x7f2478104840 2024-09-21T06:17:49.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.738+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2478104c50 con 0x7f2478104840 2024-09-21T06:17:49.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.739+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f24680199f0 con 0x7f2478104840 2024-09-21T06:17:49.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.740+0000 7f246f7fe640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 0x7f24640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:49.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.740+0000 7f2475d9b640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 0x7f24640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:49.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.741+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f24680e7c10 con 0x7f2478104840 2024-09-21T06:17:49.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.741+0000 7f2475d9b640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 0x7f24640b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f247810fae0 tx=0x7f2460005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:49.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.745+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24680ae4c0 con 0x7f2478104840 2024-09-21T06:17:49.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.934+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24781a94f0 con 0x7f2478104840 2024-09-21T06:17:49.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.935+0000 7f246f7fe640 1 -- 172.21.15.38:0/478605612 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22581 (secure 0 0 0) 0x7f24680b28a0 con 0x7f2478104840 2024-09-21T06:17:49.937 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:49.937 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":75,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:17:47.782193+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:17:49.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.937+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 msgr2=0x7f24640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:49.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.937+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 0x7f24640b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f247810fae0 tx=0x7f2460005f90 comp rx=0 tx=0).stop 2024-09-21T06:17:49.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.937+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 msgr2=0x7f2478102750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.937+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f246800ebc0 tx=0x7f246800c6a0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 shutdown_connections 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f24640b6560 0x7f24640b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f247810ddf0 0x7f24781031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2478105270 0x7f2478102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 --2- 172.21.15.38:0/478605612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2478104840 0x7f2478102750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 >> 172.21.15.38:0/478605612 conn(0x7f2478079730 msgr2=0x7f24780ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 shutdown_connections 2024-09-21T06:17:49.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:49.938+0000 7f247c8f9640 1 -- 172.21.15.38:0/478605612 wait complete. 2024-09-21T06:17:50.515 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:50 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:active 2024-09-21T06:17:50.516 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:50 smithi038 ceph-mon[31215]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.516 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:50 smithi038 ceph-mon[31215]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.516 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:50 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/478605612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:50.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:17:50.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:50 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:active 2024-09-21T06:17:50.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:50 smithi174 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:50 smithi174 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:50 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/478605612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:50 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] up:active 2024-09-21T06:17:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:50 smithi044 ceph-mon[34369]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:50 smithi044 ceph-mon[34369]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:50.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:50 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/478605612' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:50.803 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 -- 172.21.15.38:0/1906386912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1020c0 msgr2=0x7f48fc1024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 --2- 172.21.15.38:0/1906386912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1020c0 0x7f48fc1024d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009900 tx=0x7f48ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 -- 172.21.15.38:0/1906386912 shutdown_connections 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 --2- 172.21.15.38:0/1906386912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 0x7f48fc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 --2- 172.21.15.38:0/1906386912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1062b0 0x7f48fc1066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 --2- 172.21.15.38:0/1906386912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1020c0 0x7f48fc1024d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 -- 172.21.15.38:0/1906386912 >> 172.21.15.38:0/1906386912 conn(0x7f48fc079e40 msgr2=0x7f48fc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:51.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 -- 172.21.15.38:0/1906386912 shutdown_connections 2024-09-21T06:17:51.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.309+0000 7f4901f62640 1 -- 172.21.15.38:0/1906386912 wait complete. 2024-09-21T06:17:51.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 Processor -- start 2024-09-21T06:17:51.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 -- start start 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1020c0 0x7f48fc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 0x7f48fc19fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc113c20 con 0x7f48fc1062b0 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc113aa0 con 0x7f48fc106c00 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.310+0000 7f4901f62640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc113da0 con 0x7f48fc1020c0 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55256/0 (socket says 172.21.15.38:55256) 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 -- 172.21.15.38:0/722676615 learned_addr learned my addr 172.21.15.38:0/722676615 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1020c0 0x7f48fc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48fbfff640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 0x7f48fc19fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 -- 172.21.15.38:0/722676615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1020c0 msgr2=0x7f48fc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:51.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1020c0 0x7f48fc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 -- 172.21.15.38:0/722676615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 msgr2=0x7f48fc19fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 0x7f48fc19fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 -- 172.21.15.38:0/722676615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc1a05c0 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48faffd640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48f000d740 tx=0x7f48f000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f0017070 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f48f000de50 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.311+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc1a08b0 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.312+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f000f620 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.312+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc1a7010 con 0x7f48fc1062b0 2024-09-21T06:17:51.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.313+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc1024d0 con 0x7f48fc1062b0 2024-09-21T06:17:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.314+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f48f001a070 con 0x7f48fc1062b0 2024-09-21T06:17:51.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.315+0000 7f48f8ff9640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 0x7f48e40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.315+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 0x7f48e40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.315+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f48f00e6c50 con 0x7f48fc1062b0 2024-09-21T06:17:51.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.316+0000 7f48fb7fe640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 0x7f48e40b8af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009230 tx=0x7f48ec0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:51.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.318+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48f00ad580 con 0x7f48fc1062b0 2024-09-21T06:17:51.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:51 smithi038 ceph-mon[31215]: pgmap v262: 97 pgs: 25 creating+peering, 12 unknown, 60 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T06:17:51.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.508+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48fc19b780 con 0x7f48fc1062b0 2024-09-21T06:17:51.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.510+0000 7f48f8ff9640 1 -- 172.21.15.38:0/722676615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22581 (secure 0 0 0) 0x7f48fc19b780 con 0x7f48fc1062b0 2024-09-21T06:17:51.511 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:17:51.512 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":75,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:17:47.782193+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 msgr2=0x7f48e40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 0x7f48e40b8af0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009230 tx=0x7f48ec0058d0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 msgr2=0x7f48fc19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48f000d740 tx=0x7f48f000dc00 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 shutdown_connections 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f48e40b65e0 0x7f48e40b8af0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48fc106c00 0x7f48fc19fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48fc1062b0 0x7f48fc19abf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 --2- 172.21.15.38:0/722676615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48fc1020c0 0x7f48fc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 >> 172.21.15.38:0/722676615 conn(0x7f48fc079e40 msgr2=0x7f48fc1080d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 shutdown_connections 2024-09-21T06:17:51.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:51.512+0000 7f4901f62640 1 -- 172.21.15.38:0/722676615 wait complete. 2024-09-21T06:17:51.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:51 smithi174 ceph-mon[34815]: pgmap v262: 97 pgs: 25 creating+peering, 12 unknown, 60 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T06:17:51.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:51 smithi044 ceph-mon[34369]: pgmap v262: 97 pgs: 25 creating+peering, 12 unknown, 60 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T06:17:52.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:17:52.346 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:52.467 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:52 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/722676615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:52.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:52 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/722676615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:52.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:52 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/722676615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:17:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 -- 172.21.15.38:0/2538361152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4581094a0 msgr2=0x7fc4581098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 --2- 172.21.15.38:0/2538361152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4581094a0 0x7fc4581098b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc440009900 tx=0x7fc44002a410 comp rx=0 tx=0).stop 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 -- 172.21.15.38:0/2538361152 shutdown_connections 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 --2- 172.21.15.38:0/2538361152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc458109df0 0x7fc458110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 --2- 172.21.15.38:0/2538361152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4581094a0 0x7fc4581098b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 --2- 172.21.15.38:0/2538361152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 0x7fc458103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 -- 172.21.15.38:0/2538361152 >> 172.21.15.38:0/2538361152 conn(0x7fc45807b850 msgr2=0x7fc45807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 -- 172.21.15.38:0/2538361152 shutdown_connections 2024-09-21T06:17:52.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 -- 172.21.15.38:0/2538361152 wait complete. 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.839+0000 7fc45d60a640 1 Processor -- start 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 -- start start 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 0x7fc458075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4581094a0 0x7fc458075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113bd0 con 0x7fc458109df0 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113a50 con 0x7fc4581094a0 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc45d60a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc458113d50 con 0x7fc458103b60 2024-09-21T06:17:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55268/0 (socket says 172.21.15.38:55268) 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 -- 172.21.15.38:0/1129235382 learned_addr learned my addr 172.21.15.38:0/1129235382 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4567fc640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4581094a0 0x7fc458075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc456ffd640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 0x7fc458075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 -- 172.21.15.38:0/1129235382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 msgr2=0x7fc458075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 0x7fc458075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 -- 172.21.15.38:0/1129235382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4581094a0 msgr2=0x7fc458075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4581094a0 0x7fc458075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.840+0000 7fc4577fe640 1 -- 172.21.15.38:0/1129235382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4581a8860 con 0x7fc458109df0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc4577fe640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc44800eaa0 tx=0x7fc44800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44800cdb0 con 0x7fc458109df0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4581a8b50 con 0x7fc458109df0 2024-09-21T06:17:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc448005020 con 0x7fc458109df0 2024-09-21T06:17:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4480116d0 con 0x7fc458109df0 2024-09-21T06:17:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.841+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581a9010 con 0x7fc458109df0 2024-09-21T06:17:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.842+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc458103f70 con 0x7fc458109df0 2024-09-21T06:17:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.845+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc4480051d0 con 0x7fc458109df0 2024-09-21T06:17:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.845+0000 7fc44ffff640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 0x7fc4440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.846+0000 7fc456ffd640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 0x7fc4440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.846+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fc4480e79b0 con 0x7fc458109df0 2024-09-21T06:17:52.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.846+0000 7fc456ffd640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 0x7fc4440b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc450005fd0 tx=0x7fc450005e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:52.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:52.849+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc448016030 con 0x7fc458109df0 2024-09-21T06:17:53.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.076+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc45810bbc0 con 0x7fc458109df0 2024-09-21T06:17:53.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.277+0000 7fc44ffff640 1 -- 172.21.15.38:0/1129235382 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc4480ae200 con 0x7fc458109df0 2024-09-21T06:17:53.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.279+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 msgr2=0x7fc4440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:53.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 0x7fc4440b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc450005fd0 tx=0x7fc450005e40 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 msgr2=0x7fc458076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc44800eaa0 tx=0x7fc44800ef60 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 shutdown_connections 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4440b6560 0x7fc4440b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc458109df0 0x7fc458076190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4581094a0 0x7fc458075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 --2- 172.21.15.38:0/1129235382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc458103b60 0x7fc458075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 >> 172.21.15.38:0/1129235382 conn(0x7fc45807b850 msgr2=0x7fc458107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 shutdown_connections 2024-09-21T06:17:53.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:53.280+0000 7fc45d60a640 1 -- 172.21.15.38:0/1129235382 wait complete. 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:53 smithi038 ceph-mon[31215]: pgmap v263: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-09-21T06:17:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:53 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:17:53.546 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:53 smithi174 ceph-mon[34815]: pgmap v263: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-09-21T06:17:53.546 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:53 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:17:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:53 smithi044 ceph-mon[34369]: pgmap v263: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-09-21T06:17:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:53 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:17:53.861 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T06:17:53.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T06:17:54.119 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:54.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:54 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:17:54.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:54 smithi044 ceph-mon[34369]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:54.405 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: 2024-09-21T06:17:54.104+0000 7f28e32ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:17:54.505 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:54 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:17:54.505 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:54 smithi038 ceph-mon[31215]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:54.559 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:54 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1129235382' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:17:54.559 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:54 smithi174 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 -- 172.21.15.38:0/1271343241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c109df0 msgr2=0x7ffa6c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 --2- 172.21.15.38:0/1271343241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c109df0 0x7ffa6c110620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009900 tx=0x7ffa6402a410 comp rx=0 tx=0).stop 2024-09-21T06:17:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 -- 172.21.15.38:0/1271343241 shutdown_connections 2024-09-21T06:17:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 --2- 172.21.15.38:0/1271343241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c109df0 0x7ffa6c110620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:54.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 --2- 172.21.15.38:0/1271343241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 --2- 172.21.15.38:0/1271343241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 0x7ffa6c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 -- 172.21.15.38:0/1271343241 >> 172.21.15.38:0/1271343241 conn(0x7ffa6c07b850 msgr2=0x7ffa6c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 -- 172.21.15.38:0/1271343241 shutdown_connections 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.599+0000 7ffa71580640 1 -- 172.21.15.38:0/1271343241 wait complete. 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.600+0000 7ffa71580640 1 Processor -- start 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.600+0000 7ffa71580640 1 -- start start 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.600+0000 7ffa71580640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 0x7ffa6c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 0x7ffa6c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113bd0 con 0x7ffa6c1094a0 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113a50 con 0x7ffa6c109df0 2024-09-21T06:17:54.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c113d50 con 0x7ffa6c103b60 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55282/0 (socket says 172.21.15.38:55282) 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 -- 172.21.15.38:0/684392536 learned_addr learned my addr 172.21.15.38:0/684392536 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6affd640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 0x7ffa6c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6b7fe640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 0x7ffa6c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 -- 172.21.15.38:0/684392536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 msgr2=0x7ffa6c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 0x7ffa6c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 -- 172.21.15.38:0/684392536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 msgr2=0x7ffa6c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 0x7ffa6c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 -- 172.21.15.38:0/684392536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c1a0490 con 0x7ffa6c1094a0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6b7fe640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 0x7ffa6c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa6a7fc640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000ebc0 tx=0x7ffa6000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60010630 con 0x7ffa6c1094a0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c1a0780 con 0x7ffa6c1094a0 2024-09-21T06:17:54.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa60010ca0 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60017c10 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.601+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c1a6ee0 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.602+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c103f70 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.605+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ffa600107d0 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.606+0000 7ffa53fff640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 0x7ffa540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.606+0000 7ffa6affd640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 0x7ffa540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.606+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ffa600e7f00 con 0x7ffa6c1094a0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.606+0000 7ffa6affd640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 0x7ffa540b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005d00 tx=0x7ffa5c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:54.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.609+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa60010ac0 con 0x7ffa6c1094a0 2024-09-21T06:17:54.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:54.835+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7ffa6c02e640 con 0x7ffa6c1094a0 2024-09-21T06:17:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.294+0000 7ffa53fff640 1 -- 172.21.15.38:0/684392536 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ffa600ae750 con 0x7ffa6c1094a0 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 msgr2=0x7ffa540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 0x7ffa540b8a70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005d00 tx=0x7ffa5c00b410 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 msgr2=0x7ffa6c19aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000ebc0 tx=0x7ffa6000c6a0 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 shutdown_connections 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffa540b6560 0x7ffa540b8a70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa6c109df0 0x7ffa6c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa6c1094a0 0x7ffa6c19aac0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 --2- 172.21.15.38:0/684392536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa6c103b60 0x7ffa6c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 >> 172.21.15.38:0/684392536 conn(0x7ffa6c07b850 msgr2=0x7ffa6c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 shutdown_connections 2024-09-21T06:17:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:55.296+0000 7ffa71580640 1 -- 172.21.15.38:0/684392536 wait complete. 2024-09-21T06:17:55.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:55 smithi038 ceph-mon[31215]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T06:17:55.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:17:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:55 smithi174 ceph-mon[34815]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T06:17:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:17:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:55 smithi044 ceph-mon[34369]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-21T06:17:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:17:55.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T06:17:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:56.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:17:56.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:17:56.569 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:17:56.569 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:56.569 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T06:17:56.569 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:56 smithi038 ceph-mon[31215]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T06:17:56.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:17:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:17:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:17:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T06:17:56.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:56 smithi174 ceph-mon[34815]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T06:17:56.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:17:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/684392536' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:17:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:17:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:17:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T06:17:56.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:56 smithi044 ceph-mon[34369]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T06:17:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 -- 172.21.15.38:0/4192255720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c105220 msgr2=0x7fd44c105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 --2- 172.21.15.38:0/4192255720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c105220 0x7fd44c105630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd440009900 tx=0x7fd44002a410 comp rx=0 tx=0).stop 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 -- 172.21.15.38:0/4192255720 shutdown_connections 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 --2- 172.21.15.38:0/4192255720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 0x7fd44c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 --2- 172.21.15.38:0/4192255720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c105220 0x7fd44c105630 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 --2- 172.21.15.38:0/4192255720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c103210 0x7fd44c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 -- 172.21.15.38:0/4192255720 >> 172.21.15.38:0/4192255720 conn(0x7fd44c079ea0 msgr2=0x7fd44c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 -- 172.21.15.38:0/4192255720 shutdown_connections 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 -- 172.21.15.38:0/4192255720 wait complete. 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.662+0000 7fd451c20640 1 Processor -- start 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 -- start start 2024-09-21T06:17:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 0x7fd44c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 0x7fd44c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c112b60 con 0x7fd44c103210 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1129e0 con 0x7fd44c105b70 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd451c20640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c112ce0 con 0x7fd44c105220 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd44b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd44b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55292/0 (socket says 172.21.15.38:55292) 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd44b7fe640 1 -- 172.21.15.38:0/1648741391 learned_addr learned my addr 172.21.15.38:0/1648741391 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd44affd640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 0x7fd44c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.663+0000 7fd44bfff640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 0x7fd44c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 -- 172.21.15.38:0/1648741391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 msgr2=0x7fd44c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 0x7fd44c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 -- 172.21.15.38:0/1648741391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 msgr2=0x7fd44c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 0x7fd44c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 -- 172.21.15.38:0/1648741391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1a0570 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44affd640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 0x7fd44c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd44b7fe640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c970 tx=0x7fd43c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c004220 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd43c0043c0 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c1a0860 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00f450 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.664+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1a6fc0 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.665+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c103620 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.668+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fd43c003730 con 0x7fd44c103210 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.668+0000 7fd448ff9640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 0x7fd4340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.669+0000 7fd44affd640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 0x7fd4340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.669+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fd43c0e7410 con 0x7fd44c103210 2024-09-21T06:17:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.669+0000 7fd44affd640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 0x7fd4340b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd440005940 tx=0x7fd4400058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.672+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd43c014030 con 0x7fd44c103210 2024-09-21T06:17:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.898+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd44c1a72b0 con 0x7fd44c103210 2024-09-21T06:17:56.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.937+0000 7fd448ff9640 1 -- 172.21.15.38:0/1648741391 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fd43c0b2040 con 0x7fd44c103210 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 msgr2=0x7fd4340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 0x7fd4340b8a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd440005940 tx=0x7fd4400058d0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 msgr2=0x7fd44c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00c970 tx=0x7fd43c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 shutdown_connections 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4340b6560 0x7fd4340b8a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd44c105b70 0x7fd44c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd44c105220 0x7fd44c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 --2- 172.21.15.38:0/1648741391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd44c103210 0x7fd44c19a600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 >> 172.21.15.38:0/1648741391 conn(0x7fd44c079ea0 msgr2=0x7fd44c108730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:56.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 shutdown_connections 2024-09-21T06:17:56.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:56.939+0000 7fd451c20640 1 -- 172.21.15.38:0/1648741391 wait complete. 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:active 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: Cluster is now healthy 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:active 2024-09-21T06:17:57.600 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:57 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:17:57.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T06:17:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:active 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: Cluster is now healthy 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:active 2024-09-21T06:17:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:57 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: pgmap v265: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] up:active 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: Cluster is now healthy 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T06:17:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:17:57.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1648741391' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:17:57.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] up:active 2024-09-21T06:17:57.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:57 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:17:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:17:58.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 -- 172.21.15.38:0/3532130310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3741083a0 msgr2=0x7fe3741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 --2- 172.21.15.38:0/3532130310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3741083a0 0x7fe3741087b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe368009900 tx=0x7fe36802a410 comp rx=0 tx=0).stop 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 -- 172.21.15.38:0/3532130310 shutdown_connections 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 --2- 172.21.15.38:0/3532130310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 0x7fe37410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 --2- 172.21.15.38:0/3532130310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3741083a0 0x7fe3741087b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 --2- 172.21.15.38:0/3532130310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe374102a60 0x7fe374102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 -- 172.21.15.38:0/3532130310 >> 172.21.15.38:0/3532130310 conn(0x7fe374079730 msgr2=0x7fe374079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 -- 172.21.15.38:0/3532130310 shutdown_connections 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.401+0000 7fe37a70b640 1 -- 172.21.15.38:0/3532130310 wait complete. 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 Processor -- start 2024-09-21T06:17:58.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 -- start start 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 0x7fe37419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 0x7fe37419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe374112a80 con 0x7fe374102a60 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe374112900 con 0x7fe374108cf0 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe37a70b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe374112c00 con 0x7fe3741083a0 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.402+0000 7fe373fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55312/0 (socket says 172.21.15.38:55312) 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 -- 172.21.15.38:0/1407840092 learned_addr learned my addr 172.21.15.38:0/1407840092 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe378ca8640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 0x7fe37419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe3737fe640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 0x7fe37419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 -- 172.21.15.38:0/1407840092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 msgr2=0x7fe37419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 0x7fe37419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 -- 172.21.15.38:0/1407840092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 msgr2=0x7fe37419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 0x7fe37419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 -- 172.21.15.38:0/1407840092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3741a04d0 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe3737fe640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 0x7fe37419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe373fff640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e9f0 tx=0x7fe36400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36400cd80 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3741a07c0 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3640054f0 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.403+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364010690 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.404+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3740ff550 con 0x7fe374102a60 2024-09-21T06:17:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.405+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374103ce0 con 0x7fe374102a60 2024-09-21T06:17:58.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.407+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe3640046c0 con 0x7fe374102a60 2024-09-21T06:17:58.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.408+0000 7fe3717fa640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 0x7fe35c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:17:58.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.408+0000 7fe3737fe640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 0x7fe35c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:17:58.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.408+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe3640e7ab0 con 0x7fe374102a60 2024-09-21T06:17:58.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.409+0000 7fe3737fe640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 0x7fe35c0b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe368000c00 tx=0x7fe368005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:17:58.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.412+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe364056710 con 0x7fe374102a60 2024-09-21T06:17:58.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:58.637+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe37410baf0 con 0x7fe374102a60 2024-09-21T06:17:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.318+0000 7fe3717fa640 1 -- 172.21.15.38:0/1407840092 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fe3640ae300 con 0x7fe374102a60 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.320+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 msgr2=0x7fe35c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.320+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 0x7fe35c0b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe368000c00 tx=0x7fe368005a20 comp rx=0 tx=0).stop 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.320+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 msgr2=0x7fe37419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.320+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e9f0 tx=0x7fe36400edf0 comp rx=0 tx=0).stop 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 shutdown_connections 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe35c0b6560 0x7fe35c0b8a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe374108cf0 0x7fe37419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3741083a0 0x7fe37419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 --2- 172.21.15.38:0/1407840092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe374102a60 0x7fe37419a560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:17:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 >> 172.21.15.38:0/1407840092 conn(0x7fe374079730 msgr2=0x7fe37406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:17:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 shutdown_connections 2024-09-21T06:17:59.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:17:59.321+0000 7fe37a70b640 1 -- 172.21.15.38:0/1407840092 wait complete. 2024-09-21T06:17:59.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:59 smithi044 ceph-mon[34369]: pgmap v266: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-21T06:17:59.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:17:59 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:17:59.405 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: 2024-09-21T06:17:59.104+0000 7f28e32ab640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T06:17:59.405 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:17:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: 2024-09-21T06:17:59.104+0000 7f28e32ab640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T06:17:59.624 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:59 smithi038 ceph-mon[31215]: pgmap v266: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-21T06:17:59.624 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:17:59 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:17:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:59 smithi174 ceph-mon[34815]: pgmap v266: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 2.8 KiB/s wr, 8 op/s 2024-09-21T06:17:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:17:59 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:17:59.935 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T06:17:59.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T06:18:00.199 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:00.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:00 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:18:00.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:00 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:18:00.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:00 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:18:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:00 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:18:00.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1407840092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:18:00.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 -- 172.21.15.38:0/3332586886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9928103b60 msgr2=0x7f9928103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 --2- 172.21.15.38:0/3332586886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9928103b60 0x7f9928103f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9924009900 tx=0x7f992402a410 comp rx=0 tx=0).stop 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 -- 172.21.15.38:0/3332586886 shutdown_connections 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 --2- 172.21.15.38:0/3332586886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 0x7f9928110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 --2- 172.21.15.38:0/3332586886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99281094a0 0x7f99281098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 --2- 172.21.15.38:0/3332586886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9928103b60 0x7f9928103f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 -- 172.21.15.38:0/3332586886 >> 172.21.15.38:0/3332586886 conn(0x7f992807b850 msgr2=0x7f992807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 -- 172.21.15.38:0/3332586886 shutdown_connections 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.657+0000 7f993043f640 1 -- 172.21.15.38:0/3332586886 wait complete. 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 Processor -- start 2024-09-21T06:18:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 -- start start 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9928103b60 0x7f992819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 0x7f992819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9928113bd0 con 0x7f99281094a0 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9928113a50 con 0x7f9928103b60 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f993043f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9928113d50 con 0x7f9928109df0 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f992d9da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f992d9da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51852/0 (socket says 172.21.15.38:51852) 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f992d9da640 1 -- 172.21.15.38:0/3016983965 learned_addr learned my addr 172.21.15.38:0/3016983965 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f992e1db640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9928103b60 0x7f992819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.658+0000 7f992e9dc640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 0x7f992819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 -- 172.21.15.38:0/3016983965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 msgr2=0x7f992819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 0x7f992819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 -- 172.21.15.38:0/3016983965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9928103b60 msgr2=0x7f992819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9928103b60 0x7f992819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 -- 172.21.15.38:0/3016983965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99281a0550 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f992d9da640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f991800e9f0 tx=0x7f991800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991800ccc0 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99281a0840 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9918010900 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99281a6fa0 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.659+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918018900 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.660+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9928103f70 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.662+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f9918010ab0 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.663+0000 7f991f7fe640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 0x7f99140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.663+0000 7f992e1db640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 0x7f99140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.663+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f99180e7a90 con 0x7f99281094a0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.664+0000 7f992e1db640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 0x7f99140b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9924009230 tx=0x7f99240058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:00.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.666+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99180b2720 con 0x7f99281094a0 2024-09-21T06:18:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.880+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9928063800 con 0x7f99140b6560 2024-09-21T06:18:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.907+0000 7f991f7fe640 1 -- 172.21.15.38:0/3016983965 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9928063800 con 0x7f99140b6560 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 msgr2=0x7f99140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 0x7f99140b8a70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9924009230 tx=0x7f99240058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 msgr2=0x7f992819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f991800e9f0 tx=0x7f991800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 shutdown_connections 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99140b6560 0x7f99140b8a70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9928109df0 0x7f992819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f99281094a0 0x7f992819ab80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 --2- 172.21.15.38:0/3016983965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9928103b60 0x7f992819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:00.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 >> 172.21.15.38:0/3016983965 conn(0x7f992807b850 msgr2=0x7f9928107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:00.912 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:18:00.885+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:18:00.912 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:18:00.885+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:18:00.912 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:18:00.885+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:18:00.912 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:18:00.885+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:18:00.912 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:18:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:18:00.885+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:18:00.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.909+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 shutdown_connections 2024-09-21T06:18:00.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:00.910+0000 7f993043f640 1 -- 172.21.15.38:0/3016983965 wait complete. 2024-09-21T06:18:01.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:01 smithi038 ceph-mon[31215]: pgmap v267: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.3 KiB/s wr, 10 op/s 2024-09-21T06:18:01.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T06:18:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:01 smithi174 ceph-mon[34815]: pgmap v267: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.3 KiB/s wr, 10 op/s 2024-09-21T06:18:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:01 smithi044 ceph-mon[34369]: pgmap v267: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.3 KiB/s wr, 10 op/s 2024-09-21T06:18:01.797 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 -- 172.21.15.38:0/3174238242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 msgr2=0x7fc5c81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/3174238242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c81087e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009900 tx=0x7fc5bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 -- 172.21.15.38:0/3174238242 shutdown_connections 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/3174238242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/3174238242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c81087e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/3174238242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 0x7fc5c8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 -- 172.21.15.38:0/3174238242 >> 172.21.15.38:0/3174238242 conn(0x7fc5c8079760 msgr2=0x7fc5c8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 -- 172.21.15.38:0/3174238242 shutdown_connections 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.310+0000 7fc5ceec1640 1 -- 172.21.15.38:0/3174238242 wait complete. 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.311+0000 7fc5ceec1640 1 Processor -- start 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.311+0000 7fc5ceec1640 1 -- start start 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 0x7fc5c819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8113bd0 con 0x7fc5c81083d0 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8113a50 con 0x7fc5c8108d20 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ceec1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8113d50 con 0x7fc5c8102ae0 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51894/0 (socket says 172.21.15.38:51894) 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 -- 172.21.15.38:0/603375481 learned_addr learned my addr 172.21.15.38:0/603375481 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5ccc5d640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 0x7fc5c819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:02.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5cd45e640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 -- 172.21.15.38:0/603375481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 msgr2=0x7fc5c819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 0x7fc5c819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 -- 172.21.15.38:0/603375481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 msgr2=0x7fc5c819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 -- 172.21.15.38:0/603375481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c81a0510 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5cd45e640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.312+0000 7fc5c7fff640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc005940 tx=0x7fc5bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.313+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc03f030 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.313+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c81a07a0 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.313+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc5bc0318f0 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.313+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc035070 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.313+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c81a6f60 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.314+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c8103d10 con 0x7fc5c81083d0 2024-09-21T06:18:02.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.316+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc5bc042030 con 0x7fc5c81083d0 2024-09-21T06:18:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.316+0000 7fc5c5ffb640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 0x7fc5b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.317+0000 7fc5ccc5d640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 0x7fc5b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.317+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fc5bc107bb0 con 0x7fc5c81083d0 2024-09-21T06:18:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.317+0000 7fc5ccc5d640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 0x7fc5b00b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8005fd0 tx=0x7fc5b800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.320+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5bc0ce460 con 0x7fc5c81083d0 2024-09-21T06:18:02.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.352+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc5bc0c9fd0 con 0x7fc5c81083d0 2024-09-21T06:18:02.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:02 smithi038 ceph-mon[31215]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:02.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.547+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc5c8063800 con 0x7fc5b00b6560 2024-09-21T06:18:02.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.575+0000 7fc5c5ffb640 1 -- 172.21.15.38:0/603375481 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc5c8063800 con 0x7fc5b00b6560 2024-09-21T06:18:02.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 msgr2=0x7fc5b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 0x7fc5b00b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8005fd0 tx=0x7fc5b800b390 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 msgr2=0x7fc5c819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc005940 tx=0x7fc5bc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 shutdown_connections 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc5b00b6560 0x7fc5b00b8a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8108d20 0x7fc5c819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc5c81083d0 0x7fc5c819ab40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 --2- 172.21.15.38:0/603375481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102ae0 0x7fc5c819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 >> 172.21.15.38:0/603375481 conn(0x7fc5c8079760 msgr2=0x7fc5c8105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 shutdown_connections 2024-09-21T06:18:02.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:02.578+0000 7fc5ceec1640 1 -- 172.21.15.38:0/603375481 wait complete. 2024-09-21T06:18:02.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:02 smithi174 ceph-mon[34815]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:02 smithi044 ceph-mon[34369]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:03.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T06:18:03.446 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:03 smithi038 ceph-mon[31215]: pgmap v268: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T06:18:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:03 smithi038 ceph-mon[31215]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:18:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:03 smithi174 ceph-mon[34815]: pgmap v268: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T06:18:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:03 smithi174 ceph-mon[34815]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:18:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:03 smithi044 ceph-mon[34369]: pgmap v268: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-21T06:18:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:03 smithi044 ceph-mon[34369]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 -- 172.21.15.38:0/963620837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2781094a0 msgr2=0x7ff2781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 --2- 172.21.15.38:0/963620837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2781094a0 0x7ff2781098b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 -- 172.21.15.38:0/963620837 shutdown_connections 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 --2- 172.21.15.38:0/963620837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278109df0 0x7ff278110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 --2- 172.21.15.38:0/963620837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2781094a0 0x7ff2781098b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 --2- 172.21.15.38:0/963620837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff278103b60 0x7ff278103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 -- 172.21.15.38:0/963620837 >> 172.21.15.38:0/963620837 conn(0x7ff27807b850 msgr2=0x7ff27807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 -- 172.21.15.38:0/963620837 shutdown_connections 2024-09-21T06:18:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 -- 172.21.15.38:0/963620837 wait complete. 2024-09-21T06:18:03.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.902+0000 7ff27dc51640 1 Processor -- start 2024-09-21T06:18:03.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 -- start start 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278103b60 0x7ff27819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2781094a0 0x7ff27819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff278113bd0 con 0x7ff278109df0 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff278113a50 con 0x7ff2781094a0 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff27dc51640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff278113d50 con 0x7ff278103b60 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff277fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff277fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51914/0 (socket says 172.21.15.38:51914) 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff277fff640 1 -- 172.21.15.38:0/1510913772 learned_addr learned my addr 172.21.15.38:0/1510913772 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff276ffd640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2781094a0 0x7ff27819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.903+0000 7ff2777fe640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278103b60 0x7ff27819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 -- 172.21.15.38:0/1510913772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278103b60 msgr2=0x7ff27819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:03.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278103b60 0x7ff27819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 -- 172.21.15.38:0/1510913772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2781094a0 msgr2=0x7ff27819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2781094a0 0x7ff27819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 -- 172.21.15.38:0/1510913772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2781a0590 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff277fff640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff27000cce0 tx=0x7ff27000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000f450 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff27000fac0 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781a0880 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270018b20 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.904+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781a70a0 con 0x7ff278109df0 2024-09-21T06:18:03.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.905+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff278103f70 con 0x7ff278109df0 2024-09-21T06:18:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.907+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff27000f5f0 con 0x7ff278109df0 2024-09-21T06:18:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.907+0000 7ff274ff9640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 0x7ff2600b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.908+0000 7ff2777fe640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 0x7ff2600b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.908+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ff2700e7c90 con 0x7ff278109df0 2024-09-21T06:18:03.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.908+0000 7ff2777fe640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 0x7ff2600b8bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff26800abe0 tx=0x7ff26800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:03.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:03.911+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff270056710 con 0x7ff278109df0 2024-09-21T06:18:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.127+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ff278063800 con 0x7ff2600b66a0 2024-09-21T06:18:04.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.133+0000 7ff274ff9640 1 -- 172.21.15.38:0/1510913772 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff278063800 con 0x7ff2600b66a0 2024-09-21T06:18:04.135 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/qa/sv_0/32e6cc5b-53a6-4a28-8563-f2a056605fe4 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 msgr2=0x7ff2600b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 0x7ff2600b8bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff26800abe0 tx=0x7ff26800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 msgr2=0x7ff27819ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff27000cce0 tx=0x7ff27000a620 comp rx=0 tx=0).stop 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 shutdown_connections 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff2600b66a0 0x7ff2600b8bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff278109df0 0x7ff27819ff20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2781094a0 0x7ff27819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 --2- 172.21.15.38:0/1510913772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff278103b60 0x7ff27819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 >> 172.21.15.38:0/1510913772 conn(0x7ff27807b850 msgr2=0x7ff2781075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 shutdown_connections 2024-09-21T06:18:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:04.135+0000 7ff27dc51640 1 -- 172.21.15.38:0/1510913772 wait complete. 2024-09-21T06:18:04.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:04 smithi038 ceph-mon[31215]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:04.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:04 smithi174 ceph-mon[34815]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:04.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:04 smithi044 ceph-mon[34369]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:04.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T06:18:05.074 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:05.449 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:05 smithi038 ceph-mon[31215]: pgmap v269: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-21T06:18:05.449 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:05 smithi038 ceph-mon[31215]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 -- 172.21.15.38:0/2301190095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc102ae0 msgr2=0x7f73fc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 --2- 172.21.15.38:0/2301190095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc102ae0 0x7f73fc102ef0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009900 tx=0x7f73ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 -- 172.21.15.38:0/2301190095 shutdown_connections 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 --2- 172.21.15.38:0/2301190095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc108d20 0x7f73fc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 --2- 172.21.15.38:0/2301190095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 0x7f73fc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 --2- 172.21.15.38:0/2301190095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc102ae0 0x7f73fc102ef0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 -- 172.21.15.38:0/2301190095 >> 172.21.15.38:0/2301190095 conn(0x7f73fc079760 msgr2=0x7f73fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 -- 172.21.15.38:0/2301190095 shutdown_connections 2024-09-21T06:18:05.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.545+0000 7f740121a640 1 -- 172.21.15.38:0/2301190095 wait complete. 2024-09-21T06:18:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.546+0000 7f740121a640 1 Processor -- start 2024-09-21T06:18:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.546+0000 7f740121a640 1 -- start start 2024-09-21T06:18:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 0x7f73fc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 0x7f73fc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc112b30 con 0x7f73fc108d20 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc1129b0 con 0x7f73fc1083d0 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f740121a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc112cb0 con 0x7f73fc102ae0 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 0x7f73fc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 0x7f73fc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:40776/0 (socket says 172.21.15.38:40776) 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fa59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 0x7f73fc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51940/0 (socket says 172.21.15.38:51940) 2024-09-21T06:18:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fad9d640 1 -- 172.21.15.38:0/208800383 learned_addr learned my addr 172.21.15.38:0/208800383 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 -- 172.21.15.38:0/208800383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 msgr2=0x7f73fc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 0x7f73fc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 -- 172.21.15.38:0/208800383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 msgr2=0x7f73fc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 0x7f73fc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.547+0000 7f73fb59e640 1 -- 172.21.15.38:0/208800383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc1a0500 con 0x7f73fc108d20 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f73fb59e640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73f400ca30 tx=0x7f73f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4004d20 con 0x7f73fc108d20 2024-09-21T06:18:05.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73f4005020 con 0x7f73fc108d20 2024-09-21T06:18:05.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc1a07f0 con 0x7f73fc108d20 2024-09-21T06:18:05.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400f670 con 0x7f73fc108d20 2024-09-21T06:18:05.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.548+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc1a6f50 con 0x7f73fc108d20 2024-09-21T06:18:05.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.549+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc103d10 con 0x7f73fc108d20 2024-09-21T06:18:05.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.551+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f73f40051d0 con 0x7f73fc108d20 2024-09-21T06:18:05.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.551+0000 7f73e3fff640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 0x7f73e40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:05.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.552+0000 7f73fad9d640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 0x7f73e40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:05.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.552+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f73f40e7a90 con 0x7f73fc108d20 2024-09-21T06:18:05.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.552+0000 7f73fad9d640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 0x7f73e40b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0096c0 tx=0x7f73ec005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:05.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.555+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73f4014070 con 0x7f73fc108d20 2024-09-21T06:18:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:05 smithi174 ceph-mon[34815]: pgmap v269: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-21T06:18:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:05 smithi174 ceph-mon[34815]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:05 smithi044 ceph-mon[34369]: pgmap v269: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-21T06:18:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:05 smithi044 ceph-mon[34369]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:05.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.773+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f73fc101740 con 0x7f73e40b65f0 2024-09-21T06:18:05.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.801+0000 7f73e3fff640 1 -- 172.21.15.38:0/208800383 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f73fc101740 con 0x7f73e40b65f0 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 msgr2=0x7f73e40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 0x7f73e40b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0096c0 tx=0x7f73ec005a20 comp rx=0 tx=0).stop 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 msgr2=0x7f73fc19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73f400ca30 tx=0x7f73f400ce30 comp rx=0 tx=0).stop 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 shutdown_connections 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f73e40b65f0 0x7f73e40b8b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73fc108d20 0x7f73fc19fdd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73fc1083d0 0x7f73fc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 --2- 172.21.15.38:0/208800383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73fc102ae0 0x7f73fc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 >> 172.21.15.38:0/208800383 conn(0x7f73fc079760 msgr2=0x7f73fc06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 shutdown_connections 2024-09-21T06:18:05.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:05.803+0000 7f740121a640 1 -- 172.21.15.38:0/208800383 wait complete. 2024-09-21T06:18:06.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T06:18:06.779 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 -- 172.21.15.38:0/1482524368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c4102a90 msgr2=0x7f84c4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:07.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 --2- 172.21.15.38:0/1482524368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c4102a90 0x7f84c4102ea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009900 tx=0x7f84c002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 -- 172.21.15.38:0/1482524368 shutdown_connections 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 --2- 172.21.15.38:0/1482524368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 0x7f84c410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 --2- 172.21.15.38:0/1482524368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c41083d0 0x7f84c41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 --2- 172.21.15.38:0/1482524368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c4102a90 0x7f84c4102ea0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.253+0000 7f84cc20b640 1 -- 172.21.15.38:0/1482524368 >> 172.21.15.38:0/1482524368 conn(0x7f84c4079750 msgr2=0x7f84c4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.254+0000 7f84cc20b640 1 -- 172.21.15.38:0/1482524368 shutdown_connections 2024-09-21T06:18:07.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.254+0000 7f84cc20b640 1 -- 172.21.15.38:0/1482524368 wait complete. 2024-09-21T06:18:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.254+0000 7f84cc20b640 1 Processor -- start 2024-09-21T06:18:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 -- start start 2024-09-21T06:18:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c4102a90 0x7f84c410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 0x7f84c4110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4113c20 con 0x7f84c41083d0 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4113aa0 con 0x7f84c4102a90 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84cc20b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4113da0 con 0x7f84c4108d20 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51966/0 (socket says 172.21.15.38:51966) 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 -- 172.21.15.38:0/3519545100 learned_addr learned my addr 172.21.15.38:0/3519545100 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c9fa7640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c4102a90 0x7f84c410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84ca7a8640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 0x7f84c4110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 -- 172.21.15.38:0/3519545100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 msgr2=0x7f84c4110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 0x7f84c4110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 -- 172.21.15.38:0/3519545100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c4102a90 msgr2=0x7f84c410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c4102a90 0x7f84c410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.255+0000 7f84c97a6640 1 -- 172.21.15.38:0/3519545100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c41a87a0 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84c97a6640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c970 tx=0x7f84b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4014070 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c41a8a90 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f84b4004440 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4003e40 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.256+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c41a8fd0 con 0x7f84c41083d0 2024-09-21T06:18:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.257+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4103d10 con 0x7f84c41083d0 2024-09-21T06:18:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.259+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f84b4017070 con 0x7f84c41083d0 2024-09-21T06:18:07.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.260+0000 7f84baffd640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 0x7f84b00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:07.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.260+0000 7f84c9fa7640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 0x7f84b00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:07.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.260+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f84b40e77c0 con 0x7f84c41083d0 2024-09-21T06:18:07.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.261+0000 7f84c9fa7640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 0x7f84b00b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84c4111a30 tx=0x7f84c0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.264+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84b401e020 con 0x7f84c41083d0 2024-09-21T06:18:07.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.483+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f84c4063800 con 0x7f84b00b65f0 2024-09-21T06:18:07.485 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:07 smithi038 ceph-mon[31215]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T06:18:07.485 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:07 smithi038 ceph-mon[31215]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.488+0000 7f84baffd640 1 -- 172.21.15.38:0/3519545100 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f84c4063800 con 0x7f84b00b65f0 2024-09-21T06:18:07.490 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/qa/sv_1/29d3b5d9-7e45-4e21-81bd-d4adc88cf6d9 2024-09-21T06:18:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 msgr2=0x7f84b00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 0x7f84b00b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f84c4111a30 tx=0x7f84c0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 msgr2=0x7f84c4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c970 tx=0x7f84b400ce30 comp rx=0 tx=0).stop 2024-09-21T06:18:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 shutdown_connections 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f84b00b65f0 0x7f84b00b8b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84c4108d20 0x7f84c4110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84c41083d0 0x7f84c4110520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 --2- 172.21.15.38:0/3519545100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c4102a90 0x7f84c410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.490+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 >> 172.21.15.38:0/3519545100 conn(0x7f84c4079750 msgr2=0x7f84c4101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.491+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 shutdown_connections 2024-09-21T06:18:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:07.491+0000 7f84cc20b640 1 -- 172.21.15.38:0/3519545100 wait complete. 2024-09-21T06:18:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:07 smithi174 ceph-mon[34815]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T06:18:07.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:07 smithi174 ceph-mon[34815]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:07.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:07 smithi044 ceph-mon[34369]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T06:18:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:07 smithi044 ceph-mon[34369]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:08.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:08.387 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:08.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 -- 172.21.15.38:0/2956611085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c102a80 msgr2=0x7fdb5c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:08.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 --2- 172.21.15.38:0/2956611085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c102a80 0x7fdb5c102e90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb5002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 -- 172.21.15.38:0/2956611085 shutdown_connections 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 --2- 172.21.15.38:0/2956611085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c108d10 0x7fdb5c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 --2- 172.21.15.38:0/2956611085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c1083c0 0x7fdb5c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 --2- 172.21.15.38:0/2956611085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c102a80 0x7fdb5c102e90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.772+0000 7fdb62c23640 1 -- 172.21.15.38:0/2956611085 >> 172.21.15.38:0/2956611085 conn(0x7fdb5c079740 msgr2=0x7fdb5c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.773+0000 7fdb62c23640 1 -- 172.21.15.38:0/2956611085 shutdown_connections 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.773+0000 7fdb62c23640 1 -- 172.21.15.38:0/2956611085 wait complete. 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.773+0000 7fdb62c23640 1 Processor -- start 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.773+0000 7fdb62c23640 1 -- start start 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c102a80 0x7fdb5c104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c1083c0 0x7fdb5c1047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:08.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c112ac0 con 0x7fdb5c108d10 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c112940 con 0x7fdb5c1083c0 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb62c23640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c112c40 con 0x7fdb5c102a80 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb609bf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c102a80 0x7fdb5c104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb5bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c1083c0 0x7fdb5c1047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51986/0 (socket says 172.21.15.38:51986) 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 -- 172.21.15.38:0/472480349 learned_addr learned my addr 172.21.15.38:0/472480349 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 -- 172.21.15.38:0/472480349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c102a80 msgr2=0x7fdb5c104270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c102a80 0x7fdb5c104270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 -- 172.21.15.38:0/472480349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c1083c0 msgr2=0x7fdb5c1047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c1083c0 0x7fdb5c1047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:08.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 -- 172.21.15.38:0/472480349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c1a8840 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.774+0000 7fdb611c0640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cad0 tx=0x7fdb5400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.775+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400ae20 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.775+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c1a8b30 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.775+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdb54005020 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.775+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400f6b0 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.775+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1a9020 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.776+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c103d00 con 0x7fdb5c108d10 2024-09-21T06:18:08.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.777+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fdb540051d0 con 0x7fdb5c108d10 2024-09-21T06:18:08.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.778+0000 7fdb59ffb640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 0x7fdb4c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:08.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.779+0000 7fdb609bf640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 0x7fdb4c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:08.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.779+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fdb540e7480 con 0x7fdb5c108d10 2024-09-21T06:18:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.779+0000 7fdb609bf640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 0x7fdb4c0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c105cc0 tx=0x7fdb500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:08.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:08.783+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb54014030 con 0x7fdb5c108d10 2024-09-21T06:18:09.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.007+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5c105570 con 0x7fdb5c108d10 2024-09-21T06:18:09.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.008+0000 7fdb59ffb640 1 -- 172.21.15.38:0/472480349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7fdb540b1fb0 con 0x7fdb5c108d10 2024-09-21T06:18:09.010 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:09.010 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:18:09.010 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 msgr2=0x7fdb4c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 0x7fdb4c0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c105cc0 tx=0x7fdb500058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 msgr2=0x7fdb5c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cad0 tx=0x7fdb5400cf90 comp rx=0 tx=0).stop 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 shutdown_connections 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdb4c0b65f0 0x7fdb4c0b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb5c108d10 0x7fdb5c104cf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c1083c0 0x7fdb5c1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:09.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 --2- 172.21.15.38:0/472480349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb5c102a80 0x7fdb5c104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 >> 172.21.15.38:0/472480349 conn(0x7fdb5c079740 msgr2=0x7fdb5c106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 shutdown_connections 2024-09-21T06:18:09.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:09.010+0000 7fdb62c23640 1 -- 172.21.15.38:0/472480349 wait complete. 2024-09-21T06:18:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:09 smithi174 ceph-mon[34815]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:09 smithi174 ceph-mon[34815]: pgmap v271: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-21T06:18:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:09 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/472480349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:09 smithi044 ceph-mon[34369]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:09 smithi044 ceph-mon[34369]: pgmap v271: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-21T06:18:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:09 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/472480349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:09.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:09 smithi038 ceph-mon[31215]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:18:09.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:09 smithi038 ceph-mon[31215]: pgmap v271: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-21T06:18:09.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:09 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/472480349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:09.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:18:09.970 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 -- 172.21.15.38:0/1453149171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 msgr2=0x7f0b50102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 --2- 172.21.15.38:0/1453149171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b50102ef0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009900 tx=0x7f0b4c02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 -- 172.21.15.38:0/1453149171 shutdown_connections 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 --2- 172.21.15.38:0/1453149171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 0x7f0b5010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 --2- 172.21.15.38:0/1453149171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 0x7f0b501087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 --2- 172.21.15.38:0/1453149171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b50102ef0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 -- 172.21.15.38:0/1453149171 >> 172.21.15.38:0/1453149171 conn(0x7f0b50079760 msgr2=0x7f0b50079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 -- 172.21.15.38:0/1453149171 shutdown_connections 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.474+0000 7f0b5761a640 1 -- 172.21.15.38:0/1453149171 wait complete. 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.475+0000 7f0b5761a640 1 Processor -- start 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.475+0000 7f0b5761a640 1 -- start start 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 0x7f0b5019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 0x7f0b5019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50113c40 con 0x7f0b50102ae0 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50113ac0 con 0x7f0b501083d0 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b5761a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0b50113dc0 con 0x7f0b50108d20 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35756/0 (socket says 172.21.15.38:35756) 2024-09-21T06:18:10.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 -- 172.21.15.38:0/2136418123 learned_addr learned my addr 172.21.15.38:0/2136418123 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b55bb7640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 0x7f0b5019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b54bb5640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 0x7f0b5019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 -- 172.21.15.38:0/2136418123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 msgr2=0x7f0b5019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 0x7f0b5019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 -- 172.21.15.38:0/2136418123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 msgr2=0x7f0b5019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 0x7f0b5019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.476+0000 7f0b553b6640 1 -- 172.21.15.38:0/2136418123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b501a0500 con 0x7f0b50102ae0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b553b6640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c006010 tx=0x7f0b4c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c03f070 con 0x7f0b50102ae0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b4c031e10 con 0x7f0b50102ae0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b501a0790 con 0x7f0b50102ae0 2024-09-21T06:18:10.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c035030 con 0x7f0b50102ae0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.477+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501a6f50 con 0x7f0b50102ae0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.478+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b50103d10 con 0x7f0b50102ae0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.480+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f0b4c042070 con 0x7f0b50102ae0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.481+0000 7f0b467fc640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 0x7f0b3c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.481+0000 7f0b54bb5640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 0x7f0b3c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.481+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f0b4c1084a0 con 0x7f0b50102ae0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.482+0000 7f0b54bb5640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 0x7f0b3c0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b50100be0 tx=0x7f0b4000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:10.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.484+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b4c0d2f70 con 0x7f0b50102ae0 2024-09-21T06:18:10.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.673+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b5010ab20 con 0x7f0b50102ae0 2024-09-21T06:18:10.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.675+0000 7f0b467fc640 1 -- 172.21.15.38:0/2136418123 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22581 (secure 0 0 0) 0x7f0b4c0d7eb0 con 0x7f0b50102ae0 2024-09-21T06:18:10.677 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:10.677 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":75,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:17:47.782193+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 msgr2=0x7f0b3c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 0x7f0b3c0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b50100be0 tx=0x7f0b4000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 msgr2=0x7f0b5019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c006010 tx=0x7f0b4c004430 comp rx=0 tx=0).stop 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 shutdown_connections 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b3c0b65f0 0x7f0b3c0b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b50108d20 0x7f0b5019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b501083d0 0x7f0b5019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 --2- 172.21.15.38:0/2136418123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b50102ae0 0x7f0b5019a590 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.677+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 >> 172.21.15.38:0/2136418123 conn(0x7f0b50079760 msgr2=0x7f0b50101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.678+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 shutdown_connections 2024-09-21T06:18:10.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:10.678+0000 7f0b5761a640 1 -- 172.21.15.38:0/2136418123 wait complete. 2024-09-21T06:18:11.388 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:18:11.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:18:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:11 smithi174 ceph-mon[34815]: pgmap v272: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-21T06:18:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:11 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2136418123' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:11 smithi044 ceph-mon[34369]: pgmap v272: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-21T06:18:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:11 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2136418123' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:11 smithi038 ceph-mon[31215]: pgmap v272: 97 pgs: 97 active+clean; 625 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-21T06:18:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:11 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2136418123' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:12.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.119+0000 7f9f58e61640 1 -- 172.21.15.38:0/483956951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 msgr2=0x7f9f5410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.119+0000 7f9f58e61640 1 --2- 172.21.15.38:0/483956951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5410f560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009ca0 tx=0x7f9f4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 -- 172.21.15.38:0/483956951 shutdown_connections 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 --2- 172.21.15.38:0/483956951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5410f560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 --2- 172.21.15.38:0/483956951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f541083e0 0x7f9f541087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 --2- 172.21.15.38:0/483956951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f54102aa0 0x7f9f54102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 -- 172.21.15.38:0/483956951 >> 172.21.15.38:0/483956951 conn(0x7f9f540797e0 msgr2=0x7f9f54079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 -- 172.21.15.38:0/483956951 shutdown_connections 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.120+0000 7f9f58e61640 1 -- 172.21.15.38:0/483956951 wait complete. 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 Processor -- start 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 -- start start 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f54102aa0 0x7f9f5419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 0x7f9f5419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54112ae0 con 0x7f9f54108d30 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54112960 con 0x7f9f541083e0 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f58e61640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f54112c60 con 0x7f9f54102aa0 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f52d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f52d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35774/0 (socket says 172.21.15.38:35774) 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f52d9d640 1 -- 172.21.15.38:0/2862225671 learned_addr learned my addr 172.21.15.38:0/2862225671 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:12.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.121+0000 7f9f5259c640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f54102aa0 0x7f9f5419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f51d9b640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 0x7f9f5419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 -- 172.21.15.38:0/2862225671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f54102aa0 msgr2=0x7f9f5419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f54102aa0 0x7f9f5419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 -- 172.21.15.38:0/2862225671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 msgr2=0x7f9f5419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 0x7f9f5419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 -- 172.21.15.38:0/2862225671 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f541a65e0 con 0x7f9f54108d30 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f51d9b640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 0x7f9f5419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f52d9d640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c033040 tx=0x7f9f4c003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c031650 con 0x7f9f54108d30 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f541a6870 con 0x7f9f54108d30 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f4c0317f0 con 0x7f9f54108d30 2024-09-21T06:18:12.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c02fa80 con 0x7f9f54108d30 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.122+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f541a6db0 con 0x7f9f54108d30 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.123+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f54102eb0 con 0x7f9f54108d30 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.125+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f9f4c02fc20 con 0x7f9f54108d30 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.126+0000 7f9f437fe640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 0x7f9f3c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.127+0000 7f9f5259c640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 0x7f9f3c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.127+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f9f4c108960 con 0x7f9f54108d30 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.127+0000 7f9f5259c640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 0x7f9f3c0b8b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9f5406c380 tx=0x7f9f44005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:12.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.130+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f4c0cf0b0 con 0x7f9f54108d30 2024-09-21T06:18:12.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.317+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f54063800 con 0x7f9f3c0b6620 2024-09-21T06:18:12.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.325+0000 7f9f437fe640 1 -- 172.21.15.38:0/2862225671 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258684 (secure 0 0 0) 0x7f9f54063800 con 0x7f9f3c0b6620 2024-09-21T06:18:12.328 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:12.329 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:18:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 msgr2=0x7f9f3c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 0x7f9f3c0b8b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9f5406c380 tx=0x7f9f44005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 msgr2=0x7f9f5419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c033040 tx=0x7f9f4c003c90 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 shutdown_connections 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f3c0b6620 0x7f9f3c0b8b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f54108d30 0x7f9f5419bdd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f541083e0 0x7f9f5419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 --2- 172.21.15.38:0/2862225671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f54102aa0 0x7f9f5419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 >> 172.21.15.38:0/2862225671 conn(0x7f9f540797e0 msgr2=0x7f9f54104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 shutdown_connections 2024-09-21T06:18:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:12.328+0000 7f9f58e61640 1 -- 172.21.15.38:0/2862225671 wait complete. 2024-09-21T06:18:12.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T06:18:12.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:12 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T06:18:12.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:12 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T06:18:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T06:18:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]} : dispatch 2024-09-21T06:18:12.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-21T06:18:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-21T06:18:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-21T06:18:12.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:12 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]} : dispatch 2024-09-21T06:18:12.934 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-09-21T06:18:11.662005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650841,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":187,"num_write":280,"num_write_kb":2256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385812,"kb_used_data":11604,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556012,"statfs":{"total":1151940427776,"available":1151545356288,"internally_reserved":0,"allocated":11882496,"data_stored":6716552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55251,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":90,"num_read_kb":105,"num_write":48,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003660"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263510+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:17:48.263510+0000","last_peered":"2024-09-21T06:17:48.263510+0000","last_clean":"2024-09-21T06:17:48.263510+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:17:48.263510+0000","last_undegraded":"2024-09-21T06:17:48.263510+0000","last_fullsized":"2024-09-21T06:17:48.263510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263386+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:17:48.263386+0000","last_peered":"2024-09-21T06:17:48.263386+0000","last_clean":"2024-09-21T06:17:48.263386+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:17:48.263386+0000","last_undegraded":"2024-09-21T06:17:48.263386+0000","last_fullsized":"2024-09-21T06:17:48.263386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263029+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:17:48.263029+0000","last_peered":"2024-09-21T06:17:48.263029+0000","last_clean":"2024-09-21T06:17:48.263029+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:17:48.263029+0000","last_undegraded":"2024-09-21T06:17:48.263029+0000","last_fullsized":"2024-09-21T06:17:48.263029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257990+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:17:48.257990+0000","last_peered":"2024-09-21T06:17:48.257990+0000","last_clean":"2024-09-21T06:17:48.257990+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:17:48.257990+0000","last_undegraded":"2024-09-21T06:17:48.257990+0000","last_fullsized":"2024-09-21T06:17:48.257990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258905+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:17:48.258905+0000","last_peered":"2024-09-21T06:17:48.258905+0000","last_clean":"2024-09-21T06:17:48.258905+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:17:48.258905+0000","last_undegraded":"2024-09-21T06:17:48.258905+0000","last_fullsized":"2024-09-21T06:17:48.258905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240367+0000","last_change":"2024-09-21T06:17:47.246587+0000","last_active":"2024-09-21T06:17:48.240367+0000","last_peered":"2024-09-21T06:17:48.240367+0000","last_clean":"2024-09-21T06:17:48.240367+0000","last_became_active":"2024-09-21T06:17:47.246150+0000","last_became_peered":"2024-09-21T06:17:47.246150+0000","last_unstale":"2024-09-21T06:17:48.240367+0000","last_undegraded":"2024-09-21T06:17:48.240367+0000","last_fullsized":"2024-09-21T06:17:48.240367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:43.805080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260343+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:17:48.260343+0000","last_peered":"2024-09-21T06:17:48.260343+0000","last_clean":"2024-09-21T06:17:48.260343+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:17:48.260343+0000","last_undegraded":"2024-09-21T06:17:48.260343+0000","last_fullsized":"2024-09-21T06:17:48.260343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258410+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:17:48.258410+0000","last_peered":"2024-09-21T06:17:48.258410+0000","last_clean":"2024-09-21T06:17:48.258410+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:17:48.258410+0000","last_undegraded":"2024-09-21T06:17:48.258410+0000","last_fullsized":"2024-09-21T06:17:48.258410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258579+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:17:48.258579+0000","last_peered":"2024-09-21T06:17:48.258579+0000","last_clean":"2024-09-21T06:17:48.258579+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:17:48.258579+0000","last_undegraded":"2024-09-21T06:17:48.258579+0000","last_fullsized":"2024-09-21T06:17:48.258579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240901+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:17:48.240901+0000","last_peered":"2024-09-21T06:17:48.240901+0000","last_clean":"2024-09-21T06:17:48.240901+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:17:48.240901+0000","last_undegraded":"2024-09-21T06:17:48.240901+0000","last_fullsized":"2024-09-21T06:17:48.240901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260212+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:17:48.260212+0000","last_peered":"2024-09-21T06:17:48.260212+0000","last_clean":"2024-09-21T06:17:48.260212+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:17:48.260212+0000","last_undegraded":"2024-09-21T06:17:48.260212+0000","last_fullsized":"2024-09-21T06:17:48.260212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258274+0000","last_change":"2024-09-21T06:17:47.252995+0000","last_active":"2024-09-21T06:17:48.258274+0000","last_peered":"2024-09-21T06:17:48.258274+0000","last_clean":"2024-09-21T06:17:48.258274+0000","last_became_active":"2024-09-21T06:17:47.252589+0000","last_became_peered":"2024-09-21T06:17:47.252589+0000","last_unstale":"2024-09-21T06:17:48.258274+0000","last_undegraded":"2024-09-21T06:17:48.258274+0000","last_fullsized":"2024-09-21T06:17:48.258274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:47.384446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242273+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:17:48.242273+0000","last_peered":"2024-09-21T06:17:48.242273+0000","last_clean":"2024-09-21T06:17:48.242273+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:17:48.242273+0000","last_undegraded":"2024-09-21T06:17:48.242273+0000","last_fullsized":"2024-09-21T06:17:48.242273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262895+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:17:48.262895+0000","last_peered":"2024-09-21T06:17:48.262895+0000","last_clean":"2024-09-21T06:17:48.262895+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:17:48.262895+0000","last_undegraded":"2024-09-21T06:17:48.262895+0000","last_fullsized":"2024-09-21T06:17:48.262895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262708+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:17:48.262708+0000","last_peered":"2024-09-21T06:17:48.262708+0000","last_clean":"2024-09-21T06:17:48.262708+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:17:48.262708+0000","last_undegraded":"2024-09-21T06:17:48.262708+0000","last_fullsized":"2024-09-21T06:17:48.262708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258033+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:17:48.258033+0000","last_peered":"2024-09-21T06:17:48.258033+0000","last_clean":"2024-09-21T06:17:48.258033+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:17:48.258033+0000","last_undegraded":"2024-09-21T06:17:48.258033+0000","last_fullsized":"2024-09-21T06:17:48.258033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263610+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:17:48.263610+0000","last_peered":"2024-09-21T06:17:48.263610+0000","last_clean":"2024-09-21T06:17:48.263610+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:17:48.263610+0000","last_undegraded":"2024-09-21T06:17:48.263610+0000","last_fullsized":"2024-09-21T06:17:48.263610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257988+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:17:48.257988+0000","last_peered":"2024-09-21T06:17:48.257988+0000","last_clean":"2024-09-21T06:17:48.257988+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:17:48.257988+0000","last_undegraded":"2024-09-21T06:17:48.257988+0000","last_fullsized":"2024-09-21T06:17:48.257988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244525+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:17:48.244525+0000","last_peered":"2024-09-21T06:17:48.244525+0000","last_clean":"2024-09-21T06:17:48.244525+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:17:48.244525+0000","last_undegraded":"2024-09-21T06:17:48.244525+0000","last_fullsized":"2024-09-21T06:17:48.244525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262561+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:17:48.262561+0000","last_peered":"2024-09-21T06:17:48.262561+0000","last_clean":"2024-09-21T06:17:48.262561+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:17:48.262561+0000","last_undegraded":"2024-09-21T06:17:48.262561+0000","last_fullsized":"2024-09-21T06:17:48.262561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242405+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:17:48.242405+0000","last_peered":"2024-09-21T06:17:48.242405+0000","last_clean":"2024-09-21T06:17:48.242405+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:17:48.242405+0000","last_undegraded":"2024-09-21T06:17:48.242405+0000","last_fullsized":"2024-09-21T06:17:48.242405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257646+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:17:48.257646+0000","last_peered":"2024-09-21T06:17:48.257646+0000","last_clean":"2024-09-21T06:17:48.257646+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:17:48.257646+0000","last_undegraded":"2024-09-21T06:17:48.257646+0000","last_fullsized":"2024-09-21T06:17:48.257646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258734+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:17:48.258734+0000","last_peered":"2024-09-21T06:17:48.258734+0000","last_clean":"2024-09-21T06:17:48.258734+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:17:48.258734+0000","last_undegraded":"2024-09-21T06:17:48.258734+0000","last_fullsized":"2024-09-21T06:17:48.258734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257872+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:17:48.257872+0000","last_peered":"2024-09-21T06:17:48.257872+0000","last_clean":"2024-09-21T06:17:48.257872+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:17:48.257872+0000","last_undegraded":"2024-09-21T06:17:48.257872+0000","last_fullsized":"2024-09-21T06:17:48.257872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258699+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:17:48.258699+0000","last_peered":"2024-09-21T06:17:48.258699+0000","last_clean":"2024-09-21T06:17:48.258699+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:17:48.258699+0000","last_undegraded":"2024-09-21T06:17:48.258699+0000","last_fullsized":"2024-09-21T06:17:48.258699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244623+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:17:48.244623+0000","last_peered":"2024-09-21T06:17:48.244623+0000","last_clean":"2024-09-21T06:17:48.244623+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:17:48.244623+0000","last_undegraded":"2024-09-21T06:17:48.244623+0000","last_fullsized":"2024-09-21T06:17:48.244623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263243+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:17:48.263243+0000","last_peered":"2024-09-21T06:17:48.263243+0000","last_clean":"2024-09-21T06:17:48.263243+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:17:48.263243+0000","last_undegraded":"2024-09-21T06:17:48.263243+0000","last_fullsized":"2024-09-21T06:17:48.263243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242372+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:17:48.242372+0000","last_peered":"2024-09-21T06:17:48.242372+0000","last_clean":"2024-09-21T06:17:48.242372+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:17:48.242372+0000","last_undegraded":"2024-09-21T06:17:48.242372+0000","last_fullsized":"2024-09-21T06:17:48.242372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263036+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:17:48.263036+0000","last_peered":"2024-09-21T06:17:48.263036+0000","last_clean":"2024-09-21T06:17:48.263036+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:17:48.263036+0000","last_undegraded":"2024-09-21T06:17:48.263036+0000","last_fullsized":"2024-09-21T06:17:48.263036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244296+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:17:48.244296+0000","last_peered":"2024-09-21T06:17:48.244296+0000","last_clean":"2024-09-21T06:17:48.244296+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:17:48.244296+0000","last_undegraded":"2024-09-21T06:17:48.244296+0000","last_fullsized":"2024-09-21T06:17:48.244296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244116+0000","last_change":"2024-09-21T06:17:47.246133+0000","last_active":"2024-09-21T06:17:48.244116+0000","last_peered":"2024-09-21T06:17:48.244116+0000","last_clean":"2024-09-21T06:17:48.244116+0000","last_became_active":"2024-09-21T06:17:47.245650+0000","last_became_peered":"2024-09-21T06:17:47.245650+0000","last_unstale":"2024-09-21T06:17:48.244116+0000","last_undegraded":"2024-09-21T06:17:48.244116+0000","last_fullsized":"2024-09-21T06:17:48.244116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:09.546544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261868+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:17:48.261868+0000","last_peered":"2024-09-21T06:17:48.261868+0000","last_clean":"2024-09-21T06:17:48.261868+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:17:48.261868+0000","last_undegraded":"2024-09-21T06:17:48.261868+0000","last_fullsized":"2024-09-21T06:17:48.261868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258073+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:17:48.258073+0000","last_peered":"2024-09-21T06:17:48.258073+0000","last_clean":"2024-09-21T06:17:48.258073+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:17:48.258073+0000","last_undegraded":"2024-09-21T06:17:48.258073+0000","last_fullsized":"2024-09-21T06:17:48.258073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:04.960803+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:18:04.960803+0000","last_peered":"2024-09-21T06:18:04.960803+0000","last_clean":"2024-09-21T06:18:04.960803+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:18:04.960803+0000","last_undegraded":"2024-09-21T06:18:04.960803+0000","last_fullsized":"2024-09-21T06:18:04.960803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258199+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:17:48.258199+0000","last_peered":"2024-09-21T06:17:48.258199+0000","last_clean":"2024-09-21T06:17:48.258199+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:17:48.258199+0000","last_undegraded":"2024-09-21T06:17:48.258199+0000","last_fullsized":"2024-09-21T06:17:48.258199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.322398+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:17:56.322398+0000","last_peered":"2024-09-21T06:17:56.322398+0000","last_clean":"2024-09-21T06:17:56.322398+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:17:56.322398+0000","last_undegraded":"2024-09-21T06:17:56.322398+0000","last_fullsized":"2024-09-21T06:17:56.322398+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.321941+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:17:56.321941+0000","last_peered":"2024-09-21T06:17:56.321941+0000","last_clean":"2024-09-21T06:17:56.321941+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:17:56.321941+0000","last_undegraded":"2024-09-21T06:17:56.321941+0000","last_fullsized":"2024-09-21T06:17:56.321941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258435+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:17:48.258435+0000","last_peered":"2024-09-21T06:17:48.258435+0000","last_clean":"2024-09-21T06:17:48.258435+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:17:48.258435+0000","last_undegraded":"2024-09-21T06:17:48.258435+0000","last_fullsized":"2024-09-21T06:17:48.258435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258645+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:17:48.258645+0000","last_peered":"2024-09-21T06:17:48.258645+0000","last_clean":"2024-09-21T06:17:48.258645+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:17:48.258645+0000","last_undegraded":"2024-09-21T06:17:48.258645+0000","last_fullsized":"2024-09-21T06:17:48.258645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.256800+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:17:48.256800+0000","last_peered":"2024-09-21T06:17:48.256800+0000","last_clean":"2024-09-21T06:17:48.256800+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:17:48.256800+0000","last_undegraded":"2024-09-21T06:17:48.256800+0000","last_fullsized":"2024-09-21T06:17:48.256800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:09.968040+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:18:09.968040+0000","last_peered":"2024-09-21T06:18:09.968040+0000","last_clean":"2024-09-21T06:18:09.968040+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:18:09.968040+0000","last_undegraded":"2024-09-21T06:18:09.968040+0000","last_fullsized":"2024-09-21T06:18:09.968040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257957+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:17:48.257957+0000","last_peered":"2024-09-21T06:17:48.257957+0000","last_clean":"2024-09-21T06:17:48.257957+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:17:48.257957+0000","last_undegraded":"2024-09-21T06:17:48.257957+0000","last_fullsized":"2024-09-21T06:17:48.257957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.312401+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:17:55.312401+0000","last_peered":"2024-09-21T06:17:55.312401+0000","last_clean":"2024-09-21T06:17:55.312401+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:17:55.312401+0000","last_undegraded":"2024-09-21T06:17:55.312401+0000","last_fullsized":"2024-09-21T06:17:55.312401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263654+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:17:48.263654+0000","last_peered":"2024-09-21T06:17:48.263654+0000","last_clean":"2024-09-21T06:17:48.263654+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:17:48.263654+0000","last_undegraded":"2024-09-21T06:17:48.263654+0000","last_fullsized":"2024-09-21T06:17:48.263654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.313360+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:17:55.313360+0000","last_peered":"2024-09-21T06:17:55.313360+0000","last_clean":"2024-09-21T06:17:55.313360+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:17:55.313360+0000","last_undegraded":"2024-09-21T06:17:55.313360+0000","last_fullsized":"2024-09-21T06:17:55.313360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259027+0000","last_change":"2024-09-21T06:17:47.246491+0000","last_active":"2024-09-21T06:17:48.259027+0000","last_peered":"2024-09-21T06:17:48.259027+0000","last_clean":"2024-09-21T06:17:48.259027+0000","last_became_active":"2024-09-21T06:17:47.246128+0000","last_became_peered":"2024-09-21T06:17:47.246128+0000","last_unstale":"2024-09-21T06:17:48.259027+0000","last_undegraded":"2024-09-21T06:17:48.259027+0000","last_fullsized":"2024-09-21T06:17:48.259027+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:11.155597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'26","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:10.971504+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:18:10.971504+0000","last_peered":"2024-09-21T06:18:10.971504+0000","last_clean":"2024-09-21T06:18:10.971504+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:18:10.971504+0000","last_undegraded":"2024-09-21T06:18:10.971504+0000","last_fullsized":"2024-09-21T06:18:10.971504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":72,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258142+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:17:48.258142+0000","last_peered":"2024-09-21T06:17:48.258142+0000","last_clean":"2024-09-21T06:17:48.258142+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:17:48.258142+0000","last_undegraded":"2024-09-21T06:17:48.258142+0000","last_fullsized":"2024-09-21T06:17:48.258142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.322731+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:17:56.322731+0000","last_peered":"2024-09-21T06:17:56.322731+0000","last_clean":"2024-09-21T06:17:56.322731+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:17:56.322731+0000","last_undegraded":"2024-09-21T06:17:56.322731+0000","last_fullsized":"2024-09-21T06:17:56.322731+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242084+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:17:48.242084+0000","last_peered":"2024-09-21T06:17:48.242084+0000","last_clean":"2024-09-21T06:17:48.242084+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:17:48.242084+0000","last_undegraded":"2024-09-21T06:17:48.242084+0000","last_fullsized":"2024-09-21T06:17:48.242084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.313267+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:17:55.313267+0000","last_peered":"2024-09-21T06:17:55.313267+0000","last_clean":"2024-09-21T06:17:55.313267+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:17:55.313267+0000","last_undegraded":"2024-09-21T06:17:55.313267+0000","last_fullsized":"2024-09-21T06:17:55.313267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260588+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:17:48.260588+0000","last_peered":"2024-09-21T06:17:48.260588+0000","last_clean":"2024-09-21T06:17:48.260588+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:17:48.260588+0000","last_undegraded":"2024-09-21T06:17:48.260588+0000","last_fullsized":"2024-09-21T06:17:48.260588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:05.961903+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:18:05.961903+0000","last_peered":"2024-09-21T06:18:05.961903+0000","last_clean":"2024-09-21T06:18:05.961903+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:18:05.961903+0000","last_undegraded":"2024-09-21T06:18:05.961903+0000","last_fullsized":"2024-09-21T06:18:05.961903+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260860+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:17:48.260860+0000","last_peered":"2024-09-21T06:17:48.260860+0000","last_clean":"2024-09-21T06:17:48.260860+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:17:48.260860+0000","last_undegraded":"2024-09-21T06:17:48.260860+0000","last_fullsized":"2024-09-21T06:17:48.260860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.323120+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:17:56.323120+0000","last_peered":"2024-09-21T06:17:56.323120+0000","last_clean":"2024-09-21T06:17:56.323120+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:17:56.323120+0000","last_undegraded":"2024-09-21T06:17:56.323120+0000","last_fullsized":"2024-09-21T06:17:56.323120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258456+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:17:48.258456+0000","last_peered":"2024-09-21T06:17:48.258456+0000","last_clean":"2024-09-21T06:17:48.258456+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:17:48.258456+0000","last_undegraded":"2024-09-21T06:17:48.258456+0000","last_fullsized":"2024-09-21T06:17:48.258456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.945482+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:17:56.945482+0000","last_peered":"2024-09-21T06:17:56.945482+0000","last_clean":"2024-09-21T06:17:56.945482+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:17:56.945482+0000","last_undegraded":"2024-09-21T06:17:56.945482+0000","last_fullsized":"2024-09-21T06:17:56.945482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263592+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:17:48.263592+0000","last_peered":"2024-09-21T06:17:48.263592+0000","last_clean":"2024-09-21T06:17:48.263592+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:17:48.263592+0000","last_undegraded":"2024-09-21T06:17:48.263592+0000","last_fullsized":"2024-09-21T06:17:48.263592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261251+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:17:48.261251+0000","last_peered":"2024-09-21T06:17:48.261251+0000","last_clean":"2024-09-21T06:17:48.261251+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:17:48.261251+0000","last_undegraded":"2024-09-21T06:17:48.261251+0000","last_fullsized":"2024-09-21T06:17:48.261251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261406+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:17:48.261406+0000","last_peered":"2024-09-21T06:17:48.261406+0000","last_clean":"2024-09-21T06:17:48.261406+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:17:48.261406+0000","last_undegraded":"2024-09-21T06:17:48.261406+0000","last_fullsized":"2024-09-21T06:17:48.261406+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.266347+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:17:48.266347+0000","last_peered":"2024-09-21T06:17:48.266347+0000","last_clean":"2024-09-21T06:17:48.266347+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:17:48.266347+0000","last_undegraded":"2024-09-21T06:17:48.266347+0000","last_fullsized":"2024-09-21T06:17:48.266347+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.541962+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:17:48.541962+0000","last_peered":"2024-09-21T06:17:48.541962+0000","last_clean":"2024-09-21T06:17:48.541962+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:17:48.541962+0000","last_undegraded":"2024-09-21T06:17:48.541962+0000","last_fullsized":"2024-09-21T06:17:48.541962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.323111+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:17:56.323111+0000","last_peered":"2024-09-21T06:17:56.323111+0000","last_clean":"2024-09-21T06:17:56.323111+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:17:56.323111+0000","last_undegraded":"2024-09-21T06:17:56.323111+0000","last_fullsized":"2024-09-21T06:17:56.323111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261093+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:17:48.261093+0000","last_peered":"2024-09-21T06:17:48.261093+0000","last_clean":"2024-09-21T06:17:48.261093+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:17:48.261093+0000","last_undegraded":"2024-09-21T06:17:48.261093+0000","last_fullsized":"2024-09-21T06:17:48.261093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260378+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:17:48.260378+0000","last_peered":"2024-09-21T06:17:48.260378+0000","last_clean":"2024-09-21T06:17:48.260378+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:17:48.260378+0000","last_undegraded":"2024-09-21T06:17:48.260378+0000","last_fullsized":"2024-09-21T06:17:48.260378+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.943900+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:17:56.943900+0000","last_peered":"2024-09-21T06:17:56.943900+0000","last_clean":"2024-09-21T06:17:56.943900+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:17:56.943900+0000","last_undegraded":"2024-09-21T06:17:56.943900+0000","last_fullsized":"2024-09-21T06:17:56.943900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259395+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:17:48.259395+0000","last_peered":"2024-09-21T06:17:48.259395+0000","last_clean":"2024-09-21T06:17:48.259395+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:17:48.259395+0000","last_undegraded":"2024-09-21T06:17:48.259395+0000","last_fullsized":"2024-09-21T06:17:48.259395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.321629+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:17:56.321629+0000","last_peered":"2024-09-21T06:17:56.321629+0000","last_clean":"2024-09-21T06:17:56.321629+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:17:56.321629+0000","last_undegraded":"2024-09-21T06:17:56.321629+0000","last_fullsized":"2024-09-21T06:17:56.321629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.241715+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:17:48.241715+0000","last_peered":"2024-09-21T06:17:48.241715+0000","last_clean":"2024-09-21T06:17:48.241715+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:17:48.241715+0000","last_undegraded":"2024-09-21T06:17:48.241715+0000","last_fullsized":"2024-09-21T06:17:48.241715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:06.963113+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:18:06.963113+0000","last_peered":"2024-09-21T06:18:06.963113+0000","last_clean":"2024-09-21T06:18:06.963113+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:18:06.963113+0000","last_undegraded":"2024-09-21T06:18:06.963113+0000","last_fullsized":"2024-09-21T06:18:06.963113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258144+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:17:48.258144+0000","last_peered":"2024-09-21T06:17:48.258144+0000","last_clean":"2024-09-21T06:17:48.258144+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:17:48.258144+0000","last_undegraded":"2024-09-21T06:17:48.258144+0000","last_fullsized":"2024-09-21T06:17:48.258144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.541941+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:17:48.541941+0000","last_peered":"2024-09-21T06:17:48.541941+0000","last_clean":"2024-09-21T06:17:48.541941+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:17:48.541941+0000","last_undegraded":"2024-09-21T06:17:48.541941+0000","last_fullsized":"2024-09-21T06:17:48.541941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240559+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:17:48.240559+0000","last_peered":"2024-09-21T06:17:48.240559+0000","last_clean":"2024-09-21T06:17:48.240559+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:17:48.240559+0000","last_undegraded":"2024-09-21T06:17:48.240559+0000","last_fullsized":"2024-09-21T06:17:48.240559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257353+0000","last_change":"2024-09-21T06:17:45.221680+0000","last_active":"2024-09-21T06:17:48.257353+0000","last_peered":"2024-09-21T06:17:48.257353+0000","last_clean":"2024-09-21T06:17:48.257353+0000","last_became_active":"2024-09-21T06:17:45.221320+0000","last_became_peered":"2024-09-21T06:17:45.221320+0000","last_unstale":"2024-09-21T06:17:48.257353+0000","last_undegraded":"2024-09-21T06:17:48.257353+0000","last_fullsized":"2024-09-21T06:17:48.257353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:23.394531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:51.206782+0000","last_change":"2024-09-21T06:17:47.243605+0000","last_active":"2024-09-21T06:17:51.206782+0000","last_peered":"2024-09-21T06:17:51.206782+0000","last_clean":"2024-09-21T06:17:51.206782+0000","last_became_active":"2024-09-21T06:17:47.243198+0000","last_became_peered":"2024-09-21T06:17:47.243198+0000","last_unstale":"2024-09-21T06:17:51.206782+0000","last_undegraded":"2024-09-21T06:17:51.206782+0000","last_fullsized":"2024-09-21T06:17:51.206782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:37.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.310364+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:17:55.310364+0000","last_peered":"2024-09-21T06:17:55.310364+0000","last_clean":"2024-09-21T06:17:55.310364+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:17:55.310364+0000","last_undegraded":"2024-09-21T06:17:55.310364+0000","last_fullsized":"2024-09-21T06:17:55.310364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242255+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:17:48.242255+0000","last_peered":"2024-09-21T06:17:48.242255+0000","last_clean":"2024-09-21T06:17:48.242255+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:17:48.242255+0000","last_undegraded":"2024-09-21T06:17:48.242255+0000","last_fullsized":"2024-09-21T06:17:48.242255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:08.257319+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:18:08.257319+0000","last_peered":"2024-09-21T06:18:08.257319+0000","last_clean":"2024-09-21T06:18:08.257319+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:18:08.257319+0000","last_undegraded":"2024-09-21T06:18:08.257319+0000","last_fullsized":"2024-09-21T06:18:08.257319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259280+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:17:48.259280+0000","last_peered":"2024-09-21T06:17:48.259280+0000","last_clean":"2024-09-21T06:17:48.259280+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:17:48.259280+0000","last_undegraded":"2024-09-21T06:17:48.259280+0000","last_fullsized":"2024-09-21T06:17:48.259280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.309783+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:17:55.309783+0000","last_peered":"2024-09-21T06:17:55.309783+0000","last_clean":"2024-09-21T06:17:55.309783+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:17:55.309783+0000","last_undegraded":"2024-09-21T06:17:55.309783+0000","last_fullsized":"2024-09-21T06:17:55.309783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263673+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:17:48.263673+0000","last_peered":"2024-09-21T06:17:48.263673+0000","last_clean":"2024-09-21T06:17:48.263673+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:17:48.263673+0000","last_undegraded":"2024-09-21T06:17:48.263673+0000","last_fullsized":"2024-09-21T06:17:48.263673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.312152+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:17:55.312152+0000","last_peered":"2024-09-21T06:17:55.312152+0000","last_clean":"2024-09-21T06:17:55.312152+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:17:55.312152+0000","last_undegraded":"2024-09-21T06:17:55.312152+0000","last_fullsized":"2024-09-21T06:17:55.312152+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.256825+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:17:48.256825+0000","last_peered":"2024-09-21T06:17:48.256825+0000","last_clean":"2024-09-21T06:17:48.256825+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:17:48.256825+0000","last_undegraded":"2024-09-21T06:17:48.256825+0000","last_fullsized":"2024-09-21T06:17:48.256825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.312997+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:17:55.312997+0000","last_peered":"2024-09-21T06:17:55.312997+0000","last_clean":"2024-09-21T06:17:55.312997+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:17:55.312997+0000","last_undegraded":"2024-09-21T06:17:55.312997+0000","last_fullsized":"2024-09-21T06:17:55.312997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261878+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:17:48.261878+0000","last_peered":"2024-09-21T06:17:48.261878+0000","last_clean":"2024-09-21T06:17:48.261878+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:17:48.261878+0000","last_undegraded":"2024-09-21T06:17:48.261878+0000","last_fullsized":"2024-09-21T06:17:48.261878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244517+0000","last_change":"2024-09-21T06:17:45.215026+0000","last_active":"2024-09-21T06:17:48.244517+0000","last_peered":"2024-09-21T06:17:48.244517+0000","last_clean":"2024-09-21T06:17:48.244517+0000","last_became_active":"2024-09-21T06:17:45.214482+0000","last_became_peered":"2024-09-21T06:17:45.214482+0000","last_unstale":"2024-09-21T06:17:48.244517+0000","last_undegraded":"2024-09-21T06:17:48.244517+0000","last_fullsized":"2024-09-21T06:17:48.244517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:51.053355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259012+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:17:48.259012+0000","last_peered":"2024-09-21T06:17:48.259012+0000","last_clean":"2024-09-21T06:17:48.259012+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:17:48.259012+0000","last_undegraded":"2024-09-21T06:17:48.259012+0000","last_fullsized":"2024-09-21T06:17:48.259012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.311133+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:17:55.311133+0000","last_peered":"2024-09-21T06:17:55.311133+0000","last_clean":"2024-09-21T06:17:55.311133+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:17:55.311133+0000","last_undegraded":"2024-09-21T06:17:55.311133+0000","last_fullsized":"2024-09-21T06:17:55.311133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.260460+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:17:48.260460+0000","last_peered":"2024-09-21T06:17:48.260460+0000","last_clean":"2024-09-21T06:17:48.260460+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:17:48.260460+0000","last_undegraded":"2024-09-21T06:17:48.260460+0000","last_fullsized":"2024-09-21T06:17:48.260460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.256925+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:17:48.256925+0000","last_peered":"2024-09-21T06:17:48.256925+0000","last_clean":"2024-09-21T06:17:48.256925+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:17:48.256925+0000","last_undegraded":"2024-09-21T06:17:48.256925+0000","last_fullsized":"2024-09-21T06:17:48.256925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.265549+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:17:48.265549+0000","last_peered":"2024-09-21T06:17:48.265549+0000","last_clean":"2024-09-21T06:17:48.265549+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:17:48.265549+0000","last_undegraded":"2024-09-21T06:17:48.265549+0000","last_fullsized":"2024-09-21T06:17:48.265549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258752+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:17:48.258752+0000","last_peered":"2024-09-21T06:17:48.258752+0000","last_clean":"2024-09-21T06:17:48.258752+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:17:48.258752+0000","last_undegraded":"2024-09-21T06:17:48.258752+0000","last_fullsized":"2024-09-21T06:17:48.258752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.322325+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:17:56.322325+0000","last_peered":"2024-09-21T06:17:56.322325+0000","last_clean":"2024-09-21T06:17:56.322325+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:17:56.322325+0000","last_undegraded":"2024-09-21T06:17:56.322325+0000","last_fullsized":"2024-09-21T06:17:56.322325+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263465+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:17:48.263465+0000","last_peered":"2024-09-21T06:17:48.263465+0000","last_clean":"2024-09-21T06:17:48.263465+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:17:48.263465+0000","last_undegraded":"2024-09-21T06:17:48.263465+0000","last_fullsized":"2024-09-21T06:17:48.263465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.265492+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:17:48.265492+0000","last_peered":"2024-09-21T06:17:48.265492+0000","last_clean":"2024-09-21T06:17:48.265492+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:17:48.265492+0000","last_undegraded":"2024-09-21T06:17:48.265492+0000","last_fullsized":"2024-09-21T06:17:48.265492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259063+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:17:48.259063+0000","last_peered":"2024-09-21T06:17:48.259063+0000","last_clean":"2024-09-21T06:17:48.259063+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:17:48.259063+0000","last_undegraded":"2024-09-21T06:17:48.259063+0000","last_fullsized":"2024-09-21T06:17:48.259063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.323038+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:17:56.323038+0000","last_peered":"2024-09-21T06:17:56.323038+0000","last_clean":"2024-09-21T06:17:56.323038+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:17:56.323038+0000","last_undegraded":"2024-09-21T06:17:56.323038+0000","last_fullsized":"2024-09-21T06:17:56.323038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60239,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":118,"num_write":155,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":169682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":398504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708340,"statfs":{"total":95995035648,"available":95957340160,"internally_reserved":0,"allocated":1503232,"data_stored":1046614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":398740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":398660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":990590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":398129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":989883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":398957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":398440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":884736,"data_stored":444475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":454160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":835584,"data_stored":399400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:18:12.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:18:13.194 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: pgmap v273: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T06:18:13.593 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:13 smithi038 ceph-mon[31215]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 -- 172.21.15.38:0/2018980980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8109df0 msgr2=0x7fe1a8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/2018980980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8109df0 0x7fe1a8110620 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009ca0 tx=0x7fe1a002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 -- 172.21.15.38:0/2018980980 shutdown_connections 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/2018980980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8109df0 0x7fe1a8110620 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/2018980980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 0x7fe1a81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/2018980980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8103b60 0x7fe1a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 -- 172.21.15.38:0/2018980980 >> 172.21.15.38:0/2018980980 conn(0x7fe1a807b850 msgr2=0x7fe1a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 -- 172.21.15.38:0/2018980980 shutdown_connections 2024-09-21T06:18:13.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.682+0000 7fe1ad07b640 1 -- 172.21.15.38:0/2018980980 wait complete. 2024-09-21T06:18:13.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.683+0000 7fe1ad07b640 1 Processor -- start 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.683+0000 7fe1ad07b640 1 -- start start 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 0x7fe1a819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8109df0 0x7fe1a819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8113bf0 con 0x7fe1a8103b60 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8113a70 con 0x7fe1a8109df0 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1ad07b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8113d70 con 0x7fe1a81094a0 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35790/0 (socket says 172.21.15.38:35790) 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 -- 172.21.15.38:0/3811014047 learned_addr learned my addr 172.21.15.38:0/3811014047 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a659c640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 0x7fe1a819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a759e640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8109df0 0x7fe1a819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:13.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 -- 172.21.15.38:0/3811014047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 msgr2=0x7fe1a819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 0x7fe1a819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 -- 172.21.15.38:0/3811014047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8109df0 msgr2=0x7fe1a819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8109df0 0x7fe1a819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.684+0000 7fe1a6d9d640 1 -- 172.21.15.38:0/3811014047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a81a04f0 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe1a6d9d640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c890 tx=0x7fe19800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198004220 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a81a07e0 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1980043c0 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980049e0 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.685+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a81a6f40 con 0x7fe1a8103b60 2024-09-21T06:18:13.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.686+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a8103f70 con 0x7fe1a8103b60 2024-09-21T06:18:13.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.687+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe198005140 con 0x7fe1a8103b60 2024-09-21T06:18:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.688+0000 7fe18ffff640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 0x7fe1900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.688+0000 7fe1a659c640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 0x7fe1900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.688+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1980e7700 con 0x7fe1a8103b60 2024-09-21T06:18:13.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.689+0000 7fe1a659c640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 0x7fe1900b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8109170 tx=0x7fe19c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:13.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.691+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe198014030 con 0x7fe1a8103b60 2024-09-21T06:18:13.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.876+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1a8063800 con 0x7fe1900b65f0 2024-09-21T06:18:13.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.883+0000 7fe18ffff640 1 -- 172.21.15.38:0/3811014047 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258705 (secure 0 0 0) 0x7fe1a8063800 con 0x7fe1900b65f0 2024-09-21T06:18:13.887 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:13.888 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:18:13.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.886+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 msgr2=0x7fe1900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.886+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 0x7fe1900b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8109170 tx=0x7fe19c00b390 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 msgr2=0x7fe1a819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c890 tx=0x7fe19800cd50 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 shutdown_connections 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe1900b65f0 0x7fe1900b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8109df0 0x7fe1a819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094a0 0x7fe1a819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 --2- 172.21.15.38:0/3811014047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1a8103b60 0x7fe1a819a580 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 >> 172.21.15.38:0/3811014047 conn(0x7fe1a807b850 msgr2=0x7fe1a8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 shutdown_connections 2024-09-21T06:18:13.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:13.887+0000 7fe1ad07b640 1 -- 172.21.15.38:0/3811014047 wait complete. 2024-09-21T06:18:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: pgmap v273: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T06:18:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:13 smithi174 ceph-mon[34815]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: pgmap v273: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 9]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-21T06:18:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:13 smithi044 ceph-mon[34369]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:18:14.581 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:14 smithi038 ceph-mon[31215]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:18:14.611 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-21T06:18:13.662514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650841,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":195,"num_read_kb":187,"num_write":280,"num_write_kb":2256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385864,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555960,"statfs":{"total":1151940427776,"available":1151545303040,"internally_reserved":0,"allocated":11927552,"data_stored":6745187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48260,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":73,"num_write":24,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002319"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263510+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:17:48.263510+0000","last_peered":"2024-09-21T06:17:48.263510+0000","last_clean":"2024-09-21T06:17:48.263510+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:17:48.263510+0000","last_undegraded":"2024-09-21T06:17:48.263510+0000","last_fullsized":"2024-09-21T06:17:48.263510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263386+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:17:48.263386+0000","last_peered":"2024-09-21T06:17:48.263386+0000","last_clean":"2024-09-21T06:17:48.263386+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:17:48.263386+0000","last_undegraded":"2024-09-21T06:17:48.263386+0000","last_fullsized":"2024-09-21T06:17:48.263386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263029+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:17:48.263029+0000","last_peered":"2024-09-21T06:17:48.263029+0000","last_clean":"2024-09-21T06:17:48.263029+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:17:48.263029+0000","last_undegraded":"2024-09-21T06:17:48.263029+0000","last_fullsized":"2024-09-21T06:17:48.263029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257990+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:17:48.257990+0000","last_peered":"2024-09-21T06:17:48.257990+0000","last_clean":"2024-09-21T06:17:48.257990+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:17:48.257990+0000","last_undegraded":"2024-09-21T06:17:48.257990+0000","last_fullsized":"2024-09-21T06:17:48.257990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400337+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:18:12.400337+0000","last_peered":"2024-09-21T06:18:12.400337+0000","last_clean":"2024-09-21T06:18:12.400337+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:18:12.400337+0000","last_undegraded":"2024-09-21T06:18:12.400337+0000","last_fullsized":"2024-09-21T06:18:12.400337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240367+0000","last_change":"2024-09-21T06:17:47.246587+0000","last_active":"2024-09-21T06:17:48.240367+0000","last_peered":"2024-09-21T06:17:48.240367+0000","last_clean":"2024-09-21T06:17:48.240367+0000","last_became_active":"2024-09-21T06:17:47.246150+0000","last_became_peered":"2024-09-21T06:17:47.246150+0000","last_unstale":"2024-09-21T06:17:48.240367+0000","last_undegraded":"2024-09-21T06:17:48.240367+0000","last_fullsized":"2024-09-21T06:17:48.240367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:43.805080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498299+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:18:13.498299+0000","last_peered":"2024-09-21T06:18:13.498299+0000","last_clean":"2024-09-21T06:18:13.498299+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:18:13.498299+0000","last_undegraded":"2024-09-21T06:18:13.498299+0000","last_fullsized":"2024-09-21T06:18:13.498299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258410+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:17:48.258410+0000","last_peered":"2024-09-21T06:17:48.258410+0000","last_clean":"2024-09-21T06:17:48.258410+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:17:48.258410+0000","last_undegraded":"2024-09-21T06:17:48.258410+0000","last_fullsized":"2024-09-21T06:17:48.258410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258579+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:17:48.258579+0000","last_peered":"2024-09-21T06:17:48.258579+0000","last_clean":"2024-09-21T06:17:48.258579+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:17:48.258579+0000","last_undegraded":"2024-09-21T06:17:48.258579+0000","last_fullsized":"2024-09-21T06:17:48.258579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240901+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:17:48.240901+0000","last_peered":"2024-09-21T06:17:48.240901+0000","last_clean":"2024-09-21T06:17:48.240901+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:17:48.240901+0000","last_undegraded":"2024-09-21T06:17:48.240901+0000","last_fullsized":"2024-09-21T06:17:48.240901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498776+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:18:13.498776+0000","last_peered":"2024-09-21T06:18:13.498776+0000","last_clean":"2024-09-21T06:18:13.498776+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:18:13.498776+0000","last_undegraded":"2024-09-21T06:18:13.498776+0000","last_fullsized":"2024-09-21T06:18:13.498776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258274+0000","last_change":"2024-09-21T06:17:47.252995+0000","last_active":"2024-09-21T06:17:48.258274+0000","last_peered":"2024-09-21T06:17:48.258274+0000","last_clean":"2024-09-21T06:17:48.258274+0000","last_became_active":"2024-09-21T06:17:47.252589+0000","last_became_peered":"2024-09-21T06:17:47.252589+0000","last_unstale":"2024-09-21T06:17:48.258274+0000","last_undegraded":"2024-09-21T06:17:48.258274+0000","last_fullsized":"2024-09-21T06:17:48.258274+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:47.384446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242273+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:17:48.242273+0000","last_peered":"2024-09-21T06:17:48.242273+0000","last_clean":"2024-09-21T06:17:48.242273+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:17:48.242273+0000","last_undegraded":"2024-09-21T06:17:48.242273+0000","last_fullsized":"2024-09-21T06:17:48.242273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262895+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:17:48.262895+0000","last_peered":"2024-09-21T06:17:48.262895+0000","last_clean":"2024-09-21T06:17:48.262895+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:17:48.262895+0000","last_undegraded":"2024-09-21T06:17:48.262895+0000","last_fullsized":"2024-09-21T06:17:48.262895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262708+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:17:48.262708+0000","last_peered":"2024-09-21T06:17:48.262708+0000","last_clean":"2024-09-21T06:17:48.262708+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:17:48.262708+0000","last_undegraded":"2024-09-21T06:17:48.262708+0000","last_fullsized":"2024-09-21T06:17:48.262708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258033+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:17:48.258033+0000","last_peered":"2024-09-21T06:17:48.258033+0000","last_clean":"2024-09-21T06:17:48.258033+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:17:48.258033+0000","last_undegraded":"2024-09-21T06:17:48.258033+0000","last_fullsized":"2024-09-21T06:17:48.258033+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263610+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:17:48.263610+0000","last_peered":"2024-09-21T06:17:48.263610+0000","last_clean":"2024-09-21T06:17:48.263610+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:17:48.263610+0000","last_undegraded":"2024-09-21T06:17:48.263610+0000","last_fullsized":"2024-09-21T06:17:48.263610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257988+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:17:48.257988+0000","last_peered":"2024-09-21T06:17:48.257988+0000","last_clean":"2024-09-21T06:17:48.257988+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:17:48.257988+0000","last_undegraded":"2024-09-21T06:17:48.257988+0000","last_fullsized":"2024-09-21T06:17:48.257988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244525+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:17:48.244525+0000","last_peered":"2024-09-21T06:17:48.244525+0000","last_clean":"2024-09-21T06:17:48.244525+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:17:48.244525+0000","last_undegraded":"2024-09-21T06:17:48.244525+0000","last_fullsized":"2024-09-21T06:17:48.244525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.262561+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:17:48.262561+0000","last_peered":"2024-09-21T06:17:48.262561+0000","last_clean":"2024-09-21T06:17:48.262561+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:17:48.262561+0000","last_undegraded":"2024-09-21T06:17:48.262561+0000","last_fullsized":"2024-09-21T06:17:48.262561+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242405+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:17:48.242405+0000","last_peered":"2024-09-21T06:17:48.242405+0000","last_clean":"2024-09-21T06:17:48.242405+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:17:48.242405+0000","last_undegraded":"2024-09-21T06:17:48.242405+0000","last_fullsized":"2024-09-21T06:17:48.242405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257646+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:17:48.257646+0000","last_peered":"2024-09-21T06:17:48.257646+0000","last_clean":"2024-09-21T06:17:48.257646+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:17:48.257646+0000","last_undegraded":"2024-09-21T06:17:48.257646+0000","last_fullsized":"2024-09-21T06:17:48.257646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258734+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:17:48.258734+0000","last_peered":"2024-09-21T06:17:48.258734+0000","last_clean":"2024-09-21T06:17:48.258734+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:17:48.258734+0000","last_undegraded":"2024-09-21T06:17:48.258734+0000","last_fullsized":"2024-09-21T06:17:48.258734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257872+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:17:48.257872+0000","last_peered":"2024-09-21T06:17:48.257872+0000","last_clean":"2024-09-21T06:17:48.257872+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:17:48.257872+0000","last_undegraded":"2024-09-21T06:17:48.257872+0000","last_fullsized":"2024-09-21T06:17:48.257872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258699+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:17:48.258699+0000","last_peered":"2024-09-21T06:17:48.258699+0000","last_clean":"2024-09-21T06:17:48.258699+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:17:48.258699+0000","last_undegraded":"2024-09-21T06:17:48.258699+0000","last_fullsized":"2024-09-21T06:17:48.258699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244623+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:17:48.244623+0000","last_peered":"2024-09-21T06:17:48.244623+0000","last_clean":"2024-09-21T06:17:48.244623+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:17:48.244623+0000","last_undegraded":"2024-09-21T06:17:48.244623+0000","last_fullsized":"2024-09-21T06:17:48.244623+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263243+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:17:48.263243+0000","last_peered":"2024-09-21T06:17:48.263243+0000","last_clean":"2024-09-21T06:17:48.263243+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:17:48.263243+0000","last_undegraded":"2024-09-21T06:17:48.263243+0000","last_fullsized":"2024-09-21T06:17:48.263243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242372+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:17:48.242372+0000","last_peered":"2024-09-21T06:17:48.242372+0000","last_clean":"2024-09-21T06:17:48.242372+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:17:48.242372+0000","last_undegraded":"2024-09-21T06:17:48.242372+0000","last_fullsized":"2024-09-21T06:17:48.242372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263036+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:17:48.263036+0000","last_peered":"2024-09-21T06:17:48.263036+0000","last_clean":"2024-09-21T06:17:48.263036+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:17:48.263036+0000","last_undegraded":"2024-09-21T06:17:48.263036+0000","last_fullsized":"2024-09-21T06:17:48.263036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244296+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:17:48.244296+0000","last_peered":"2024-09-21T06:17:48.244296+0000","last_clean":"2024-09-21T06:17:48.244296+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:17:48.244296+0000","last_undegraded":"2024-09-21T06:17:48.244296+0000","last_fullsized":"2024-09-21T06:17:48.244296+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244116+0000","last_change":"2024-09-21T06:17:47.246133+0000","last_active":"2024-09-21T06:17:48.244116+0000","last_peered":"2024-09-21T06:17:48.244116+0000","last_clean":"2024-09-21T06:17:48.244116+0000","last_became_active":"2024-09-21T06:17:47.245650+0000","last_became_peered":"2024-09-21T06:17:47.245650+0000","last_unstale":"2024-09-21T06:17:48.244116+0000","last_undegraded":"2024-09-21T06:17:48.244116+0000","last_fullsized":"2024-09-21T06:17:48.244116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:09.546544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261868+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:17:48.261868+0000","last_peered":"2024-09-21T06:17:48.261868+0000","last_clean":"2024-09-21T06:17:48.261868+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:17:48.261868+0000","last_undegraded":"2024-09-21T06:17:48.261868+0000","last_fullsized":"2024-09-21T06:17:48.261868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400366+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:18:12.400366+0000","last_peered":"2024-09-21T06:18:12.400366+0000","last_clean":"2024-09-21T06:18:12.400366+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:18:12.400366+0000","last_undegraded":"2024-09-21T06:18:12.400366+0000","last_fullsized":"2024-09-21T06:18:12.400366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:09.968859+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:18:09.968859+0000","last_peered":"2024-09-21T06:18:09.968859+0000","last_clean":"2024-09-21T06:18:09.968859+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:18:09.968859+0000","last_undegraded":"2024-09-21T06:18:09.968859+0000","last_fullsized":"2024-09-21T06:18:09.968859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258199+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:17:48.258199+0000","last_peered":"2024-09-21T06:17:48.258199+0000","last_clean":"2024-09-21T06:17:48.258199+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:17:48.258199+0000","last_undegraded":"2024-09-21T06:17:48.258199+0000","last_fullsized":"2024-09-21T06:17:48.258199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.322398+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:17:56.322398+0000","last_peered":"2024-09-21T06:17:56.322398+0000","last_clean":"2024-09-21T06:17:56.322398+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:17:56.322398+0000","last_undegraded":"2024-09-21T06:17:56.322398+0000","last_fullsized":"2024-09-21T06:17:56.322398+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.321941+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:17:56.321941+0000","last_peered":"2024-09-21T06:17:56.321941+0000","last_clean":"2024-09-21T06:17:56.321941+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:17:56.321941+0000","last_undegraded":"2024-09-21T06:17:56.321941+0000","last_fullsized":"2024-09-21T06:17:56.321941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258435+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:17:48.258435+0000","last_peered":"2024-09-21T06:17:48.258435+0000","last_clean":"2024-09-21T06:17:48.258435+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:17:48.258435+0000","last_undegraded":"2024-09-21T06:17:48.258435+0000","last_fullsized":"2024-09-21T06:17:48.258435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258645+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:17:48.258645+0000","last_peered":"2024-09-21T06:17:48.258645+0000","last_clean":"2024-09-21T06:17:48.258645+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:17:48.258645+0000","last_undegraded":"2024-09-21T06:17:48.258645+0000","last_fullsized":"2024-09-21T06:17:48.258645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.256800+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:17:48.256800+0000","last_peered":"2024-09-21T06:17:48.256800+0000","last_clean":"2024-09-21T06:17:48.256800+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:17:48.256800+0000","last_undegraded":"2024-09-21T06:17:48.256800+0000","last_fullsized":"2024-09-21T06:17:48.256800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:09.968040+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:18:09.968040+0000","last_peered":"2024-09-21T06:18:09.968040+0000","last_clean":"2024-09-21T06:18:09.968040+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:18:09.968040+0000","last_undegraded":"2024-09-21T06:18:09.968040+0000","last_fullsized":"2024-09-21T06:18:09.968040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257957+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:17:48.257957+0000","last_peered":"2024-09-21T06:17:48.257957+0000","last_clean":"2024-09-21T06:17:48.257957+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:17:48.257957+0000","last_undegraded":"2024-09-21T06:17:48.257957+0000","last_fullsized":"2024-09-21T06:17:48.257957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263654+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:17:48.263654+0000","last_peered":"2024-09-21T06:17:48.263654+0000","last_clean":"2024-09-21T06:17:48.263654+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:17:48.263654+0000","last_undegraded":"2024-09-21T06:17:48.263654+0000","last_fullsized":"2024-09-21T06:17:48.263654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.313360+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:17:55.313360+0000","last_peered":"2024-09-21T06:17:55.313360+0000","last_clean":"2024-09-21T06:17:55.313360+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:17:55.313360+0000","last_undegraded":"2024-09-21T06:17:55.313360+0000","last_fullsized":"2024-09-21T06:17:55.313360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259027+0000","last_change":"2024-09-21T06:17:47.246491+0000","last_active":"2024-09-21T06:17:48.259027+0000","last_peered":"2024-09-21T06:17:48.259027+0000","last_clean":"2024-09-21T06:17:48.259027+0000","last_became_active":"2024-09-21T06:17:47.246128+0000","last_became_peered":"2024-09-21T06:17:47.246128+0000","last_unstale":"2024-09-21T06:17:48.259027+0000","last_undegraded":"2024-09-21T06:17:48.259027+0000","last_fullsized":"2024-09-21T06:17:48.259027+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:11.155597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'26","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:10.971504+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:18:10.971504+0000","last_peered":"2024-09-21T06:18:10.971504+0000","last_clean":"2024-09-21T06:18:10.971504+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:18:10.971504+0000","last_undegraded":"2024-09-21T06:18:10.971504+0000","last_fullsized":"2024-09-21T06:18:10.971504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":72,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400663+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:18:12.400663+0000","last_peered":"2024-09-21T06:18:12.400663+0000","last_clean":"2024-09-21T06:18:12.400663+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:18:12.400663+0000","last_undegraded":"2024-09-21T06:18:12.400663+0000","last_fullsized":"2024-09-21T06:18:12.400663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.322731+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:17:56.322731+0000","last_peered":"2024-09-21T06:17:56.322731+0000","last_clean":"2024-09-21T06:17:56.322731+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:17:56.322731+0000","last_undegraded":"2024-09-21T06:17:56.322731+0000","last_fullsized":"2024-09-21T06:17:56.322731+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242084+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:17:48.242084+0000","last_peered":"2024-09-21T06:17:48.242084+0000","last_clean":"2024-09-21T06:17:48.242084+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:17:48.242084+0000","last_undegraded":"2024-09-21T06:17:48.242084+0000","last_fullsized":"2024-09-21T06:17:48.242084+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.313267+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:17:55.313267+0000","last_peered":"2024-09-21T06:17:55.313267+0000","last_clean":"2024-09-21T06:17:55.313267+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:17:55.313267+0000","last_undegraded":"2024-09-21T06:17:55.313267+0000","last_fullsized":"2024-09-21T06:17:55.313267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499529+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:18:13.499529+0000","last_peered":"2024-09-21T06:18:13.499529+0000","last_clean":"2024-09-21T06:18:13.499529+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:18:13.499529+0000","last_undegraded":"2024-09-21T06:18:13.499529+0000","last_fullsized":"2024-09-21T06:18:13.499529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:10.969754+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:18:10.969754+0000","last_peered":"2024-09-21T06:18:10.969754+0000","last_clean":"2024-09-21T06:18:10.969754+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:18:10.969754+0000","last_undegraded":"2024-09-21T06:18:10.969754+0000","last_fullsized":"2024-09-21T06:18:10.969754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498038+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:18:13.498038+0000","last_peered":"2024-09-21T06:18:13.498038+0000","last_clean":"2024-09-21T06:18:13.498038+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:18:13.498038+0000","last_undegraded":"2024-09-21T06:18:13.498038+0000","last_fullsized":"2024-09-21T06:18:13.498038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400165+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:12.400165+0000","last_peered":"2024-09-21T06:18:12.400165+0000","last_clean":"2024-09-21T06:18:12.400165+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:12.400165+0000","last_undegraded":"2024-09-21T06:18:12.400165+0000","last_fullsized":"2024-09-21T06:18:12.400165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258456+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:17:48.258456+0000","last_peered":"2024-09-21T06:17:48.258456+0000","last_clean":"2024-09-21T06:17:48.258456+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:17:48.258456+0000","last_undegraded":"2024-09-21T06:17:48.258456+0000","last_fullsized":"2024-09-21T06:17:48.258456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400943+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:12.400943+0000","last_peered":"2024-09-21T06:18:12.400943+0000","last_clean":"2024-09-21T06:18:12.400943+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:12.400943+0000","last_undegraded":"2024-09-21T06:18:12.400943+0000","last_fullsized":"2024-09-21T06:18:12.400943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263592+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:17:48.263592+0000","last_peered":"2024-09-21T06:17:48.263592+0000","last_clean":"2024-09-21T06:17:48.263592+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:17:48.263592+0000","last_undegraded":"2024-09-21T06:17:48.263592+0000","last_fullsized":"2024-09-21T06:17:48.263592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261251+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:17:48.261251+0000","last_peered":"2024-09-21T06:17:48.261251+0000","last_clean":"2024-09-21T06:17:48.261251+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:17:48.261251+0000","last_undegraded":"2024-09-21T06:17:48.261251+0000","last_fullsized":"2024-09-21T06:17:48.261251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498575+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:18:13.498575+0000","last_peered":"2024-09-21T06:18:13.498575+0000","last_clean":"2024-09-21T06:18:13.498575+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:18:13.498575+0000","last_undegraded":"2024-09-21T06:18:13.498575+0000","last_fullsized":"2024-09-21T06:18:13.498575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.266347+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:17:48.266347+0000","last_peered":"2024-09-21T06:17:48.266347+0000","last_clean":"2024-09-21T06:17:48.266347+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:17:48.266347+0000","last_undegraded":"2024-09-21T06:17:48.266347+0000","last_fullsized":"2024-09-21T06:17:48.266347+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499721+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:18:13.499721+0000","last_peered":"2024-09-21T06:18:13.499721+0000","last_clean":"2024-09-21T06:18:13.499721+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:18:13.499721+0000","last_undegraded":"2024-09-21T06:18:13.499721+0000","last_fullsized":"2024-09-21T06:18:13.499721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.323111+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:17:56.323111+0000","last_peered":"2024-09-21T06:17:56.323111+0000","last_clean":"2024-09-21T06:17:56.323111+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:17:56.323111+0000","last_undegraded":"2024-09-21T06:17:56.323111+0000","last_fullsized":"2024-09-21T06:17:56.323111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498924+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:18:13.498924+0000","last_peered":"2024-09-21T06:18:13.498924+0000","last_clean":"2024-09-21T06:18:13.498924+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:18:13.498924+0000","last_undegraded":"2024-09-21T06:18:13.498924+0000","last_fullsized":"2024-09-21T06:18:13.498924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498481+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498481+0000","last_peered":"2024-09-21T06:18:13.498481+0000","last_clean":"2024-09-21T06:18:13.498481+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498481+0000","last_undegraded":"2024-09-21T06:18:13.498481+0000","last_fullsized":"2024-09-21T06:18:13.498481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.943900+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:17:56.943900+0000","last_peered":"2024-09-21T06:17:56.943900+0000","last_clean":"2024-09-21T06:17:56.943900+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:17:56.943900+0000","last_undegraded":"2024-09-21T06:17:56.943900+0000","last_fullsized":"2024-09-21T06:17:56.943900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259395+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:17:48.259395+0000","last_peered":"2024-09-21T06:17:48.259395+0000","last_clean":"2024-09-21T06:17:48.259395+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:17:48.259395+0000","last_undegraded":"2024-09-21T06:17:48.259395+0000","last_fullsized":"2024-09-21T06:17:48.259395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.241715+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:17:48.241715+0000","last_peered":"2024-09-21T06:17:48.241715+0000","last_clean":"2024-09-21T06:17:48.241715+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:17:48.241715+0000","last_undegraded":"2024-09-21T06:17:48.241715+0000","last_fullsized":"2024-09-21T06:17:48.241715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:06.963113+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:18:06.963113+0000","last_peered":"2024-09-21T06:18:06.963113+0000","last_clean":"2024-09-21T06:18:06.963113+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:18:06.963113+0000","last_undegraded":"2024-09-21T06:18:06.963113+0000","last_fullsized":"2024-09-21T06:18:06.963113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258144+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:17:48.258144+0000","last_peered":"2024-09-21T06:17:48.258144+0000","last_clean":"2024-09-21T06:17:48.258144+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:17:48.258144+0000","last_undegraded":"2024-09-21T06:17:48.258144+0000","last_fullsized":"2024-09-21T06:17:48.258144+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.240559+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:17:48.240559+0000","last_peered":"2024-09-21T06:17:48.240559+0000","last_clean":"2024-09-21T06:17:48.240559+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:17:48.240559+0000","last_undegraded":"2024-09-21T06:17:48.240559+0000","last_fullsized":"2024-09-21T06:17:48.240559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.257353+0000","last_change":"2024-09-21T06:17:45.221680+0000","last_active":"2024-09-21T06:17:48.257353+0000","last_peered":"2024-09-21T06:17:48.257353+0000","last_clean":"2024-09-21T06:17:48.257353+0000","last_became_active":"2024-09-21T06:17:45.221320+0000","last_became_peered":"2024-09-21T06:17:45.221320+0000","last_unstale":"2024-09-21T06:17:48.257353+0000","last_undegraded":"2024-09-21T06:17:48.257353+0000","last_fullsized":"2024-09-21T06:17:48.257353+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:23.394531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:51.206782+0000","last_change":"2024-09-21T06:17:47.243605+0000","last_active":"2024-09-21T06:17:51.206782+0000","last_peered":"2024-09-21T06:17:51.206782+0000","last_clean":"2024-09-21T06:17:51.206782+0000","last_became_active":"2024-09-21T06:17:47.243198+0000","last_became_peered":"2024-09-21T06:17:47.243198+0000","last_unstale":"2024-09-21T06:17:51.206782+0000","last_undegraded":"2024-09-21T06:17:51.206782+0000","last_fullsized":"2024-09-21T06:17:51.206782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:23:37.877335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400887+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:12.400887+0000","last_peered":"2024-09-21T06:18:12.400887+0000","last_clean":"2024-09-21T06:18:12.400887+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:12.400887+0000","last_undegraded":"2024-09-21T06:18:12.400887+0000","last_fullsized":"2024-09-21T06:18:12.400887+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.242255+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:17:48.242255+0000","last_peered":"2024-09-21T06:17:48.242255+0000","last_clean":"2024-09-21T06:17:48.242255+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:17:48.242255+0000","last_undegraded":"2024-09-21T06:17:48.242255+0000","last_fullsized":"2024-09-21T06:17:48.242255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:18:08.257319+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:18:08.257319+0000","last_peered":"2024-09-21T06:18:08.257319+0000","last_clean":"2024-09-21T06:18:08.257319+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:18:08.257319+0000","last_undegraded":"2024-09-21T06:18:08.257319+0000","last_fullsized":"2024-09-21T06:18:08.257319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259280+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:17:48.259280+0000","last_peered":"2024-09-21T06:17:48.259280+0000","last_clean":"2024-09-21T06:17:48.259280+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:17:48.259280+0000","last_undegraded":"2024-09-21T06:17:48.259280+0000","last_fullsized":"2024-09-21T06:17:48.259280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.309783+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:17:55.309783+0000","last_peered":"2024-09-21T06:17:55.309783+0000","last_clean":"2024-09-21T06:17:55.309783+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:17:55.309783+0000","last_undegraded":"2024-09-21T06:17:55.309783+0000","last_fullsized":"2024-09-21T06:17:55.309783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263673+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:17:48.263673+0000","last_peered":"2024-09-21T06:17:48.263673+0000","last_clean":"2024-09-21T06:17:48.263673+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:17:48.263673+0000","last_undegraded":"2024-09-21T06:17:48.263673+0000","last_fullsized":"2024-09-21T06:17:48.263673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.312152+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:17:55.312152+0000","last_peered":"2024-09-21T06:17:55.312152+0000","last_clean":"2024-09-21T06:17:55.312152+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:17:55.312152+0000","last_undegraded":"2024-09-21T06:17:55.312152+0000","last_fullsized":"2024-09-21T06:17:55.312152+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400165+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:18:12.400165+0000","last_peered":"2024-09-21T06:18:12.400165+0000","last_clean":"2024-09-21T06:18:12.400165+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:18:12.400165+0000","last_undegraded":"2024-09-21T06:18:12.400165+0000","last_fullsized":"2024-09-21T06:18:12.400165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:55.312997+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:17:55.312997+0000","last_peered":"2024-09-21T06:17:55.312997+0000","last_clean":"2024-09-21T06:17:55.312997+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:17:55.312997+0000","last_undegraded":"2024-09-21T06:17:55.312997+0000","last_fullsized":"2024-09-21T06:17:55.312997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.261878+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:17:48.261878+0000","last_peered":"2024-09-21T06:17:48.261878+0000","last_clean":"2024-09-21T06:17:48.261878+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:17:48.261878+0000","last_undegraded":"2024-09-21T06:17:48.261878+0000","last_fullsized":"2024-09-21T06:17:48.261878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.244517+0000","last_change":"2024-09-21T06:17:45.215026+0000","last_active":"2024-09-21T06:17:48.244517+0000","last_peered":"2024-09-21T06:17:48.244517+0000","last_clean":"2024-09-21T06:17:48.244517+0000","last_became_active":"2024-09-21T06:17:45.214482+0000","last_became_peered":"2024-09-21T06:17:45.214482+0000","last_unstale":"2024-09-21T06:17:48.244517+0000","last_undegraded":"2024-09-21T06:17:48.244517+0000","last_fullsized":"2024-09-21T06:17:48.244517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:51.053355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259012+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:17:48.259012+0000","last_peered":"2024-09-21T06:17:48.259012+0000","last_clean":"2024-09-21T06:17:48.259012+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:17:48.259012+0000","last_undegraded":"2024-09-21T06:17:48.259012+0000","last_fullsized":"2024-09-21T06:17:48.259012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400382+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:12.400382+0000","last_peered":"2024-09-21T06:18:12.400382+0000","last_clean":"2024-09-21T06:18:12.400382+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:12.400382+0000","last_undegraded":"2024-09-21T06:18:12.400382+0000","last_fullsized":"2024-09-21T06:18:12.400382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498640+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:18:13.498640+0000","last_peered":"2024-09-21T06:18:13.498640+0000","last_clean":"2024-09-21T06:18:13.498640+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:18:13.498640+0000","last_undegraded":"2024-09-21T06:18:13.498640+0000","last_fullsized":"2024-09-21T06:18:13.498640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.256925+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:17:48.256925+0000","last_peered":"2024-09-21T06:17:48.256925+0000","last_clean":"2024-09-21T06:17:48.256925+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:17:48.256925+0000","last_undegraded":"2024-09-21T06:17:48.256925+0000","last_fullsized":"2024-09-21T06:17:48.256925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400867+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:12.400867+0000","last_peered":"2024-09-21T06:18:12.400867+0000","last_clean":"2024-09-21T06:18:12.400867+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:12.400867+0000","last_undegraded":"2024-09-21T06:18:12.400867+0000","last_fullsized":"2024-09-21T06:18:12.400867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.258752+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:17:48.258752+0000","last_peered":"2024-09-21T06:17:48.258752+0000","last_clean":"2024-09-21T06:17:48.258752+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:17:48.258752+0000","last_undegraded":"2024-09-21T06:17:48.258752+0000","last_fullsized":"2024-09-21T06:17:48.258752+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:18:12.400785+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:12.400785+0000","last_peered":"2024-09-21T06:18:12.400785+0000","last_clean":"2024-09-21T06:18:12.400785+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:12.400785+0000","last_undegraded":"2024-09-21T06:18:12.400785+0000","last_fullsized":"2024-09-21T06:18:12.400785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.263465+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:17:48.263465+0000","last_peered":"2024-09-21T06:17:48.263465+0000","last_clean":"2024-09-21T06:17:48.263465+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:17:48.263465+0000","last_undegraded":"2024-09-21T06:17:48.263465+0000","last_fullsized":"2024-09-21T06:17:48.263465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.265492+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:17:48.265492+0000","last_peered":"2024-09-21T06:17:48.265492+0000","last_clean":"2024-09-21T06:17:48.265492+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:17:48.265492+0000","last_undegraded":"2024-09-21T06:17:48.265492+0000","last_fullsized":"2024-09-21T06:17:48.265492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:48.259063+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:17:48.259063+0000","last_peered":"2024-09-21T06:17:48.259063+0000","last_clean":"2024-09-21T06:17:48.259063+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:17:48.259063+0000","last_undegraded":"2024-09-21T06:17:48.259063+0000","last_fullsized":"2024-09-21T06:17:48.259063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T06:17:56.323038+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:17:56.323038+0000","last_peered":"2024-09-21T06:17:56.323038+0000","last_clean":"2024-09-21T06:17:56.323038+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:17:56.323038+0000","last_undegraded":"2024-09-21T06:17:56.323038+0000","last_fullsized":"2024-09-21T06:17:56.323038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60239,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":114,"num_read_kb":118,"num_write":155,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":180717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":398504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708340,"statfs":{"total":95995035648,"available":95957340160,"internally_reserved":0,"allocated":1503232,"data_stored":1046614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":398740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":843776,"data_stored":407460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36752,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708400,"statfs":{"total":95995035648,"available":95957401600,"internally_reserved":0,"allocated":1437696,"data_stored":999390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":398129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":989883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":398957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":398440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":455510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":454160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":835584,"data_stored":399400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:18:14.615 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:18:14.615 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T06:18:14.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T06:18:14.874 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:14.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:14 smithi174 ceph-mon[34815]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:18:14.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:14 smithi044 ceph-mon[34369]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 -- 172.21.15.38:0/790506645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c1051a0 msgr2=0x7eff7c1055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 --2- 172.21.15.38:0/790506645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c1051a0 0x7eff7c1055b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7eff70009900 tx=0x7eff7002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 -- 172.21.15.38:0/790506645 shutdown_connections 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 --2- 172.21.15.38:0/790506645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c105af0 0x7eff7c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 --2- 172.21.15.38:0/790506645 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c1051a0 0x7eff7c1055b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 --2- 172.21.15.38:0/790506645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1031d0 0x7eff7c1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 -- 172.21.15.38:0/790506645 >> 172.21.15.38:0/790506645 conn(0x7eff7c079de0 msgr2=0x7eff7c07a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 -- 172.21.15.38:0/790506645 shutdown_connections 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.316+0000 7eff81914640 1 -- 172.21.15.38:0/790506645 wait complete. 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 Processor -- start 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 -- start start 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c1031d0 0x7eff7c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1051a0 0x7eff7c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c112a90 con 0x7eff7c105af0 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c112910 con 0x7eff7c1031d0 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff81914640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c112c10 con 0x7eff7c1051a0 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.317+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35804/0 (socket says 172.21.15.38:35804) 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 -- 172.21.15.38:0/1318695078 learned_addr learned my addr 172.21.15.38:0/1318695078 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7affd640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c1031d0 0x7eff7c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7a7fc640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1051a0 0x7eff7c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 -- 172.21.15.38:0/1318695078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1051a0 msgr2=0x7eff7c19b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1051a0 0x7eff7c19b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 -- 172.21.15.38:0/1318695078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c1031d0 msgr2=0x7eff7c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c1031d0 0x7eff7c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 -- 172.21.15.38:0/1318695078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c1a6670 con 0x7eff7c105af0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff7b7fe640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff74009fd0 tx=0x7eff7400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74017070 con 0x7eff7c105af0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff74003e40 con 0x7eff7c105af0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c1a6960 con 0x7eff7c105af0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74004820 con 0x7eff7c105af0 2024-09-21T06:18:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.318+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c1a6e70 con 0x7eff7c105af0 2024-09-21T06:18:15.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.319+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c1035e0 con 0x7eff7c105af0 2024-09-21T06:18:15.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.321+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7eff74003970 con 0x7eff7c105af0 2024-09-21T06:18:15.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.322+0000 7eff80912640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 0x7eff640b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:15.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.322+0000 7eff7affd640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 0x7eff640b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:15.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.322+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7eff740e7290 con 0x7eff7c105af0 2024-09-21T06:18:15.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.322+0000 7eff7affd640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 0x7eff640b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff7c1029f0 tx=0x7eff6c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.325+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff74003c60 con 0x7eff7c105af0 2024-09-21T06:18:15.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.589+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7eff7c02e640 con 0x7eff7c105af0 2024-09-21T06:18:15.591 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:15 smithi038 ceph-mon[31215]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:18:15.591 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:15 smithi038 ceph-mon[31215]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:15.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.593+0000 7eff80912640 1 -- 172.21.15.38:0/1318695078 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7eff740ad9a0 con 0x7eff7c105af0 2024-09-21T06:18:15.595 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-09-21T06:18:15.595 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQAnZe5mnsM6IxAAYlSfuavpxRlP9amnAO+vZA== 2024-09-21T06:18:15.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.596+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 msgr2=0x7eff640b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:15.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 0x7eff640b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff7c1029f0 tx=0x7eff6c00b390 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 msgr2=0x7eff7c19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff74009fd0 tx=0x7eff7400b260 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 shutdown_connections 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7eff640b6670 0x7eff640b8b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff7c105af0 0x7eff7c19bde0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff7c1051a0 0x7eff7c19b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 --2- 172.21.15.38:0/1318695078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff7c1031d0 0x7eff7c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 >> 172.21.15.38:0/1318695078 conn(0x7eff7c079de0 msgr2=0x7eff7c107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 shutdown_connections 2024-09-21T06:18:15.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:15.597+0000 7eff81914640 1 -- 172.21.15.38:0/1318695078 wait complete. 2024-09-21T06:18:15.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:15 smithi174 ceph-mon[34815]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:18:15.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:15 smithi174 ceph-mon[34815]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:15.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:15 smithi044 ceph-mon[34369]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:18:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:15 smithi044 ceph-mon[34369]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:16.305 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:18:16.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T06:18:16.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:18:16.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T06:18:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:16.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:16 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:18:16.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:16 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:18:16.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:16 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:18:16.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:16 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:18:16.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:16 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:18:16.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:16 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1318695078' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:18:17.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 -- 172.21.15.38:0/1969233267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c109df0 msgr2=0x7fcd3c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:17.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1969233267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c109df0 0x7fcd3c110620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009ca0 tx=0x7fcd3402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 -- 172.21.15.38:0/1969233267 shutdown_connections 2024-09-21T06:18:17.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1969233267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c109df0 0x7fcd3c110620 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1969233267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1969233267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c103b60 0x7fcd3c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 -- 172.21.15.38:0/1969233267 >> 172.21.15.38:0/1969233267 conn(0x7fcd3c07b850 msgr2=0x7fcd3c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 -- 172.21.15.38:0/1969233267 shutdown_connections 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.110+0000 7fcd423b8640 1 -- 172.21.15.38:0/1969233267 wait complete. 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 Processor -- start 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 -- start start 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 0x7fcd3c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c113bd0 con 0x7fcd3c103b60 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c113a50 con 0x7fcd3c1094a0 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.111+0000 7fcd423b8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c113d50 con 0x7fcd3c109df0 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35828/0 (socket says 172.21.15.38:35828) 2024-09-21T06:18:17.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 -- 172.21.15.38:0/1310476957 learned_addr learned my addr 172.21.15.38:0/1310476957 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd40955640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 0x7fcd3c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 -- 172.21.15.38:0/1310476957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 msgr2=0x7fcd3c19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 0x7fcd3c19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 -- 172.21.15.38:0/1310476957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 msgr2=0x7fcd3c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3b7fe640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 -- 172.21.15.38:0/1310476957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c1a0490 con 0x7fcd3c103b60 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd40955640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 0x7fcd3c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3b7fe640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd3bfff640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d950 tx=0x7fcd2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c017070 con 0x7fcd3c103b60 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c1a0780 con 0x7fcd3c103b60 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcd2c009c30 con 0x7fcd3c103b60 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00f6b0 con 0x7fcd3c103b60 2024-09-21T06:18:17.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.112+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c1a6ee0 con 0x7fcd3c103b60 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.114+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3c103f70 con 0x7fcd3c103b60 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.115+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fcd2c0109c0 con 0x7fcd3c103b60 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.116+0000 7fcd397fa640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 0x7fcd240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.116+0000 7fcd3b7fe640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 0x7fcd240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.116+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fcd2c0e72b0 con 0x7fcd3c103b60 2024-09-21T06:18:17.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.116+0000 7fcd3b7fe640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 0x7fcd240b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c1070d0 tx=0x7fcd30005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:17.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.121+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd2c009de0 con 0x7fcd3c103b60 2024-09-21T06:18:17.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.310+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fcd3c10b650 con 0x7fcd3c103b60 2024-09-21T06:18:17.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.310+0000 7fcd397fa640 1 -- 172.21.15.38:0/1310476957 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v59) ==== 86+0+133 (secure 0 0 0) 0x7fcd2c0ad940 con 0x7fcd3c103b60 2024-09-21T06:18:17.312 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:17.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 msgr2=0x7fcd240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 0x7fcd240b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c1070d0 tx=0x7fcd30005d30 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 msgr2=0x7fcd3c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00d950 tx=0x7fcd2c00de10 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 shutdown_connections 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fcd240b65f0 0x7fcd240b8b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcd3c109df0 0x7fcd3c19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd3c1094a0 0x7fcd3c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 --2- 172.21.15.38:0/1310476957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd3c103b60 0x7fcd3c19a520 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 >> 172.21.15.38:0/1310476957 conn(0x7fcd3c07b850 msgr2=0x7fcd3c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 shutdown_connections 2024-09-21T06:18:17.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:17.313+0000 7fcd423b8640 1 -- 172.21.15.38:0/1310476957 wait complete. 2024-09-21T06:18:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:17 smithi038 ceph-mon[31215]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T06:18:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:17 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1310476957' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:18:17.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:17 smithi174 ceph-mon[34815]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T06:18:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:17 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1310476957' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:18:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:17 smithi044 ceph-mon[34369]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-21T06:18:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:17 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1310476957' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:18:17.927 INFO:teuthology.orchestra.run.smithi038.stdout:[{"version":59,"timestamp":"2024-09-21T06:17:38.286533+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T06:18:17.928 INFO:tasks.ceph_manager:config epoch is 59 2024-09-21T06:18:17.928 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:18:17.928 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:18:17.928 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T06:18:18.187 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 -- 172.21.15.38:0/1814362280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 msgr2=0x7f4558102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 --2- 172.21.15.38:0/1814362280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f4558102e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4554009900 tx=0x7f455402a410 comp rx=0 tx=0).stop 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 -- 172.21.15.38:0/1814362280 shutdown_connections 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 --2- 172.21.15.38:0/1814362280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4558108cf0 0x7f455810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 --2- 172.21.15.38:0/1814362280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45581083a0 0x7f45581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 --2- 172.21.15.38:0/1814362280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f4558102e70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 -- 172.21.15.38:0/1814362280 >> 172.21.15.38:0/1814362280 conn(0x7f4558079730 msgr2=0x7f4558079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 -- 172.21.15.38:0/1814362280 shutdown_connections 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.648+0000 7f455fe57640 1 -- 172.21.15.38:0/1814362280 wait complete. 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 Processor -- start 2024-09-21T06:18:18.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 -- start start 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45581083a0 0x7f4558199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 0x7f455819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4558112aa0 con 0x7f4558102a60 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4558112920 con 0x7f4558108cf0 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455fe57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4558112c20 con 0x7f45581083a0 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455dbf3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455dbf3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35836/0 (socket says 172.21.15.38:35836) 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.649+0000 7f455dbf3640 1 -- 172.21.15.38:0/3488121534 learned_addr learned my addr 172.21.15.38:0/3488121534 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455e3f4640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 0x7f455819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455d3f2640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45581083a0 0x7f4558199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 -- 172.21.15.38:0/3488121534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45581083a0 msgr2=0x7f4558199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45581083a0 0x7f4558199a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 -- 172.21.15.38:0/3488121534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 msgr2=0x7f455819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:18.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 0x7f455819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 -- 172.21.15.38:0/3488121534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455819f440 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455e3f4640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 0x7f455819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455dbf3640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4554005ab0 tx=0x7f4554004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554046070 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4554003ac0 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455819f6d0 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554035050 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.650+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455806ae60 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.651+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558103ce0 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.653+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4554049070 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.653+0000 7f454effd640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 0x7f45440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.654+0000 7f455d3f2640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 0x7f45440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.654+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4554109770 con 0x7f4558102a60 2024-09-21T06:18:18.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.654+0000 7f455d3f2640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 0x7f45440b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4548005fd0 tx=0x7f4548005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:18.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.657+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45540cfe00 con 0x7f4558102a60 2024-09-21T06:18:18.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.896+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f455806b940 con 0x7f4558102a60 2024-09-21T06:18:18.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.901+0000 7f454effd640 1 -- 172.21.15.38:0/3488121534 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+296452 (secure 0 0 0) 0x7f45540d41e0 con 0x7f4558102a60 2024-09-21T06:18:18.907 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 msgr2=0x7f45440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 0x7f45440b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4548005fd0 tx=0x7f4548005850 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 msgr2=0x7f45581994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4554005ab0 tx=0x7f4554004270 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 shutdown_connections 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f45440b65f0 0x7f45440b8b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4558108cf0 0x7f455819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45581083a0 0x7f4558199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 --2- 172.21.15.38:0/3488121534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4558102a60 0x7f45581994d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 >> 172.21.15.38:0/3488121534 conn(0x7f4558079730 msgr2=0x7f4558101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 shutdown_connections 2024-09-21T06:18:18.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:18.904+0000 7f455fe57640 1 -- 172.21.15.38:0/3488121534 wait complete. 2024-09-21T06:18:19.665 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:19 smithi038 ceph-mon[31215]: pgmap v278: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:19.665 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3488121534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:18:19.699 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":4178988721},{"type":"v1","addr":"172.21.15.38:6801","nonce":4178988721}]},"active_addr":"172.21.15.38:6801/4178988721","active_change":"2024-09-21T06:11:11.566250+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.38:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1124876418}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3736705689}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3400488800}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1447053189}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":58895124}]}]} 2024-09-21T06:18:19.705 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T06:18:19.705 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T06:18:19.705 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:18:19.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:19 smithi174 ceph-mon[34815]: pgmap v278: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:19.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3488121534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:18:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:19 smithi044 ceph-mon[34369]: pgmap v278: 97 pgs: 97 active+clean; 644 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.0 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3488121534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:18:19.967 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:20.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 -- 172.21.15.38:0/2322359971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373810de60 msgr2=0x7f3738110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 --2- 172.21.15.38:0/2322359971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373810de60 0x7f3738110330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3730009ca0 tx=0x7f373002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 -- 172.21.15.38:0/2322359971 shutdown_connections 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 --2- 172.21.15.38:0/2322359971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373810de60 0x7f3738110330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 --2- 172.21.15.38:0/2322359971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738105380 0x7f373810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 --2- 172.21.15.38:0/2322359971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738104a30 0x7f3738104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 -- 172.21.15.38:0/2322359971 >> 172.21.15.38:0/2322359971 conn(0x7f3738079760 msgr2=0x7f3738079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 -- 172.21.15.38:0/2322359971 shutdown_connections 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.507+0000 7f373d700640 1 -- 172.21.15.38:0/2322359971 wait complete. 2024-09-21T06:18:20.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 Processor -- start 2024-09-21T06:18:20.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 -- start start 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738105380 0x7f373819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f373810de60 0x7f37381a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113c00 con 0x7f3738104a30 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113a80 con 0x7f373810de60 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.508+0000 7f373d700640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3738113d80 con 0x7f3738105380 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55834/0 (socket says 172.21.15.38:55834) 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 -- 172.21.15.38:0/1206517551 learned_addr learned my addr 172.21.15.38:0/1206517551 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:20.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f37367fc640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738105380 0x7f373819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f37377fe640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f373810de60 0x7f37381a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 -- 172.21.15.38:0/1206517551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738105380 msgr2=0x7f373819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738105380 0x7f373819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 -- 172.21.15.38:0/1206517551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f373810de60 msgr2=0x7f37381a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f373810de60 0x7f37381a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 -- 172.21.15.38:0/1206517551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37381a2600 con 0x7f3738104a30 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f3736ffd640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f372800d950 tx=0x7f372800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728017070 con 0x7f3738104a30 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f372800be10 con 0x7f3738104a30 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37381a28f0 con 0x7f3738104a30 2024-09-21T06:18:20.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.509+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372800f620 con 0x7f3738104a30 2024-09-21T06:18:20.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.510+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37381a9110 con 0x7f3738104a30 2024-09-21T06:18:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.511+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f373806c1f0 con 0x7f3738104a30 2024-09-21T06:18:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.512+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f372801a070 con 0x7f3738104a30 2024-09-21T06:18:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.513+0000 7f372ffff640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 0x7f37240b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.513+0000 7f37367fc640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 0x7f37240b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:20.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.513+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f37280e6f70 con 0x7f3738104a30 2024-09-21T06:18:20.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.514+0000 7f37367fc640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 0x7f37240b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f373810fb70 tx=0x7f372000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:20.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.516+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37280ad5a0 con 0x7f3738104a30 2024-09-21T06:18:20.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.707+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3738104e40 con 0x7f3738104a30 2024-09-21T06:18:20.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.709+0000 7f372ffff640 1 -- 172.21.15.38:0/1206517551 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7f37280b1980 con 0x7f3738104a30 2024-09-21T06:18:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:20.712 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:18:20.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 msgr2=0x7f37240b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 0x7f37240b8b30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f373810fb70 tx=0x7f372000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 msgr2=0x7f373819c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f372800d950 tx=0x7f372800dd50 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 shutdown_connections 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f37240b6620 0x7f37240b8b30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f373810de60 0x7f37381a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3738105380 0x7f373819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 --2- 172.21.15.38:0/1206517551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3738104a30 0x7f373819c750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 >> 172.21.15.38:0/1206517551 conn(0x7f3738079760 msgr2=0x7f37381036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 shutdown_connections 2024-09-21T06:18:20.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:20.712+0000 7f373d700640 1 -- 172.21.15.38:0/1206517551 wait complete. 2024-09-21T06:18:21.450 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T06:18:21.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:18:21.708 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:21 smithi038 ceph-mon[31215]: pgmap v279: 97 pgs: 97 active+clean; 644 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1206517551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:21 smithi174 ceph-mon[34815]: pgmap v279: 97 pgs: 97 active+clean; 644 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1206517551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:21.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:21 smithi044 ceph-mon[34369]: pgmap v279: 97 pgs: 97 active+clean; 644 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T06:18:21.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1206517551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 -- 172.21.15.38:0/23222496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c1083d0 msgr2=0x7fb74c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 --2- 172.21.15.38:0/23222496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c1083d0 0x7fb74c1087e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb740009900 tx=0x7fb74002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 -- 172.21.15.38:0/23222496 shutdown_connections 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 --2- 172.21.15.38:0/23222496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 --2- 172.21.15.38:0/23222496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c1083d0 0x7fb74c1087e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 --2- 172.21.15.38:0/23222496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c102ae0 0x7fb74c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 -- 172.21.15.38:0/23222496 >> 172.21.15.38:0/23222496 conn(0x7fb74c079760 msgr2=0x7fb74c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 -- 172.21.15.38:0/23222496 shutdown_connections 2024-09-21T06:18:22.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.182+0000 7fb751b8c640 1 -- 172.21.15.38:0/23222496 wait complete. 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.183+0000 7fb751b8c640 1 Processor -- start 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 -- start start 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c1083d0 0x7fb74c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c112ab0 con 0x7fb74c102ae0 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c112930 con 0x7fb74c108d20 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb751b8c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c112c30 con 0x7fb74c1083d0 2024-09-21T06:18:22.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55854/0 (socket says 172.21.15.38:55854) 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb74b7fe640 1 -- 172.21.15.38:0/34788486 learned_addr learned my addr 172.21.15.38:0/34788486 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb74affd640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c1083d0 0x7fb74c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.184+0000 7fb74bfff640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 -- 172.21.15.38:0/34788486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c1083d0 msgr2=0x7fb74c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c1083d0 0x7fb74c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 -- 172.21.15.38:0/34788486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 msgr2=0x7fb74c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 -- 172.21.15.38:0/34788486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c1a0500 con 0x7fb74c102ae0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74bfff640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb74b7fe640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00d950 tx=0x7fb73c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c017030 con 0x7fb74c102ae0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74c1a07f0 con 0x7fb74c102ae0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb73c004020 con 0x7fb74c102ae0 2024-09-21T06:18:22.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0047a0 con 0x7fb74c102ae0 2024-09-21T06:18:22.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.185+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74c1a6f50 con 0x7fb74c102ae0 2024-09-21T06:18:22.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.186+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74c103d10 con 0x7fb74c102ae0 2024-09-21T06:18:22.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.188+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb73c0041d0 con 0x7fb74c102ae0 2024-09-21T06:18:22.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.189+0000 7fb748ff9640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 0x7fb7340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:22.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.189+0000 7fb74affd640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 0x7fb7340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:22.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.189+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb73c0e7780 con 0x7fb74c102ae0 2024-09-21T06:18:22.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.190+0000 7fb74affd640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 0x7fb7340b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb740000c00 tx=0x7fb740009630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:22.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.193+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb73c0addb0 con 0x7fb74c102ae0 2024-09-21T06:18:22.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.382+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb74c102ef0 con 0x7fb74c102ae0 2024-09-21T06:18:22.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.385+0000 7fb748ff9640 1 -- 172.21.15.38:0/34788486 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7fb73c0b2190 con 0x7fb74c102ae0 2024-09-21T06:18:22.388 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:22.388 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:18:22.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 msgr2=0x7fb7340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 0x7fb7340b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb740000c00 tx=0x7fb740009630 comp rx=0 tx=0).stop 2024-09-21T06:18:22.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 msgr2=0x7fb74c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:22.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00d950 tx=0x7fb73c00de10 comp rx=0 tx=0).stop 2024-09-21T06:18:22.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 shutdown_connections 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb7340b65f0 0x7fb7340b8b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb74c108d20 0x7fb74c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb74c1083d0 0x7fb74c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 --2- 172.21.15.38:0/34788486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb74c102ae0 0x7fb74c19a590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.387+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 >> 172.21.15.38:0/34788486 conn(0x7fb74c079760 msgr2=0x7fb74c101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.388+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 shutdown_connections 2024-09-21T06:18:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:22.388+0000 7fb751b8c640 1 -- 172.21.15.38:0/34788486 wait complete. 2024-09-21T06:18:22.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:22 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/34788486' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:22.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:22 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/34788486' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:22.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:22 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/34788486' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:18:23.032 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T06:18:23.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T06:18:23.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T06:18:23.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T06:18:23.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T06:18:23.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T06:18:23.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T06:18:23.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T06:18:23.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T06:18:23.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T06:18:23.036 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T06:18:23.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T06:18:23.435 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:23 smithi038 ceph-mon[31215]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T06:18:23.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:23 smithi174 ceph-mon[34815]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T06:18:23.892 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.895 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.898 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:23 smithi044 ceph-mon[34369]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 12 B/s, 0 objects/s recovering 2024-09-21T06:18:23.907 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.907 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.908 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.909 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.911 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.915 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.918 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.926 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:23.926 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:25.575 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:25 smithi038 ceph-mon[31215]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T06:18:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 -- 172.21.15.38:0/734518473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c1094a0 msgr2=0x7fd17c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 --2- 172.21.15.38:0/734518473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c1094a0 0x7fd17c1098b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd170009900 tx=0x7fd17002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 -- 172.21.15.38:0/734518473 shutdown_connections 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 --2- 172.21.15.38:0/734518473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c109df0 0x7fd17c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 --2- 172.21.15.38:0/734518473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c1094a0 0x7fd17c1098b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.790+0000 7fd1808f9640 1 --2- 172.21.15.38:0/734518473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c103b60 0x7fd17c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.791+0000 7fd1808f9640 1 -- 172.21.15.38:0/734518473 >> 172.21.15.38:0/734518473 conn(0x7fd17c07b850 msgr2=0x7fd17c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.791+0000 7fd1808f9640 1 -- 172.21.15.38:0/734518473 shutdown_connections 2024-09-21T06:18:25.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.791+0000 7fd1808f9640 1 -- 172.21.15.38:0/734518473 wait complete. 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.791+0000 7fd1808f9640 1 Processor -- start 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 -- start start 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c103b60 0x7fd17c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c1094a0 0x7fd17c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 0x7fd17c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c113c10 con 0x7fd17c109df0 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c113a90 con 0x7fd17c1094a0 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd1808f9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c113d90 con 0x7fd17c103b60 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 0x7fd17c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 0x7fd17c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55894/0 (socket says 172.21.15.38:55894) 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 -- 172.21.15.38:0/1966529980 learned_addr learned my addr 172.21.15.38:0/1966529980 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c103b60 0x7fd17c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd179d9b640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c1094a0 0x7fd17c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 -- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c103b60 msgr2=0x7fd17c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd17c103b60 0x7fd17c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 -- 172.21.15.38:0/1966529980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c1094a0 msgr2=0x7fd17c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c1094a0 0x7fd17c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.792+0000 7fd17ad9d640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c1a0530 con 0x7fd17c109df0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd17ad9d640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 0x7fd17c19fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b970 tx=0x7fd17400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174019070 con 0x7fd17c109df0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd17400cb40 con 0x7fd17c109df0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c1a0820 con 0x7fd17c109df0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174007650 con 0x7fd17c109df0 2024-09-21T06:18:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.793+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c1a6f80 con 0x7fd17c109df0 2024-09-21T06:18:25.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.794+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd17c063b50 con 0x7fd17c109df0 2024-09-21T06:18:25.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.796+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd17401c070 con 0x7fd17c109df0 2024-09-21T06:18:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.796+0000 7fd16b7fe640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd1640b65f0 0x7fd1640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd17a59c640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd1640b65f0 0x7fd1640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd1740e7240 con 0x7fd17c109df0 2024-09-21T06:18:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd16b7fe640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] conn(0x7fd1640c02e0 0x7fd1640c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:25.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd174024e50 con 0x7fd1640c02e0 2024-09-21T06:18:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd1740e7690 con 0x7fd17c109df0 2024-09-21T06:18:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd17a59c640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd1640b65f0 0x7fd1640b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0058c0 tx=0x7fd16c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.797+0000 7fd179d9b640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] conn(0x7fd1640c02e0 0x7fd1640c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:25.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.798+0000 7fd179d9b640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] conn(0x7fd1640c02e0 0x7fd1640c27d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:25.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.799+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== osd.2 v2:172.21.15.174:6800/1341151207 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd174024e50 con 0x7fd1640c02e0 2024-09-21T06:18:25.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.812+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 --> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd17c063fd0 con 0x7fd1640c02e0 2024-09-21T06:18:25.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd16b7fe640 1 -- 172.21.15.38:0/1966529980 <== osd.2 v2:172.21.15.174:6800/1341151207 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd17c063fd0 con 0x7fd1640c02e0 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] conn(0x7fd1640c02e0 msgr2=0x7fd1640c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] conn(0x7fd1640c02e0 0x7fd1640c27d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd1640b65f0 msgr2=0x7fd1640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd1640b65f0 0x7fd1640b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0058c0 tx=0x7fd16c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 msgr2=0x7fd17c19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 --2- 172.21.15.38:0/1966529980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd17c109df0 0x7fd17c19fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b970 tx=0x7fd17400be30 comp rx=0 tx=0).stop 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd17ad9d640 1 -- 172.21.15.38:0/1966529980 reap_dead start 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 shutdown_connections 2024-09-21T06:18:25.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 >> 172.21.15.38:0/1966529980 conn(0x7fd17c07b850 msgr2=0x7fd17c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 shutdown_connections 2024-09-21T06:18:25.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.813+0000 7fd1808f9640 1 -- 172.21.15.38:0/1966529980 wait complete. 2024-09-21T06:18:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:25 smithi174 ceph-mon[34815]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T06:18:25.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:25 smithi044 ceph-mon[34369]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T06:18:26.719 INFO:teuthology.orchestra.run.smithi038.stdout:81604378691 2024-09-21T06:18:26.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.052+0000 7f963c1fa640 1 -- 172.21.15.38:0/3134860175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9634104880 msgr2=0x7f9634104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.052+0000 7f963c1fa640 1 --2- 172.21.15.38:0/3134860175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9634104880 0x7f9634104c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9630009900 tx=0x7f963002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 -- 172.21.15.38:0/3134860175 shutdown_connections 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 --2- 172.21.15.38:0/3134860175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f963410de30 0x7f9634110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 --2- 172.21.15.38:0/3134860175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96341052b0 0x7f963410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 --2- 172.21.15.38:0/3134860175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9634104880 0x7f9634104c90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 -- 172.21.15.38:0/3134860175 >> 172.21.15.38:0/3134860175 conn(0x7f9634079730 msgr2=0x7f9634079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 -- 172.21.15.38:0/3134860175 shutdown_connections 2024-09-21T06:18:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 -- 172.21.15.38:0/3134860175 wait complete. 2024-09-21T06:18:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 Processor -- start 2024-09-21T06:18:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.053+0000 7f963c1fa640 1 -- start start 2024-09-21T06:18:27.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9634104880 0x7f9634102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96341052b0 0x7f9634102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 0x7f9634103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9634113bb0 con 0x7f963410de30 2024-09-21T06:18:27.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9634113a30 con 0x7f9634104880 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963c1fa640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9634113d30 con 0x7f96341052b0 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 0x7f9634103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 0x7f9634103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55924/0 (socket says 172.21.15.38:55924) 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 -- 172.21.15.38:0/1121868379 learned_addr learned my addr 172.21.15.38:0/1121868379 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f9639f96640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9634104880 0x7f9634102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f9639795640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96341052b0 0x7f9634102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 -- 172.21.15.38:0/1121868379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96341052b0 msgr2=0x7f9634102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96341052b0 0x7f9634102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 -- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9634104880 msgr2=0x7f9634102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9634104880 0x7f9634102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96341a87d0 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.054+0000 7f963a797640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 0x7f9634103210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f962c00eaa0 tx=0x7f962c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.055+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c00cdb0 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.055+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96341a8ac0 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.055+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f962c005020 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.055+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0116d0 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.055+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96341a8fd0 con 0x7f963410de30 2024-09-21T06:18:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.056+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9634108370 con 0x7f963410de30 2024-09-21T06:18:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.057+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f962c0051d0 con 0x7f963410de30 2024-09-21T06:18:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f962affd640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96200b65f0 0x7f96200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f9639f96640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96200b65f0 0x7f96200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f962c0e7b60 con 0x7f963410de30 2024-09-21T06:18:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f962affd640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] conn(0x7f96200c02e0 0x7f96200c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962c014ec0 con 0x7f96200c02e0 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.058+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f962c0e7f10 con 0x7f963410de30 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.059+0000 7f9639f96640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96200b65f0 0x7f96200b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96300314b0 tx=0x7f96300058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.059+0000 7f9639795640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] conn(0x7f96200c02e0 0x7f96200c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.059+0000 7f9639795640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] conn(0x7f96200c02e0 0x7f96200c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.060+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== osd.7 v2:172.21.15.44:6816/1039773435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f962c014ec0 con 0x7f96200c02e0 2024-09-21T06:18:27.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 --> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f963406b4c0 con 0x7f96200c02e0 2024-09-21T06:18:27.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f962affd640 1 -- 172.21.15.38:0/1121868379 <== osd.7 v2:172.21.15.44:6816/1039773435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f963406b4c0 con 0x7f96200c02e0 2024-09-21T06:18:27.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] conn(0x7f96200c02e0 msgr2=0x7f96200c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] conn(0x7f96200c02e0 0x7f96200c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96200b65f0 msgr2=0x7f96200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96200b65f0 0x7f96200b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96300314b0 tx=0x7f96300058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 msgr2=0x7f9634103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.074+0000 7f963c1fa640 1 --2- 172.21.15.38:0/1121868379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f963410de30 0x7f9634103210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f962c00eaa0 tx=0x7f962c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.075+0000 7f963a797640 1 -- 172.21.15.38:0/1121868379 reap_dead start 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.075+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 shutdown_connections 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.075+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 >> 172.21.15.38:0/1121868379 conn(0x7f9634079730 msgr2=0x7f9634107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.075+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 shutdown_connections 2024-09-21T06:18:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.075+0000 7f963c1fa640 1 -- 172.21.15.38:0/1121868379 wait complete. 2024-09-21T06:18:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.267+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/1366082950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb8105300 msgr2=0x7f5bb810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.267+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/1366082950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb8105300 0x7f5bb810d850 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009900 tx=0x7f5bac02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:27.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/1366082950 shutdown_connections 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/1366082950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bb810de10 0x7f5bb8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/1366082950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb8105300 0x7f5bb810d850 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/1366082950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb81049b0 0x7f5bb8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/1366082950 >> 172.21.15.38:0/1366082950 conn(0x7f5bb8079730 msgr2=0x7f5bb8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/1366082950 shutdown_connections 2024-09-21T06:18:27.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.268+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/1366082950 wait complete. 2024-09-21T06:18:27.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 Processor -- start 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 -- start start 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 0x7f5bb819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb8105300 0x7f5bb819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bb810de10 0x7f5bb819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8113be0 con 0x7f5bb81049b0 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8113a60 con 0x7f5bb8105300 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bbe2ed640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8113d60 con 0x7f5bb810de10 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.269+0000 7f5bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 0x7f5bb819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 0x7f5bb819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55950/0 (socket says 172.21.15.38:55950) 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 -- 172.21.15.38:0/2675360121 learned_addr learned my addr 172.21.15.38:0/2675360121 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bbc88a640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bb810de10 0x7f5bb819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb77fe640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb8105300 0x7f5bb819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 -- 172.21.15.38:0/2675360121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bb810de10 msgr2=0x7f5bb819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bb810de10 0x7f5bb819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 -- 172.21.15.38:0/2675360121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb8105300 msgr2=0x7f5bb819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb8105300 0x7f5bb819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb81a04e0 con 0x7f5bb81049b0 2024-09-21T06:18:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb77fe640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb8105300 0x7f5bb819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb7fff640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 0x7f5bb819a570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800d770 tx=0x7f5ba800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8017070 con 0x7f5bb81049b0 2024-09-21T06:18:27.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ba8009c30 con 0x7f5bb81049b0 2024-09-21T06:18:27.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.270+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb81a07d0 con 0x7f5bb81049b0 2024-09-21T06:18:27.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.271+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8003d70 con 0x7f5bb81049b0 2024-09-21T06:18:27.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.271+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb81a6f30 con 0x7f5bb81049b0 2024-09-21T06:18:27.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.272+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bb8100fc0 con 0x7f5bb81049b0 2024-09-21T06:18:27.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.274+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5ba8004000 con 0x7f5bb81049b0 2024-09-21T06:18:27.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb57fa640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5ba00b65f0 0x7f5ba00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb77fe640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5ba00b65f0 0x7f5ba00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5ba80e72a0 con 0x7f5bb81049b0 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb57fa640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] conn(0x7f5ba00c02e0 0x7f5ba00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ba8015e80 con 0x7f5ba00c02e0 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f5ba80e76f0 con 0x7f5bb81049b0 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.275+0000 7f5bbc88a640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] conn(0x7f5ba00c02e0 0x7f5ba00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.276+0000 7f5bb77fe640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5ba00b65f0 0x7f5ba00b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bac02aa00 tx=0x7f5bac000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.276+0000 7f5bbc88a640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] conn(0x7f5ba00c02e0 0x7f5ba00c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:27.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.276+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== osd.9 v2:172.21.15.38:6826/2245140106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ba8015e80 con 0x7f5ba00c02e0 2024-09-21T06:18:27.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.290+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 --> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5bb806b560 con 0x7f5ba00c02e0 2024-09-21T06:18:27.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bb57fa640 1 -- 172.21.15.38:0/2675360121 <== osd.9 v2:172.21.15.38:6826/2245140106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5bb806b560 con 0x7f5ba00c02e0 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] conn(0x7f5ba00c02e0 msgr2=0x7f5ba00c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] conn(0x7f5ba00c02e0 0x7f5ba00c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5ba00b65f0 msgr2=0x7f5ba00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5ba00b65f0 0x7f5ba00b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bac02aa00 tx=0x7f5bac000bc0 comp rx=0 tx=0).stop 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 msgr2=0x7f5bb819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 --2- 172.21.15.38:0/2675360121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5bb81049b0 0x7f5bb819a570 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800d770 tx=0x7f5ba800dc30 comp rx=0 tx=0).stop 2024-09-21T06:18:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbc88a640 1 -- 172.21.15.38:0/2675360121 reap_dead start 2024-09-21T06:18:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 shutdown_connections 2024-09-21T06:18:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.291+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 >> 172.21.15.38:0/2675360121 conn(0x7f5bb8079730 msgr2=0x7f5bb80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.292+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 shutdown_connections 2024-09-21T06:18:27.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.292+0000 7f5bbe2ed640 1 -- 172.21.15.38:0/2675360121 wait complete. 2024-09-21T06:18:27.611 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:27 smithi038 ceph-mon[31215]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:27.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:27 smithi174 ceph-mon[34815]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:27.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:27 smithi044 ceph-mon[34369]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 938 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 -- 172.21.15.38:0/2399967579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08102a60 msgr2=0x7faa08102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 --2- 172.21.15.38:0/2399967579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08102a60 0x7faa08102e70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009900 tx=0x7fa9f802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 -- 172.21.15.38:0/2399967579 shutdown_connections 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 --2- 172.21.15.38:0/2399967579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08108cf0 0x7faa0810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 --2- 172.21.15.38:0/2399967579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa081083a0 0x7faa081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 --2- 172.21.15.38:0/2399967579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08102a60 0x7faa08102e70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 -- 172.21.15.38:0/2399967579 >> 172.21.15.38:0/2399967579 conn(0x7faa08079730 msgr2=0x7faa08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 -- 172.21.15.38:0/2399967579 shutdown_connections 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.475+0000 7faa0de68640 1 -- 172.21.15.38:0/2399967579 wait complete. 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 Processor -- start 2024-09-21T06:18:28.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 -- start start 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08102a60 0x7faa0819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa081083a0 0x7faa0819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 0x7faa0819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa08112b00 con 0x7faa08108cf0 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa08112980 con 0x7faa081083a0 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa0de68640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa08112c80 con 0x7faa08102a60 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 0x7faa0819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa07fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 0x7faa0819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55972/0 (socket says 172.21.15.38:55972) 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa081083a0 0x7faa0819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa07fff640 1 -- 172.21.15.38:0/974633365 learned_addr learned my addr 172.21.15.38:0/974633365 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.476+0000 7faa077fe640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08102a60 0x7faa0819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 -- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08102a60 msgr2=0x7faa0819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08102a60 0x7faa0819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 -- 172.21.15.38:0/974633365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa081083a0 msgr2=0x7faa0819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa081083a0 0x7faa0819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa081a0530 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa077fe640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa08102a60 0x7faa0819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa07fff640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 0x7faa0819fe00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faa0000b970 tx=0x7faa0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00019070 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa081a0820 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa0000cb40 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00007650 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.477+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa081a6f80 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.478+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa081019d0 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.480+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7faa0001c070 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa04ff9640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9f00b65f0 0x7fa9f00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa077fe640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9f00b65f0 0x7fa9f00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faa000e7270 con 0x7faa08108cf0 2024-09-21T06:18:28.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa04ff9640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] conn(0x7fa9f00c02e0 0x7fa9f00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa00018ec0 con 0x7fa9f00c02e0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7faa000e76c0 con 0x7faa08108cf0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa077fe640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9f00b65f0 0x7fa9f00b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005ab0 tx=0x7fa9f8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.481+0000 7faa06ffd640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] conn(0x7fa9f00c02e0 0x7fa9f00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.482+0000 7faa06ffd640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] conn(0x7fa9f00c02e0 0x7fa9f00c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.483+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== osd.5 v2:172.21.15.174:6808/2947272530 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa00018ec0 con 0x7fa9f00c02e0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.496+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 --> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa08103ce0 con 0x7fa9f00c02e0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.497+0000 7faa04ff9640 1 -- 172.21.15.38:0/974633365 <== osd.5 v2:172.21.15.174:6808/2947272530 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa08103ce0 con 0x7fa9f00c02e0 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] conn(0x7fa9f00c02e0 msgr2=0x7fa9f00c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] conn(0x7fa9f00c02e0 0x7fa9f00c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9f00b65f0 msgr2=0x7fa9f00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9f00b65f0 0x7fa9f00b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005ab0 tx=0x7fa9f8005a20 comp rx=0 tx=0).stop 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 msgr2=0x7faa0819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 --2- 172.21.15.38:0/974633365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa08108cf0 0x7faa0819fe00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faa0000b970 tx=0x7faa0000be30 comp rx=0 tx=0).stop 2024-09-21T06:18:28.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa07fff640 1 -- 172.21.15.38:0/974633365 reap_dead start 2024-09-21T06:18:28.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 shutdown_connections 2024-09-21T06:18:28.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 >> 172.21.15.38:0/974633365 conn(0x7faa08079730 msgr2=0x7faa0806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:28.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 shutdown_connections 2024-09-21T06:18:28.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:27.498+0000 7faa0de68640 1 -- 172.21.15.38:0/974633365 wait complete. 2024-09-21T06:18:28.709 INFO:teuthology.orchestra.run.smithi038.stdout:154618822707 2024-09-21T06:18:28.709 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 -- 172.21.15.38:0/3999526748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054108cf0 msgr2=0x7f505410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 --2- 172.21.15.38:0/3999526748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054108cf0 0x7f505410f520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f504c009ca0 tx=0x7f504c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 -- 172.21.15.38:0/3999526748 shutdown_connections 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 --2- 172.21.15.38:0/3999526748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054108cf0 0x7f505410f520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 --2- 172.21.15.38:0/3999526748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50541083a0 0x7f50541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 --2- 172.21.15.38:0/3999526748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5054102a60 0x7f5054102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.885+0000 7f5059d72640 1 -- 172.21.15.38:0/3999526748 >> 172.21.15.38:0/3999526748 conn(0x7f5054079730 msgr2=0x7f5054079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.886+0000 7f5059d72640 1 -- 172.21.15.38:0/3999526748 shutdown_connections 2024-09-21T06:18:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.886+0000 7f5059d72640 1 -- 172.21.15.38:0/3999526748 wait complete. 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.886+0000 7f5059d72640 1 Processor -- start 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.886+0000 7f5059d72640 1 -- start start 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 0x7f505419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50541083a0 0x7f505419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5054108cf0 0x7f505419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5054112a80 con 0x7f5054102a60 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5054112900 con 0x7f5054108cf0 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5059d72640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5054112c00 con 0x7f50541083a0 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 0x7f505419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 0x7f505419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55990/0 (socket says 172.21.15.38:55990) 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 -- 172.21.15.38:0/3685325971 learned_addr learned my addr 172.21.15.38:0/3685325971 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f504affd640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50541083a0 0x7f505419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f5053fff640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5054108cf0 0x7f505419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 -- 172.21.15.38:0/3685325971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50541083a0 msgr2=0x7f505419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50541083a0 0x7f505419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 -- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5054108cf0 msgr2=0x7f505419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5054108cf0 0x7f505419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.887+0000 7f50537fe640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50541a0310 con 0x7f5054102a60 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f50537fe640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 0x7f505419a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f504400c920 tx=0x7f504400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044007bb0 con 0x7f5054102a60 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50541a0600 con 0x7f5054102a60 2024-09-21T06:18:28.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5044007d50 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50440187c0 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.888+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541a6e20 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.889+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5054063b50 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.891+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f504400f450 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.892+0000 7f50517fa640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50400b6620 0x7f50400b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.892+0000 7f504affd640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50400b6620 0x7f50400b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f50440e7d30 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f504affd640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50400b6620 0x7f50400b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f505406a1f0 tx=0x7f503c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f50517fa640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] conn(0x7f50400c0310 0x7f50400c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5044011ec0 con 0x7f50400c0310 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f50440e8170 con 0x7f5054102a60 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.893+0000 7f5053fff640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] conn(0x7f50400c0310 0x7f50400c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.894+0000 7f5053fff640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] conn(0x7f50400c0310 0x7f50400c2800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.894+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== osd.4 v2:172.21.15.44:6808/1910802405 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5044011ec0 con 0x7f50400c0310 2024-09-21T06:18:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.908+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 --> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5054063f50 con 0x7f50400c0310 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f50517fa640 1 -- 172.21.15.38:0/3685325971 <== osd.4 v2:172.21.15.44:6808/1910802405 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5054063f50 con 0x7f50400c0310 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] conn(0x7f50400c0310 msgr2=0x7f50400c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] conn(0x7f50400c0310 0x7f50400c2800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50400b6620 msgr2=0x7f50400b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50400b6620 0x7f50400b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f505406a1f0 tx=0x7f503c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 msgr2=0x7f505419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5059d72640 1 --2- 172.21.15.38:0/3685325971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5054102a60 0x7f505419a460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f504400c920 tx=0x7f504400cd20 comp rx=0 tx=0).stop 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.909+0000 7f5053fff640 1 -- 172.21.15.38:0/3685325971 reap_dead start 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.910+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 shutdown_connections 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.910+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 >> 172.21.15.38:0/3685325971 conn(0x7f5054079730 msgr2=0x7f505406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.910+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 shutdown_connections 2024-09-21T06:18:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:28.910+0000 7f5059d72640 1 -- 172.21.15.38:0/3685325971 wait complete. 2024-09-21T06:18:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 -- 172.21.15.38:0/3964245734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 msgr2=0x7f86b4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/3964245734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b4102e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009900 tx=0x7f86a402a410 comp rx=0 tx=0).stop 2024-09-21T06:18:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 -- 172.21.15.38:0/3964245734 shutdown_connections 2024-09-21T06:18:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/3964245734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86b4108d10 0x7f86b410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/3964245734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 0x7f86b41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/3964245734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b4102e90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 -- 172.21.15.38:0/3964245734 >> 172.21.15.38:0/3964245734 conn(0x7f86b4079740 msgr2=0x7f86b4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:29.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 -- 172.21.15.38:0/3964245734 shutdown_connections 2024-09-21T06:18:29.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.308+0000 7f86b8cd4640 1 -- 172.21.15.38:0/3964245734 wait complete. 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.309+0000 7f86b8cd4640 1 Processor -- start 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.309+0000 7f86b8cd4640 1 -- start start 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 0x7f86b419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86b4108d10 0x7f86b419fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4112b20 con 0x7f86b4102a80 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41129a0 con 0x7f86b4108d10 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b8cd4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4112ca0 con 0x7f86b41083c0 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56006/0 (socket says 172.21.15.38:56006) 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 -- 172.21.15.38:0/1787866088 learned_addr learned my addr 172.21.15.38:0/1787866088 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b1d9b640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 0x7f86b419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b2d9d640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86b4108d10 0x7f86b419fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:29.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 -- 172.21.15.38:0/1787866088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 msgr2=0x7f86b419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 0x7f86b419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 -- 172.21.15.38:0/1787866088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86b4108d10 msgr2=0x7f86b419fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86b4108d10 0x7f86b419fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b41a05d0 con 0x7f86b4102a80 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b1d9b640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86b41083c0 0x7f86b419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.310+0000 7f86b259c640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b419a660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86a4005ab0 tx=0x7f86a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.311+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a403f030 con 0x7f86b4102a80 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.311+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41a0860 con 0x7f86b4102a80 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.311+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86a4003cd0 con 0x7f86b4102a80 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.311+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035070 con 0x7f86b4102a80 2024-09-21T06:18:29.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.311+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b4104150 con 0x7f86b4102a80 2024-09-21T06:18:29.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.312+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86b4101a20 con 0x7f86b4102a80 2024-09-21T06:18:29.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.314+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f86a4042030 con 0x7f86b4102a80 2024-09-21T06:18:29.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.314+0000 7f86a37fe640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f869c0b65f0 0x7f869c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:29.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.314+0000 7f86b1d9b640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f869c0b65f0 0x7f869c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:29.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f86a4107be0 con 0x7f86b4102a80 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86a37fe640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] conn(0x7f869c0c02e0 0x7f869c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86a402eec0 con 0x7f869c0c02e0 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f86a410c220 con 0x7f86b4102a80 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86b2d9d640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] conn(0x7f869c0c02e0 0x7f869c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86b1d9b640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f869c0b65f0 0x7f869c0b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86b4079e20 tx=0x7f86a8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.315+0000 7f86b2d9d640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] conn(0x7f869c0c02e0 0x7f869c0c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:29.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.316+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== osd.6 v2:172.21.15.38:6818/1769685316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86a402eec0 con 0x7f869c0c02e0 2024-09-21T06:18:29.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.330+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 --> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86b406b390 con 0x7f869c0c02e0 2024-09-21T06:18:29.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.330+0000 7f86a37fe640 1 -- 172.21.15.38:0/1787866088 <== osd.6 v2:172.21.15.38:6818/1769685316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f86b406b390 con 0x7f869c0c02e0 2024-09-21T06:18:29.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.330+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] conn(0x7f869c0c02e0 msgr2=0x7f869c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.330+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] conn(0x7f869c0c02e0 0x7f869c0c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f869c0b65f0 msgr2=0x7f869c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f869c0b65f0 0x7f869c0b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86b4079e20 tx=0x7f86a8008040 comp rx=0 tx=0).stop 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 msgr2=0x7f86b419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 --2- 172.21.15.38:0/1787866088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86b4102a80 0x7f86b419a660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86a4005ab0 tx=0x7f86a40042f0 comp rx=0 tx=0).stop 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b2d9d640 1 -- 172.21.15.38:0/1787866088 reap_dead start 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 shutdown_connections 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 >> 172.21.15.38:0/1787866088 conn(0x7f86b4079740 msgr2=0x7f86b4106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 shutdown_connections 2024-09-21T06:18:29.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.331+0000 7f86b8cd4640 1 -- 172.21.15.38:0/1787866088 wait complete. 2024-09-21T06:18:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:29 smithi038 ceph-mon[31215]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:29.707 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:29 smithi044 ceph-mon[34369]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:29.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:29 smithi174 ceph-mon[34815]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T06:18:30.380 INFO:teuthology.orchestra.run.smithi038.stdout:133143986232 2024-09-21T06:18:30.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 -- 172.21.15.38:0/267826671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f8105300 msgr2=0x7f29f810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 --2- 172.21.15.38:0/267826671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f8105300 0x7f29f810d850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009900 tx=0x7f29e802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 -- 172.21.15.38:0/267826671 shutdown_connections 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 --2- 172.21.15.38:0/267826671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29f810de10 0x7f29f8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 --2- 172.21.15.38:0/267826671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f8105300 0x7f29f810d850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 --2- 172.21.15.38:0/267826671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29f81049b0 0x7f29f8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 -- 172.21.15.38:0/267826671 >> 172.21.15.38:0/267826671 conn(0x7f29f8079730 msgr2=0x7f29f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 -- 172.21.15.38:0/267826671 shutdown_connections 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.536+0000 7f2a0017a640 1 -- 172.21.15.38:0/267826671 wait complete. 2024-09-21T06:18:31.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 Processor -- start 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 -- start start 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29f81049b0 0x7f29f819c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29f8105300 0x7f29f819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 0x7f29f81a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113b90 con 0x7f29f810de10 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113a10 con 0x7f29f8105300 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f2a0017a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113d10 con 0x7f29f81049b0 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f29fe717640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 0x7f29f81a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f29fe717640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 0x7f29f81a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55850/0 (socket says 172.21.15.38:55850) 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f29fe717640 1 -- 172.21.15.38:0/976898159 learned_addr learned my addr 172.21.15.38:0/976898159 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.537+0000 7f29fd715640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29f8105300 0x7f29f819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fdf16640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29f81049b0 0x7f29f819c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 -- 172.21.15.38:0/976898159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29f81049b0 msgr2=0x7f29f819c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29f81049b0 0x7f29f819c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 -- 172.21.15.38:0/976898159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29f8105300 msgr2=0x7f29f819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29f8105300 0x7f29f819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f81a26f0 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29fe717640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 0x7f29f81a1fc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29f000d750 tx=0x7f29f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0017070 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f29f00054f0 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0004cd0 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f81a29e0 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.538+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f81a9140 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.539+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29f8104100 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.541+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f29f0009bd0 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.541+0000 7f29eeffd640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29e40b65f0 0x7f29e40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.541+0000 7f29fdf16640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29e40b65f0 0x7f29e40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29f00e7520 con 0x7f29f810de10 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29eeffd640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] conn(0x7f29e40c02e0 0x7f29e40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:31.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f0021e50 con 0x7f29e40c02e0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f29f00e7970 con 0x7f29f810de10 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29fd715640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] conn(0x7f29e40c02e0 0x7f29e40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29fdf16640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29e40b65f0 0x7f29e40b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29f806bc60 tx=0x7f29f4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.542+0000 7f29fd715640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] conn(0x7f29e40c02e0 0x7f29e40c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.543+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== osd.3 v2:172.21.15.38:6810/2396097926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f0021e50 con 0x7f29e40c02e0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 --> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29f806b560 con 0x7f29e40c02e0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f29eeffd640 1 -- 172.21.15.38:0/976898159 <== osd.3 v2:172.21.15.38:6810/2396097926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29f806b560 con 0x7f29e40c02e0 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] conn(0x7f29e40c02e0 msgr2=0x7f29e40c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] conn(0x7f29e40c02e0 0x7f29e40c27d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29e40b65f0 msgr2=0x7f29e40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29e40b65f0 0x7f29e40b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29f806bc60 tx=0x7f29f4009500 comp rx=0 tx=0).stop 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 msgr2=0x7f29f81a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 --2- 172.21.15.38:0/976898159 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29f810de10 0x7f29f81a1fc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f29f000d750 tx=0x7f29f000dc10 comp rx=0 tx=0).stop 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f29fe717640 1 -- 172.21.15.38:0/976898159 reap_dead start 2024-09-21T06:18:31.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 shutdown_connections 2024-09-21T06:18:31.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 >> 172.21.15.38:0/976898159 conn(0x7f29f8079730 msgr2=0x7f29f81036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:31.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 shutdown_connections 2024-09-21T06:18:31.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:29.557+0000 7f2a0017a640 1 -- 172.21.15.38:0/976898159 wait complete. 2024-09-21T06:18:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:31 smithi038 ceph-mon[31215]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:18:31.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:31 smithi174 ceph-mon[34815]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:18:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:31 smithi044 ceph-mon[34369]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:18:31.937 INFO:teuthology.orchestra.run.smithi038.stdout:253403070495 2024-09-21T06:18:31.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T06:18:32.438 INFO:teuthology.orchestra.run.smithi038.stdout:111669149758 2024-09-21T06:18:32.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T06:18:32.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 -- 172.21.15.38:0/826529633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 msgr2=0x7f9a5010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/826529633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5010f520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009ca0 tx=0x7f9a4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 -- 172.21.15.38:0/826529633 shutdown_connections 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/826529633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5010f520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/826529633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 0x7f9a501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/826529633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 0x7f9a50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 -- 172.21.15.38:0/826529633 >> 172.21.15.38:0/826529633 conn(0x7f9a50079730 msgr2=0x7f9a50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 -- 172.21.15.38:0/826529633 shutdown_connections 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.727+0000 7f9a57c4c640 1 -- 172.21.15.38:0/826529633 wait complete. 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.728+0000 7f9a57c4c640 1 Processor -- start 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.728+0000 7f9a57c4c640 1 -- start start 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 0x7f9a50198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:32.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 0x7f9a50198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9a501119a0 con 0x7f9a50108cf0 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50111820 con 0x7f9a501083a0 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50111b20 con 0x7f9a50102a60 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55882/0 (socket says 172.21.15.38:55882) 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 -- 172.21.15.38:0/719512301 learned_addr learned my addr 172.21.15.38:0/719512301 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a559e8640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 0x7f9a50198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a551e7640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 0x7f9a50198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 -- 172.21.15.38:0/719512301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 msgr2=0x7f9a50198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 0x7f9a50198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 -- 172.21.15.38:0/719512301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 msgr2=0x7f9a50198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 0x7f9a50198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5019e300 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a559e8640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a50102a60 0x7f9a50198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a551e7640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a501083a0 0x7f9a50198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a561e9640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5019dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a48005e30 tx=0x7f9a48003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a48031650 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9a480317f0 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.729+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5019e590 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.730+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4802fac0 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.730+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a501a4d50 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.730+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a50063b50 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.733+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f9a4802fc60 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a46ffd640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9a3c0b65f0 0x7f9a3c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a559e8640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9a3c0b65f0 0x7f9a3c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9a48108bc0 con 0x7f9a50108cf0 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a46ffd640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] conn(0x7f9a3c0c02e0 0x7f9a3c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:32.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a3c0c2ea0 con 0x7f9a3c0c02e0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9a48108f70 con 0x7f9a50108cf0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a559e8640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9a3c0b65f0 0x7f9a3c0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00bbc0 tx=0x7f9a4c00d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.734+0000 7f9a551e7640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] conn(0x7f9a3c0c02e0 0x7f9a3c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.735+0000 7f9a551e7640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] conn(0x7f9a3c0c02e0 0x7f9a3c0c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.735+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== osd.0 v2:172.21.15.38:6802/1319599999 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a3c0c2ea0 con 0x7f9a3c0c02e0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.749+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 --> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a50063fd0 con 0x7f9a3c0c02e0 2024-09-21T06:18:32.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.749+0000 7f9a46ffd640 1 -- 172.21.15.38:0/719512301 <== osd.0 v2:172.21.15.38:6802/1319599999 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a50063fd0 con 0x7f9a3c0c02e0 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] conn(0x7f9a3c0c02e0 msgr2=0x7f9a3c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] conn(0x7f9a3c0c02e0 0x7f9a3c0c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9a3c0b65f0 msgr2=0x7f9a3c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9a3c0b65f0 0x7f9a3c0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00bbc0 tx=0x7f9a4c00d040 comp rx=0 tx=0).stop 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 msgr2=0x7f9a5019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:32.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 --2- 172.21.15.38:0/719512301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a50108cf0 0x7f9a5019dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a48005e30 tx=0x7f9a48003d80 comp rx=0 tx=0).stop 2024-09-21T06:18:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a561e9640 1 -- 172.21.15.38:0/719512301 reap_dead start 2024-09-21T06:18:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 shutdown_connections 2024-09-21T06:18:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 >> 172.21.15.38:0/719512301 conn(0x7f9a50079730 msgr2=0x7f9a501043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 shutdown_connections 2024-09-21T06:18:32.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.750+0000 7f9a57c4c640 1 -- 172.21.15.38:0/719512301 wait complete. 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 -- 172.21.15.38:0/3927609098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f64103b90 msgr2=0x7f8f64103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 --2- 172.21.15.38:0/3927609098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f64103b90 0x7f8f64103fa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009900 tx=0x7f8f5402a410 comp rx=0 tx=0).stop 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 -- 172.21.15.38:0/3927609098 shutdown_connections 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 --2- 172.21.15.38:0/3927609098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64109e20 0x7f8f64110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 --2- 172.21.15.38:0/3927609098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f641094d0 0x7f8f641098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 --2- 172.21.15.38:0/3927609098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f64103b90 0x7f8f64103fa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 -- 172.21.15.38:0/3927609098 >> 172.21.15.38:0/3927609098 conn(0x7f8f640ff5e0 msgr2=0x7f8f64101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 -- 172.21.15.38:0/3927609098 shutdown_connections 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.963+0000 7f8f6a938640 1 -- 172.21.15.38:0/3927609098 wait complete. 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.964+0000 7f8f6a938640 1 Processor -- start 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.964+0000 7f8f6a938640 1 -- start start 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.964+0000 7f8f6a938640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64103b90 0x7f8f64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 0x7f8f64075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f64109e20 0x7f8f64076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64113c20 con 0x7f8f641094d0 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64113aa0 con 0x7f8f64103b90 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64113da0 con 0x7f8f64109e20 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 0x7f8f64075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 0x7f8f64075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55896/0 (socket says 172.21.15.38:55896) 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 -- 172.21.15.38:0/895075280 learned_addr learned my addr 172.21.15.38:0/895075280 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:33.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f63fff640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64103b90 0x7f8f64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f68ed5640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f64109e20 0x7f8f64076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 -- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f64109e20 msgr2=0x7f8f64076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f64109e20 0x7f8f64076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 -- 172.21.15.38:0/895075280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64103b90 msgr2=0x7f8f64075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64103b90 0x7f8f64075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f641a8830 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f63fff640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f64103b90 0x7f8f64075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f68ed5640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f64109e20 0x7f8f64076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f637fe640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 0x7f8f64075c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d750 tx=0x7f8f5800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58017070 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.965+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f641a8b20 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.966+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f580054f0 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.966+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58004d90 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.966+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f641a9060 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.966+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f64063b50 con 0x7f8f641094d0 2024-09-21T06:18:33.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.968+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8f58004f30 con 0x7f8f641094d0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f617fa640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f4c0b65f0 0x7f8f4c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f63fff640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f4c0b65f0 0x7f8f4c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8f580e7530 con 0x7f8f641094d0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f617fa640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] conn(0x7f8f4c0c02e0 0x7f8f4c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f58021e50 con 0x7f8f4c0c02e0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.969+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f8f580e78e0 con 0x7f8f641094d0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.970+0000 7f8f63fff640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f4c0b65f0 0x7f8f4c0b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f54005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.970+0000 7f8f68ed5640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] conn(0x7f8f4c0c02e0 0x7f8f4c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.970+0000 7f8f68ed5640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] conn(0x7f8f4c0c02e0 0x7f8f4c0c27d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.971+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== osd.8 v2:172.21.15.174:6816/3305912414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f58021e50 con 0x7f8f4c0c02e0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.985+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 --> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f64063f50 con 0x7f8f4c0c02e0 2024-09-21T06:18:33.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.985+0000 7f8f617fa640 1 -- 172.21.15.38:0/895075280 <== osd.8 v2:172.21.15.174:6816/3305912414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8f64063f50 con 0x7f8f4c0c02e0 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] conn(0x7f8f4c0c02e0 msgr2=0x7f8f4c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] conn(0x7f8f4c0c02e0 0x7f8f4c0c27d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f4c0b65f0 msgr2=0x7f8f4c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f4c0b65f0 0x7f8f4c0b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000c00 tx=0x7f8f54005a20 comp rx=0 tx=0).stop 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 msgr2=0x7f8f64075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 --2- 172.21.15.38:0/895075280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f641094d0 0x7f8f64075c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d750 tx=0x7f8f5800dc10 comp rx=0 tx=0).stop 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f68ed5640 1 -- 172.21.15.38:0/895075280 reap_dead start 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 shutdown_connections 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 >> 172.21.15.38:0/895075280 conn(0x7f8f640ff5e0 msgr2=0x7f8f64101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 shutdown_connections 2024-09-21T06:18:33.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.986+0000 7f8f6a938640 1 -- 172.21.15.38:0/895075280 wait complete. 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 -- 172.21.15.38:0/1962564426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 msgr2=0x7f4ce8110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 --2- 172.21.15.38:0/1962564426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce8110660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009c10 tx=0x7f4ce002a6f0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 -- 172.21.15.38:0/1962564426 shutdown_connections 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 --2- 172.21.15.38:0/1962564426 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce8110660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 --2- 172.21.15.38:0/1962564426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8106280 0x7f4ce8106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 --2- 172.21.15.38:0/1962564426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ce8102030 0x7f4ce8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 -- 172.21.15.38:0/1962564426 >> 172.21.15.38:0/1962564426 conn(0x7f4ce8077c60 msgr2=0x7f4ce80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 -- 172.21.15.38:0/1962564426 shutdown_connections 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.632+0000 7f4cf0483640 1 -- 172.21.15.38:0/1962564426 wait complete. 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.633+0000 7f4cf0483640 1 Processor -- start 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.633+0000 7f4cf0483640 1 -- start start 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.633+0000 7f4cf0483640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 0x7f4ce8074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.633+0000 7f4cf0483640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ce8106280 0x7f4ce806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cf0483640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cf0483640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8115df0 con 0x7f4ce8102030 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cf0483640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8115c70 con 0x7f4ce8106280 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cf0483640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8115f70 con 0x7f4ce8106bd0 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 0x7f4ce8074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 0x7f4ce8074e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55860/0 (socket says 172.21.15.38:55860) 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 -- 172.21.15.38:0/3989521977 learned_addr learned my addr 172.21.15.38:0/3989521977 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4ceda1e640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ce8106280 0x7f4ce806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4ceea20640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 -- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 msgr2=0x7f4ce806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 -- 172.21.15.38:0/3989521977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ce8106280 msgr2=0x7f4ce806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ce8106280 0x7f4ce806e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4cee21f640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce806ee50 con 0x7f4ce8102030 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.634+0000 7f4ceea20640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ce8106bd0 0x7f4ce806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:33.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cee21f640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 0x7f4ce8074e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400e9c0 tx=0x7f4ce400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400cd80 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ce4010900 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce8073af0 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4018980 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.635+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce8074030 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.636+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ce80745e0 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.638+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4ce401f020 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4cdf7fe640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4cd40b6670 0x7f4cd40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4ceda1e640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4cd40b6670 0x7f4cd40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ce40e7f80 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4cdf7fe640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] conn(0x7f4cd40c0360 0x7f4cd40c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ce4015e80 con 0x7f4cd40c0360 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.639+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f4ce40e8330 con 0x7f4ce8102030 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.640+0000 7f4ceea20640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] conn(0x7f4cd40c0360 0x7f4cd40c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:33.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.640+0000 7f4ceda1e640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4cd40b6670 0x7f4cd40b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ce81090e0 tx=0x7f4cd8009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.640+0000 7f4ceea20640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] conn(0x7f4cd40c0360 0x7f4cd40c2850 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.641+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== osd.11 v2:172.21.15.174:6824/1533000307 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ce4015e80 con 0x7f4cd40c0360 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.655+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 --> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ce806ab90 con 0x7f4cd40c0360 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.656+0000 7f4cdf7fe640 1 -- 172.21.15.38:0/3989521977 <== osd.11 v2:172.21.15.174:6824/1533000307 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4ce806ab90 con 0x7f4cd40c0360 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.656+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] conn(0x7f4cd40c0360 msgr2=0x7f4cd40c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.656+0000 7f4cf0483640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] conn(0x7f4cd40c0360 0x7f4cd40c2850 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4cd40b6670 msgr2=0x7f4cd40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4cd40b6670 0x7f4cd40b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ce81090e0 tx=0x7f4cd8009260 comp rx=0 tx=0).stop 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 msgr2=0x7f4ce8074e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 --2- 172.21.15.38:0/3989521977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ce8102030 0x7f4ce8074e20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400e9c0 tx=0x7f4ce400edc0 comp rx=0 tx=0).stop 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4ceea20640 1 -- 172.21.15.38:0/3989521977 reap_dead start 2024-09-21T06:18:33.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 shutdown_connections 2024-09-21T06:18:33.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 >> 172.21.15.38:0/3989521977 conn(0x7f4ce8077c60 msgr2=0x7f4ce81074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:33.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 shutdown_connections 2024-09-21T06:18:33.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:32.657+0000 7f4cf0483640 1 -- 172.21.15.38:0/3989521977 wait complete. 2024-09-21T06:18:33.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:33 smithi038 ceph-mon[31215]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:18:33.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:33 smithi174 ceph-mon[34815]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:18:33.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:33 smithi044 ceph-mon[34369]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:18:34.233 INFO:teuthology.orchestra.run.smithi038.stdout:296352743447 2024-09-21T06:18:34.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 -- 172.21.15.38:0/4214826870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 msgr2=0x7f101c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 --2- 172.21.15.38:0/4214826870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c110620 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1014009ca0 tx=0x7f101402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 -- 172.21.15.38:0/4214826870 shutdown_connections 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 --2- 172.21.15.38:0/4214826870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c110620 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 --2- 172.21.15.38:0/4214826870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101c1094a0 0x7f101c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 --2- 172.21.15.38:0/4214826870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c103b60 0x7f101c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.991+0000 7f1023d3d640 1 -- 172.21.15.38:0/4214826870 >> 172.21.15.38:0/4214826870 conn(0x7f101c07b850 msgr2=0x7f101c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 -- 172.21.15.38:0/4214826870 shutdown_connections 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 -- 172.21.15.38:0/4214826870 wait complete. 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 Processor -- start 2024-09-21T06:18:34.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 -- start start 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101c103b60 0x7f101c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.992+0000 7f1023d3d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c1094a0 0x7f101c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1023d3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1023d3d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f101c113bd0 con 0x7f101c109df0 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1023d3d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f101c113a50 con 0x7f101c103b60 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1023d3d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f101c113d50 con 0x7f101c1094a0 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55868/0 (socket says 172.21.15.38:55868) 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 -- 172.21.15.38:0/1698605628 learned_addr learned my addr 172.21.15.38:0/1698605628 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1021ad9640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101c103b60 0x7f101c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10212d8640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c1094a0 0x7f101c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 -- 172.21.15.38:0/1698605628 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c1094a0 msgr2=0x7f101c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c1094a0 0x7f101c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 -- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101c103b60 msgr2=0x7f101c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f101c103b60 0x7f101c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c1a0470 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f10222da640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c19fd40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1014005e30 tx=0x7f1014003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1014031650 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10140317f0 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101402fb70 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.993+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c1a0700 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.994+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c1a6ec0 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.994+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f101c063b50 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.996+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f101402fd10 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1012ffd640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10080b6670 0x7f10080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1021ad9640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10080b6670 0x7f10080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f10141089e0 con 0x7f101c109df0 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1012ffd640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] conn(0x7f10080c0360 0x7f10080c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:34.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10080c2f20 con 0x7f10080c0360 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f1014108e30 con 0x7f101c109df0 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f1021ad9640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10080b6670 0x7f10080b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1018005d00 tx=0x7f101800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.997+0000 7f10212d8640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] conn(0x7f10080c0360 0x7f10080c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.998+0000 7f10212d8640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] conn(0x7f10080c0360 0x7f10080c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:24.999+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== osd.1 v2:172.21.15.44:6800/375751782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10080c2f20 con 0x7f10080c0360 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 --> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f101c063f80 con 0x7f10080c0360 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1012ffd640 1 -- 172.21.15.38:0/1698605628 <== osd.1 v2:172.21.15.44:6800/375751782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f101c063f80 con 0x7f10080c0360 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] conn(0x7f10080c0360 msgr2=0x7f10080c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] conn(0x7f10080c0360 0x7f10080c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10080b6670 msgr2=0x7f10080b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10080b6670 0x7f10080b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1018005d00 tx=0x7f101800b410 comp rx=0 tx=0).stop 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 msgr2=0x7f101c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f1023d3d640 1 --2- 172.21.15.38:0/1698605628 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f101c109df0 0x7f101c19fd40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1014005e30 tx=0x7f1014003f90 comp rx=0 tx=0).stop 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.013+0000 7f10222da640 1 -- 172.21.15.38:0/1698605628 reap_dead start 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.014+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 shutdown_connections 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.014+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 >> 172.21.15.38:0/1698605628 conn(0x7f101c07b850 msgr2=0x7f101c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.014+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 shutdown_connections 2024-09-21T06:18:34.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:25.014+0000 7f1023d3d640 1 -- 172.21.15.38:0/1698605628 wait complete. 2024-09-21T06:18:35.273 INFO:teuthology.orchestra.run.smithi038.stdout:60129542215 2024-09-21T06:18:35.274 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T06:18:35.625 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:35 smithi038 ceph-mon[31215]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:18:35.655 INFO:teuthology.orchestra.run.smithi038.stdout:180388626479 2024-09-21T06:18:35.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T06:18:35.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:35 smithi174 ceph-mon[34815]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:18:35.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:35 smithi044 ceph-mon[34369]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-21T06:18:36.099 INFO:teuthology.orchestra.run.smithi038.stdout:227633266725 2024-09-21T06:18:36.099 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T06:18:36.201 INFO:teuthology.orchestra.run.smithi038.stdout:38654705742 2024-09-21T06:18:36.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T06:18:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.442+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1732862383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc41094b0 msgr2=0x7f9fc41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.442+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1732862383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc41094b0 0x7f9fc41098c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1732862383 shutdown_connections 2024-09-21T06:18:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1732862383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc4109e00 0x7f9fc4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1732862383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc41094b0 0x7f9fc41098c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1732862383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fc4103bc0 0x7f9fc4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1732862383 >> 172.21.15.38:0/1732862383 conn(0x7f9fc407b910 msgr2=0x7f9fc407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1732862383 shutdown_connections 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1732862383 wait complete. 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 Processor -- start 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.443+0000 7f9fca9cb640 1 -- start start 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fc4103bc0 0x7f9fc419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc41094b0 0x7f9fc419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 0x7f9fc419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4113be0 con 0x7f9fc4109e00 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4113a60 con 0x7f9fc4103bc0 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fca9cb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4113d60 con 0x7f9fc41094b0 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 0x7f9fc419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:36.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 0x7f9fc419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55912/0 (socket says 172.21.15.38:55912) 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 -- 172.21.15.38:0/1439490177 learned_addr learned my addr 172.21.15.38:0/1439490177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc3fff640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fc4103bc0 0x7f9fc419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc37fe640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc41094b0 0x7f9fc419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 -- 172.21.15.38:0/1439490177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc41094b0 msgr2=0x7f9fc419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc41094b0 0x7f9fc419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 -- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fc4103bc0 msgr2=0x7f9fc419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fc4103bc0 0x7f9fc419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.444+0000 7f9fc8f68640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc41a04c0 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fc8f68640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 0x7f9fc419fe50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00cce0 tx=0x7f9fbc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc00f450 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc41a07b0 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9fbc00fac0 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc018be0 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.445+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc41a0c70 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.446+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fc4063b50 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.448+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f9fbc00fc70 con 0x7f9fc4109e00 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc17fa640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9fac0b6620 0x7f9fac0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:36.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc3fff640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9fac0b6620 0x7f9fac0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9fbc0e7e60 con 0x7f9fc4109e00 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc17fa640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] conn(0x7f9fac0c0310 0x7f9fac0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fac0c2ed0 con 0x7f9fac0c0310 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.449+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9fbc0e82b0 con 0x7f9fc4109e00 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.450+0000 7f9fc3fff640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9fac0b6620 0x7f9fac0b8b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005d00 tx=0x7f9fb400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.450+0000 7f9fc37fe640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] conn(0x7f9fac0c0310 0x7f9fac0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.450+0000 7f9fc37fe640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] conn(0x7f9fac0c0310 0x7f9fac0c2800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.451+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== osd.10 v2:172.21.15.44:6824/2459414427 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9fac0c2ed0 con 0x7f9fac0c0310 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.465+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 --> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fc4063fd0 con 0x7f9fac0c0310 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fc17fa640 1 -- 172.21.15.38:0/1439490177 <== osd.10 v2:172.21.15.44:6824/2459414427 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9fc4063fd0 con 0x7f9fac0c0310 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] conn(0x7f9fac0c0310 msgr2=0x7f9fac0c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] conn(0x7f9fac0c0310 0x7f9fac0c2800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9fac0b6620 msgr2=0x7f9fac0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9fac0b6620 0x7f9fac0b8b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4005d00 tx=0x7f9fb400b410 comp rx=0 tx=0).stop 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 msgr2=0x7f9fc419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fca9cb640 1 --2- 172.21.15.38:0/1439490177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc4109e00 0x7f9fc419fe50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00cce0 tx=0x7f9fbc00a620 comp rx=0 tx=0).stop 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.466+0000 7f9fc8f68640 1 -- 172.21.15.38:0/1439490177 reap_dead start 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.467+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 shutdown_connections 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.467+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 >> 172.21.15.38:0/1439490177 conn(0x7f9fc407b910 msgr2=0x7f9fc41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.467+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 shutdown_connections 2024-09-21T06:18:36.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:34.467+0000 7f9fca9cb640 1 -- 172.21.15.38:0/1439490177 wait complete. 2024-09-21T06:18:36.902 INFO:teuthology.orchestra.run.smithi038.stdout:274877906972 2024-09-21T06:18:36.902 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T06:18:37.388 INFO:teuthology.orchestra.run.smithi038.stdout:201863462953 2024-09-21T06:18:37.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T06:18:37.448 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.456 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.458 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.464 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.476 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.476 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.478 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:37.607 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:37 smithi038 ceph-mon[31215]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:18:37.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:37 smithi174 ceph-mon[34815]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:18:37.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:37 smithi044 ceph-mon[34369]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:18:38.038 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 -- 172.21.15.38:0/11407085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47181083a0 msgr2=0x7f47181087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 --2- 172.21.15.38:0/11407085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47181083a0 0x7f47181087b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4708009900 tx=0x7f470802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 -- 172.21.15.38:0/11407085 shutdown_connections 2024-09-21T06:18:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 --2- 172.21.15.38:0/11407085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718108cf0 0x7f471810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 --2- 172.21.15.38:0/11407085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47181083a0 0x7f47181087b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 --2- 172.21.15.38:0/11407085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4718102a60 0x7f4718102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 -- 172.21.15.38:0/11407085 >> 172.21.15.38:0/11407085 conn(0x7f4718079730 msgr2=0x7f4718079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.212+0000 7f471fe4c640 1 -- 172.21.15.38:0/11407085 shutdown_connections 2024-09-21T06:18:38.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.213+0000 7f471fe4c640 1 -- 172.21.15.38:0/11407085 wait complete. 2024-09-21T06:18:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.213+0000 7f471fe4c640 1 Processor -- start 2024-09-21T06:18:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.213+0000 7f471fe4c640 1 -- start start 2024-09-21T06:18:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718102a60 0x7f47180ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47181083a0 0x7f47180ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4718112ad0 con 0x7f4718108cf0 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4718112950 con 0x7f47181083a0 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471fe4c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4718112c50 con 0x7f4718102a60 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55926/0 (socket says 172.21.15.38:55926) 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 -- 172.21.15.38:0/2073980373 learned_addr learned my addr 172.21.15.38:0/2073980373 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471d3e7640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47181083a0 0x7f47180ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471dbe8640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718102a60 0x7f47180ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 -- 172.21.15.38:0/2073980373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718102a60 msgr2=0x7f47180ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718102a60 0x7f47180ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 -- 172.21.15.38:0/2073980373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47181083a0 msgr2=0x7f47180ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47181083a0 0x7f47180ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 -- 172.21.15.38:0/2073980373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47181a8830 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f471e3e9640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f471000cad0 tx=0x7f471000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.214+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471000ae20 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.215+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47181a8b20 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.215+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4710005020 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.215+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471000f6b0 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.215+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47181a9030 con 0x7f4718108cf0 2024-09-21T06:18:38.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.216+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4718102e70 con 0x7f4718108cf0 2024-09-21T06:18:38.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.218+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f47100051d0 con 0x7f4718108cf0 2024-09-21T06:18:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.219+0000 7f470effd640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 0x7f47040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.219+0000 7f471dbe8640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 0x7f47040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.219+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f47100e78d0 con 0x7f4718108cf0 2024-09-21T06:18:38.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.219+0000 7f471dbe8640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 0x7f47040b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47181010c0 tx=0x7f471400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:38.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.222+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4710014030 con 0x7f4718108cf0 2024-09-21T06:18:38.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.414+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4718100970 con 0x7f4718108cf0 2024-09-21T06:18:38.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.415+0000 7f470effd640 1 -- 172.21.15.38:0/2073980373 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4718100970 con 0x7f4718108cf0 2024-09-21T06:18:38.416 INFO:teuthology.orchestra.run.smithi038.stdout:111669149759 2024-09-21T06:18:38.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 msgr2=0x7f47040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 0x7f47040b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47181010c0 tx=0x7f471400b390 comp rx=0 tx=0).stop 2024-09-21T06:18:38.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 msgr2=0x7f47181000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:38.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f471000cad0 tx=0x7f471000cf90 comp rx=0 tx=0).stop 2024-09-21T06:18:38.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 shutdown_connections 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47040b65f0 0x7f47040b8b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4718108cf0 0x7f47181000f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47181083a0 0x7f47180ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 --2- 172.21.15.38:0/2073980373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4718102a60 0x7f47180ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 >> 172.21.15.38:0/2073980373 conn(0x7f4718079730 msgr2=0x7f47181019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 shutdown_connections 2024-09-21T06:18:38.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:38.417+0000 7f471fe4c640 1 -- 172.21.15.38:0/2073980373 wait complete. 2024-09-21T06:18:38.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:38 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2073980373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:18:38.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:38 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2073980373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:18:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:38 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2073980373' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:18:39.102 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149758 got 111669149759 for osd.3 2024-09-21T06:18:39.102 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 -- 172.21.15.38:0/2163238208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d41083c0 msgr2=0x7fe7d41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 --2- 172.21.15.38:0/2163238208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d41083c0 0x7fe7d41087d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009900 tx=0x7fe7bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 -- 172.21.15.38:0/2163238208 shutdown_connections 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 --2- 172.21.15.38:0/2163238208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4108d10 0x7fe7d410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 --2- 172.21.15.38:0/2163238208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d41083c0 0x7fe7d41087d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 --2- 172.21.15.38:0/2163238208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d4102a80 0x7fe7d4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.500+0000 7fe7da866640 1 -- 172.21.15.38:0/2163238208 >> 172.21.15.38:0/2163238208 conn(0x7fe7d4079740 msgr2=0x7fe7d4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.501+0000 7fe7da866640 1 -- 172.21.15.38:0/2163238208 shutdown_connections 2024-09-21T06:18:39.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.501+0000 7fe7da866640 1 -- 172.21.15.38:0/2163238208 wait complete. 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.501+0000 7fe7da866640 1 Processor -- start 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.501+0000 7fe7da866640 1 -- start start 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4102a80 0x7fe7d41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d41083c0 0x7fe7d4199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4112b00 con 0x7fe7d4108d10 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4112980 con 0x7fe7d41083c0 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7da866640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4112c80 con 0x7fe7d4102a80 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42290/0 (socket says 172.21.15.38:42290) 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 -- 172.21.15.38:0/3975441177 learned_addr learned my addr 172.21.15.38:0/3975441177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:39.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d41083c0 0x7fe7d4199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d3fff640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4102a80 0x7fe7d41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 -- 172.21.15.38:0/3975441177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4102a80 msgr2=0x7fe7d41995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4102a80 0x7fe7d41995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 -- 172.21.15.38:0/3975441177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d41083c0 msgr2=0x7fe7d4199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d41083c0 0x7fe7d4199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 -- 172.21.15.38:0/3975441177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d419f560 con 0x7fe7d4108d10 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d8e03640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00b970 tx=0x7fe7cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.502+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc019070 con 0x7fe7d4108d10 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.503+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d419f850 con 0x7fe7d4108d10 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.503+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7cc00cb40 con 0x7fe7d4108d10 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.503+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc007610 con 0x7fe7d4108d10 2024-09-21T06:18:39.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.503+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d41a5fb0 con 0x7fe7d4108d10 2024-09-21T06:18:39.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.504+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d4103d00 con 0x7fe7d4108d10 2024-09-21T06:18:39.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.505+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe7cc01c070 con 0x7fe7d4108d10 2024-09-21T06:18:39.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.506+0000 7fe7d1ffb640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 0x7fe7c00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.506+0000 7fe7d3fff640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 0x7fe7c00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.507+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe7cc0e6ea0 con 0x7fe7d4108d10 2024-09-21T06:18:39.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.507+0000 7fe7d3fff640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 0x7fe7c00b8b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4005fd0 tx=0x7fe7c4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.510+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7cc0b18b0 con 0x7fe7d4108d10 2024-09-21T06:18:39.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 -- 172.21.15.38:0/4230963695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878108cf0 msgr2=0x7fa87810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 --2- 172.21.15.38:0/4230963695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878108cf0 0x7fa87810f520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa870009ca0 tx=0x7fa87002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 -- 172.21.15.38:0/4230963695 shutdown_connections 2024-09-21T06:18:39.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 --2- 172.21.15.38:0/4230963695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878108cf0 0x7fa87810f520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 --2- 172.21.15.38:0/4230963695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8781083a0 0x7fa8781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 --2- 172.21.15.38:0/4230963695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878102a60 0x7fa878102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 -- 172.21.15.38:0/4230963695 >> 172.21.15.38:0/4230963695 conn(0x7fa878079730 msgr2=0x7fa878079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 -- 172.21.15.38:0/4230963695 shutdown_connections 2024-09-21T06:18:39.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.693+0000 7fa87cba0640 1 -- 172.21.15.38:0/4230963695 wait complete. 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.694+0000 7fa87cba0640 1 Processor -- start 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.694+0000 7fa87cba0640 1 -- start start 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8781083a0 0x7fa878199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa878108cf0 0x7fa87819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112af0 con 0x7fa878102a60 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112970 con 0x7fa878108cf0 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87cba0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa878112c70 con 0x7fa8781083a0 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42322/0 (socket says 172.21.15.38:42322) 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 -- 172.21.15.38:0/1389342598 learned_addr learned my addr 172.21.15.38:0/1389342598 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa875d9b640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8781083a0 0x7fa878199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa876d9d640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa878108cf0 0x7fa87819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 -- 172.21.15.38:0/1389342598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8781083a0 msgr2=0x7fa878199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8781083a0 0x7fa878199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 -- 172.21.15.38:0/1389342598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa878108cf0 msgr2=0x7fa87819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa878108cf0 0x7fa87819eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.695+0000 7fa87659c640 1 -- 172.21.15.38:0/1389342598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87819f3d0 con 0x7fa878102a60 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa87659c640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d770 tx=0x7fa86800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868017070 con 0x7fa878102a60 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87819f6c0 con 0x7fa878102a60 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa8680054f0 con 0x7fa878102a60 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868004de0 con 0x7fa878102a60 2024-09-21T06:18:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.696+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781a5e20 con 0x7fa878102a60 2024-09-21T06:18:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.697+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878102e70 con 0x7fa878102a60 2024-09-21T06:18:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.698+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa868004f80 con 0x7fa878102a60 2024-09-21T06:18:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.699+0000 7fa8677fe640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 0x7fa8600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.699+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa8680e70c0 con 0x7fa878102a60 2024-09-21T06:18:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.699+0000 7fa875d9b640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 0x7fa8600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.700+0000 7fa875d9b640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 0x7fa8600b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa878079cc0 tx=0x7fa86c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.702+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe7d4102e90 con 0x7fe7d4108d10 2024-09-21T06:18:39.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.704+0000 7fe7d1ffb640 1 -- 172.21.15.38:0/3975441177 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7d4102e90 con 0x7fe7d4108d10 2024-09-21T06:18:39.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.704+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8680ad750 con 0x7fa878102a60 2024-09-21T06:18:39.706 INFO:teuthology.orchestra.run.smithi038.stdout:180388626480 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 msgr2=0x7fe7c00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 0x7fe7c00b8b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4005fd0 tx=0x7fe7c4005850 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 msgr2=0x7fe7d419ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00b970 tx=0x7fe7cc00be30 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 shutdown_connections 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7c00b6670 0x7fe7c00b8b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7d4108d10 0x7fe7d419ee30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7d41083c0 0x7fe7d4199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 --2- 172.21.15.38:0/3975441177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe7d4102a80 0x7fe7d41995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 >> 172.21.15.38:0/3975441177 conn(0x7fe7d4079740 msgr2=0x7fe7d4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 shutdown_connections 2024-09-21T06:18:39.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.707+0000 7fe7da866640 1 -- 172.21.15.38:0/3975441177 wait complete. 2024-09-21T06:18:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:39 smithi038 ceph-mon[31215]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:18:39.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:39 smithi174 ceph-mon[34815]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:18:39.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1285828262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20102f20 msgr2=0x7f6f2010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1285828262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20102f20 0x7f6f2010fc40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009900 tx=0x7f6f1002a480 comp rx=0 tx=0).stop 2024-09-21T06:18:39.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1285828262 shutdown_connections 2024-09-21T06:18:39.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1285828262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20110180 0x7f6f201125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1285828262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20102f20 0x7f6f2010fc40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1285828262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f201029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.886+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1285828262 >> 172.21.15.38:0/1285828262 conn(0x7f6f20079730 msgr2=0x7f6f20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.887+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1285828262 shutdown_connections 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.887+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1285828262 wait complete. 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.887+0000 7f6f27d2b640 1 Processor -- start 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.887+0000 7f6f27d2b640 1 -- start start 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f2019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 0x7f6f2019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20115d90 con 0x7f6f20110180 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20115c10 con 0x7f6f201025d0 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20115f10 con 0x7f6f20102f20 2024-09-21T06:18:39.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42330/0 (socket says 172.21.15.38:42330) 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 -- 172.21.15.38:0/1470551622 learned_addr learned my addr 172.21.15.38:0/1470551622 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f25ac7640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f2019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f252c6640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 0x7f6f2019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 -- 172.21.15.38:0/1470551622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 msgr2=0x7f6f2019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 0x7f6f2019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 -- 172.21.15.38:0/1470551622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 msgr2=0x7f6f2019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f2019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 -- 172.21.15.38:0/1470551622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f201a2650 con 0x7f6f20110180 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f25ac7640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f2019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f252c6640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 0x7f6f2019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f262c8640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009fd0 tx=0x7f6f1800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18017070 con 0x7f6f20110180 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f201a2940 con 0x7f6f20110180 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f18003e40 con 0x7f6f20110180 2024-09-21T06:18:39.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.888+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18004820 con 0x7f6f20110180 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.889+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201a90a0 con 0x7f6f20110180 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.890+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f201029e0 con 0x7f6f20110180 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.891+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f6f180106e0 con 0x7f6f20110180 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.892+0000 7f6f16ffd640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 0x7f6f0c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.892+0000 7f6f25ac7640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 0x7f6f0c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.892+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f180e74f0 con 0x7f6f20110180 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.892+0000 7f6f25ac7640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 0x7f6f0c0b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:39.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.896+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f180adb20 con 0x7f6f20110180 2024-09-21T06:18:39.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:39 smithi044 ceph-mon[34369]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:18:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.910+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa87810a530 con 0x7fa878102a60 2024-09-21T06:18:39.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.911+0000 7fa8677fe640 1 -- 172.21.15.38:0/1389342598 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa868092e20 con 0x7fa878102a60 2024-09-21T06:18:39.913 INFO:teuthology.orchestra.run.smithi038.stdout:154618822709 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 msgr2=0x7fa8600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 0x7fa8600b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa878079cc0 tx=0x7fa86c00b410 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 msgr2=0x7fa878199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d770 tx=0x7fa86800dc30 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 shutdown_connections 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa8600b65f0 0x7fa8600b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa878108cf0 0x7fa87819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8781083a0 0x7fa878199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 --2- 172.21.15.38:0/1389342598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa878102a60 0x7fa878199460 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:39.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 >> 172.21.15.38:0/1389342598 conn(0x7fa878079730 msgr2=0x7fa8781043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 shutdown_connections 2024-09-21T06:18:39.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:39.913+0000 7fa87cba0640 1 -- 172.21.15.38:0/1389342598 wait complete. 2024-09-21T06:18:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.088+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6f201a9270 con 0x7f6f20110180 2024-09-21T06:18:40.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.089+0000 7f6f16ffd640 1 -- 172.21.15.38:0/1470551622 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6f180b1f00 con 0x7f6f20110180 2024-09-21T06:18:40.091 INFO:teuthology.orchestra.run.smithi038.stdout:296352743448 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 msgr2=0x7f6f0c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 0x7f6f0c0b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c005850 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 msgr2=0x7f6f201a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009fd0 tx=0x7f6f1800b260 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 shutdown_connections 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f0c0b65f0 0x7f6f0c0b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f20110180 0x7f6f201a1f20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f20102f20 0x7f6f2019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 --2- 172.21.15.38:0/1470551622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f201025d0 0x7f6f2019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 >> 172.21.15.38:0/1470551622 conn(0x7f6f20079730 msgr2=0x7f6f20109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 shutdown_connections 2024-09-21T06:18:40.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:40.091+0000 7f6f27d2b640 1 -- 172.21.15.38:0/1470551622 wait complete. 2024-09-21T06:18:40.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:40 smithi038 ceph-mon[31215]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:40.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:40 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3975441177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:18:40.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:40 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1389342598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:18:40.685 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:40 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1470551622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:18:40.714 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743447 got 296352743448 for osd.11 2024-09-21T06:18:40.715 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:40.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:40 smithi174 ceph-mon[34815]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:40.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:40 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3975441177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:18:40.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:40 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1389342598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:18:40.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:40 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1470551622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:18:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:40 smithi044 ceph-mon[34369]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:40 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3975441177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:18:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:40 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1389342598' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:18:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:40 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1470551622' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:18:41.270 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 -- 172.21.15.38:0/1341136040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 msgr2=0x7f949410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 --2- 172.21.15.38:0/1341136040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949410f550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f948c009ca0 tx=0x7f948c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 -- 172.21.15.38:0/1341136040 shutdown_connections 2024-09-21T06:18:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 --2- 172.21.15.38:0/1341136040 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949410f550 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 --2- 172.21.15.38:0/1341136040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94941083d0 0x7f94941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 --2- 172.21.15.38:0/1341136040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9494102ae0 0x7f9494102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 -- 172.21.15.38:0/1341136040 >> 172.21.15.38:0/1341136040 conn(0x7f9494079760 msgr2=0x7f9494079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 -- 172.21.15.38:0/1341136040 shutdown_connections 2024-09-21T06:18:41.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.274+0000 7f949a92d640 1 -- 172.21.15.38:0/1341136040 wait complete. 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.275+0000 7f949a92d640 1 Processor -- start 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 -- start start 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9494102ae0 0x7f949419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 0x7f949419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112ad0 con 0x7f9494108d20 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112950 con 0x7f9494102ae0 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f949a92d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9494112c50 con 0x7f94941083d0 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f9498eca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f9498eca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42340/0 (socket says 172.21.15.38:42340) 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f9493fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9494102ae0 0x7f949419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.276+0000 7f9498eca640 1 -- 172.21.15.38:0/644057039 learned_addr learned my addr 172.21.15.38:0/644057039 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f94937fe640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 0x7f949419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 -- 172.21.15.38:0/644057039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 msgr2=0x7f949419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 0x7f949419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 -- 172.21.15.38:0/644057039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9494102ae0 msgr2=0x7f949419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9494102ae0 0x7f949419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 -- 172.21.15.38:0/644057039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94941a6550 con 0x7f9494108d20 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f94937fe640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 0x7f949419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f9498eca640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f948c003f10 tx=0x7f948c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c031650 con 0x7f9494108d20 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94941a67e0 con 0x7f9494108d20 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f948c0317f0 con 0x7f9494108d20 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c02fa10 con 0x7f9494108d20 2024-09-21T06:18:41.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.277+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941a6d70 con 0x7f9494108d20 2024-09-21T06:18:41.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.279+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9494102ef0 con 0x7f9494108d20 2024-09-21T06:18:41.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.281+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f948c02fbb0 con 0x7f9494108d20 2024-09-21T06:18:41.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.282+0000 7f94917fa640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 0x7f947c0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.282+0000 7f9493fff640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 0x7f947c0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.282+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f948c108970 con 0x7f9494108d20 2024-09-21T06:18:41.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.283+0000 7f9493fff640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 0x7f947c0b8b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f949406c640 tx=0x7f9484005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.284+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f948c0cf000 con 0x7f9494108d20 2024-09-21T06:18:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 -- 172.21.15.38:0/704370707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4102ae0 msgr2=0x7fa9f4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 --2- 172.21.15.38:0/704370707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4102ae0 0x7fa9f4102ef0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009900 tx=0x7fa9e802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 -- 172.21.15.38:0/704370707 shutdown_connections 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 --2- 172.21.15.38:0/704370707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4108d20 0x7fa9f410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 --2- 172.21.15.38:0/704370707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 0x7fa9f41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 --2- 172.21.15.38:0/704370707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4102ae0 0x7fa9f4102ef0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 -- 172.21.15.38:0/704370707 >> 172.21.15.38:0/704370707 conn(0x7fa9f40797b0 msgr2=0x7fa9f4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 -- 172.21.15.38:0/704370707 shutdown_connections 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.471+0000 7fa9fae57640 1 -- 172.21.15.38:0/704370707 wait complete. 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 Processor -- start 2024-09-21T06:18:41.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 -- start start 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 0x7fa9f419b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4112b60 con 0x7fa9f4108d20 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f41129e0 con 0x7fa9f4102ae0 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9fae57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4112ce0 con 0x7fa9f41083d0 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f93f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f8bf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f93f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42362/0 (socket says 172.21.15.38:42362) 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f93f4640 1 -- 172.21.15.38:0/1624512107 learned_addr learned my addr 172.21.15.38:0/1624512107 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f8bf3640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:43978/0 (socket says 172.21.15.38:43978) 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.472+0000 7fa9f3fff640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 0x7fa9f419b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 -- 172.21.15.38:0/1624512107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 msgr2=0x7fa9f419b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 0x7fa9f419b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 -- 172.21.15.38:0/1624512107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 msgr2=0x7fa9f419b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 -- 172.21.15.38:0/1624512107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f41a6680 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f8bf3640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f93f4640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00eaa0 tx=0x7fa9ec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec004d20 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9ec005020 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f41a6970 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec0116d0 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.473+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f41a6ee0 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.474+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f4102ef0 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.476+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa9ec0051d0 con 0x7fa9f4108d20 2024-09-21T06:18:41.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.477+0000 7fa9f1ffb640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 0x7fa9e40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.477+0000 7fa9f8bf3640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 0x7fa9e40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.477+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa9ec0e7730 con 0x7fa9f4108d20 2024-09-21T06:18:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.477+0000 7fa9f8bf3640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 0x7fa9e40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9f406c380 tx=0x7fa9e80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:41.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.481+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9ec016030 con 0x7fa9f4108d20 2024-09-21T06:18:41.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.492+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f949406bef0 con 0x7f9494108d20 2024-09-21T06:18:41.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.493+0000 7f94917fa640 1 -- 172.21.15.38:0/644057039 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f949406bef0 con 0x7f9494108d20 2024-09-21T06:18:41.495 INFO:teuthology.orchestra.run.smithi038.stdout:60129542218 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 msgr2=0x7f947c0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 0x7f947c0b8b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f949406c640 tx=0x7f9484005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 msgr2=0x7f949419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f948c003f10 tx=0x7f948c003f40 comp rx=0 tx=0).stop 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 shutdown_connections 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f947c0b6660 0x7f947c0b8b70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9494108d20 0x7f949419bd40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94941083d0 0x7f949419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 --2- 172.21.15.38:0/644057039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9494102ae0 0x7f949419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 >> 172.21.15.38:0/644057039 conn(0x7f9494079760 msgr2=0x7f9494104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 shutdown_connections 2024-09-21T06:18:41.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.495+0000 7f949a92d640 1 -- 172.21.15.38:0/644057039 wait complete. 2024-09-21T06:18:41.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.675+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa9f402e640 con 0x7fa9f4108d20 2024-09-21T06:18:41.677 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/644057039' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:18:41.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.676+0000 7fa9f1ffb640 1 -- 172.21.15.38:0/1624512107 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9ec0addc0 con 0x7fa9f4108d20 2024-09-21T06:18:41.678 INFO:teuthology.orchestra.run.smithi038.stdout:81604378694 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 msgr2=0x7fa9e40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 0x7fa9e40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9f406c380 tx=0x7fa9e80058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 msgr2=0x7fa9f419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00eaa0 tx=0x7fa9ec00eea0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 shutdown_connections 2024-09-21T06:18:41.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9e40b6620 0x7fa9e40b8b30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4108d20 0x7fa9f419be70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9f41083d0 0x7fa9f419b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 --2- 172.21.15.38:0/1624512107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9f4102ae0 0x7fa9f419b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.678+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 >> 172.21.15.38:0/1624512107 conn(0x7fa9f40797b0 msgr2=0x7fa9f4106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.679+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 shutdown_connections 2024-09-21T06:18:41.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:41.679+0000 7fa9fae57640 1 -- 172.21.15.38:0/1624512107 wait complete. 2024-09-21T06:18:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:41 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/644057039' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:18:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:41 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/644057039' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:18:41.938 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626480 for osd.6 2024-09-21T06:18:41.938 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:42.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:42 smithi038 ceph-mon[31215]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:18:42.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:42 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1624512107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:18:42.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:42 smithi174 ceph-mon[34815]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:18:42.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:42 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1624512107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:18:42.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:42 smithi044 ceph-mon[34369]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:18:42.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:42 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1624512107' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:18:43.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/1446263820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d78103b60 msgr2=0x7f8d78103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/1446263820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d78103b60 0x7f8d78103f70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009900 tx=0x7f8d6802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/1446263820 shutdown_connections 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/1446263820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78109df0 0x7f8d78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/1446263820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d781094a0 0x7f8d781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/1446263820 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d78103b60 0x7f8d78103f70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/1446263820 >> 172.21.15.38:0/1446263820 conn(0x7f8d7807b850 msgr2=0x7f8d7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/1446263820 shutdown_connections 2024-09-21T06:18:43.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/1446263820 wait complete. 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.053+0000 7f8d7e0ee640 1 Processor -- start 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 -- start start 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78103b60 0x7f8d78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 0x7f8d78076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78113c10 con 0x7f8d781094a0 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78113a90 con 0x7f8d78109df0 2024-09-21T06:18:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d7e0ee640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78113d90 con 0x7f8d78103b60 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42380/0 (socket says 172.21.15.38:42380) 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d76ffd640 1 -- 172.21.15.38:0/336054578 learned_addr learned my addr 172.21.15.38:0/336054578 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d777fe640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78103b60 0x7f8d78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.054+0000 7f8d77fff640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 0x7f8d78076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 -- 172.21.15.38:0/336054578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78103b60 msgr2=0x7f8d78075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78103b60 0x7f8d78075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 -- 172.21.15.38:0/336054578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 msgr2=0x7f8d78076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 0x7f8d78076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 -- 172.21.15.38:0/336054578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d781a88e0 con 0x7f8d781094a0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d77fff640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 0x7f8d78076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d76ffd640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c970 tx=0x7f8d6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c004220 con 0x7f8d781094a0 2024-09-21T06:18:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d6c0043c0 con 0x7f8d781094a0 2024-09-21T06:18:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d781a8bd0 con 0x7f8d781094a0 2024-09-21T06:18:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c004a00 con 0x7f8d781094a0 2024-09-21T06:18:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.055+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d781a90c0 con 0x7f8d781094a0 2024-09-21T06:18:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.056+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d78103f70 con 0x7f8d781094a0 2024-09-21T06:18:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.058+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8d6c0050b0 con 0x7f8d781094a0 2024-09-21T06:18:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.058+0000 7f8d74ff9640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 0x7f8d600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.058+0000 7f8d777fe640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 0x7f8d600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.059+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8d6c0e72d0 con 0x7f8d781094a0 2024-09-21T06:18:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.059+0000 7f8d777fe640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 0x7f8d600b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d78077160 tx=0x7f8d680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.063+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d6c014030 con 0x7f8d781094a0 2024-09-21T06:18:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.259+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8d7802e640 con 0x7f8d781094a0 2024-09-21T06:18:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.259+0000 7f8d74ff9640 1 -- 172.21.15.38:0/336054578 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8d6c0ad960 con 0x7f8d781094a0 2024-09-21T06:18:43.261 INFO:teuthology.orchestra.run.smithi038.stdout:133143986234 2024-09-21T06:18:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.261+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 msgr2=0x7f8d600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.261+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 0x7f8d600b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d78077160 tx=0x7f8d680058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 msgr2=0x7f8d78075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c970 tx=0x7f8d6c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 shutdown_connections 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d600b65f0 0x7f8d600b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d78109df0 0x7f8d78076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d781094a0 0x7f8d78075c50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 --2- 172.21.15.38:0/336054578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d78103b60 0x7f8d78075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 >> 172.21.15.38:0/336054578 conn(0x7f8d7807b850 msgr2=0x7f8d781074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 shutdown_connections 2024-09-21T06:18:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:43.262+0000 7f8d7e0ee640 1 -- 172.21.15.38:0/336054578 wait complete. 2024-09-21T06:18:43.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:43 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/336054578' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:18:43.758 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822709 for osd.5 2024-09-21T06:18:43.758 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:43.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:43 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/336054578' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:18:43.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:43 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/336054578' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:18:44.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542215 got 60129542218 for osd.1 2024-09-21T06:18:44.114 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:44.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:44 smithi174 ceph-mon[34815]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-21T06:18:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:44 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:44 smithi044 ceph-mon[34369]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-21T06:18:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:44 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:44.724 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:44 smithi038 ceph-mon[31215]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-21T06:18:44.725 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:44 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:18:44.757 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986232 got 133143986234 for osd.4 2024-09-21T06:18:44.757 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/2584717149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a0109e20 msgr2=0x7fa1a0110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/2584717149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a0109e20 0x7fa1a0110650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa198009ca0 tx=0x7fa19802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/2584717149 shutdown_connections 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/2584717149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a0109e20 0x7fa1a0110650 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/2584717149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a01094d0 0x7fa1a01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/2584717149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/2584717149 >> 172.21.15.38:0/2584717149 conn(0x7fa1a00ff600 msgr2=0x7fa1a0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/2584717149 shutdown_connections 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.990+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/2584717149 wait complete. 2024-09-21T06:18:44.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.991+0000 7fa1a4ecb640 1 Processor -- start 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.991+0000 7fa1a4ecb640 1 -- start start 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a0109e20 0x7fa1a0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113c20 con 0x7fa1a01094d0 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113aa0 con 0x7fa1a0109e20 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1a4ecb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113da0 con 0x7fa1a0103b90 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42406/0 (socket says 172.21.15.38:42406) 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 -- 172.21.15.38:0/4002770909 learned_addr learned my addr 172.21.15.38:0/4002770909 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa19e59c640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa19ed9d640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a0109e20 0x7fa1a0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 -- 172.21.15.38:0/4002770909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 msgr2=0x7fa1a0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 -- 172.21.15.38:0/4002770909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a0109e20 msgr2=0x7fa1a0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a0109e20 0x7fa1a0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 -- 172.21.15.38:0/4002770909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a01a87f0 con 0x7fa1a01094d0 2024-09-21T06:18:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa19e59c640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa197fff640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e970 tx=0x7fa18800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.992+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800cd80 con 0x7fa1a01094d0 2024-09-21T06:18:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.993+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a01a8ae0 con 0x7fa1a01094d0 2024-09-21T06:18:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.993+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1880035f0 con 0x7fa1a01094d0 2024-09-21T06:18:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.993+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188010690 con 0x7fa1a01094d0 2024-09-21T06:18:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.993+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a01a9070 con 0x7fa1a01094d0 2024-09-21T06:18:44.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.994+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a0103fa0 con 0x7fa1a01094d0 2024-09-21T06:18:44.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.996+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fa1880037a0 con 0x7fa1a01094d0 2024-09-21T06:18:44.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.997+0000 7fa1977fe640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 0x7fa18c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:44.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.997+0000 7fa19e59c640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 0x7fa18c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:44.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.997+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa1880e7a80 con 0x7fa1a01094d0 2024-09-21T06:18:44.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:44.998+0000 7fa19e59c640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 0x7fa18c0b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0077160 tx=0x7fa190005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:45.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.000+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa188056710 con 0x7fa1a01094d0 2024-09-21T06:18:45.013 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:45.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.201+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa1a0076a10 con 0x7fa1a01094d0 2024-09-21T06:18:45.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.201+0000 7fa1977fe640 1 -- 172.21.15.38:0/4002770909 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1a0076a10 con 0x7fa1a01094d0 2024-09-21T06:18:45.203 INFO:teuthology.orchestra.run.smithi038.stdout:38654705744 2024-09-21T06:18:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.203+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 msgr2=0x7fa18c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.203+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 0x7fa18c0b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0077160 tx=0x7fa190005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.203+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 msgr2=0x7fa1a0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:45.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.203+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa18800e970 tx=0x7fa18800ee30 comp rx=0 tx=0).stop 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 shutdown_connections 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa18c0b65f0 0x7fa18c0b8b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1a0109e20 0x7fa1a0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1a01094d0 0x7fa1a0075c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 --2- 172.21.15.38:0/4002770909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa1a0103b90 0x7fa1a0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 >> 172.21.15.38:0/4002770909 conn(0x7fa1a00ff600 msgr2=0x7fa1a0106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 shutdown_connections 2024-09-21T06:18:45.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.204+0000 7fa1a4ecb640 1 -- 172.21.15.38:0/4002770909 wait complete. 2024-09-21T06:18:45.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378691 got 81604378694 for osd.2 2024-09-21T06:18:45.410 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 -- 172.21.15.38:0/2318043066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 msgr2=0x7fe66c110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 --2- 172.21.15.38:0/2318043066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c110450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe664009ca0 tx=0x7fe66402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 -- 172.21.15.38:0/2318043066 shutdown_connections 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 --2- 172.21.15.38:0/2318043066 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c110450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 --2- 172.21.15.38:0/2318043066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c1092d0 0x7fe66c1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 --2- 172.21.15.38:0/2318043066 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c103990 0x7fe66c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 -- 172.21.15.38:0/2318043066 >> 172.21.15.38:0/2318043066 conn(0x7fe66c0ff3e0 msgr2=0x7fe66c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:46.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 -- 172.21.15.38:0/2318043066 shutdown_connections 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.917+0000 7fe670f9f640 1 -- 172.21.15.38:0/2318043066 wait complete. 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.918+0000 7fe670f9f640 1 Processor -- start 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 -- start start 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c103990 0x7fe66c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c1092d0 0x7fe66c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c113a20 con 0x7fe66c109c20 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1138a0 con 0x7fe66c103990 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe670f9f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c113ba0 con 0x7fe66c1092d0 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42420/0 (socket says 172.21.15.38:42420) 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 -- 172.21.15.38:0/409824607 learned_addr learned my addr 172.21.15.38:0/409824607 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:46.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66b7fe640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c103990 0x7fe66c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stdout:274877906974 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66affd640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c1092d0 0x7fe66c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 -- 172.21.15.38:0/409824607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c1092d0 msgr2=0x7fe66c19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c1092d0 0x7fe66c19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 -- 172.21.15.38:0/409824607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c103990 msgr2=0x7fe66c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:46.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c103990 0x7fe66c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.919+0000 7fe66bfff640 1 -- 172.21.15.38:0/409824607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c1a02e0 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe66bfff640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe664005e30 tx=0x7fe664003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664031650 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe6640317f0 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1a0570 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402fac0 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.920+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1a6d30 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.921+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c103da0 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.923+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe66402fc60 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.924+0000 7fe668ff9640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 0x7fe6540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.924+0000 7fe66b7fe640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 0x7fe6540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.924+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe6641089a0 con 0x7fe66c109c20 2024-09-21T06:18:46.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.924+0000 7fe66b7fe640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 0x7fe6540b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009bd0 tx=0x7fe65c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:45.927+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6640cefd0 con 0x7fe66c109c20 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.120+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe66c19b4a0 con 0x7fe66c109c20 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.120+0000 7fe668ff9640 1 -- 172.21.15.38:0/409824607 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe66c19b4a0 con 0x7fe66c109c20 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 msgr2=0x7fe6540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 0x7fe6540b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009bd0 tx=0x7fe65c005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 msgr2=0x7fe66c19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe664005e30 tx=0x7fe664003d80 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 shutdown_connections 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe6540b65f0 0x7fe6540b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c109c20 0x7fe66c19fbb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe66c1092d0 0x7fe66c19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 --2- 172.21.15.38:0/409824607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe66c103990 0x7fe66c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:46.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 >> 172.21.15.38:0/409824607 conn(0x7fe66c0ff3e0 msgr2=0x7fe66c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:46.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 shutdown_connections 2024-09-21T06:18:46.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:46.123+0000 7fe670f9f640 1 -- 172.21.15.38:0/409824607 wait complete. 2024-09-21T06:18:46.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:46 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4002770909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:18:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:46 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4002770909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:18:46.414 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.414 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.414 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.414 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:46 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:46.414 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4002770909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:18:46.747 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906972 got 274877906974 for osd.10 2024-09-21T06:18:46.747 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:46.777 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:47.244 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705742 got 38654705744 for osd.0 2024-09-21T06:18:47.245 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:47.329 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:47 smithi038 ceph-mon[31215]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:18:47.330 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:47 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/409824607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:18:47.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:47 smithi174 ceph-mon[34815]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:18:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:47 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/409824607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:18:47.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:47 smithi044 ceph-mon[34369]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:18:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:47 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/409824607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 -- 172.21.15.38:0/3521494884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4104860 msgr2=0x7fbaa4104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 --2- 172.21.15.38:0/3521494884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4104860 0x7fbaa4104c70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fba94009ca0 tx=0x7fba9402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 -- 172.21.15.38:0/3521494884 shutdown_connections 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 --2- 172.21.15.38:0/3521494884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa410de10 0x7fbaa41102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 --2- 172.21.15.38:0/3521494884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa4105290 0x7fbaa410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 --2- 172.21.15.38:0/3521494884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4104860 0x7fbaa4104c70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 -- 172.21.15.38:0/3521494884 >> 172.21.15.38:0/3521494884 conn(0x7fbaa4079730 msgr2=0x7fbaa4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 -- 172.21.15.38:0/3521494884 shutdown_connections 2024-09-21T06:18:47.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.432+0000 7fbaa904f640 1 -- 172.21.15.38:0/3521494884 wait complete. 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.433+0000 7fbaa904f640 1 Processor -- start 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.433+0000 7fbaa904f640 1 -- start start 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.433+0000 7fbaa904f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa4104860 0x7fbaa419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.433+0000 7fbaa904f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa904f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa410de10 0x7fbaa419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa904f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4113bc0 con 0x7fbaa4105290 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa904f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4113a40 con 0x7fbaa410de10 2024-09-21T06:18:47.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa904f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4113d40 con 0x7fbaa4104860 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42444/0 (socket says 172.21.15.38:42444) 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 -- 172.21.15.38:0/737222565 learned_addr learned my addr 172.21.15.38:0/737222565 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa2d9d640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa4104860 0x7fbaa419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa359e640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa410de10 0x7fbaa419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 -- 172.21.15.38:0/737222565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa4104860 msgr2=0x7fbaa419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa4104860 0x7fbaa419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 -- 172.21.15.38:0/737222565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa410de10 msgr2=0x7fbaa419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa410de10 0x7fbaa419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 -- 172.21.15.38:0/737222565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41a04c0 con 0x7fbaa4105290 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.434+0000 7fbaa259c640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d950 tx=0x7fba9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.435+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98017070 con 0x7fbaa4105290 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.435+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa41a07b0 con 0x7fbaa4105290 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.435+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba98009c30 con 0x7fbaa4105290 2024-09-21T06:18:47.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.435+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba980047a0 con 0x7fbaa4105290 2024-09-21T06:18:47.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.435+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa41a6f10 con 0x7fbaa4105290 2024-09-21T06:18:47.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.436+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4104c70 con 0x7fbaa4105290 2024-09-21T06:18:47.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.439+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fba98004020 con 0x7fbaa4105290 2024-09-21T06:18:47.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.439+0000 7fba8bfff640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 0x7fba8c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:47.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.439+0000 7fbaa2d9d640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 0x7fba8c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:47.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.440+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fba980e7660 con 0x7fbaa4105290 2024-09-21T06:18:47.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.440+0000 7fbaa2d9d640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 0x7fba8c0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba94005e30 tx=0x7fba94009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:47.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.443+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba98020020 con 0x7fbaa4105290 2024-09-21T06:18:47.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.635+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbaa41a7170 con 0x7fbaa4105290 2024-09-21T06:18:47.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.635+0000 7fba8bfff640 1 -- 172.21.15.38:0/737222565 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fba980adc90 con 0x7fbaa4105290 2024-09-21T06:18:47.637 INFO:teuthology.orchestra.run.smithi038.stdout:253403070499 2024-09-21T06:18:47.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 msgr2=0x7fba8c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 0x7fba8c0b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba94005e30 tx=0x7fba94009360 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 msgr2=0x7fbaa419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d950 tx=0x7fba9800de10 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 shutdown_connections 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba8c0b65f0 0x7fba8c0b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaa410de10 0x7fbaa419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaa4105290 0x7fbaa419aaf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 --2- 172.21.15.38:0/737222565 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaa4104860 0x7fbaa419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 >> 172.21.15.38:0/737222565 conn(0x7fbaa4079730 msgr2=0x7fbaa4107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 shutdown_connections 2024-09-21T06:18:47.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:47.638+0000 7fbaa904f640 1 -- 172.21.15.38:0/737222565 wait complete. 2024-09-21T06:18:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 -- 172.21.15.38:0/1812486181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c1049e0 msgr2=0x7efd9c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 --2- 172.21.15.38:0/1812486181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c1049e0 0x7efd9c104df0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009900 tx=0x7efd8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:18:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 -- 172.21.15.38:0/1812486181 shutdown_connections 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 --2- 172.21.15.38:0/1812486181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 0x7efd9c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 --2- 172.21.15.38:0/1812486181 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c105330 0x7efd9c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 --2- 172.21.15.38:0/1812486181 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c1049e0 0x7efd9c104df0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 -- 172.21.15.38:0/1812486181 >> 172.21.15.38:0/1812486181 conn(0x7efd9c079750 msgr2=0x7efd9c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 -- 172.21.15.38:0/1812486181 shutdown_connections 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.296+0000 7efda0ffd640 1 -- 172.21.15.38:0/1812486181 wait complete. 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 Processor -- start 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 -- start start 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c1049e0 0x7efd9c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 0x7efd9c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c113c90 con 0x7efd9c105330 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c113b10 con 0x7efd9c10de40 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efda0ffd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c113e10 con 0x7efd9c1049e0 2024-09-21T06:18:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efd99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efd99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42462/0 (socket says 172.21.15.38:42462) 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.297+0000 7efd99d9b640 1 -- 172.21.15.38:0/3176800611 learned_addr learned my addr 172.21.15.38:0/3176800611 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd9ad9d640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 0x7efd9c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd9a59c640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c1049e0 0x7efd9c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 -- 172.21.15.38:0/3176800611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c1049e0 msgr2=0x7efd9c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c1049e0 0x7efd9c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 -- 172.21.15.38:0/3176800611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 msgr2=0x7efd9c19fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 0x7efd9c19fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 -- 172.21.15.38:0/3176800611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1a0590 con 0x7efd9c105330 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd99d9b640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd90006fd0 tx=0x7efd9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90011830 con 0x7efd9c105330 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd90016070 con 0x7efd9c105330 2024-09-21T06:18:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c1a0880 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9000f2e0 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.298+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1a6fe0 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.299+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c06c280 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.301+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7efd900119d0 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.302+0000 7efd8b7fe640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 0x7efd840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.302+0000 7efd9a59c640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 0x7efd840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.302+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efd900e7200 con 0x7efd9c105330 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.302+0000 7efd9a59c640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 0x7efd840b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.305+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd900ad890 con 0x7efd9c105330 2024-09-21T06:18:48.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:48 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/737222565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:18:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:48 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/737222565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:18:48.430 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:48 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/737222565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:18:48.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.495+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7efd9c104df0 con 0x7efd9c105330 2024-09-21T06:18:48.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.495+0000 7efd8b7fe640 1 -- 172.21.15.38:0/3176800611 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efd900b1c70 con 0x7efd9c105330 2024-09-21T06:18:48.497 INFO:teuthology.orchestra.run.smithi038.stdout:227633266728 2024-09-21T06:18:48.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.497+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 msgr2=0x7efd840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.497+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 0x7efd840b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006010 tx=0x7efd8c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 msgr2=0x7efd9c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd90006fd0 tx=0x7efd9000b8e0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 shutdown_connections 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd840b65f0 0x7efd840b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c10de40 0x7efd9c19fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd9c105330 0x7efd9c19abc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 --2- 172.21.15.38:0/3176800611 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd9c1049e0 0x7efd9c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 >> 172.21.15.38:0/3176800611 conn(0x7efd9c079750 msgr2=0x7efd9c1078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 shutdown_connections 2024-09-21T06:18:48.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.498+0000 7efda0ffd640 1 -- 172.21.15.38:0/3176800611 wait complete. 2024-09-21T06:18:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1489695513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 msgr2=0x7f5eb01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1489695513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb01098c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009900 tx=0x7f5ea002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1489695513 shutdown_connections 2024-09-21T06:18:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1489695513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 0x7f5eb0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1489695513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb01098c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1489695513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0103bc0 0x7f5eb0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.527+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1489695513 >> 172.21.15.38:0/1489695513 conn(0x7f5eb007b910 msgr2=0x7f5eb007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.528+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1489695513 shutdown_connections 2024-09-21T06:18:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.528+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1489695513 wait complete. 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.528+0000 7f5eb7ca6640 1 Processor -- start 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 -- start start 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0103bc0 0x7f5eb019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 0x7f5eb019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0113c30 con 0x7f5eb01094b0 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0113ab0 con 0x7f5eb0109e00 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb7ca6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0113db0 con 0x7f5eb0103bc0 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb5241640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb5241640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42480/0 (socket says 172.21.15.38:42480) 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb5241640 1 -- 172.21.15.38:0/1634668353 learned_addr learned my addr 172.21.15.38:0/1634668353 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.529+0000 7f5eb6243640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 0x7f5eb019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 -- 172.21.15.38:0/1634668353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0103bc0 msgr2=0x7f5eb019a5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0103bc0 0x7f5eb019a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 -- 172.21.15.38:0/1634668353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 msgr2=0x7f5eb019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 0x7f5eb019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 -- 172.21.15.38:0/1634668353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb01a0550 con 0x7f5eb01094b0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb5241640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0004770 tx=0x7f5ea0003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea003f070 con 0x7f5eb01094b0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb01a07e0 con 0x7f5eb01094b0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ea0031be0 con 0x7f5eb01094b0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0035030 con 0x7f5eb01094b0 2024-09-21T06:18:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.530+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb01a6fa0 con 0x7f5eb01094b0 2024-09-21T06:18:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.531+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb0103fd0 con 0x7f5eb01094b0 2024-09-21T06:18:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.534+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5ea0042070 con 0x7f5eb01094b0 2024-09-21T06:18:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.535+0000 7f5ea6ffd640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 0x7f5e9c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.535+0000 7f5eb5a42640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 0x7f5e9c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.535+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5ea0108280 con 0x7f5eb01094b0 2024-09-21T06:18:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.536+0000 7f5eb5a42640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 0x7f5e9c0b8c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009a60 tx=0x7f5eac005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:48.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.539+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ea0049030 con 0x7f5eb01094b0 2024-09-21T06:18:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.729+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5eb010bbd0 con 0x7f5eb01094b0 2024-09-21T06:18:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.730+0000 7f5ea6ffd640 1 -- 172.21.15.38:0/1634668353 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5ea00ce930 con 0x7f5eb01094b0 2024-09-21T06:18:48.731 INFO:teuthology.orchestra.run.smithi038.stdout:201863462957 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 msgr2=0x7f5e9c0b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 0x7f5e9c0b8c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009a60 tx=0x7f5eac005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 msgr2=0x7f5eb019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0004770 tx=0x7f5ea0003bb0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 shutdown_connections 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5e9c0b6740 0x7f5e9c0b8c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5eb0109e00 0x7f5eb019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5eb01094b0 0x7f5eb019ab80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 --2- 172.21.15.38:0/1634668353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb0103bc0 0x7f5eb019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:48.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 >> 172.21.15.38:0/1634668353 conn(0x7f5eb007b910 msgr2=0x7f5eb0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 shutdown_connections 2024-09-21T06:18:48.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:48.732+0000 7f5eb7ca6640 1 -- 172.21.15.38:0/1634668353 wait complete. 2024-09-21T06:18:49.121 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266725 got 227633266728 for osd.8 2024-09-21T06:18:49.121 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:49.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:49 smithi174 ceph-mon[34815]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:18:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:49 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3176800611' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:18:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:49 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1634668353' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:18:49.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:49 smithi044 ceph-mon[34369]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:18:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:49 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3176800611' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:18:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:49 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1634668353' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:18:49.446 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:49 smithi038 ceph-mon[31215]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:18:49.446 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:49 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3176800611' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:18:49.446 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:49 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1634668353' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:18:49.473 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070495 got 253403070499 for osd.9 2024-09-21T06:18:49.474 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:50.137 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462957 for osd.7 2024-09-21T06:18:50.137 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:50.137 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:18:50.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:18:50.853 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:51.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:51 smithi038 ceph-mon[31215]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 -- 172.21.15.38:0/3718401427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006fa20 msgr2=0x7fd24011ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 --2- 172.21.15.38:0/3718401427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006fa20 0x7fd24011ca40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd230009900 tx=0x7fd23002a410 comp rx=0 tx=0).stop 2024-09-21T06:18:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 -- 172.21.15.38:0/3718401427 shutdown_connections 2024-09-21T06:18:51.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 --2- 172.21.15.38:0/3718401427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24011cf80 0x7fd24011f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 --2- 172.21.15.38:0/3718401427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006fa20 0x7fd24011ca40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 --2- 172.21.15.38:0/3718401427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24006f0d0 0x7fd24006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.349+0000 7fd247462640 1 -- 172.21.15.38:0/3718401427 >> 172.21.15.38:0/3718401427 conn(0x7fd24010a3c0 msgr2=0x7fd24010c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.350+0000 7fd247462640 1 -- 172.21.15.38:0/3718401427 shutdown_connections 2024-09-21T06:18:51.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.350+0000 7fd247462640 1 -- 172.21.15.38:0/3718401427 wait complete. 2024-09-21T06:18:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.350+0000 7fd247462640 1 Processor -- start 2024-09-21T06:18:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.350+0000 7fd247462640 1 -- start start 2024-09-21T06:18:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24006fa20 0x7fd2401a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:51.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24011cf80 0x7fd2401aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401229a0 con 0x7fd24006f0d0 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd240122820 con 0x7fd24011cf80 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd247462640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd240122b20 con 0x7fd24006fa20 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35906/0 (socket says 172.21.15.38:35906) 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 -- 172.21.15.38:0/3742533795 learned_addr learned my addr 172.21.15.38:0/3742533795 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2449fd640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24006fa20 0x7fd2401a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2459ff640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24011cf80 0x7fd2401aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 -- 172.21.15.38:0/3742533795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24006fa20 msgr2=0x7fd2401a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24006fa20 0x7fd2401a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 -- 172.21.15.38:0/3742533795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24011cf80 msgr2=0x7fd2401aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24011cf80 0x7fd2401aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 -- 172.21.15.38:0/3742533795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2401af2e0 con 0x7fd24006f0d0 2024-09-21T06:18:51.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.351+0000 7fd2451fe640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d950 tx=0x7fd23c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.352+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c017030 con 0x7fd24006f0d0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.352+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd23c004020 con 0x7fd24006f0d0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.352+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2401af5d0 con 0x7fd24006f0d0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.352+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0047a0 con 0x7fd24006f0d0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.352+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2401b5d30 con 0x7fd24006f0d0 2024-09-21T06:18:51.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.353+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24006f4e0 con 0x7fd24006f0d0 2024-09-21T06:18:51.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.356+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd23c0041d0 con 0x7fd24006f0d0 2024-09-21T06:18:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.356+0000 7fd2367fc640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 0x7fd22c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.357+0000 7fd2449fd640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 0x7fd22c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:51.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.357+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd23c0e75e0 con 0x7fd24006f0d0 2024-09-21T06:18:51.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.357+0000 7fd2449fd640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 0x7fd22c0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd230005940 tx=0x7fd2300058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:51.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.359+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd23c0adc70 con 0x7fd24006f0d0 2024-09-21T06:18:51.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:51 smithi174 ceph-mon[34815]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:51 smithi044 ceph-mon[34369]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:51.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.552+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd240063800 con 0x7fd22c0b65f0 2024-09-21T06:18:51.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.558+0000 7fd2367fc640 1 -- 172.21.15.38:0/3742533795 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7fd240063800 con 0x7fd22c0b65f0 2024-09-21T06:18:51.562 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:51.563 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.561+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 msgr2=0x7fd22c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.561+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 0x7fd22c0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd230005940 tx=0x7fd2300058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.561+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 msgr2=0x7fd2401a9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.561+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d950 tx=0x7fd23c00de10 comp rx=0 tx=0).stop 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.561+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 shutdown_connections 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd22c0b65f0 0x7fd22c0b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd24011cf80 0x7fd2401aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24006fa20 0x7fd2401a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 --2- 172.21.15.38:0/3742533795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd24006f0d0 0x7fd2401a9370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 >> 172.21.15.38:0/3742533795 conn(0x7fd24010a3c0 msgr2=0x7fd24011ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 shutdown_connections 2024-09-21T06:18:51.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:51.562+0000 7fd247462640 1 -- 172.21.15.38:0/3742533795 wait complete. 2024-09-21T06:18:52.191 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-21T06:18:49.672574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660493,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":412,"num_read_kb":308,"num_write":286,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394628,"kb_used_data":12024,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547196,"statfs":{"total":1151940427776,"available":1151536328704,"internally_reserved":0,"allocated":12312576,"data_stored":6965787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003152"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396969+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:18:13.396969+0000","last_peered":"2024-09-21T06:18:13.396969+0000","last_clean":"2024-09-21T06:18:13.396969+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:18:13.396969+0000","last_undegraded":"2024-09-21T06:18:13.396969+0000","last_fullsized":"2024-09-21T06:18:13.396969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497810+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:18:13.497810+0000","last_peered":"2024-09-21T06:18:13.497810+0000","last_clean":"2024-09-21T06:18:13.497810+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:18:13.497810+0000","last_undegraded":"2024-09-21T06:18:13.497810+0000","last_fullsized":"2024-09-21T06:18:13.497810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497510+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:18:13.497510+0000","last_peered":"2024-09-21T06:18:13.497510+0000","last_clean":"2024-09-21T06:18:13.497510+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:18:13.497510+0000","last_undegraded":"2024-09-21T06:18:13.497510+0000","last_fullsized":"2024-09-21T06:18:13.497510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498281+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:18:13.498281+0000","last_peered":"2024-09-21T06:18:13.498281+0000","last_clean":"2024-09-21T06:18:13.498281+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:18:13.498281+0000","last_undegraded":"2024-09-21T06:18:13.498281+0000","last_fullsized":"2024-09-21T06:18:13.498281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399284+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:18:13.399284+0000","last_peered":"2024-09-21T06:18:13.399284+0000","last_clean":"2024-09-21T06:18:13.399284+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:18:13.399284+0000","last_undegraded":"2024-09-21T06:18:13.399284+0000","last_fullsized":"2024-09-21T06:18:13.399284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.404236+0000","last_change":"2024-09-21T06:18:13.404093+0000","last_active":"2024-09-21T06:18:13.404236+0000","last_peered":"2024-09-21T06:18:13.404236+0000","last_clean":"2024-09-21T06:18:13.404236+0000","last_became_active":"2024-09-21T06:18:13.403608+0000","last_became_peered":"2024-09-21T06:18:13.403608+0000","last_unstale":"2024-09-21T06:18:13.404236+0000","last_undegraded":"2024-09-21T06:18:13.404236+0000","last_fullsized":"2024-09-21T06:18:13.404236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:54.362457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498299+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:18:13.498299+0000","last_peered":"2024-09-21T06:18:13.498299+0000","last_clean":"2024-09-21T06:18:13.498299+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:18:13.498299+0000","last_undegraded":"2024-09-21T06:18:13.498299+0000","last_fullsized":"2024-09-21T06:18:13.498299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398723+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:18:13.398723+0000","last_peered":"2024-09-21T06:18:13.398723+0000","last_clean":"2024-09-21T06:18:13.398723+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:18:13.398723+0000","last_undegraded":"2024-09-21T06:18:13.398723+0000","last_fullsized":"2024-09-21T06:18:13.398723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402933+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:18:13.402933+0000","last_peered":"2024-09-21T06:18:13.402933+0000","last_clean":"2024-09-21T06:18:13.402933+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:18:13.402933+0000","last_undegraded":"2024-09-21T06:18:13.402933+0000","last_fullsized":"2024-09-21T06:18:13.402933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400891+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:18:13.400891+0000","last_peered":"2024-09-21T06:18:13.400891+0000","last_clean":"2024-09-21T06:18:13.400891+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:18:13.400891+0000","last_undegraded":"2024-09-21T06:18:13.400891+0000","last_fullsized":"2024-09-21T06:18:13.400891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498776+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:18:13.498776+0000","last_peered":"2024-09-21T06:18:13.498776+0000","last_clean":"2024-09-21T06:18:13.498776+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:18:13.498776+0000","last_undegraded":"2024-09-21T06:18:13.498776+0000","last_fullsized":"2024-09-21T06:18:13.498776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.405365+0000","last_change":"2024-09-21T06:18:13.404172+0000","last_active":"2024-09-21T06:18:13.405365+0000","last_peered":"2024-09-21T06:18:13.405365+0000","last_clean":"2024-09-21T06:18:13.405365+0000","last_became_active":"2024-09-21T06:18:13.403643+0000","last_became_peered":"2024-09-21T06:18:13.403643+0000","last_unstale":"2024-09-21T06:18:13.405365+0000","last_undegraded":"2024-09-21T06:18:13.405365+0000","last_fullsized":"2024-09-21T06:18:13.405365+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:12.264818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398064+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:18:13.398064+0000","last_peered":"2024-09-21T06:18:13.398064+0000","last_clean":"2024-09-21T06:18:13.398064+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:18:13.398064+0000","last_undegraded":"2024-09-21T06:18:13.398064+0000","last_fullsized":"2024-09-21T06:18:13.398064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497486+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:18:13.497486+0000","last_peered":"2024-09-21T06:18:13.497486+0000","last_clean":"2024-09-21T06:18:13.497486+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:18:13.497486+0000","last_undegraded":"2024-09-21T06:18:13.497486+0000","last_fullsized":"2024-09-21T06:18:13.497486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497476+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:18:13.497476+0000","last_peered":"2024-09-21T06:18:13.497476+0000","last_clean":"2024-09-21T06:18:13.497476+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:18:13.497476+0000","last_undegraded":"2024-09-21T06:18:13.497476+0000","last_fullsized":"2024-09-21T06:18:13.497476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401678+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:18:13.401678+0000","last_peered":"2024-09-21T06:18:13.401678+0000","last_clean":"2024-09-21T06:18:13.401678+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:18:13.401678+0000","last_undegraded":"2024-09-21T06:18:13.401678+0000","last_fullsized":"2024-09-21T06:18:13.401678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396971+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:18:13.396971+0000","last_peered":"2024-09-21T06:18:13.396971+0000","last_clean":"2024-09-21T06:18:13.396971+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:18:13.396971+0000","last_undegraded":"2024-09-21T06:18:13.396971+0000","last_fullsized":"2024-09-21T06:18:13.396971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401146+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:18:13.401146+0000","last_peered":"2024-09-21T06:18:13.401146+0000","last_clean":"2024-09-21T06:18:13.401146+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:18:13.401146+0000","last_undegraded":"2024-09-21T06:18:13.401146+0000","last_fullsized":"2024-09-21T06:18:13.401146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401050+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:18:13.401050+0000","last_peered":"2024-09-21T06:18:13.401050+0000","last_clean":"2024-09-21T06:18:13.401050+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:18:13.401050+0000","last_undegraded":"2024-09-21T06:18:13.401050+0000","last_fullsized":"2024-09-21T06:18:13.401050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396703+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:18:13.396703+0000","last_peered":"2024-09-21T06:18:13.396703+0000","last_clean":"2024-09-21T06:18:13.396703+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:18:13.396703+0000","last_undegraded":"2024-09-21T06:18:13.396703+0000","last_fullsized":"2024-09-21T06:18:13.396703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398178+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:18:13.398178+0000","last_peered":"2024-09-21T06:18:13.398178+0000","last_clean":"2024-09-21T06:18:13.398178+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:18:13.398178+0000","last_undegraded":"2024-09-21T06:18:13.398178+0000","last_fullsized":"2024-09-21T06:18:13.398178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402133+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:18:13.402133+0000","last_peered":"2024-09-21T06:18:13.402133+0000","last_clean":"2024-09-21T06:18:13.402133+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:18:13.402133+0000","last_undegraded":"2024-09-21T06:18:13.402133+0000","last_fullsized":"2024-09-21T06:18:13.402133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398760+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:18:13.398760+0000","last_peered":"2024-09-21T06:18:13.398760+0000","last_clean":"2024-09-21T06:18:13.398760+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:18:13.398760+0000","last_undegraded":"2024-09-21T06:18:13.398760+0000","last_fullsized":"2024-09-21T06:18:13.398760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498022+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:18:13.498022+0000","last_peered":"2024-09-21T06:18:13.498022+0000","last_clean":"2024-09-21T06:18:13.498022+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:18:13.498022+0000","last_undegraded":"2024-09-21T06:18:13.498022+0000","last_fullsized":"2024-09-21T06:18:13.498022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399284+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:18:13.399284+0000","last_peered":"2024-09-21T06:18:13.399284+0000","last_clean":"2024-09-21T06:18:13.399284+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:18:13.399284+0000","last_undegraded":"2024-09-21T06:18:13.399284+0000","last_fullsized":"2024-09-21T06:18:13.399284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401189+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:18:13.401189+0000","last_peered":"2024-09-21T06:18:13.401189+0000","last_clean":"2024-09-21T06:18:13.401189+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:18:13.401189+0000","last_undegraded":"2024-09-21T06:18:13.401189+0000","last_fullsized":"2024-09-21T06:18:13.401189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396790+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:18:13.396790+0000","last_peered":"2024-09-21T06:18:13.396790+0000","last_clean":"2024-09-21T06:18:13.396790+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:18:13.396790+0000","last_undegraded":"2024-09-21T06:18:13.396790+0000","last_fullsized":"2024-09-21T06:18:13.396790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398194+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:18:13.398194+0000","last_peered":"2024-09-21T06:18:13.398194+0000","last_clean":"2024-09-21T06:18:13.398194+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:18:13.398194+0000","last_undegraded":"2024-09-21T06:18:13.398194+0000","last_fullsized":"2024-09-21T06:18:13.398194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497730+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:18:13.497730+0000","last_peered":"2024-09-21T06:18:13.497730+0000","last_clean":"2024-09-21T06:18:13.497730+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:18:13.497730+0000","last_undegraded":"2024-09-21T06:18:13.497730+0000","last_fullsized":"2024-09-21T06:18:13.497730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400410+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:18:13.400410+0000","last_peered":"2024-09-21T06:18:13.400410+0000","last_clean":"2024-09-21T06:18:13.400410+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:18:13.400410+0000","last_undegraded":"2024-09-21T06:18:13.400410+0000","last_fullsized":"2024-09-21T06:18:13.400410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500515+0000","last_change":"2024-09-21T06:18:13.500386+0000","last_active":"2024-09-21T06:18:13.500515+0000","last_peered":"2024-09-21T06:18:13.500515+0000","last_clean":"2024-09-21T06:18:13.500515+0000","last_became_active":"2024-09-21T06:18:13.499861+0000","last_became_peered":"2024-09-21T06:18:13.499861+0000","last_unstale":"2024-09-21T06:18:13.500515+0000","last_undegraded":"2024-09-21T06:18:13.500515+0000","last_fullsized":"2024-09-21T06:18:13.500515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:05.084576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396532+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:18:13.396532+0000","last_peered":"2024-09-21T06:18:13.396532+0000","last_clean":"2024-09-21T06:18:13.396532+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:18:13.396532+0000","last_undegraded":"2024-09-21T06:18:13.396532+0000","last_fullsized":"2024-09-21T06:18:13.396532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399196+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:18:13.399196+0000","last_peered":"2024-09-21T06:18:13.399196+0000","last_clean":"2024-09-21T06:18:13.399196+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:18:13.399196+0000","last_undegraded":"2024-09-21T06:18:13.399196+0000","last_fullsized":"2024-09-21T06:18:13.399196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:45.021917+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:18:45.021917+0000","last_peered":"2024-09-21T06:18:45.021917+0000","last_clean":"2024-09-21T06:18:45.021917+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:18:45.021917+0000","last_undegraded":"2024-09-21T06:18:45.021917+0000","last_fullsized":"2024-09-21T06:18:45.021917+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498470+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:18:13.498470+0000","last_peered":"2024-09-21T06:18:13.498470+0000","last_clean":"2024-09-21T06:18:13.498470+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:18:13.498470+0000","last_undegraded":"2024-09-21T06:18:13.498470+0000","last_fullsized":"2024-09-21T06:18:13.498470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400475+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:18:13.400475+0000","last_peered":"2024-09-21T06:18:13.400475+0000","last_clean":"2024-09-21T06:18:13.400475+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:18:13.400475+0000","last_undegraded":"2024-09-21T06:18:13.400475+0000","last_fullsized":"2024-09-21T06:18:13.400475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397823+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:18:13.397823+0000","last_peered":"2024-09-21T06:18:13.397823+0000","last_clean":"2024-09-21T06:18:13.397823+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:18:13.397823+0000","last_undegraded":"2024-09-21T06:18:13.397823+0000","last_fullsized":"2024-09-21T06:18:13.397823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398796+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:18:13.398796+0000","last_peered":"2024-09-21T06:18:13.398796+0000","last_clean":"2024-09-21T06:18:13.398796+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:18:13.398796+0000","last_undegraded":"2024-09-21T06:18:13.398796+0000","last_fullsized":"2024-09-21T06:18:13.398796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498355+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:18:13.498355+0000","last_peered":"2024-09-21T06:18:13.498355+0000","last_clean":"2024-09-21T06:18:13.498355+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:18:13.498355+0000","last_undegraded":"2024-09-21T06:18:13.498355+0000","last_fullsized":"2024-09-21T06:18:13.498355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400949+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:18:13.400949+0000","last_peered":"2024-09-21T06:18:13.400949+0000","last_clean":"2024-09-21T06:18:13.400949+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:18:13.400949+0000","last_undegraded":"2024-09-21T06:18:13.400949+0000","last_fullsized":"2024-09-21T06:18:13.400949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":76,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:45.021386+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:18:45.021386+0000","last_peered":"2024-09-21T06:18:45.021386+0000","last_clean":"2024-09-21T06:18:45.021386+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:18:45.021386+0000","last_undegraded":"2024-09-21T06:18:45.021386+0000","last_fullsized":"2024-09-21T06:18:45.021386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402469+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:18:13.402469+0000","last_peered":"2024-09-21T06:18:13.402469+0000","last_clean":"2024-09-21T06:18:13.402469+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:18:13.402469+0000","last_undegraded":"2024-09-21T06:18:13.402469+0000","last_fullsized":"2024-09-21T06:18:13.402469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497765+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:18:13.497765+0000","last_peered":"2024-09-21T06:18:13.497765+0000","last_clean":"2024-09-21T06:18:13.497765+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:18:13.497765+0000","last_undegraded":"2024-09-21T06:18:13.497765+0000","last_fullsized":"2024-09-21T06:18:13.497765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498383+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:18:13.498383+0000","last_peered":"2024-09-21T06:18:13.498383+0000","last_clean":"2024-09-21T06:18:13.498383+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:18:13.498383+0000","last_undegraded":"2024-09-21T06:18:13.498383+0000","last_fullsized":"2024-09-21T06:18:13.498383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.405416+0000","last_change":"2024-09-21T06:18:13.405270+0000","last_active":"2024-09-21T06:18:13.405416+0000","last_peered":"2024-09-21T06:18:13.405416+0000","last_clean":"2024-09-21T06:18:13.405416+0000","last_became_active":"2024-09-21T06:18:13.404759+0000","last_became_peered":"2024-09-21T06:18:13.404759+0000","last_unstale":"2024-09-21T06:18:13.405416+0000","last_undegraded":"2024-09-21T06:18:13.405416+0000","last_fullsized":"2024-09-21T06:18:13.405416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.678457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:46.022427+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:18:46.022427+0000","last_peered":"2024-09-21T06:18:46.022427+0000","last_clean":"2024-09-21T06:18:46.022427+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:18:46.022427+0000","last_undegraded":"2024-09-21T06:18:46.022427+0000","last_fullsized":"2024-09-21T06:18:46.022427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":118,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399847+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:18:13.399847+0000","last_peered":"2024-09-21T06:18:13.399847+0000","last_clean":"2024-09-21T06:18:13.399847+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:18:13.399847+0000","last_undegraded":"2024-09-21T06:18:13.399847+0000","last_fullsized":"2024-09-21T06:18:13.399847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400650+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:18:13.400650+0000","last_peered":"2024-09-21T06:18:13.400650+0000","last_clean":"2024-09-21T06:18:13.400650+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:18:13.400650+0000","last_undegraded":"2024-09-21T06:18:13.400650+0000","last_fullsized":"2024-09-21T06:18:13.400650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398065+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:18:13.398065+0000","last_peered":"2024-09-21T06:18:13.398065+0000","last_clean":"2024-09-21T06:18:13.398065+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:18:13.398065+0000","last_undegraded":"2024-09-21T06:18:13.398065+0000","last_fullsized":"2024-09-21T06:18:13.398065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498259+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:18:13.498259+0000","last_peered":"2024-09-21T06:18:13.498259+0000","last_clean":"2024-09-21T06:18:13.498259+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:18:13.498259+0000","last_undegraded":"2024-09-21T06:18:13.498259+0000","last_fullsized":"2024-09-21T06:18:13.498259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499529+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:18:13.499529+0000","last_peered":"2024-09-21T06:18:13.499529+0000","last_clean":"2024-09-21T06:18:13.499529+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:18:13.499529+0000","last_undegraded":"2024-09-21T06:18:13.499529+0000","last_fullsized":"2024-09-21T06:18:13.499529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:46.043286+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:18:46.043286+0000","last_peered":"2024-09-21T06:18:46.043286+0000","last_clean":"2024-09-21T06:18:46.043286+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:18:46.043286+0000","last_undegraded":"2024-09-21T06:18:46.043286+0000","last_fullsized":"2024-09-21T06:18:46.043286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498038+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:18:13.498038+0000","last_peered":"2024-09-21T06:18:13.498038+0000","last_clean":"2024-09-21T06:18:13.498038+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:18:13.498038+0000","last_undegraded":"2024-09-21T06:18:13.498038+0000","last_fullsized":"2024-09-21T06:18:13.498038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399100+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:13.399100+0000","last_peered":"2024-09-21T06:18:13.399100+0000","last_clean":"2024-09-21T06:18:13.399100+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:13.399100+0000","last_undegraded":"2024-09-21T06:18:13.399100+0000","last_fullsized":"2024-09-21T06:18:13.399100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498099+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:18:13.498099+0000","last_peered":"2024-09-21T06:18:13.498099+0000","last_clean":"2024-09-21T06:18:13.498099+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:18:13.498099+0000","last_undegraded":"2024-09-21T06:18:13.498099+0000","last_fullsized":"2024-09-21T06:18:13.498099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399604+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:13.399604+0000","last_peered":"2024-09-21T06:18:13.399604+0000","last_clean":"2024-09-21T06:18:13.399604+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:13.399604+0000","last_undegraded":"2024-09-21T06:18:13.399604+0000","last_fullsized":"2024-09-21T06:18:13.399604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396889+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:18:13.396889+0000","last_peered":"2024-09-21T06:18:13.396889+0000","last_clean":"2024-09-21T06:18:13.396889+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:18:13.396889+0000","last_undegraded":"2024-09-21T06:18:13.396889+0000","last_fullsized":"2024-09-21T06:18:13.396889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397973+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:18:13.397973+0000","last_peered":"2024-09-21T06:18:13.397973+0000","last_clean":"2024-09-21T06:18:13.397973+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:18:13.397973+0000","last_undegraded":"2024-09-21T06:18:13.397973+0000","last_fullsized":"2024-09-21T06:18:13.397973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498575+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:18:13.498575+0000","last_peered":"2024-09-21T06:18:13.498575+0000","last_clean":"2024-09-21T06:18:13.498575+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:18:13.498575+0000","last_undegraded":"2024-09-21T06:18:13.498575+0000","last_fullsized":"2024-09-21T06:18:13.498575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498457+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:18:13.498457+0000","last_peered":"2024-09-21T06:18:13.498457+0000","last_clean":"2024-09-21T06:18:13.498457+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:18:13.498457+0000","last_undegraded":"2024-09-21T06:18:13.498457+0000","last_fullsized":"2024-09-21T06:18:13.498457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499721+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:18:13.499721+0000","last_peered":"2024-09-21T06:18:13.499721+0000","last_clean":"2024-09-21T06:18:13.499721+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:18:13.499721+0000","last_undegraded":"2024-09-21T06:18:13.499721+0000","last_fullsized":"2024-09-21T06:18:13.499721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400818+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:18:13.400818+0000","last_peered":"2024-09-21T06:18:13.400818+0000","last_clean":"2024-09-21T06:18:13.400818+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:18:13.400818+0000","last_undegraded":"2024-09-21T06:18:13.400818+0000","last_fullsized":"2024-09-21T06:18:13.400818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498924+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:18:13.498924+0000","last_peered":"2024-09-21T06:18:13.498924+0000","last_clean":"2024-09-21T06:18:13.498924+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:18:13.498924+0000","last_undegraded":"2024-09-21T06:18:13.498924+0000","last_fullsized":"2024-09-21T06:18:13.498924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498481+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498481+0000","last_peered":"2024-09-21T06:18:13.498481+0000","last_clean":"2024-09-21T06:18:13.498481+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498481+0000","last_undegraded":"2024-09-21T06:18:13.498481+0000","last_fullsized":"2024-09-21T06:18:13.498481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498500+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:18:13.498500+0000","last_peered":"2024-09-21T06:18:13.498500+0000","last_clean":"2024-09-21T06:18:13.498500+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:18:13.498500+0000","last_undegraded":"2024-09-21T06:18:13.498500+0000","last_fullsized":"2024-09-21T06:18:13.498500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399073+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:18:13.399073+0000","last_peered":"2024-09-21T06:18:13.399073+0000","last_clean":"2024-09-21T06:18:13.399073+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:18:13.399073+0000","last_undegraded":"2024-09-21T06:18:13.399073+0000","last_fullsized":"2024-09-21T06:18:13.399073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397812+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:18:13.397812+0000","last_peered":"2024-09-21T06:18:13.397812+0000","last_clean":"2024-09-21T06:18:13.397812+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:18:13.397812+0000","last_undegraded":"2024-09-21T06:18:13.397812+0000","last_fullsized":"2024-09-21T06:18:13.397812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:47.044269+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:18:47.044269+0000","last_peered":"2024-09-21T06:18:47.044269+0000","last_clean":"2024-09-21T06:18:47.044269+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:18:47.044269+0000","last_undegraded":"2024-09-21T06:18:47.044269+0000","last_fullsized":"2024-09-21T06:18:47.044269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498157+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:18:13.498157+0000","last_peered":"2024-09-21T06:18:13.498157+0000","last_clean":"2024-09-21T06:18:13.498157+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:18:13.498157+0000","last_undegraded":"2024-09-21T06:18:13.498157+0000","last_fullsized":"2024-09-21T06:18:13.498157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400516+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:18:13.400516+0000","last_peered":"2024-09-21T06:18:13.400516+0000","last_clean":"2024-09-21T06:18:13.400516+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:18:13.400516+0000","last_undegraded":"2024-09-21T06:18:13.400516+0000","last_fullsized":"2024-09-21T06:18:13.400516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499061+0000","last_change":"2024-09-21T06:18:13.498949+0000","last_active":"2024-09-21T06:18:13.499061+0000","last_peered":"2024-09-21T06:18:13.499061+0000","last_clean":"2024-09-21T06:18:13.499061+0000","last_became_active":"2024-09-21T06:18:13.498496+0000","last_became_peered":"2024-09-21T06:18:13.498496+0000","last_unstale":"2024-09-21T06:18:13.499061+0000","last_undegraded":"2024-09-21T06:18:13.499061+0000","last_fullsized":"2024-09-21T06:18:13.499061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:42.982233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.407772+0000","last_change":"2024-09-21T06:18:13.407681+0000","last_active":"2024-09-21T06:18:13.407772+0000","last_peered":"2024-09-21T06:18:13.407772+0000","last_clean":"2024-09-21T06:18:13.407772+0000","last_became_active":"2024-09-21T06:18:13.403705+0000","last_became_peered":"2024-09-21T06:18:13.403705+0000","last_unstale":"2024-09-21T06:18:13.407772+0000","last_undegraded":"2024-09-21T06:18:13.407772+0000","last_fullsized":"2024-09-21T06:18:13.407772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:09.176309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399933+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:13.399933+0000","last_peered":"2024-09-21T06:18:13.399933+0000","last_clean":"2024-09-21T06:18:13.399933+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:13.399933+0000","last_undegraded":"2024-09-21T06:18:13.399933+0000","last_fullsized":"2024-09-21T06:18:13.399933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398244+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:18:13.398244+0000","last_peered":"2024-09-21T06:18:13.398244+0000","last_clean":"2024-09-21T06:18:13.398244+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:18:13.398244+0000","last_undegraded":"2024-09-21T06:18:13.398244+0000","last_fullsized":"2024-09-21T06:18:13.398244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401500+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:18:13.401500+0000","last_peered":"2024-09-21T06:18:13.401500+0000","last_clean":"2024-09-21T06:18:13.401500+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:18:13.401500+0000","last_undegraded":"2024-09-21T06:18:13.401500+0000","last_fullsized":"2024-09-21T06:18:13.401500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399383+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:18:13.399383+0000","last_peered":"2024-09-21T06:18:13.399383+0000","last_clean":"2024-09-21T06:18:13.399383+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:18:13.399383+0000","last_undegraded":"2024-09-21T06:18:13.399383+0000","last_fullsized":"2024-09-21T06:18:13.399383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498978+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:18:13.498978+0000","last_peered":"2024-09-21T06:18:13.498978+0000","last_clean":"2024-09-21T06:18:13.498978+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:18:13.498978+0000","last_undegraded":"2024-09-21T06:18:13.498978+0000","last_fullsized":"2024-09-21T06:18:13.498978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497685+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:18:13.497685+0000","last_peered":"2024-09-21T06:18:13.497685+0000","last_clean":"2024-09-21T06:18:13.497685+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:18:13.497685+0000","last_undegraded":"2024-09-21T06:18:13.497685+0000","last_fullsized":"2024-09-21T06:18:13.497685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402231+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:18:13.402231+0000","last_peered":"2024-09-21T06:18:13.402231+0000","last_clean":"2024-09-21T06:18:13.402231+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:18:13.402231+0000","last_undegraded":"2024-09-21T06:18:13.402231+0000","last_fullsized":"2024-09-21T06:18:13.402231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399075+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:18:13.399075+0000","last_peered":"2024-09-21T06:18:13.399075+0000","last_clean":"2024-09-21T06:18:13.399075+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:18:13.399075+0000","last_undegraded":"2024-09-21T06:18:13.399075+0000","last_fullsized":"2024-09-21T06:18:13.399075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398885+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:18:13.398885+0000","last_peered":"2024-09-21T06:18:13.398885+0000","last_clean":"2024-09-21T06:18:13.398885+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:18:13.398885+0000","last_undegraded":"2024-09-21T06:18:13.398885+0000","last_fullsized":"2024-09-21T06:18:13.398885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396641+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:18:13.396641+0000","last_peered":"2024-09-21T06:18:13.396641+0000","last_clean":"2024-09-21T06:18:13.396641+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:18:13.396641+0000","last_undegraded":"2024-09-21T06:18:13.396641+0000","last_fullsized":"2024-09-21T06:18:13.396641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.406158+0000","last_change":"2024-09-21T06:18:13.405449+0000","last_active":"2024-09-21T06:18:13.406158+0000","last_peered":"2024-09-21T06:18:13.406158+0000","last_clean":"2024-09-21T06:18:13.406158+0000","last_became_active":"2024-09-21T06:18:13.400865+0000","last_became_peered":"2024-09-21T06:18:13.400865+0000","last_unstale":"2024-09-21T06:18:13.406158+0000","last_undegraded":"2024-09-21T06:18:13.406158+0000","last_fullsized":"2024-09-21T06:18:13.406158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:59.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398891+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:18:13.398891+0000","last_peered":"2024-09-21T06:18:13.398891+0000","last_clean":"2024-09-21T06:18:13.398891+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:18:13.398891+0000","last_undegraded":"2024-09-21T06:18:13.398891+0000","last_fullsized":"2024-09-21T06:18:13.398891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399293+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:13.399293+0000","last_peered":"2024-09-21T06:18:13.399293+0000","last_clean":"2024-09-21T06:18:13.399293+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:13.399293+0000","last_undegraded":"2024-09-21T06:18:13.399293+0000","last_fullsized":"2024-09-21T06:18:13.399293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498640+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:18:13.498640+0000","last_peered":"2024-09-21T06:18:13.498640+0000","last_clean":"2024-09-21T06:18:13.498640+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:18:13.498640+0000","last_undegraded":"2024-09-21T06:18:13.498640+0000","last_fullsized":"2024-09-21T06:18:13.498640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498314+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:18:13.498314+0000","last_peered":"2024-09-21T06:18:13.498314+0000","last_clean":"2024-09-21T06:18:13.498314+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:18:13.498314+0000","last_undegraded":"2024-09-21T06:18:13.498314+0000","last_fullsized":"2024-09-21T06:18:13.498314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399760+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:13.399760+0000","last_peered":"2024-09-21T06:18:13.399760+0000","last_clean":"2024-09-21T06:18:13.399760+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:13.399760+0000","last_undegraded":"2024-09-21T06:18:13.399760+0000","last_fullsized":"2024-09-21T06:18:13.399760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402224+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:18:13.402224+0000","last_peered":"2024-09-21T06:18:13.402224+0000","last_clean":"2024-09-21T06:18:13.402224+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:18:13.402224+0000","last_undegraded":"2024-09-21T06:18:13.402224+0000","last_fullsized":"2024-09-21T06:18:13.402224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399746+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:13.399746+0000","last_peered":"2024-09-21T06:18:13.399746+0000","last_clean":"2024-09-21T06:18:13.399746+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:13.399746+0000","last_undegraded":"2024-09-21T06:18:13.399746+0000","last_fullsized":"2024-09-21T06:18:13.399746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497680+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:18:13.497680+0000","last_peered":"2024-09-21T06:18:13.497680+0000","last_clean":"2024-09-21T06:18:13.497680+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:18:13.497680+0000","last_undegraded":"2024-09-21T06:18:13.497680+0000","last_fullsized":"2024-09-21T06:18:13.497680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399443+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:18:13.399443+0000","last_peered":"2024-09-21T06:18:13.399443+0000","last_clean":"2024-09-21T06:18:13.399443+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:18:13.399443+0000","last_undegraded":"2024-09-21T06:18:13.399443+0000","last_fullsized":"2024-09-21T06:18:13.399443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399195+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:18:13.399195+0000","last_peered":"2024-09-21T06:18:13.399195+0000","last_clean":"2024-09-21T06:18:13.399195+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:18:13.399195+0000","last_undegraded":"2024-09-21T06:18:13.399195+0000","last_fullsized":"2024-09-21T06:18:13.399195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401798+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:18:13.401798+0000","last_peered":"2024-09-21T06:18:13.401798+0000","last_clean":"2024-09-21T06:18:13.401798+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:18:13.401798+0000","last_undegraded":"2024-09-21T06:18:13.401798+0000","last_fullsized":"2024-09-21T06:18:13.401798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69891,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":331,"num_read_kb":239,"num_write":161,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":415941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1544192,"data_stored":1073703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":416294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266729,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":416097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36772,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708380,"statfs":{"total":95995035648,"available":95957381120,"internally_reserved":0,"allocated":1454080,"data_stored":1008027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":415566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":1007320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":416394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":860160,"data_stored":415760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":482599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":481249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":416837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:18:52.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:18:52.465 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 -- 172.21.15.38:0/1009997286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 msgr2=0x7f50c0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 --2- 172.21.15.38:0/1009997286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c0110330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009ca0 tx=0x7f50b802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 -- 172.21.15.38:0/1009997286 shutdown_connections 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 --2- 172.21.15.38:0/1009997286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c0110330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 --2- 172.21.15.38:0/1009997286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0105380 0x7f50c010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 --2- 172.21.15.38:0/1009997286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0104a30 0x7f50c0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 -- 172.21.15.38:0/1009997286 >> 172.21.15.38:0/1009997286 conn(0x7f50c0079760 msgr2=0x7f50c0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 -- 172.21.15.38:0/1009997286 shutdown_connections 2024-09-21T06:18:53.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.990+0000 7f50c8501640 1 -- 172.21.15.38:0/1009997286 wait complete. 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 Processor -- start 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 -- start start 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 0x7f50c019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0105380 0x7f50c019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113c00 con 0x7f50c010de60 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113a80 con 0x7f50c0104a30 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c8501640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113d80 con 0x7f50c0105380 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c6a9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c6a9e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35922/0 (socket says 172.21.15.38:35922) 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c6a9e640 1 -- 172.21.15.38:0/1892512786 learned_addr learned my addr 172.21.15.38:0/1892512786 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c5a9c640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0105380 0x7f50c019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.991+0000 7f50c629d640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 0x7f50c019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:53.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 -- 172.21.15.38:0/1892512786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0105380 msgr2=0x7f50c019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0105380 0x7f50c019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 -- 172.21.15.38:0/1892512786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 msgr2=0x7f50c019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 0x7f50c019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 -- 172.21.15.38:0/1892512786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01a0520 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c629d640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 0x7f50c019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c6a9e640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f50b8033040 tx=0x7f50b8003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8031650 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f50b80317f0 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c01a07b0 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b802fa80 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.992+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c01a6f70 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.993+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c006c1f0 con 0x7f50c010de60 2024-09-21T06:18:53.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.995+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f50b802fc20 con 0x7f50c010de60 2024-09-21T06:18:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.996+0000 7f50b77fe640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 0x7f50ac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.996+0000 7f50c629d640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 0x7f50ac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.996+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f50b8108a90 con 0x7f50c010de60 2024-09-21T06:18:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.996+0000 7f50c629d640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 0x7f50ac0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50c006c8f0 tx=0x7f50bc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:53.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:52.999+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50b80cf0c0 con 0x7f50c010de60 2024-09-21T06:18:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.188+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50c0101c70 con 0x7f50ac0b65f0 2024-09-21T06:18:53.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.193+0000 7f50b77fe640 1 -- 172.21.15.38:0/1892512786 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258699 (secure 0 0 0) 0x7f50c0101c70 con 0x7f50ac0b65f0 2024-09-21T06:18:53.197 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:18:53.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 msgr2=0x7f50ac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:53.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 0x7f50ac0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50c006c8f0 tx=0x7f50bc005f90 comp rx=0 tx=0).stop 2024-09-21T06:18:53.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 msgr2=0x7f50c019fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:53.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f50b8033040 tx=0x7f50b8003c90 comp rx=0 tx=0).stop 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 shutdown_connections 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50ac0b65f0 0x7f50ac0b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50c010de60 0x7f50c019fdf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50c0105380 0x7f50c019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 --2- 172.21.15.38:0/1892512786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50c0104a30 0x7f50c019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 >> 172.21.15.38:0/1892512786 conn(0x7f50c0079760 msgr2=0x7f50c0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 shutdown_connections 2024-09-21T06:18:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:53.197+0000 7f50c8501640 1 -- 172.21.15.38:0/1892512786 wait complete. 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:53.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:18:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:18:53.836 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-21T06:18:51.673138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660493,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":427,"num_read_kb":318,"num_write":286,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394628,"kb_used_data":12024,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547196,"statfs":{"total":1151940427776,"available":1151536328704,"internally_reserved":0,"allocated":12312576,"data_stored":6965787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396969+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:18:13.396969+0000","last_peered":"2024-09-21T06:18:13.396969+0000","last_clean":"2024-09-21T06:18:13.396969+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:18:13.396969+0000","last_undegraded":"2024-09-21T06:18:13.396969+0000","last_fullsized":"2024-09-21T06:18:13.396969+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497810+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:18:13.497810+0000","last_peered":"2024-09-21T06:18:13.497810+0000","last_clean":"2024-09-21T06:18:13.497810+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:18:13.497810+0000","last_undegraded":"2024-09-21T06:18:13.497810+0000","last_fullsized":"2024-09-21T06:18:13.497810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497510+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:18:13.497510+0000","last_peered":"2024-09-21T06:18:13.497510+0000","last_clean":"2024-09-21T06:18:13.497510+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:18:13.497510+0000","last_undegraded":"2024-09-21T06:18:13.497510+0000","last_fullsized":"2024-09-21T06:18:13.497510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498281+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:18:13.498281+0000","last_peered":"2024-09-21T06:18:13.498281+0000","last_clean":"2024-09-21T06:18:13.498281+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:18:13.498281+0000","last_undegraded":"2024-09-21T06:18:13.498281+0000","last_fullsized":"2024-09-21T06:18:13.498281+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399284+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:18:13.399284+0000","last_peered":"2024-09-21T06:18:13.399284+0000","last_clean":"2024-09-21T06:18:13.399284+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:18:13.399284+0000","last_undegraded":"2024-09-21T06:18:13.399284+0000","last_fullsized":"2024-09-21T06:18:13.399284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.404236+0000","last_change":"2024-09-21T06:18:13.404093+0000","last_active":"2024-09-21T06:18:13.404236+0000","last_peered":"2024-09-21T06:18:13.404236+0000","last_clean":"2024-09-21T06:18:13.404236+0000","last_became_active":"2024-09-21T06:18:13.403608+0000","last_became_peered":"2024-09-21T06:18:13.403608+0000","last_unstale":"2024-09-21T06:18:13.404236+0000","last_undegraded":"2024-09-21T06:18:13.404236+0000","last_fullsized":"2024-09-21T06:18:13.404236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:54.362457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498299+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:18:13.498299+0000","last_peered":"2024-09-21T06:18:13.498299+0000","last_clean":"2024-09-21T06:18:13.498299+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:18:13.498299+0000","last_undegraded":"2024-09-21T06:18:13.498299+0000","last_fullsized":"2024-09-21T06:18:13.498299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398723+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:18:13.398723+0000","last_peered":"2024-09-21T06:18:13.398723+0000","last_clean":"2024-09-21T06:18:13.398723+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:18:13.398723+0000","last_undegraded":"2024-09-21T06:18:13.398723+0000","last_fullsized":"2024-09-21T06:18:13.398723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402933+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:18:13.402933+0000","last_peered":"2024-09-21T06:18:13.402933+0000","last_clean":"2024-09-21T06:18:13.402933+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:18:13.402933+0000","last_undegraded":"2024-09-21T06:18:13.402933+0000","last_fullsized":"2024-09-21T06:18:13.402933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400891+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:18:13.400891+0000","last_peered":"2024-09-21T06:18:13.400891+0000","last_clean":"2024-09-21T06:18:13.400891+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:18:13.400891+0000","last_undegraded":"2024-09-21T06:18:13.400891+0000","last_fullsized":"2024-09-21T06:18:13.400891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498776+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:18:13.498776+0000","last_peered":"2024-09-21T06:18:13.498776+0000","last_clean":"2024-09-21T06:18:13.498776+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:18:13.498776+0000","last_undegraded":"2024-09-21T06:18:13.498776+0000","last_fullsized":"2024-09-21T06:18:13.498776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.405365+0000","last_change":"2024-09-21T06:18:13.404172+0000","last_active":"2024-09-21T06:18:13.405365+0000","last_peered":"2024-09-21T06:18:13.405365+0000","last_clean":"2024-09-21T06:18:13.405365+0000","last_became_active":"2024-09-21T06:18:13.403643+0000","last_became_peered":"2024-09-21T06:18:13.403643+0000","last_unstale":"2024-09-21T06:18:13.405365+0000","last_undegraded":"2024-09-21T06:18:13.405365+0000","last_fullsized":"2024-09-21T06:18:13.405365+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:12.264818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398064+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:18:13.398064+0000","last_peered":"2024-09-21T06:18:13.398064+0000","last_clean":"2024-09-21T06:18:13.398064+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:18:13.398064+0000","last_undegraded":"2024-09-21T06:18:13.398064+0000","last_fullsized":"2024-09-21T06:18:13.398064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497486+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:18:13.497486+0000","last_peered":"2024-09-21T06:18:13.497486+0000","last_clean":"2024-09-21T06:18:13.497486+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:18:13.497486+0000","last_undegraded":"2024-09-21T06:18:13.497486+0000","last_fullsized":"2024-09-21T06:18:13.497486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497476+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:18:13.497476+0000","last_peered":"2024-09-21T06:18:13.497476+0000","last_clean":"2024-09-21T06:18:13.497476+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:18:13.497476+0000","last_undegraded":"2024-09-21T06:18:13.497476+0000","last_fullsized":"2024-09-21T06:18:13.497476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401678+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:18:13.401678+0000","last_peered":"2024-09-21T06:18:13.401678+0000","last_clean":"2024-09-21T06:18:13.401678+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:18:13.401678+0000","last_undegraded":"2024-09-21T06:18:13.401678+0000","last_fullsized":"2024-09-21T06:18:13.401678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396971+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:18:13.396971+0000","last_peered":"2024-09-21T06:18:13.396971+0000","last_clean":"2024-09-21T06:18:13.396971+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:18:13.396971+0000","last_undegraded":"2024-09-21T06:18:13.396971+0000","last_fullsized":"2024-09-21T06:18:13.396971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401146+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:18:13.401146+0000","last_peered":"2024-09-21T06:18:13.401146+0000","last_clean":"2024-09-21T06:18:13.401146+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:18:13.401146+0000","last_undegraded":"2024-09-21T06:18:13.401146+0000","last_fullsized":"2024-09-21T06:18:13.401146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401050+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:18:13.401050+0000","last_peered":"2024-09-21T06:18:13.401050+0000","last_clean":"2024-09-21T06:18:13.401050+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:18:13.401050+0000","last_undegraded":"2024-09-21T06:18:13.401050+0000","last_fullsized":"2024-09-21T06:18:13.401050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396703+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:18:13.396703+0000","last_peered":"2024-09-21T06:18:13.396703+0000","last_clean":"2024-09-21T06:18:13.396703+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:18:13.396703+0000","last_undegraded":"2024-09-21T06:18:13.396703+0000","last_fullsized":"2024-09-21T06:18:13.396703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398178+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:18:13.398178+0000","last_peered":"2024-09-21T06:18:13.398178+0000","last_clean":"2024-09-21T06:18:13.398178+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:18:13.398178+0000","last_undegraded":"2024-09-21T06:18:13.398178+0000","last_fullsized":"2024-09-21T06:18:13.398178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402133+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:18:13.402133+0000","last_peered":"2024-09-21T06:18:13.402133+0000","last_clean":"2024-09-21T06:18:13.402133+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:18:13.402133+0000","last_undegraded":"2024-09-21T06:18:13.402133+0000","last_fullsized":"2024-09-21T06:18:13.402133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398760+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:18:13.398760+0000","last_peered":"2024-09-21T06:18:13.398760+0000","last_clean":"2024-09-21T06:18:13.398760+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:18:13.398760+0000","last_undegraded":"2024-09-21T06:18:13.398760+0000","last_fullsized":"2024-09-21T06:18:13.398760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498022+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:18:13.498022+0000","last_peered":"2024-09-21T06:18:13.498022+0000","last_clean":"2024-09-21T06:18:13.498022+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:18:13.498022+0000","last_undegraded":"2024-09-21T06:18:13.498022+0000","last_fullsized":"2024-09-21T06:18:13.498022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399284+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:18:13.399284+0000","last_peered":"2024-09-21T06:18:13.399284+0000","last_clean":"2024-09-21T06:18:13.399284+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:18:13.399284+0000","last_undegraded":"2024-09-21T06:18:13.399284+0000","last_fullsized":"2024-09-21T06:18:13.399284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401189+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:18:13.401189+0000","last_peered":"2024-09-21T06:18:13.401189+0000","last_clean":"2024-09-21T06:18:13.401189+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:18:13.401189+0000","last_undegraded":"2024-09-21T06:18:13.401189+0000","last_fullsized":"2024-09-21T06:18:13.401189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396790+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:18:13.396790+0000","last_peered":"2024-09-21T06:18:13.396790+0000","last_clean":"2024-09-21T06:18:13.396790+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:18:13.396790+0000","last_undegraded":"2024-09-21T06:18:13.396790+0000","last_fullsized":"2024-09-21T06:18:13.396790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398194+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:18:13.398194+0000","last_peered":"2024-09-21T06:18:13.398194+0000","last_clean":"2024-09-21T06:18:13.398194+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:18:13.398194+0000","last_undegraded":"2024-09-21T06:18:13.398194+0000","last_fullsized":"2024-09-21T06:18:13.398194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497730+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:18:13.497730+0000","last_peered":"2024-09-21T06:18:13.497730+0000","last_clean":"2024-09-21T06:18:13.497730+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:18:13.497730+0000","last_undegraded":"2024-09-21T06:18:13.497730+0000","last_fullsized":"2024-09-21T06:18:13.497730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400410+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:18:13.400410+0000","last_peered":"2024-09-21T06:18:13.400410+0000","last_clean":"2024-09-21T06:18:13.400410+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:18:13.400410+0000","last_undegraded":"2024-09-21T06:18:13.400410+0000","last_fullsized":"2024-09-21T06:18:13.400410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500515+0000","last_change":"2024-09-21T06:18:13.500386+0000","last_active":"2024-09-21T06:18:13.500515+0000","last_peered":"2024-09-21T06:18:13.500515+0000","last_clean":"2024-09-21T06:18:13.500515+0000","last_became_active":"2024-09-21T06:18:13.499861+0000","last_became_peered":"2024-09-21T06:18:13.499861+0000","last_unstale":"2024-09-21T06:18:13.500515+0000","last_undegraded":"2024-09-21T06:18:13.500515+0000","last_fullsized":"2024-09-21T06:18:13.500515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:05.084576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396532+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:18:13.396532+0000","last_peered":"2024-09-21T06:18:13.396532+0000","last_clean":"2024-09-21T06:18:13.396532+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:18:13.396532+0000","last_undegraded":"2024-09-21T06:18:13.396532+0000","last_fullsized":"2024-09-21T06:18:13.396532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399196+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:18:13.399196+0000","last_peered":"2024-09-21T06:18:13.399196+0000","last_clean":"2024-09-21T06:18:13.399196+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:18:13.399196+0000","last_undegraded":"2024-09-21T06:18:13.399196+0000","last_fullsized":"2024-09-21T06:18:13.399196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:45.021917+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:18:45.021917+0000","last_peered":"2024-09-21T06:18:45.021917+0000","last_clean":"2024-09-21T06:18:45.021917+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:18:45.021917+0000","last_undegraded":"2024-09-21T06:18:45.021917+0000","last_fullsized":"2024-09-21T06:18:45.021917+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498470+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:18:13.498470+0000","last_peered":"2024-09-21T06:18:13.498470+0000","last_clean":"2024-09-21T06:18:13.498470+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:18:13.498470+0000","last_undegraded":"2024-09-21T06:18:13.498470+0000","last_fullsized":"2024-09-21T06:18:13.498470+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400475+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:18:13.400475+0000","last_peered":"2024-09-21T06:18:13.400475+0000","last_clean":"2024-09-21T06:18:13.400475+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:18:13.400475+0000","last_undegraded":"2024-09-21T06:18:13.400475+0000","last_fullsized":"2024-09-21T06:18:13.400475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397823+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:18:13.397823+0000","last_peered":"2024-09-21T06:18:13.397823+0000","last_clean":"2024-09-21T06:18:13.397823+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:18:13.397823+0000","last_undegraded":"2024-09-21T06:18:13.397823+0000","last_fullsized":"2024-09-21T06:18:13.397823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398796+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:18:13.398796+0000","last_peered":"2024-09-21T06:18:13.398796+0000","last_clean":"2024-09-21T06:18:13.398796+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:18:13.398796+0000","last_undegraded":"2024-09-21T06:18:13.398796+0000","last_fullsized":"2024-09-21T06:18:13.398796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498355+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:18:13.498355+0000","last_peered":"2024-09-21T06:18:13.498355+0000","last_clean":"2024-09-21T06:18:13.498355+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:18:13.498355+0000","last_undegraded":"2024-09-21T06:18:13.498355+0000","last_fullsized":"2024-09-21T06:18:13.498355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400949+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:18:13.400949+0000","last_peered":"2024-09-21T06:18:13.400949+0000","last_clean":"2024-09-21T06:18:13.400949+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:18:13.400949+0000","last_undegraded":"2024-09-21T06:18:13.400949+0000","last_fullsized":"2024-09-21T06:18:13.400949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:50.028536+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:18:50.028536+0000","last_peered":"2024-09-21T06:18:50.028536+0000","last_clean":"2024-09-21T06:18:50.028536+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:18:50.028536+0000","last_undegraded":"2024-09-21T06:18:50.028536+0000","last_fullsized":"2024-09-21T06:18:50.028536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402469+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:18:13.402469+0000","last_peered":"2024-09-21T06:18:13.402469+0000","last_clean":"2024-09-21T06:18:13.402469+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:18:13.402469+0000","last_undegraded":"2024-09-21T06:18:13.402469+0000","last_fullsized":"2024-09-21T06:18:13.402469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497765+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:18:13.497765+0000","last_peered":"2024-09-21T06:18:13.497765+0000","last_clean":"2024-09-21T06:18:13.497765+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:18:13.497765+0000","last_undegraded":"2024-09-21T06:18:13.497765+0000","last_fullsized":"2024-09-21T06:18:13.497765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498383+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:18:13.498383+0000","last_peered":"2024-09-21T06:18:13.498383+0000","last_clean":"2024-09-21T06:18:13.498383+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:18:13.498383+0000","last_undegraded":"2024-09-21T06:18:13.498383+0000","last_fullsized":"2024-09-21T06:18:13.498383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.405416+0000","last_change":"2024-09-21T06:18:13.405270+0000","last_active":"2024-09-21T06:18:13.405416+0000","last_peered":"2024-09-21T06:18:13.405416+0000","last_clean":"2024-09-21T06:18:13.405416+0000","last_became_active":"2024-09-21T06:18:13.404759+0000","last_became_peered":"2024-09-21T06:18:13.404759+0000","last_unstale":"2024-09-21T06:18:13.405416+0000","last_undegraded":"2024-09-21T06:18:13.405416+0000","last_fullsized":"2024-09-21T06:18:13.405416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.678457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":170,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:51.030085+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:18:51.030085+0000","last_peered":"2024-09-21T06:18:51.030085+0000","last_clean":"2024-09-21T06:18:51.030085+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:18:51.030085+0000","last_undegraded":"2024-09-21T06:18:51.030085+0000","last_fullsized":"2024-09-21T06:18:51.030085+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":123,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399847+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:18:13.399847+0000","last_peered":"2024-09-21T06:18:13.399847+0000","last_clean":"2024-09-21T06:18:13.399847+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:18:13.399847+0000","last_undegraded":"2024-09-21T06:18:13.399847+0000","last_fullsized":"2024-09-21T06:18:13.399847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400650+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:18:13.400650+0000","last_peered":"2024-09-21T06:18:13.400650+0000","last_clean":"2024-09-21T06:18:13.400650+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:18:13.400650+0000","last_undegraded":"2024-09-21T06:18:13.400650+0000","last_fullsized":"2024-09-21T06:18:13.400650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398065+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:18:13.398065+0000","last_peered":"2024-09-21T06:18:13.398065+0000","last_clean":"2024-09-21T06:18:13.398065+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:18:13.398065+0000","last_undegraded":"2024-09-21T06:18:13.398065+0000","last_fullsized":"2024-09-21T06:18:13.398065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498259+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:18:13.498259+0000","last_peered":"2024-09-21T06:18:13.498259+0000","last_clean":"2024-09-21T06:18:13.498259+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:18:13.498259+0000","last_undegraded":"2024-09-21T06:18:13.498259+0000","last_fullsized":"2024-09-21T06:18:13.498259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499529+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:18:13.499529+0000","last_peered":"2024-09-21T06:18:13.499529+0000","last_clean":"2024-09-21T06:18:13.499529+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:18:13.499529+0000","last_undegraded":"2024-09-21T06:18:13.499529+0000","last_fullsized":"2024-09-21T06:18:13.499529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":81,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:46.043286+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:18:46.043286+0000","last_peered":"2024-09-21T06:18:46.043286+0000","last_clean":"2024-09-21T06:18:46.043286+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:18:46.043286+0000","last_undegraded":"2024-09-21T06:18:46.043286+0000","last_fullsized":"2024-09-21T06:18:46.043286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498038+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:18:13.498038+0000","last_peered":"2024-09-21T06:18:13.498038+0000","last_clean":"2024-09-21T06:18:13.498038+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:18:13.498038+0000","last_undegraded":"2024-09-21T06:18:13.498038+0000","last_fullsized":"2024-09-21T06:18:13.498038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399100+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:13.399100+0000","last_peered":"2024-09-21T06:18:13.399100+0000","last_clean":"2024-09-21T06:18:13.399100+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:13.399100+0000","last_undegraded":"2024-09-21T06:18:13.399100+0000","last_fullsized":"2024-09-21T06:18:13.399100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498099+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:18:13.498099+0000","last_peered":"2024-09-21T06:18:13.498099+0000","last_clean":"2024-09-21T06:18:13.498099+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:18:13.498099+0000","last_undegraded":"2024-09-21T06:18:13.498099+0000","last_fullsized":"2024-09-21T06:18:13.498099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399604+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:13.399604+0000","last_peered":"2024-09-21T06:18:13.399604+0000","last_clean":"2024-09-21T06:18:13.399604+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:13.399604+0000","last_undegraded":"2024-09-21T06:18:13.399604+0000","last_fullsized":"2024-09-21T06:18:13.399604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396889+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:18:13.396889+0000","last_peered":"2024-09-21T06:18:13.396889+0000","last_clean":"2024-09-21T06:18:13.396889+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:18:13.396889+0000","last_undegraded":"2024-09-21T06:18:13.396889+0000","last_fullsized":"2024-09-21T06:18:13.396889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397973+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:18:13.397973+0000","last_peered":"2024-09-21T06:18:13.397973+0000","last_clean":"2024-09-21T06:18:13.397973+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:18:13.397973+0000","last_undegraded":"2024-09-21T06:18:13.397973+0000","last_fullsized":"2024-09-21T06:18:13.397973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498575+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:18:13.498575+0000","last_peered":"2024-09-21T06:18:13.498575+0000","last_clean":"2024-09-21T06:18:13.498575+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:18:13.498575+0000","last_undegraded":"2024-09-21T06:18:13.498575+0000","last_fullsized":"2024-09-21T06:18:13.498575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498457+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:18:13.498457+0000","last_peered":"2024-09-21T06:18:13.498457+0000","last_clean":"2024-09-21T06:18:13.498457+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:18:13.498457+0000","last_undegraded":"2024-09-21T06:18:13.498457+0000","last_fullsized":"2024-09-21T06:18:13.498457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499721+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:18:13.499721+0000","last_peered":"2024-09-21T06:18:13.499721+0000","last_clean":"2024-09-21T06:18:13.499721+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:18:13.499721+0000","last_undegraded":"2024-09-21T06:18:13.499721+0000","last_fullsized":"2024-09-21T06:18:13.499721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400818+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:18:13.400818+0000","last_peered":"2024-09-21T06:18:13.400818+0000","last_clean":"2024-09-21T06:18:13.400818+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:18:13.400818+0000","last_undegraded":"2024-09-21T06:18:13.400818+0000","last_fullsized":"2024-09-21T06:18:13.400818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498924+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:18:13.498924+0000","last_peered":"2024-09-21T06:18:13.498924+0000","last_clean":"2024-09-21T06:18:13.498924+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:18:13.498924+0000","last_undegraded":"2024-09-21T06:18:13.498924+0000","last_fullsized":"2024-09-21T06:18:13.498924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":94,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498481+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498481+0000","last_peered":"2024-09-21T06:18:13.498481+0000","last_clean":"2024-09-21T06:18:13.498481+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498481+0000","last_undegraded":"2024-09-21T06:18:13.498481+0000","last_fullsized":"2024-09-21T06:18:13.498481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498500+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:18:13.498500+0000","last_peered":"2024-09-21T06:18:13.498500+0000","last_clean":"2024-09-21T06:18:13.498500+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:18:13.498500+0000","last_undegraded":"2024-09-21T06:18:13.498500+0000","last_fullsized":"2024-09-21T06:18:13.498500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399073+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:18:13.399073+0000","last_peered":"2024-09-21T06:18:13.399073+0000","last_clean":"2024-09-21T06:18:13.399073+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:18:13.399073+0000","last_undegraded":"2024-09-21T06:18:13.399073+0000","last_fullsized":"2024-09-21T06:18:13.399073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397812+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:18:13.397812+0000","last_peered":"2024-09-21T06:18:13.397812+0000","last_clean":"2024-09-21T06:18:13.397812+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:18:13.397812+0000","last_undegraded":"2024-09-21T06:18:13.397812+0000","last_fullsized":"2024-09-21T06:18:13.397812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:47.044269+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:18:47.044269+0000","last_peered":"2024-09-21T06:18:47.044269+0000","last_clean":"2024-09-21T06:18:47.044269+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:18:47.044269+0000","last_undegraded":"2024-09-21T06:18:47.044269+0000","last_fullsized":"2024-09-21T06:18:47.044269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498157+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:18:13.498157+0000","last_peered":"2024-09-21T06:18:13.498157+0000","last_clean":"2024-09-21T06:18:13.498157+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:18:13.498157+0000","last_undegraded":"2024-09-21T06:18:13.498157+0000","last_fullsized":"2024-09-21T06:18:13.498157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400516+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:18:13.400516+0000","last_peered":"2024-09-21T06:18:13.400516+0000","last_clean":"2024-09-21T06:18:13.400516+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:18:13.400516+0000","last_undegraded":"2024-09-21T06:18:13.400516+0000","last_fullsized":"2024-09-21T06:18:13.400516+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499061+0000","last_change":"2024-09-21T06:18:13.498949+0000","last_active":"2024-09-21T06:18:13.499061+0000","last_peered":"2024-09-21T06:18:13.499061+0000","last_clean":"2024-09-21T06:18:13.499061+0000","last_became_active":"2024-09-21T06:18:13.498496+0000","last_became_peered":"2024-09-21T06:18:13.498496+0000","last_unstale":"2024-09-21T06:18:13.499061+0000","last_undegraded":"2024-09-21T06:18:13.499061+0000","last_fullsized":"2024-09-21T06:18:13.499061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:42.982233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.407772+0000","last_change":"2024-09-21T06:18:13.407681+0000","last_active":"2024-09-21T06:18:13.407772+0000","last_peered":"2024-09-21T06:18:13.407772+0000","last_clean":"2024-09-21T06:18:13.407772+0000","last_became_active":"2024-09-21T06:18:13.403705+0000","last_became_peered":"2024-09-21T06:18:13.403705+0000","last_unstale":"2024-09-21T06:18:13.407772+0000","last_undegraded":"2024-09-21T06:18:13.407772+0000","last_fullsized":"2024-09-21T06:18:13.407772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:09.176309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399933+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:13.399933+0000","last_peered":"2024-09-21T06:18:13.399933+0000","last_clean":"2024-09-21T06:18:13.399933+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:13.399933+0000","last_undegraded":"2024-09-21T06:18:13.399933+0000","last_fullsized":"2024-09-21T06:18:13.399933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398244+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:18:13.398244+0000","last_peered":"2024-09-21T06:18:13.398244+0000","last_clean":"2024-09-21T06:18:13.398244+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:18:13.398244+0000","last_undegraded":"2024-09-21T06:18:13.398244+0000","last_fullsized":"2024-09-21T06:18:13.398244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401500+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:18:13.401500+0000","last_peered":"2024-09-21T06:18:13.401500+0000","last_clean":"2024-09-21T06:18:13.401500+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:18:13.401500+0000","last_undegraded":"2024-09-21T06:18:13.401500+0000","last_fullsized":"2024-09-21T06:18:13.401500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399383+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:18:13.399383+0000","last_peered":"2024-09-21T06:18:13.399383+0000","last_clean":"2024-09-21T06:18:13.399383+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:18:13.399383+0000","last_undegraded":"2024-09-21T06:18:13.399383+0000","last_fullsized":"2024-09-21T06:18:13.399383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498978+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:18:13.498978+0000","last_peered":"2024-09-21T06:18:13.498978+0000","last_clean":"2024-09-21T06:18:13.498978+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:18:13.498978+0000","last_undegraded":"2024-09-21T06:18:13.498978+0000","last_fullsized":"2024-09-21T06:18:13.498978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497685+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:18:13.497685+0000","last_peered":"2024-09-21T06:18:13.497685+0000","last_clean":"2024-09-21T06:18:13.497685+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:18:13.497685+0000","last_undegraded":"2024-09-21T06:18:13.497685+0000","last_fullsized":"2024-09-21T06:18:13.497685+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402231+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:18:13.402231+0000","last_peered":"2024-09-21T06:18:13.402231+0000","last_clean":"2024-09-21T06:18:13.402231+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:18:13.402231+0000","last_undegraded":"2024-09-21T06:18:13.402231+0000","last_fullsized":"2024-09-21T06:18:13.402231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399075+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:18:13.399075+0000","last_peered":"2024-09-21T06:18:13.399075+0000","last_clean":"2024-09-21T06:18:13.399075+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:18:13.399075+0000","last_undegraded":"2024-09-21T06:18:13.399075+0000","last_fullsized":"2024-09-21T06:18:13.399075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398885+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:18:13.398885+0000","last_peered":"2024-09-21T06:18:13.398885+0000","last_clean":"2024-09-21T06:18:13.398885+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:18:13.398885+0000","last_undegraded":"2024-09-21T06:18:13.398885+0000","last_fullsized":"2024-09-21T06:18:13.398885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.396641+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:18:13.396641+0000","last_peered":"2024-09-21T06:18:13.396641+0000","last_clean":"2024-09-21T06:18:13.396641+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:18:13.396641+0000","last_undegraded":"2024-09-21T06:18:13.396641+0000","last_fullsized":"2024-09-21T06:18:13.396641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.406158+0000","last_change":"2024-09-21T06:18:13.405449+0000","last_active":"2024-09-21T06:18:13.406158+0000","last_peered":"2024-09-21T06:18:13.406158+0000","last_clean":"2024-09-21T06:18:13.406158+0000","last_became_active":"2024-09-21T06:18:13.400865+0000","last_became_peered":"2024-09-21T06:18:13.400865+0000","last_unstale":"2024-09-21T06:18:13.406158+0000","last_undegraded":"2024-09-21T06:18:13.406158+0000","last_fullsized":"2024-09-21T06:18:13.406158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:59.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398891+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:18:13.398891+0000","last_peered":"2024-09-21T06:18:13.398891+0000","last_clean":"2024-09-21T06:18:13.398891+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:18:13.398891+0000","last_undegraded":"2024-09-21T06:18:13.398891+0000","last_fullsized":"2024-09-21T06:18:13.398891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399293+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:13.399293+0000","last_peered":"2024-09-21T06:18:13.399293+0000","last_clean":"2024-09-21T06:18:13.399293+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:13.399293+0000","last_undegraded":"2024-09-21T06:18:13.399293+0000","last_fullsized":"2024-09-21T06:18:13.399293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498640+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:18:13.498640+0000","last_peered":"2024-09-21T06:18:13.498640+0000","last_clean":"2024-09-21T06:18:13.498640+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:18:13.498640+0000","last_undegraded":"2024-09-21T06:18:13.498640+0000","last_fullsized":"2024-09-21T06:18:13.498640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498314+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:18:13.498314+0000","last_peered":"2024-09-21T06:18:13.498314+0000","last_clean":"2024-09-21T06:18:13.498314+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:18:13.498314+0000","last_undegraded":"2024-09-21T06:18:13.498314+0000","last_fullsized":"2024-09-21T06:18:13.498314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399760+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:13.399760+0000","last_peered":"2024-09-21T06:18:13.399760+0000","last_clean":"2024-09-21T06:18:13.399760+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:13.399760+0000","last_undegraded":"2024-09-21T06:18:13.399760+0000","last_fullsized":"2024-09-21T06:18:13.399760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402224+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:18:13.402224+0000","last_peered":"2024-09-21T06:18:13.402224+0000","last_clean":"2024-09-21T06:18:13.402224+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:18:13.402224+0000","last_undegraded":"2024-09-21T06:18:13.402224+0000","last_fullsized":"2024-09-21T06:18:13.402224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399746+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:13.399746+0000","last_peered":"2024-09-21T06:18:13.399746+0000","last_clean":"2024-09-21T06:18:13.399746+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:13.399746+0000","last_undegraded":"2024-09-21T06:18:13.399746+0000","last_fullsized":"2024-09-21T06:18:13.399746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.497680+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:18:13.497680+0000","last_peered":"2024-09-21T06:18:13.497680+0000","last_clean":"2024-09-21T06:18:13.497680+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:18:13.497680+0000","last_undegraded":"2024-09-21T06:18:13.497680+0000","last_fullsized":"2024-09-21T06:18:13.497680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399443+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:18:13.399443+0000","last_peered":"2024-09-21T06:18:13.399443+0000","last_clean":"2024-09-21T06:18:13.399443+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:18:13.399443+0000","last_undegraded":"2024-09-21T06:18:13.399443+0000","last_fullsized":"2024-09-21T06:18:13.399443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399195+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:18:13.399195+0000","last_peered":"2024-09-21T06:18:13.399195+0000","last_clean":"2024-09-21T06:18:13.399195+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:18:13.399195+0000","last_undegraded":"2024-09-21T06:18:13.399195+0000","last_fullsized":"2024-09-21T06:18:13.399195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401798+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:18:13.401798+0000","last_peered":"2024-09-21T06:18:13.401798+0000","last_clean":"2024-09-21T06:18:13.401798+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:18:13.401798+0000","last_undegraded":"2024-09-21T06:18:13.401798+0000","last_fullsized":"2024-09-21T06:18:13.401798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69891,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":346,"num_read_kb":249,"num_write":161,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":415941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1544192,"data_stored":1073703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":416294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266729,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":416097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36772,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708380,"statfs":{"total":95995035648,"available":95957381120,"internally_reserved":0,"allocated":1454080,"data_stored":1008027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":415566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":1007320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":416394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":860160,"data_stored":415760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":482599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542221,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":481249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":416837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:18:53.839 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:18:53.839 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:18:53.840 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:18:53.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T06:18:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:54.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:54 smithi038 ceph-mon[31215]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 -- 172.21.15.38:0/1593957384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 msgr2=0x7f5a30110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 --2- 172.21.15.38:0/1593957384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30110630 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009ca0 tx=0x7f5a2802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 -- 172.21.15.38:0/1593957384 shutdown_connections 2024-09-21T06:18:54.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 --2- 172.21.15.38:0/1593957384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30110630 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 --2- 172.21.15.38:0/1593957384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a301094b0 0x7f5a301098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 --2- 172.21.15.38:0/1593957384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a30103b70 0x7f5a30103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 -- 172.21.15.38:0/1593957384 >> 172.21.15.38:0/1593957384 conn(0x7f5a300ff5e0 msgr2=0x7f5a30101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 -- 172.21.15.38:0/1593957384 shutdown_connections 2024-09-21T06:18:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.590+0000 7f5a3870b640 1 -- 172.21.15.38:0/1593957384 wait complete. 2024-09-21T06:18:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 Processor -- start 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 -- start start 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 0x7f5a30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a301094b0 0x7f5a30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113be0 con 0x7f5a30109e00 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113a60 con 0x7f5a301094b0 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.591+0000 7f5a3870b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a30113d60 con 0x7f5a30103b70 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a364a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 0x7f5a30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35944/0 (socket says 172.21.15.38:35944) 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 -- 172.21.15.38:0/4084566308 learned_addr learned my addr 172.21.15.38:0/4084566308 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a35ca6640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a301094b0 0x7f5a30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 -- 172.21.15.38:0/4084566308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 msgr2=0x7f5a30075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 0x7f5a30075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 -- 172.21.15.38:0/4084566308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a301094b0 msgr2=0x7f5a30075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a301094b0 0x7f5a30075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 -- 172.21.15.38:0/4084566308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a301a87e0 con 0x7f5a30109e00 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a364a7640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 0x7f5a30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a36ca8640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005e30 tx=0x7f5a28003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28031650 con 0x7f5a30109e00 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a280317f0 con 0x7f5a30109e00 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.592+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a301a8a70 con 0x7f5a30109e00 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.593+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2802f9d0 con 0x7f5a30109e00 2024-09-21T06:18:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.593+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a8fb0 con 0x7f5a30109e00 2024-09-21T06:18:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.594+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a30103f80 con 0x7f5a30109e00 2024-09-21T06:18:54.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.595+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5a28004b40 con 0x7f5a30109e00 2024-09-21T06:18:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.596+0000 7f5a277fe640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 0x7f5a1c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.596+0000 7f5a364a7640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 0x7f5a1c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.596+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5a28108940 con 0x7f5a30109e00 2024-09-21T06:18:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.597+0000 7f5a364a7640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 0x7f5a1c0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a30077160 tx=0x7f5a2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.600+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a280cefd0 con 0x7f5a30109e00 2024-09-21T06:18:54.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:54 smithi174 ceph-mon[34815]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:54.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:54 smithi044 ceph-mon[34369]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:18:54.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.830+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a3002e640 con 0x7f5a30109e00 2024-09-21T06:18:54.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.830+0000 7f5a277fe640 1 -- 172.21.15.38:0/4084566308 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5a280d33b0 con 0x7f5a30109e00 2024-09-21T06:18:54.832 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:54.832 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:18:54.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.832+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 msgr2=0x7f5a1c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.832+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 0x7f5a1c0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a30077160 tx=0x7f5a2c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.832+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 msgr2=0x7f5a30076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.832+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005e30 tx=0x7f5a28003d80 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 shutdown_connections 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a1c0b65f0 0x7f5a1c0b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a30109e00 0x7f5a30076190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a301094b0 0x7f5a30075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 --2- 172.21.15.38:0/4084566308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a30103b70 0x7f5a30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 >> 172.21.15.38:0/4084566308 conn(0x7f5a300ff5e0 msgr2=0x7f5a30107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 shutdown_connections 2024-09-21T06:18:54.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:54.833+0000 7f5a3870b640 1 -- 172.21.15.38:0/4084566308 wait complete. 2024-09-21T06:18:55.439 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:55 smithi038 ceph-mon[31215]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:18:55.439 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4084566308' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:18:55.473 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:18:55.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:55 smithi174 ceph-mon[34815]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:18:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4084566308' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:18:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:55 smithi044 ceph-mon[34369]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:18:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4084566308' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:18:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:56.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 -- 172.21.15.38:0/3083169575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c1101a0 msgr2=0x7f596c1125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 --2- 172.21.15.38:0/3083169575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c1101a0 0x7f596c1125c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5964009ca0 tx=0x7f596402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 -- 172.21.15.38:0/3083169575 shutdown_connections 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 --2- 172.21.15.38:0/3083169575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c1101a0 0x7f596c1125c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 --2- 172.21.15.38:0/3083169575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c076080 0x7f596c10fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 --2- 172.21.15.38:0/3083169575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 0x7f596c075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 -- 172.21.15.38:0/3083169575 >> 172.21.15.38:0/3083169575 conn(0x7f596c07b910 msgr2=0x7f596c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 -- 172.21.15.38:0/3083169575 shutdown_connections 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.198+0000 7f5972808640 1 -- 172.21.15.38:0/3083169575 wait complete. 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 Processor -- start 2024-09-21T06:18:56.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 -- start start 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 0x7f596c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c1101a0 0x7f596c1a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f596c115df0 con 0x7f596c076080 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f596c115c70 con 0x7f596c075730 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f5972808640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f596c115f70 con 0x7f596c1101a0 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.199+0000 7f596b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35954/0 (socket says 172.21.15.38:35954) 2024-09-21T06:18:56.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 -- 172.21.15.38:0/2169202241 learned_addr learned my addr 172.21.15.38:0/2169202241 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596bfff640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 0x7f596c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f5970da5640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c1101a0 0x7f596c1a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 -- 172.21.15.38:0/2169202241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c1101a0 msgr2=0x7f596c1a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c1101a0 0x7f596c1a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 -- 172.21.15.38:0/2169202241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 msgr2=0x7f596c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 0x7f596c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 -- 172.21.15.38:0/2169202241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1a26f0 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f596b7fe640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f596000c970 tx=0x7f596000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960004220 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1a29e0 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f59600043c0 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960004a00 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.200+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1a9140 con 0x7f596c076080 2024-09-21T06:18:56.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.201+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c075b40 con 0x7f596c076080 2024-09-21T06:18:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.203+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f59600050b0 con 0x7f596c076080 2024-09-21T06:18:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.204+0000 7f59697fa640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 0x7f59540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.204+0000 7f596bfff640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 0x7f59540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:56.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.204+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f59600e75d0 con 0x7f596c076080 2024-09-21T06:18:56.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.204+0000 7f596bfff640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 0x7f59540b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f595c005d00 tx=0x7f595c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:56.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.207+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5960014030 con 0x7f596c076080 2024-09-21T06:18:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.434+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f596c19d8b0 con 0x7f596c076080 2024-09-21T06:18:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.435+0000 7f59697fa640 1 -- 172.21.15.38:0/2169202241 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7f59600adc60 con 0x7f596c076080 2024-09-21T06:18:56.436 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:56.437 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:18:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 msgr2=0x7f59540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 0x7f59540b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f595c005d00 tx=0x7f595c00b410 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 msgr2=0x7f596c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f596000c970 tx=0x7f596000ce30 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 shutdown_connections 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f59540b65f0 0x7f59540b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f596c1101a0 0x7f596c1a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f596c076080 0x7f596c19cd20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 --2- 172.21.15.38:0/2169202241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f596c075730 0x7f596c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 >> 172.21.15.38:0/2169202241 conn(0x7f596c07b910 msgr2=0x7f596c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 shutdown_connections 2024-09-21T06:18:56.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:56.437+0000 7f5972808640 1 -- 172.21.15.38:0/2169202241 wait complete. 2024-09-21T06:18:57.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:18:57.301 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:57.578 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:57 smithi038 ceph-mon[31215]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:57.578 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:57 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2169202241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:57 smithi174 ceph-mon[34815]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:57 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2169202241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:57 smithi044 ceph-mon[34369]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:18:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:57 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2169202241' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1939398774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68101f70 msgr2=0x7f3c68102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1939398774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68101f70 0x7f3c68102380 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009900 tx=0x7f3c5802a410 comp rx=0 tx=0).stop 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1939398774 shutdown_connections 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1939398774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68109e00 0x7f3c68110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1939398774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c681098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1939398774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68101f70 0x7f3c68102380 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1939398774 >> 172.21.15.38:0/1939398774 conn(0x7f3c68077c60 msgr2=0x7f3c680780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1939398774 shutdown_connections 2024-09-21T06:18:57.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.785+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1939398774 wait complete. 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 Processor -- start 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 -- start start 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68101f70 0x7f3c68102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c68103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68113c00 con 0x7f3c68109e00 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68113a80 con 0x7f3c681094b0 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c6cc49640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68113d80 con 0x7f3c68101f70 2024-09-21T06:18:57.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c66d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c66d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35968/0 (socket says 172.21.15.38:35968) 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.786+0000 7f3c66d9d640 1 -- 172.21.15.38:0/1863853670 learned_addr learned my addr 172.21.15.38:0/1863853670 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c65d9b640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c68103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c6659c640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68101f70 0x7f3c68102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 -- 172.21.15.38:0/1863853670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68101f70 msgr2=0x7f3c68102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68101f70 0x7f3c68102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 -- 172.21.15.38:0/1863853670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 msgr2=0x7f3c68103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c68103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 -- 172.21.15.38:0/1863853670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c681a87f0 con 0x7f3c68109e00 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c65d9b640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c68103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:18:57.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c66d9d640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000eb10 tx=0x7f3c6000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60004b20 con 0x7f3c68109e00 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3c60004cc0 con 0x7f3c68109e00 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60010720 con 0x7f3c68109e00 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c681a8ae0 con 0x7f3c68109e00 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.787+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c681a9020 con 0x7f3c68109e00 2024-09-21T06:18:57.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.789+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c68102380 con 0x7f3c68109e00 2024-09-21T06:18:57.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.790+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f3c600108c0 con 0x7f3c68109e00 2024-09-21T06:18:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.791+0000 7f3c5f7fe640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 0x7f3c540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.792+0000 7f3c6659c640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 0x7f3c540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:57.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.792+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3c600e7d60 con 0x7f3c68109e00 2024-09-21T06:18:57.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.792+0000 7f3c6659c640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 0x7f3c540b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c68104960 tx=0x7f3c580058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:57.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:57.795+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c60056710 con 0x7f3c68109e00 2024-09-21T06:18:58.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.026+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c68104210 con 0x7f3c68109e00 2024-09-21T06:18:58.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.026+0000 7f3c5f7fe640 1 -- 172.21.15.38:0/1863853670 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7f3c68104210 con 0x7f3c68109e00 2024-09-21T06:18:58.028 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:58.028 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:18:58.029 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 msgr2=0x7f3c540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 0x7f3c540b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c68104960 tx=0x7f3c580058d0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 msgr2=0x7f3c68103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000eb10 tx=0x7f3c6000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 shutdown_connections 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3c540b65f0 0x7f3c540b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3c68109e00 0x7f3c68103990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c681094b0 0x7f3c68103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 --2- 172.21.15.38:0/1863853670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3c68101f70 0x7f3c68102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 >> 172.21.15.38:0/1863853670 conn(0x7f3c68077c60 msgr2=0x7f3c681074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 shutdown_connections 2024-09-21T06:18:58.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:58.029+0000 7f3c6cc49640 1 -- 172.21.15.38:0/1863853670 wait complete. 2024-09-21T06:18:58.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:58 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1863853670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:58 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1863853670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:58.664 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:58 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1863853670' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:18:58.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:18:58.951 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 -- 172.21.15.38:0/3535030833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e41062b0 msgr2=0x7f95e41066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/3535030833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e41062b0 0x7f95e41066c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009900 tx=0x7f95d402a410 comp rx=0 tx=0).stop 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 -- 172.21.15.38:0/3535030833 shutdown_connections 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/3535030833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e4106c00 0x7f95e4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/3535030833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e41062b0 0x7f95e41066c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/3535030833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e41024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 -- 172.21.15.38:0/3535030833 >> 172.21.15.38:0/3535030833 conn(0x7f95e4079e40 msgr2=0x7f95e407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 -- 172.21.15.38:0/3535030833 shutdown_connections 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.443+0000 7f95ebfb1640 1 -- 172.21.15.38:0/3535030833 wait complete. 2024-09-21T06:18:59.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.444+0000 7f95ebfb1640 1 Processor -- start 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.444+0000 7f95ebfb1640 1 -- start start 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e4104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41062b0 0x7f95e4103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 0x7f95e41035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4113c20 con 0x7f95e4106c00 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4113aa0 con 0x7f95e41062b0 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ebfb1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4113da0 con 0x7f95e41020c0 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95e9d4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e4104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95e9d4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e4104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:37718/0 (socket says 172.21.15.38:37718) 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95e9d4d640 1 -- 172.21.15.38:0/2586132665 learned_addr learned my addr 172.21.15.38:0/2586132665 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 0x7f95e41035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95e954c640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41062b0 0x7f95e4103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 -- 172.21.15.38:0/2586132665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 msgr2=0x7f95e4104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:59.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e4104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 -- 172.21.15.38:0/2586132665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41062b0 msgr2=0x7f95e4103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41062b0 0x7f95e4103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 -- 172.21.15.38:0/2586132665 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e4103dc0 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.445+0000 7f95ea54e640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 0x7f95e41035a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009fd0 tx=0x7f95dc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.446+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00ce20 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.446+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f95dc005020 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.446+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e41acf90 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.446+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc010720 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.446+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e41ad3f0 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.447+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e41024d0 con 0x7f95e4106c00 2024-09-21T06:18:59.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.449+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f95dc005560 con 0x7f95e4106c00 2024-09-21T06:18:59.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.450+0000 7f95daffd640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 0x7f95d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:18:59.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.450+0000 7f95e9d4d640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 0x7f95d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:18:59.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.450+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f95dc0e7ca0 con 0x7f95e4106c00 2024-09-21T06:18:59.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.451+0000 7f95e9d4d640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 0x7f95d00b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f95e419e4a0 tx=0x7f95e000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:18:59.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.453+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95dc0ae2d0 con 0x7f95e4106c00 2024-09-21T06:18:59.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.642+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95e402e640 con 0x7f95e4106c00 2024-09-21T06:18:59.644 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:18:59 smithi038 ceph-mon[31215]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:18:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:18:59 smithi174 ceph-mon[34815]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:18:59.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.644+0000 7f95daffd640 1 -- 172.21.15.38:0/2586132665 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7f95dc0b26b0 con 0x7f95e4106c00 2024-09-21T06:18:59.645 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:18:59.645 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:18:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 msgr2=0x7f95d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:59.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 0x7f95d00b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f95e419e4a0 tx=0x7f95e000b410 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 msgr2=0x7f95e41035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 0x7f95e41035a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009fd0 tx=0x7f95dc00ef10 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 shutdown_connections 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f95d00b65f0 0x7f95d00b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f95e4106c00 0x7f95e41035a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95e41062b0 0x7f95e4103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 --2- 172.21.15.38:0/2586132665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95e41020c0 0x7f95e4104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 >> 172.21.15.38:0/2586132665 conn(0x7f95e4079e40 msgr2=0x7f95e4107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 shutdown_connections 2024-09-21T06:18:59.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:18:59.646+0000 7f95ebfb1640 1 -- 172.21.15.38:0/2586132665 wait complete. 2024-09-21T06:18:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:18:59 smithi044 ceph-mon[34369]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:19:00.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:00.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:00 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2586132665' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:00.496 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:00.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:00 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2586132665' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:00.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:00 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2586132665' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 -- 172.21.15.38:0/3297571800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd01094a0 msgr2=0x7f7cd01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 --2- 172.21.15.38:0/3297571800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd01094a0 0x7f7cd01098b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009900 tx=0x7f7cc402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 -- 172.21.15.38:0/3297571800 shutdown_connections 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 --2- 172.21.15.38:0/3297571800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 --2- 172.21.15.38:0/3297571800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd01094a0 0x7f7cd01098b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 --2- 172.21.15.38:0/3297571800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd0103b60 0x7f7cd0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 -- 172.21.15.38:0/3297571800 >> 172.21.15.38:0/3297571800 conn(0x7f7cd007b850 msgr2=0x7f7cd007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 -- 172.21.15.38:0/3297571800 shutdown_connections 2024-09-21T06:19:00.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.932+0000 7f7cd607f640 1 -- 172.21.15.38:0/3297571800 wait complete. 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 Processor -- start 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 -- start start 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd01094a0 0x7f7cd019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0113c10 con 0x7f7cd0103b60 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0113a90 con 0x7f7cd0109df0 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cd607f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0113d90 con 0x7f7cd01094a0 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7ccf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:00.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7ccf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35186/0 (socket says 172.21.15.38:35186) 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7ccf7fe640 1 -- 172.21.15.38:0/286559591 learned_addr learned my addr 172.21.15.38:0/286559591 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7cceffd640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd01094a0 0x7f7cd019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.933+0000 7f7ccffff640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 -- 172.21.15.38:0/286559591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd01094a0 msgr2=0x7f7cd019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd01094a0 0x7f7cd019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 -- 172.21.15.38:0/286559591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 msgr2=0x7f7cd019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 -- 172.21.15.38:0/286559591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd01a0550 con 0x7f7cd0103b60 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccffff640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7ccf7fe640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ba50 tx=0x7f7cc000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0019070 con 0x7f7cd0103b60 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7cc000cbe0 con 0x7f7cd0103b60 2024-09-21T06:19:00.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd01a0840 con 0x7f7cd0103b60 2024-09-21T06:19:00.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00076e0 con 0x7f7cd0103b60 2024-09-21T06:19:00.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.934+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd01a6fa0 con 0x7f7cd0103b60 2024-09-21T06:19:00.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.935+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd0103f70 con 0x7f7cd0103b60 2024-09-21T06:19:00.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.937+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f7cc001c070 con 0x7f7cd0103b60 2024-09-21T06:19:00.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.938+0000 7f7cccff9640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 0x7f7cb80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:00.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.938+0000 7f7cceffd640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 0x7f7cb80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:00.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.938+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7cc00e6b40 con 0x7f7cd0103b60 2024-09-21T06:19:00.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.938+0000 7f7cceffd640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 0x7f7cb80b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009230 tx=0x7f7cc4032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:00.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:00.942+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cc00ad1d0 con 0x7f7cd0103b60 2024-09-21T06:19:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.173+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd010bc40 con 0x7f7cd0103b60 2024-09-21T06:19:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.174+0000 7f7cccff9640 1 -- 172.21.15.38:0/286559591 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7f7cc00b15b0 con 0x7f7cd0103b60 2024-09-21T06:19:01.176 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:01.176 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:19:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 msgr2=0x7f7cb80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 0x7f7cb80b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009230 tx=0x7f7cc4032c70 comp rx=0 tx=0).stop 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 msgr2=0x7f7cd019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ba50 tx=0x7f7cc000bf10 comp rx=0 tx=0).stop 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 shutdown_connections 2024-09-21T06:19:01.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7cb80b65f0 0x7f7cb80b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cd0109df0 0x7f7cd019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7cd01094a0 0x7f7cd019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 --2- 172.21.15.38:0/286559591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7cd0103b60 0x7f7cd019a5e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.176+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 >> 172.21.15.38:0/286559591 conn(0x7f7cd007b850 msgr2=0x7f7cd0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.177+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 shutdown_connections 2024-09-21T06:19:01.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:01.177+0000 7f7cd607f640 1 -- 172.21.15.38:0/286559591 wait complete. 2024-09-21T06:19:01.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:01 smithi038 ceph-mon[31215]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:01.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:01 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/286559591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:01 smithi174 ceph-mon[34815]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:01 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/286559591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:01 smithi044 ceph-mon[34369]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:01 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/286559591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:01.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:17:47.782150+0000', 'modified': '2024-09-21T06:17:58.639191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24728, 'mds_1': 24695, 'mds_2': 24667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24641': {'gid': 24641, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6833/3742968843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3742968843}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 3742968843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/2784474374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 2784474374}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 2784474374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/3535582137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3535582137}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3535582137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/2335561806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 2335561806}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 2335561806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.44:6837/2962370729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 2962370729}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 2962370729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24728': {'gid': 24728, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/2983639005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2983639005}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2983639005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24728, 'qdb_cluster': [24728, 24695, 24667]} 2024-09-21T06:19:01.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:19:01.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:19:02.111 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:02.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 -- 172.21.15.38:0/3876772962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83681094c0 msgr2=0x7f83681098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 --2- 172.21.15.38:0/3876772962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83681094c0 0x7f83681098d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f835c009900 tx=0x7f835c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:02.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 -- 172.21.15.38:0/3876772962 shutdown_connections 2024-09-21T06:19:02.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 --2- 172.21.15.38:0/3876772962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 0x7f8368110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 --2- 172.21.15.38:0/3876772962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83681094c0 0x7f83681098d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 --2- 172.21.15.38:0/3876772962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8368103b80 0x7f8368103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 -- 172.21.15.38:0/3876772962 >> 172.21.15.38:0/3876772962 conn(0x7f83680ff610 msgr2=0x7f8368101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 -- 172.21.15.38:0/3876772962 shutdown_connections 2024-09-21T06:19:02.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.608+0000 7f836db71640 1 -- 172.21.15.38:0/3876772962 wait complete. 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.609+0000 7f836db71640 1 Processor -- start 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.609+0000 7f836db71640 1 -- start start 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83681094c0 0x7f836819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 0x7f836819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8368113bf0 con 0x7f8368103b80 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8368113a70 con 0x7f83681094c0 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f836db71640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8368113d70 con 0x7f8368109e10 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35206/0 (socket says 172.21.15.38:35206) 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 -- 172.21.15.38:0/14134787 learned_addr learned my addr 172.21.15.38:0/14134787 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f8366ffd640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83681094c0 0x7f836819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f8367fff640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 0x7f836819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 -- 172.21.15.38:0/14134787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 msgr2=0x7f836819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 0x7f836819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 -- 172.21.15.38:0/14134787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83681094c0 msgr2=0x7f836819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83681094c0 0x7f836819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 -- 172.21.15.38:0/14134787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83681a0510 con 0x7f8368103b80 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f83677fe640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f835800e9f0 tx=0x7f835800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.610+0000 7f8364ff9640 1 -- 172.21.15.38:0/14134787 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835800cd80 con 0x7f8368103b80 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.611+0000 7f8364ff9640 1 -- 172.21.15.38:0/14134787 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8358010900 con 0x7f8368103b80 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.611+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83681a0800 con 0x7f8368103b80 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.611+0000 7f8364ff9640 1 -- 172.21.15.38:0/14134787 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358018920 con 0x7f8368103b80 2024-09-21T06:19:02.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.611+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681a6f60 con 0x7f8368103b80 2024-09-21T06:19:02.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.613+0000 7f83740e5740 1 Processor -- start 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.613+0000 7f83740e5740 1 -- start start 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.613+0000 7f8364ff9640 1 -- 172.21.15.38:0/14134787 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8358010ab0 con 0x7f8368103b80 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.613+0000 7f83740e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a363f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.613+0000 7f83740e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a364440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f83740e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f83740e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56486a2dbc10 con 0x564869f9d280 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f83740e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56486a2cb040 con 0x564869fbdf60 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f83740e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56486a2cee50 con 0x564869f950a0 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35208/0 (socket says 172.21.15.38:35208) 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 -- 172.21.15.38:0/725288091 learned_addr learned my addr 172.21.15.38:0/725288091 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8367fff640 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a363f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f83677fe640 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a364440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 -- 172.21.15.38:0/725288091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 msgr2=0x56486a364440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a364440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 -- 172.21.15.38:0/725288091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 msgr2=0x56486a363f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a363f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8366ffd640 1 -- 172.21.15.38:0/725288091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486a029540 con 0x564869f9d280 2024-09-21T06:19:02.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8364ff9640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 0x7f83500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.614+0000 7f8367fff640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 0x7f83500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f8364ff9640 1 -- 172.21.15.38:0/14134787 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f83580e7920 con 0x7f8368103b80 2024-09-21T06:19:02.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f8366ffd640 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f835c0314b0 tx=0x7f835c031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556ef7c5fadf4f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f834dffb640 1 -- 172.21.15.38:0/725288091 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c040070 con 0x564869f9d280 2024-09-21T06:19:02.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f8367fff640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 0x7f83500b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f836000af10 tx=0x7f836000a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f834dffb640 1 -- 172.21.15.38:0/725288091 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f835c031710 con 0x564869f9d280 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.615+0000 7f834dffb640 1 -- 172.21.15.38:0/725288091 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c035040 con 0x564869f9d280 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 -- 172.21.15.38:0/725288091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 msgr2=0x56486a364980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f835c0314b0 tx=0x7f835c031bc0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 -- 172.21.15.38:0/725288091 shutdown_connections 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a364980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a364440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 --2- 172.21.15.38:0/725288091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a363f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 -- 172.21.15.38:0/725288091 >> 172.21.15.38:0/725288091 conn(0x564869fb2350 msgr2=0x56486a361df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 -- 172.21.15.38:0/725288091 shutdown_connections 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.616+0000 7f83740e5740 1 -- 172.21.15.38:0/725288091 wait complete. 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 -- start start 2024-09-21T06:19:02.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 Processor -- start 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f950a0 0x56486a36fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f9d280 0x56486a36ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56486a12c5f0 con 0x564869fbdf60 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56486a266010 con 0x564869f950a0 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56486a372680 con 0x564869f9d280 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83740e5740 10 client.0 _ll_register_callbacks cb 0x56486a2c5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f8367fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f8367fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35210/0 (socket says 172.21.15.38:35210) 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f8367fff640 1 -- 172.21.15.38:0/2949381046 learned_addr learned my addr 172.21.15.38:0/2949381046 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.617+0000 7f83677fe640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f950a0 0x56486a36fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8366ffd640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f9d280 0x56486a36ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 -- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f9d280 msgr2=0x56486a36ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f9d280 0x56486a36ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 -- 172.21.15.38:0/2949381046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f950a0 msgr2=0x56486a36fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f950a0 0x56486a36fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 -- 172.21.15.38:0/2949381046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486a293a00 con 0x564869fbdf60 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8367fff640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f836001cbe0 tx=0x7f8360004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601605460b12030a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836001cd90 con 0x564869fbdf60 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8360016030 con 0x564869fbdf60 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f835c031710 con 0x564869fbdf60 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f836000f8a0 con 0x564869fbdf60 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f83740e5740 10 client.15231 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:02.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.618+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56486a37e670 con 0x564869fbdf60 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f835c031710 con 0x564869fbdf60 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f8360031c50 con 0x564869fbdf60 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 10 client.15231 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 20 client.15231 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f7c8e0 0x56486a3821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 4 client.15231 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56486a2ddb60 con 0x564869f7c8e0 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.619+0000 7f83677fe640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f7c8e0 0x56486a3821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.620+0000 7f8346ffd640 10 client.15231 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.620+0000 7f83677fe640 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f7c8e0 0x56486a3821b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c16049f82bba520 server_cookie=83f9b99bf02cce03 in_seq=0 out_seq=0 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.620+0000 7f8346ffd640 1 -- 172.21.15.38:0/2949381046 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56486a2ddb60 con 0x564869f7c8e0 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.620+0000 7f8346ffd640 10 client.15231 handle_command_reply: tid=0 2024-09-21T06:19:02.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 client.15231 shutdown 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 msgr2=0x56486a37b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f836001cbe0 tx=0x7f8360004ab0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 shutdown_connections 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f7c8e0 0x56486a3821b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869fbdf60 0x56486a37b9a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f9d280 0x56486a36ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 --2- 172.21.15.38:0/2949381046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f950a0 0x56486a36fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f8346ffd640 0 client.15231 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:02.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 >> 172.21.15.38:0/2949381046 conn(0x564869fb2350 msgr2=0x56486a367090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 shutdown_connections 2024-09-21T06:19:02.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 1 -- 172.21.15.38:0/2949381046 wait complete. 2024-09-21T06:19:02.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.621+0000 7f83740e5740 20 client.15231 trim_cache size 0 max 16384 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 Processor -- start 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 -- start start 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a36a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a37be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56486a3804f0 con 0x564869f9d280 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56486a380bc0 con 0x564869fbdf60 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.639+0000 7f83740e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56486a381290 con 0x564869f950a0 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35218/0 (socket says 172.21.15.38:35218) 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 -- 172.21.15.38:0/3160001250 learned_addr learned my addr 172.21.15.38:0/3160001250 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f83677fe640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a36a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8367fff640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a37be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 -- 172.21.15.38:0/3160001250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 msgr2=0x56486a36a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a36a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 -- 172.21.15.38:0/3160001250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 msgr2=0x56486a37be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a37be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 -- 172.21.15.38:0/3160001250 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486a3661f0 con 0x564869f9d280 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f83677fe640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a36a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f8366ffd640 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f835c009900 tx=0x7f835c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab74e15c5f5a7ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f834d7fa640 1 -- 172.21.15.38:0/3160001250 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c040040 con 0x564869f9d280 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f834d7fa640 1 -- 172.21.15.38:0/3160001250 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f835c04d070 con 0x564869f9d280 2024-09-21T06:19:02.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.640+0000 7f834d7fa640 1 -- 172.21.15.38:0/3160001250 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c035040 con 0x564869f9d280 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 -- 172.21.15.38:0/3160001250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 msgr2=0x56486a37b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f835c009900 tx=0x7f835c009260 comp rx=0 tx=0).stop 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 -- 172.21.15.38:0/3160001250 shutdown_connections 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869fbdf60 0x56486a37be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f9d280 0x56486a37b910 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 --2- 172.21.15.38:0/3160001250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869f950a0 0x56486a36a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 -- 172.21.15.38:0/3160001250 >> 172.21.15.38:0/3160001250 conn(0x564869fb2350 msgr2=0x56486a36a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 -- 172.21.15.38:0/3160001250 shutdown_connections 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.641+0000 7f83740e5740 1 -- 172.21.15.38:0/3160001250 wait complete. 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 -- start start 2024-09-21T06:19:02.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 Processor -- start 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 0x56486a3848e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 0x56486a384e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56486a382030 con 0x564869f950a0 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56486a381960 con 0x564869f9d280 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56486a382700 con 0x564869fbdf60 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83740e5740 10 client.0 _ll_register_callbacks cb 0x7f836001c890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83677fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35226/0 (socket says 172.21.15.38:35226) 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.642+0000 7f83677fe640 1 -- 172.21.15.38:0/2955241964 learned_addr learned my addr 172.21.15.38:0/2955241964 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8366ffd640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 0x56486a3848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8367fff640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 0x56486a384e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 -- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 msgr2=0x56486a384e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 0x56486a384e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 -- 172.21.15.38:0/2955241964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 msgr2=0x56486a3848e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 0x56486a3848e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 -- 172.21.15.38:0/2955241964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486a389b30 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8367fff640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 0x56486a384e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8366ffd640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 0x56486a3848e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83677fe640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f835800e9c0 tx=0x7f83580ed450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308269aec1c7cea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580a90d0 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8358010430 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f835c04d070 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8358010e20 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83740e5740 10 client.15237 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56486a3ed8c0 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.643+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f835c04d070 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f83580a92b0 con 0x564869f950a0 2024-09-21T06:19:02.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 10 client.15237 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 20 client.15237 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f51c90 0x56486a3f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 4 client.15237 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "status"}) -- 0x56486a2d9610 con 0x564869f51c90 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f8366ffd640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f51c90 0x56486a3f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f8346ffd640 10 client.15237 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.644+0000 7f8366ffd640 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f51c90 0x56486a3f1170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0f56e7ffe80d7d4 server_cookie=c22aeaa4167c93d in_seq=0 out_seq=0 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f8346ffd640 1 -- 172.21.15.38:0/2955241964 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56486a2d9610 con 0x564869f51c90 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f8346ffd640 10 client.15237 handle_command_reply: tid=0 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 client.15237 shutdown 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 msgr2=0x56486a3843a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f835800e9c0 tx=0x7f83580ed450 comp rx=0 tx=0).stop 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 shutdown_connections 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564869f51c90 0x56486a3f1170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564869fbdf60 0x56486a384e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564869f9d280 0x56486a3848e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 --2- 172.21.15.38:0/2955241964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564869f950a0 0x56486a3843a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 >> 172.21.15.38:0/2955241964 conn(0x564869fb2350 msgr2=0x56486a361600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f8346ffd640 0 client.15237 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 shutdown_connections 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 1 -- 172.21.15.38:0/2955241964 wait complete. 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.645+0000 7f83740e5740 20 client.15237 trim_cache size 0 max 16384 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 2, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24667, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 66.331120440999996, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 92.725256952999999 2024-09-21T06:19:02.652 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 msgr2=0x7f83500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 0x7f83500b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f836000af10 tx=0x7f836000a4d0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 msgr2=0x7f836819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f835800e9f0 tx=0x7f835800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 shutdown_connections 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83500b65f0 0x7f83500b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8368109e10 0x7f836819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83681094c0 0x7f836819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 --2- 172.21.15.38:0/14134787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8368103b80 0x7f836819a5a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:02.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 >> 172.21.15.38:0/14134787 conn(0x7f83680ff610 msgr2=0x7f8368101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:02.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 shutdown_connections 2024-09-21T06:19:02.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:02.646+0000 7f836db71640 1 -- 172.21.15.38:0/14134787 wait complete. 2024-09-21T06:19:03.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T06:19:03.574 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:03 smithi174 ceph-mon[34815]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:03 smithi044 ceph-mon[34369]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:03.689 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:03 smithi038 ceph-mon[31215]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 -- 172.21.15.38:0/4014221848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254102fa0 msgr2=0x7f025410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 --2- 172.21.15.38:0/4014221848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254102fa0 0x7f025410fcc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0244009900 tx=0x7f024402a480 comp rx=0 tx=0).stop 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 -- 172.21.15.38:0/4014221848 shutdown_connections 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 --2- 172.21.15.38:0/4014221848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254110200 0x7f0254112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 --2- 172.21.15.38:0/4014221848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254102fa0 0x7f025410fcc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 --2- 172.21.15.38:0/4014221848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102650 0x7f0254102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 -- 172.21.15.38:0/4014221848 >> 172.21.15.38:0/4014221848 conn(0x7f0254079760 msgr2=0x7f0254079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 -- 172.21.15.38:0/4014221848 shutdown_connections 2024-09-21T06:19:04.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.026+0000 7f025b71f640 1 -- 172.21.15.38:0/4014221848 wait complete. 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 Processor -- start 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 -- start start 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254102650 0x7f025419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 0x7f025419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0254115e00 con 0x7f0254110200 2024-09-21T06:19:04.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0254115c80 con 0x7f0254102650 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f025b71f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0254115f80 con 0x7f0254102fa0 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f0259cbc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f0259cbc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35244/0 (socket says 172.21.15.38:35244) 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f0259cbc640 1 -- 172.21.15.38:0/3191808964 learned_addr learned my addr 172.21.15.38:0/3191808964 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.027+0000 7f02594bb640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254102650 0x7f025419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0258cba640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 0x7f025419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 -- 172.21.15.38:0/3191808964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 msgr2=0x7f025419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 0x7f025419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 -- 172.21.15.38:0/3191808964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254102650 msgr2=0x7f025419c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254102650 0x7f025419c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 -- 172.21.15.38:0/3191808964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02541a2720 con 0x7f0254110200 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0258cba640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 0x7f025419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f0259cbc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f024c00cad0 tx=0x7f024c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f024a7fc640 1 -- 172.21.15.38:0/3191808964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c00ad60 con 0x7f0254110200 2024-09-21T06:19:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02541a2a10 con 0x7f0254110200 2024-09-21T06:19:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f024a7fc640 1 -- 172.21.15.38:0/3191808964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f024c005020 con 0x7f0254110200 2024-09-21T06:19:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f024a7fc640 1 -- 172.21.15.38:0/3191808964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c00f690 con 0x7f0254110200 2024-09-21T06:19:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.028+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541a9170 con 0x7f0254110200 2024-09-21T06:19:04.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.031+0000 7f0261c93740 1 Processor -- start 2024-09-21T06:19:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.031+0000 7f024a7fc640 1 -- 172.21.15.38:0/3191808964 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f024c0051d0 con 0x7f0254110200 2024-09-21T06:19:04.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.031+0000 7f0261c93740 1 -- start start 2024-09-21T06:19:04.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a3bf60 0x559025de1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a130a0 0x559025de2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559025d59c10 con 0x559025a1b280 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559025d49040 con 0x559025a130a0 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0261c93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559025d4ce50 con 0x559025a3bf60 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35252/0 (socket says 172.21.15.38:35252) 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 -- 172.21.15.38:0/4239458304 learned_addr learned my addr 172.21.15.38:0/4239458304 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f02594bb640 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a130a0 0x559025de2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a3bf60 0x559025de1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f024a7fc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 0x7f02400b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 -- 172.21.15.38:0/4239458304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a3bf60 msgr2=0x559025de1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a3bf60 0x559025de1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 -- 172.21.15.38:0/4239458304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a130a0 msgr2=0x559025de2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a130a0 0x559025de2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.032+0000 7f0258cba640 1 -- 172.21.15.38:0/4239458304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559025aa7540 con 0x559025a1b280 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f0259cbc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 0x7f02400b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f0258cba640 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02440096c0 tx=0x7f0244009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b6dc0c8578c6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f024a7fc640 1 -- 172.21.15.38:0/3191808964 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f024c0e75d0 con 0x7f0254110200 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f023f7fe640 1 -- 172.21.15.38:0/4239458304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244035040 con 0x559025a1b280 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f023f7fe640 1 -- 172.21.15.38:0/4239458304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02440054f0 con 0x559025a1b280 2024-09-21T06:19:04.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.033+0000 7f023f7fe640 1 -- 172.21.15.38:0/4239458304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244004a90 con 0x559025a1b280 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- 172.21.15.38:0/4239458304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 msgr2=0x559025de2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0259cbc640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 0x7f02400b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f024c0ad260 tx=0x7f024c07a840 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f02440096c0 tx=0x7f0244009560 comp rx=0 tx=0).stop 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- 172.21.15.38:0/4239458304 shutdown_connections 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025de2980 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a130a0 0x559025de2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 --2- 172.21.15.38:0/4239458304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a3bf60 0x559025de1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- 172.21.15.38:0/4239458304 >> 172.21.15.38:0/4239458304 conn(0x559025a30350 msgr2=0x559025ddfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- 172.21.15.38:0/4239458304 shutdown_connections 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- 172.21.15.38:0/4239458304 wait complete. 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.034+0000 7f0261c93740 1 -- start start 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 Processor -- start 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a130a0 0x559025ded9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559025baa5f0 con 0x559025a1b280 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559025ce4010 con 0x559025a3bf60 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559025df0680 con 0x559025a130a0 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0261c93740 10 client.0 _ll_register_callbacks cb 0x559025d43340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f02594bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f02594bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35258/0 (socket says 172.21.15.38:35258) 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f02594bb640 1 -- 172.21.15.38:0/986797002 learned_addr learned my addr 172.21.15.38:0/986797002 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.035+0000 7f0258cba640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a130a0 0x559025ded9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f0258cba640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 -- 172.21.15.38:0/986797002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a130a0 msgr2=0x559025ded9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a130a0 0x559025ded9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 -- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 msgr2=0x559025df99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 -- 172.21.15.38:0/986797002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559025d11a00 con 0x559025a1b280 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f0258cba640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f02594bb640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0250011540 tx=0x7f0250011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd809252324aad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f023cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025000f6d0 con 0x559025a1b280 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f025000f870 con 0x559025a1b280 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02440054f0 con 0x559025a1b280 2024-09-21T06:19:04.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f025000fab0 con 0x559025a1b280 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f0261c93740 10 client.15249 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559025dfc650 con 0x559025a1b280 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.036+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02440054f0 con 0x559025a1b280 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0250014440 con 0x559025a1b280 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 10 client.15249 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 20 client.15249 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259fa8e0 0x559025e000e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 4 client.15249 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559025d5bb60 con 0x5590259fa8e0 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0258cba640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259fa8e0 0x559025e000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f0258cba640 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259fa8e0 0x559025e000e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f972271f85083f9c server_cookie=54208c12f9179362 in_seq=0 out_seq=0 2024-09-21T06:19:04.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.037+0000 7f023cff9640 10 client.15249 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.038+0000 7f023cff9640 1 -- 172.21.15.38:0/986797002 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559025d5bb60 con 0x5590259fa8e0 2024-09-21T06:19:04.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.038+0000 7f023cff9640 10 client.15249 handle_command_reply: tid=0 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.038+0000 7f0261c93740 1 client.15249 shutdown 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 msgr2=0x559025dedf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0250011540 tx=0x7f0250011a00 comp rx=0 tx=0).stop 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 shutdown_connections 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259fa8e0 0x559025e000e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a1b280 0x559025dedf30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 --2- 172.21.15.38:0/986797002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a130a0 0x559025ded9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 >> 172.21.15.38:0/986797002 conn(0x559025a30350 msgr2=0x559025de5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f023cff9640 0 client.15249 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 shutdown_connections 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 1 -- 172.21.15.38:0/986797002 wait complete. 2024-09-21T06:19:04.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.039+0000 7f0261c93740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 Processor -- start 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 -- start start 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025de8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559025dfe420 con 0x559025a130a0 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559025dfeaf0 con 0x559025a3bf60 2024-09-21T06:19:04.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.057+0000 7f0261c93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559025dff1c0 con 0x559025a1b280 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35260/0 (socket says 172.21.15.38:35260) 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 -- 172.21.15.38:0/2273816549 learned_addr learned my addr 172.21.15.38:0/2273816549 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f02594bb640 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025de8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 -- 172.21.15.38:0/2273816549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 msgr2=0x559025de8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025de8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 -- 172.21.15.38:0/2273816549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 msgr2=0x559025df9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 -- 172.21.15.38:0/2273816549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559025df0070 con 0x559025a130a0 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f02594bb640 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025de8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f0258cba640 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02440057c0 tx=0x7f024402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84006b2a5ef7cb15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f023effd640 1 -- 172.21.15.38:0/2273816549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244035040 con 0x559025a130a0 2024-09-21T06:19:04.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f023effd640 1 -- 172.21.15.38:0/2273816549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0244031c70 con 0x559025a130a0 2024-09-21T06:19:04.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.058+0000 7f023effd640 1 -- 172.21.15.38:0/2273816549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244003ca0 con 0x559025a130a0 2024-09-21T06:19:04.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 -- 172.21.15.38:0/2273816549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 msgr2=0x559025de8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02440057c0 tx=0x7f024402a480 comp rx=0 tx=0).stop 2024-09-21T06:19:04.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 -- 172.21.15.38:0/2273816549 shutdown_connections 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025df9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025de8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 --2- 172.21.15.38:0/2273816549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025de8a10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 -- 172.21.15.38:0/2273816549 >> 172.21.15.38:0/2273816549 conn(0x559025a30350 msgr2=0x559025ded9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 -- 172.21.15.38:0/2273816549 shutdown_connections 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.059+0000 7f0261c93740 1 -- 172.21.15.38:0/2273816549 wait complete. 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 -- start start 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 Processor -- start 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025e01d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025e06cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559025dfff60 con 0x559025a130a0 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559025dff890 con 0x559025a3bf60 2024-09-21T06:19:04.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559025e00630 con 0x559025a1b280 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0261c93740 10 client.0 _ll_register_callbacks cb 0x7f0250009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0258cba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35266/0 (socket says 172.21.15.38:35266) 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.060+0000 7f0258cba640 1 -- 172.21.15.38:0/4005336047 learned_addr learned my addr 172.21.15.38:0/4005336047 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025e06cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f02594bb640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025e01d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 -- 172.21.15.38:0/4005336047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 msgr2=0x559025e01d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025e01d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 -- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 msgr2=0x559025e06cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025e06cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 -- 172.21.15.38:0/4005336047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559025e07360 con 0x559025a130a0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f02594bb640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025e01d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0258cba640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0244033000 tx=0x7f0244032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7eebb4834e4314 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:04.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f023cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244035040 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f024403d480 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244031c70 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f024403d680 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0261c93740 10 client.15255 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.061+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559025e08720 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0244031c70 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f024403a040 con 0x559025a130a0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 10 client.15255 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 20 client.15255 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259cfc90 0x559025e6da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 4 client.15255 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "status"}) -- 0x559025d57610 con 0x5590259cfc90 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f02594bb640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259cfc90 0x559025e6da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f023cff9640 10 client.15255 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:04.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.062+0000 7f02594bb640 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259cfc90 0x559025e6da40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8325ee6a51fac30 server_cookie=3048fafe4d897de5 in_seq=0 out_seq=0 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f023cff9640 1 -- 172.21.15.38:0/4005336047 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559025d57610 con 0x5590259cfc90 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f023cff9640 10 client.15255 handle_command_reply: tid=0 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 client.15255 shutdown 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 msgr2=0x559025e017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0244033000 tx=0x7f0244032e40 comp rx=0 tx=0).stop 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 shutdown_connections 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5590259cfc90 0x559025e6da40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559025a3bf60 0x559025e06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559025a1b280 0x559025e01d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 --2- 172.21.15.38:0/4005336047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559025a130a0 0x559025e017b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 >> 172.21.15.38:0/4005336047 conn(0x559025a30350 msgr2=0x559025ded9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f023cff9640 0 client.15255 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 shutdown_connections 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 1 -- 172.21.15.38:0/4005336047 wait complete. 2024-09-21T06:19:04.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.063+0000 7f0261c93740 20 client.15255 trim_cache size 0 max 16384 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 1, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24695, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 68.762578017999999, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 96.675918901000003 2024-09-21T06:19:04.070 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 msgr2=0x7f02400b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 0x7f02400b8b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f024c0ad260 tx=0x7f024c07a840 comp rx=0 tx=0).stop 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 msgr2=0x7f02541a1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f024c00cad0 tx=0x7f024c00ced0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 shutdown_connections 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02400b65f0 0x7f02400b8b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0254110200 0x7f02541a1ff0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0254102fa0 0x7f025419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 --2- 172.21.15.38:0/3191808964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0254102650 0x7f025419c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:04.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 >> 172.21.15.38:0/3191808964 conn(0x7f0254079760 msgr2=0x7f0254109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:04.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 shutdown_connections 2024-09-21T06:19:04.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:04.064+0000 7f025b71f640 1 -- 172.21.15.38:0/3191808964 wait complete. 2024-09-21T06:19:04.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:19:04.972 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:05.376 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:05 smithi038 ceph-mon[31215]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 -- 172.21.15.38:0/1333251417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 msgr2=0x7f2fa4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 --2- 172.21.15.38:0/1333251417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa4110330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009ca0 tx=0x7f2f9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 -- 172.21.15.38:0/1333251417 shutdown_connections 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 --2- 172.21.15.38:0/1333251417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa4110330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 --2- 172.21.15.38:0/1333251417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 0x7f2fa410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 --2- 172.21.15.38:0/1333251417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 -- 172.21.15.38:0/1333251417 >> 172.21.15.38:0/1333251417 conn(0x7f2fa4079760 msgr2=0x7f2fa4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 -- 172.21.15.38:0/1333251417 shutdown_connections 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.468+0000 7f2fac290640 1 -- 172.21.15.38:0/1333251417 wait complete. 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 Processor -- start 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 -- start start 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 0x7f2fa419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4113c00 con 0x7f2fa410de60 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4113a80 con 0x7f2fa4104a30 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fac290640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4113d80 con 0x7f2fa4105380 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2faa82d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2faa82d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35298/0 (socket says 172.21.15.38:35298) 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2faa82d640 1 -- 172.21.15.38:0/4146350893 learned_addr learned my addr 172.21.15.38:0/4146350893 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.469+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 0x7f2fa419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 -- 172.21.15.38:0/4146350893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 msgr2=0x7f2fa419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 0x7f2fa419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 -- 172.21.15.38:0/4146350893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 msgr2=0x7f2fa419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 -- 172.21.15.38:0/4146350893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa41a0500 con 0x7f2fa410de60 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2faa82d640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c005cc0 tx=0x7f2f9c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2f9b7fe640 1 -- 172.21.15.38:0/4146350893 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0317d0 con 0x7f2fa410de60 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2f9b7fe640 1 -- 172.21.15.38:0/4146350893 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2f9c004510 con 0x7f2fa410de60 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa41a0790 con 0x7f2fa410de60 2024-09-21T06:19:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2f9b7fe640 1 -- 172.21.15.38:0/4146350893 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c02fda0 con 0x7f2fa410de60 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.470+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa41a6f50 con 0x7f2fa410de60 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.472+0000 7f2fb2804740 1 Processor -- start 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2f9b7fe640 1 -- 172.21.15.38:0/4146350893 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2f9c004040 con 0x7f2fa410de60 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 -- start start 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c14d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c14d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c0c4c10 con 0x55ea6bda6f60 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c0b4040 con 0x55ea6bd7e0a0 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fb2804740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c0b7e50 con 0x55ea6bd86280 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35304/0 (socket says 172.21.15.38:35304) 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2fa982b640 1 -- 172.21.15.38:0/303205172 learned_addr learned my addr 172.21.15.38:0/303205172 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.473+0000 7f2faa02c640 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2f9b7fe640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 0x7f2f900b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 -- 172.21.15.38:0/303205172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 msgr2=0x55ea6c14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 -- 172.21.15.38:0/303205172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 msgr2=0x55ea6c14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 -- 172.21.15.38:0/303205172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6be12540 con 0x55ea6bda6f60 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2faa82d640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 0x7f2f900b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2fa982b640 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f94005940 tx=0x7f2f94010370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3729611e1ea9288d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2f9b7fe640 1 -- 172.21.15.38:0/4146350893 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2f9c108c40 con 0x7f2fa410de60 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2f98d9a640 1 -- 172.21.15.38:0/303205172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94016030 con 0x55ea6bda6f60 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2f98d9a640 1 -- 172.21.15.38:0/303205172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2f94010d50 con 0x55ea6bda6f60 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.474+0000 7f2f98d9a640 1 -- 172.21.15.38:0/303205172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012480 con 0x55ea6bda6f60 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 -- 172.21.15.38:0/303205172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 msgr2=0x55ea6c14cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2f94005940 tx=0x7f2f94010370 comp rx=0 tx=0).stop 2024-09-21T06:19:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2faa82d640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 0x7f2f900b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c049000 tx=0x7f2f9c0ff670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 -- 172.21.15.38:0/303205172 shutdown_connections 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 --2- 172.21.15.38:0/303205172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c14cf00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 -- 172.21.15.38:0/303205172 >> 172.21.15.38:0/303205172 conn(0x55ea6bd9b350 msgr2=0x55ea6c14adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 -- 172.21.15.38:0/303205172 shutdown_connections 2024-09-21T06:19:05.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.475+0000 7f2fb2804740 1 -- 172.21.15.38:0/303205172 wait complete. 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 -- start start 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 Processor -- start 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ea6bf155f0 con 0x55ea6bda6f60 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c04f010 con 0x55ea6bd7e0a0 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c15b6e0 con 0x55ea6bd86280 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.476+0000 7f2fb2804740 10 client.0 _ll_register_callbacks cb 0x55ea6c0ae340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:05.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35316/0 (socket says 172.21.15.38:35316) 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 -- 172.21.15.38:0/4133165454 learned_addr learned my addr 172.21.15.38:0/4133165454 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 -- 172.21.15.38:0/4133165454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 msgr2=0x55ea6c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 -- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 msgr2=0x55ea6c158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 -- 172.21.15.38:0/4133165454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6c07ca00 con 0x55ea6bda6f60 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f94005c30 tx=0x7f2f94004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa5f5541285973b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94016030 con 0x55ea6bda6f60 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2f940052b0 con 0x55ea6bda6f60 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f94010d50 con 0x55ea6bda6f60 2024-09-21T06:19:05.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2f9402f050 con 0x55ea6bda6f60 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fb2804740 10 client.15267 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.477+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ea6c167660 con 0x55ea6bda6f60 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2f94010d50 con 0x55ea6bda6f60 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2f9401b460 con 0x55ea6bda6f60 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 10 client.15267 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 20 client.15267 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 4 client.15267 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea6c0c6b60 con 0x55ea6bd658e0 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.478+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.479+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bd658e0 0x55ea6c16acf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e5bf195135ad1f server_cookie=4ceb1d4e8bf6f9b0 in_seq=0 out_seq=0 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.479+0000 7f2f8dffb640 10 client.15267 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4133165454 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea6c0c6b60 con 0x55ea6bd658e0 2024-09-21T06:19:05.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2f8dffb640 10 client.15267 handle_command_reply: tid=0 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 client.15267 shutdown 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 msgr2=0x55ea6c164a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f94005c30 tx=0x7f2f94004c40 comp rx=0 tx=0).stop 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 shutdown_connections 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bda6f60 0x55ea6c164a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bd658e0 0x55ea6c16acf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd86280 0x55ea6c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4133165454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2f8dffb640 0 client.15267 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 >> 172.21.15.38:0/4133165454 conn(0x55ea6bd9b350 msgr2=0x55ea6c1500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 shutdown_connections 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 1 -- 172.21.15.38:0/4133165454 wait complete. 2024-09-21T06:19:05.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.480+0000 7f2fb2804740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.498+0000 7f2fb2804740 1 Processor -- start 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.498+0000 7f2fb2804740 1 -- start start 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c1649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c169030 con 0x55ea6bd86280 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c169700 con 0x55ea6bd658e0 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fb2804740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c169dd0 con 0x55ea6bd7e0a0 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35326/0 (socket says 172.21.15.38:35326) 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 -- 172.21.15.38:0/1211020225 learned_addr learned my addr 172.21.15.38:0/1211020225 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2faa02c640 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c1649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 -- 172.21.15.38:0/1211020225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 msgr2=0x55ea6c1649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c1649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 -- 172.21.15.38:0/1211020225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 msgr2=0x55ea6c16acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 -- 172.21.15.38:0/1211020225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6c14fd60 con 0x55ea6bd86280 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2fa982b640 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c610 tx=0x7f2f9400c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f99770e8a4b3488 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2f8ffff640 1 -- 172.21.15.38:0/1211020225 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94016070 con 0x55ea6bd86280 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2f8ffff640 1 -- 172.21.15.38:0/1211020225 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2f94020040 con 0x55ea6bd86280 2024-09-21T06:19:05.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.499+0000 7f2f8ffff640 1 -- 172.21.15.38:0/1211020225 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012480 con 0x55ea6bd86280 2024-09-21T06:19:05.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 -- 172.21.15.38:0/1211020225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 msgr2=0x55ea6c164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c610 tx=0x7f2f9400c5a0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 -- 172.21.15.38:0/1211020225 shutdown_connections 2024-09-21T06:19:05.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c164ee0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c1649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 --2- 172.21.15.38:0/1211020225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c16acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 -- 172.21.15.38:0/1211020225 >> 172.21.15.38:0/1211020225 conn(0x55ea6bd9b350 msgr2=0x55ea6c153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 -- 172.21.15.38:0/1211020225 shutdown_connections 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.500+0000 7f2fb2804740 1 -- 172.21.15.38:0/1211020225 wait complete. 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 -- start start 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 Processor -- start 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c173330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c173910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c16ab70 con 0x55ea6bd86280 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c16a4a0 con 0x55ea6bd658e0 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ea6c16b240 con 0x55ea6bd7e0a0 2024-09-21T06:19:05.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fb2804740 10 client.0 _ll_register_callbacks cb 0x7f2fa000c370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fa982b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35332/0 (socket says 172.21.15.38:35332) 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2fa982b640 1 -- 172.21.15.38:0/4260968534 learned_addr learned my addr 172.21.15.38:0/4260968534 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.501+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c173910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c173330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 -- 172.21.15.38:0/4260968534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 msgr2=0x55ea6c173910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c173910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 -- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 msgr2=0x55ea6c173330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c173330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 -- 172.21.15.38:0/4260968534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea6c16d060 con 0x55ea6bd86280 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fa982b640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c3f0 tx=0x7f2f9400c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5009d59f2b2975a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94016070 con 0x55ea6bd86280 2024-09-21T06:19:05.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2f9401bca0 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f94020040 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2f940052b0 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fb2804740 10 client.15273 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.502+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ea6c172a70 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2f94020040 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2f9402a400 con 0x55ea6bd86280 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 10 client.15273 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 20 client.15273 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bda6f60 0x55ea6c1d9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 4 client.15273 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "status"}) -- 0x55ea6c0c2610 con 0x55ea6bda6f60 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.503+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bda6f60 0x55ea6c1d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2f8dffb640 10 client.15273 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:05.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2faa02c640 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bda6f60 0x55ea6c1d9290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74c2dfe779256de server_cookie=9a8253b55a83f9c in_seq=0 out_seq=0 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2f8dffb640 1 -- 172.21.15.38:0/4260968534 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ea6c0c2610 con 0x55ea6bda6f60 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2f8dffb640 10 client.15273 handle_command_reply: tid=0 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 client.15273 shutdown 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 msgr2=0x55ea6c16c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c3f0 tx=0x7f2f9400c640 comp rx=0 tx=0).stop 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 shutdown_connections 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ea6bd86280 0x55ea6c16c8d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ea6bda6f60 0x55ea6c1d9290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ea6bd7e0a0 0x55ea6c173910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 --2- 172.21.15.38:0/4260968534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea6bd658e0 0x55ea6c173330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2f8dffb640 0 client.15273 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 >> 172.21.15.38:0/4260968534 conn(0x55ea6bd9b350 msgr2=0x55ea6c14a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 shutdown_connections 2024-09-21T06:19:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 1 -- 172.21.15.38:0/4260968534 wait complete. 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.504+0000 7f2fb2804740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24728, 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 77.255206912000006, 2024-09-21T06:19:05.511 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 87.347273178999998 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 msgr2=0x7f2f900b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 0x7f2f900b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c049000 tx=0x7f2f9c0ff670 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 msgr2=0x7f2fa419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c005cc0 tx=0x7f2f9c003f90 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 shutdown_connections 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2f900b6670 0x7f2f900b8b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2fa410de60 0x7f2fa419fdd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2fa4105380 0x7f2fa419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 --2- 172.21.15.38:0/4146350893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fa4104a30 0x7f2fa419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 >> 172.21.15.38:0/4146350893 conn(0x7f2fa4079760 msgr2=0x7f2fa4107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 shutdown_connections 2024-09-21T06:19:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:05.505+0000 7f2fac290640 1 -- 172.21.15.38:0/4146350893 wait complete. 2024-09-21T06:19:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:05 smithi174 ceph-mon[34815]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:19:05.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:05 smithi044 ceph-mon[34369]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:19:06.102 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T06:19:06.102 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:19:06.110 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:19:06.110 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T06:19:06.369 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 -- 172.21.15.38:0/3389046363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a81094a0 msgr2=0x7f71a81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3389046363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a81094a0 0x7f71a81098b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7190009900 tx=0x7f719002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 -- 172.21.15.38:0/3389046363 shutdown_connections 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3389046363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 0x7f71a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3389046363 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a81094a0 0x7f71a81098b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3389046363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a8103b60 0x7f71a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 -- 172.21.15.38:0/3389046363 >> 172.21.15.38:0/3389046363 conn(0x7f71a807b850 msgr2=0x7f71a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 -- 172.21.15.38:0/3389046363 shutdown_connections 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.860+0000 7f71acfa0640 1 -- 172.21.15.38:0/3389046363 wait complete. 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.861+0000 7f71acfa0640 1 Processor -- start 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.861+0000 7f71acfa0640 1 -- start start 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:06.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a81094a0 0x7f71a819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 0x7f71a819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8113bd0 con 0x7f71a8103b60 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8113a50 con 0x7f71a81094a0 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71acfa0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f71a8113d50 con 0x7f71a8109df0 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35350/0 (socket says 172.21.15.38:35350) 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 -- 172.21.15.38:0/3681733376 learned_addr learned my addr 172.21.15.38:0/3681733376 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a6d9d640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 0x7f71a819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f719dd9b640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a81094a0 0x7f71a819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 -- 172.21.15.38:0/3681733376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 msgr2=0x7f71a819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 0x7f71a819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 -- 172.21.15.38:0/3681733376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a81094a0 msgr2=0x7f71a819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a81094a0 0x7f71a819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:06.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 -- 172.21.15.38:0/3681733376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a81a04b0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.862+0000 7f71a659c640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f719800d950 tx=0x7f719800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.863+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198017030 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.863+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a81a07a0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.863+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7198004020 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.863+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71980047a0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.863+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a81a6fc0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.864+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a8104de0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.865+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f71980041d0 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.866+0000 7f719ffff640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 0x7f71940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.866+0000 7f719dd9b640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 0x7f71940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.866+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f71980e7600 con 0x7f71a8103b60 2024-09-21T06:19:06.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.867+0000 7f719dd9b640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 0x7f71940b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7190005940 tx=0x7f71900058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:06.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:06.869+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71980adc90 con 0x7f71a8103b60 2024-09-21T06:19:07.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.074+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f71a810bc20 con 0x7f71940b6620 2024-09-21T06:19:07.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.076+0000 7f719ffff640 1 -- 172.21.15.38:0/3681733376 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f71a810bc20 con 0x7f71940b6620 2024-09-21T06:19:07.077 INFO:teuthology.orchestra.run.smithi038.stdout:Backend: cephadm 2024-09-21T06:19:07.077 INFO:teuthology.orchestra.run.smithi038.stdout:Available: Yes 2024-09-21T06:19:07.077 INFO:teuthology.orchestra.run.smithi038.stdout:Paused: No 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 msgr2=0x7f71940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 0x7f71940b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7190005940 tx=0x7f71900058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 msgr2=0x7f71a819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f719800d950 tx=0x7f719800de10 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 shutdown_connections 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71940b6620 0x7f71940b8b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71a8109df0 0x7f71a819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71a81094a0 0x7f71a819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 --2- 172.21.15.38:0/3681733376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71a8103b60 0x7f71a819a600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 >> 172.21.15.38:0/3681733376 conn(0x7f71a807b850 msgr2=0x7f71a81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 shutdown_connections 2024-09-21T06:19:07.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:07.078+0000 7f71acfa0640 1 -- 172.21.15.38:0/3681733376 wait complete. 2024-09-21T06:19:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:07 smithi174 ceph-mon[34815]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:07.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:07 smithi044 ceph-mon[34369]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:07.689 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:07 smithi038 ceph-mon[31215]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:07.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T06:19:07.974 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 -- 172.21.15.38:0/3243517229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988102ac0 msgr2=0x7f9988102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 --2- 172.21.15.38:0/3243517229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988102ac0 0x7f9988102ed0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9978009900 tx=0x7f997802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 -- 172.21.15.38:0/3243517229 shutdown_connections 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 --2- 172.21.15.38:0/3243517229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9988108d00 0x7f998810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 --2- 172.21.15.38:0/3243517229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99881083b0 0x7f99881087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 --2- 172.21.15.38:0/3243517229 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988102ac0 0x7f9988102ed0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 -- 172.21.15.38:0/3243517229 >> 172.21.15.38:0/3243517229 conn(0x7f9988079790 msgr2=0x7f9988079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 -- 172.21.15.38:0/3243517229 shutdown_connections 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 -- 172.21.15.38:0/3243517229 wait complete. 2024-09-21T06:19:08.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.443+0000 7f998f49a640 1 Processor -- start 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 -- start start 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9988102ac0 0x7f998819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99881083b0 0x7f998819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9988112ae0 con 0x7f9988108d00 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9988112960 con 0x7f99881083b0 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998f49a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9988112c60 con 0x7f9988102ac0 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35364/0 (socket says 172.21.15.38:35364) 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 -- 172.21.15.38:0/3429253085 learned_addr learned my addr 172.21.15.38:0/3429253085 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998d236640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9988102ac0 0x7f998819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998ca35640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99881083b0 0x7f998819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:08.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 -- 172.21.15.38:0/3429253085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9988102ac0 msgr2=0x7f998819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9988102ac0 0x7f998819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 -- 172.21.15.38:0/3429253085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99881083b0 msgr2=0x7f998819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99881083b0 0x7f998819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.444+0000 7f998da37640 1 -- 172.21.15.38:0/3429253085 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99881a6590 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f998da37640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f998000cce0 tx=0x7f998000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998000f450 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99881a6880 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f998000fac0 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980018be0 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.445+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99881a6d70 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.446+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9988102ed0 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.448+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f998000fc70 con 0x7f9988108d00 2024-09-21T06:19:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.448+0000 7f99867fc640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 0x7f99700b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.448+0000 7f998d236640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 0x7f99700b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.448+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f99800e7c20 con 0x7f9988108d00 2024-09-21T06:19:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.449+0000 7f998d236640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 0x7f99700b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f998806c380 tx=0x7f99780058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:08.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.452+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9980014030 con 0x7f9988108d00 2024-09-21T06:19:08.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:08 smithi174 ceph-mon[34815]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:08.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.650+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9988063800 con 0x7f99700b6620 2024-09-21T06:19:08.653 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:08 smithi038 ceph-mon[31215]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:08.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:08 smithi044 ceph-mon[34369]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.662+0000 7f99867fc640 1 -- 172.21.15.38:0/3429253085 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f9988063800 con 0x7f99700b6620 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.a smithi038 running (93s) 16s ago 93s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 c8bace7c244a 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.b smithi044 running (90s) 23s ago 90s 94.0M - 19.3.0-5120-g18432218 ddce307e1f32 fa6591e16fae 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.c smithi174 running (104s) 23s ago 103s 84.1M - 19.3.0-5120-g18432218 ddce307e1f32 20326aefb5b0 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.d smithi038 running (111s) 16s ago 111s 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 665bac20b9f6 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.e smithi044 running (109s) 23s ago 108s 85.3M - 19.3.0-5120-g18432218 ddce307e1f32 f38fd373386f 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.f smithi174 running (106s) 23s ago 106s 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 102c438a10fb 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.g smithi038 running (96s) 16s ago 95s 81.7M - 19.3.0-5120-g18432218 ddce307e1f32 fb2658f3d42e 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.h smithi044 running (101s) 23s ago 101s 85.5M - 19.3.0-5120-g18432218 ddce307e1f32 ed38a2f2137b 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.i smithi174 running (99s) 23s ago 98s 86.2M - 19.3.0-5120-g18432218 ddce307e1f32 f1dea45fc8d0 2024-09-21T06:19:08.664 INFO:teuthology.orchestra.run.smithi038.stdout:mds.j smithi038 running (115s) 16s ago 114s 81.8M - 19.3.0-5120-g18432218 ddce307e1f32 690447dad426 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mds.k smithi044 running (118s) 23s ago 117s 84.8M - 19.3.0-5120-g18432218 ddce307e1f32 524e4169c53f 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mds.l smithi174 running (2m) 23s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 bb12fcb61185 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.x smithi038 *:9283,8765 running (9m) 16s ago 9m 584M - 19.3.0-5120-g18432218 ddce307e1f32 18d9ddb492f3 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.y smithi044 *:8443,8765 running (7m) 23s ago 7m 527M - 19.3.0-5120-g18432218 ddce307e1f32 1ea7776556a6 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.z smithi174 *:8443,8765 running (7m) 23s ago 7m 523M - 19.3.0-5120-g18432218 ddce307e1f32 454d8e4f5b76 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mon.a smithi038 running (9m) 16s ago 9m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 9fe2f7dd28b7 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mon.b smithi044 running (8m) 23s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 ed8d4f326caf 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:mon.c smithi174 running (8m) 23s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 20c40e55f060 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (6m) 16s ago 6m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 b4dc8f65d3a2 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi044 running (6m) 23s ago 6m 115M 4273M 19.3.0-5120-g18432218 ddce307e1f32 0dda17349397 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi174 running (6m) 23s ago 6m 125M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dc21f0ae1743 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi038 running (5m) 16s ago 5m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 399bde10c527 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi044 running (5m) 23s ago 5m 115M 4273M 19.3.0-5120-g18432218 ddce307e1f32 fd2b723e2d11 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi174 running (4m) 23s ago 4m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0b0b5299501e 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.6 smithi038 running (4m) 16s ago 4m 118M 4273M 19.3.0-5120-g18432218 ddce307e1f32 b85aff6de953 2024-09-21T06:19:08.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.7 smithi044 running (3m) 23s ago 3m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 5b418cbeecc5 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stdout:osd.8 smithi174 running (3m) 23s ago 3m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0f96fe70a1ff 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stdout:osd.9 smithi038 running (3m) 16s ago 3m 118M 4273M 19.3.0-5120-g18432218 ddce307e1f32 fa5d79876fde 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stdout:osd.10 smithi044 running (2m) 23s ago 2m 123M 4273M 19.3.0-5120-g18432218 ddce307e1f32 d3bae9fb5c21 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stdout:osd.11 smithi174 running (2m) 23s ago 2m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 c27895ff8e35 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 msgr2=0x7f99700b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 0x7f99700b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f998806c380 tx=0x7f99780058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 msgr2=0x7f998819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f998000cce0 tx=0x7f998000a620 comp rx=0 tx=0).stop 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 shutdown_connections 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f99700b6620 0x7f99700b8b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9988108d00 0x7f998819be10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99881083b0 0x7f998819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 --2- 172.21.15.38:0/3429253085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9988102ac0 0x7f998819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 >> 172.21.15.38:0/3429253085 conn(0x7f9988079790 msgr2=0x7f99881063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.664+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 shutdown_connections 2024-09-21T06:19:08.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:08.665+0000 7f998f49a640 1 -- 172.21.15.38:0/3429253085 wait complete. 2024-09-21T06:19:09.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T06:19:09.582 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:09.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:09 smithi174 ceph-mon[34815]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:19:09.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:09 smithi044 ceph-mon[34369]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:19:09.699 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:09 smithi038 ceph-mon[31215]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 -- 172.21.15.38:0/727228712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 msgr2=0x7ff92410d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 --2- 172.21.15.38:0/727228712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff92410d900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009900 tx=0x7ff90c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 -- 172.21.15.38:0/727228712 shutdown_connections 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 --2- 172.21.15.38:0/727228712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92410de40 0x7ff924110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 --2- 172.21.15.38:0/727228712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff92410d900 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 --2- 172.21.15.38:0/727228712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff924104890 0x7ff924104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 -- 172.21.15.38:0/727228712 >> 172.21.15.38:0/727228712 conn(0x7ff924079710 msgr2=0x7ff924079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 -- 172.21.15.38:0/727228712 shutdown_connections 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.043+0000 7ff92af5d640 1 -- 172.21.15.38:0/727228712 wait complete. 2024-09-21T06:19:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.044+0000 7ff92af5d640 1 Processor -- start 2024-09-21T06:19:10.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.044+0000 7ff92af5d640 1 -- start start 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff924104890 0x7ff9241027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff92410de40 0x7ff924103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff924113b80 con 0x7ff9241052c0 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff924113a00 con 0x7ff924104890 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff924113d00 con 0x7ff92410de40 2024-09-21T06:19:10.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48340/0 (socket says 172.21.15.38:48340) 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 -- 172.21.15.38:0/896294908 learned_addr learned my addr 172.21.15.38:0/896294908 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff9294fa640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff92410de40 0x7ff924103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff928cf9640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff924104890 0x7ff9241027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 -- 172.21.15.38:0/896294908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff92410de40 msgr2=0x7ff924103220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff92410de40 0x7ff924103220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 -- 172.21.15.38:0/896294908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff924104890 msgr2=0x7ff9241027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff924104890 0x7ff9241027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 -- 172.21.15.38:0/896294908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9241a8850 con 0x7ff9241052c0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff923fff640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff90c005940 tx=0x7ff90c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c03f030 con 0x7ff9241052c0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9241a8ae0 con 0x7ff9241052c0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff90c031910 con 0x7ff9241052c0 2024-09-21T06:19:10.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.045+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c035070 con 0x7ff9241052c0 2024-09-21T06:19:10.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.046+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9241a9010 con 0x7ff9241052c0 2024-09-21T06:19:10.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.047+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92406c1e0 con 0x7ff9241052c0 2024-09-21T06:19:10.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.048+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff90c042030 con 0x7ff9241052c0 2024-09-21T06:19:10.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.049+0000 7ff921ffb640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 0x7ff9100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:10.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.049+0000 7ff928cf9640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 0x7ff9100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:10.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.049+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff90c107b50 con 0x7ff9241052c0 2024-09-21T06:19:10.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.050+0000 7ff928cf9640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 0x7ff9100b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff914005fd0 tx=0x7ff914005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:10.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.053+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff90c0ce180 con 0x7ff9241052c0 2024-09-21T06:19:10.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.251+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff9241080a0 con 0x7ff9100b65f0 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.257+0000 7ff921ffb640 1 -- 172.21.15.38:0/896294908 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ff9241080a0 con 0x7ff9100b65f0 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stdout:mds.all 12/12 25s ago 2m smithi038=a;smithi038=d;smithi038=g;smithi038=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stdout:mgr 3/3 25s ago 7m smithi038=x;smithi044=y;smithi174=z;count:3 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stdout:mon 3/3 25s ago 8m smithi038:172.21.15.38=a;smithi044:172.21.15.44=b;smithi174:172.21.15.174=c;count:3 2024-09-21T06:19:10.259 INFO:teuthology.orchestra.run.smithi038.stdout:osd 12 25s ago - 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 msgr2=0x7ff9100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 0x7ff9100b8b00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff914005fd0 tx=0x7ff914005850 comp rx=0 tx=0).stop 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 msgr2=0x7ff924102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff90c005940 tx=0x7ff90c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 shutdown_connections 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9100b65f0 0x7ff9100b8b00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff92410de40 0x7ff924103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9241052c0 0x7ff924102ce0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 --2- 172.21.15.38:0/896294908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff924104890 0x7ff9241027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 >> 172.21.15.38:0/896294908 conn(0x7ff924079710 msgr2=0x7ff924107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 shutdown_connections 2024-09-21T06:19:10.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:10.259+0000 7ff92af5d640 1 -- 172.21.15.38:0/896294908 wait complete. 2024-09-21T06:19:10.597 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:10 smithi038 ceph-mon[31215]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:10.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:10 smithi174 ceph-mon[34815]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:10.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:10 smithi044 ceph-mon[34369]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:10.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T06:19:11.149 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:11.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:11 smithi038 ceph-mon[31215]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:11.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:11 smithi038 ceph-mon[31215]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 -- 172.21.15.38:0/1343442024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c1083a0 msgr2=0x7f646c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 --2- 172.21.15.38:0/1343442024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c1083a0 0x7f646c1087b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6460009900 tx=0x7f646002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 -- 172.21.15.38:0/1343442024 shutdown_connections 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 --2- 172.21.15.38:0/1343442024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c108cf0 0x7f646c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 --2- 172.21.15.38:0/1343442024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c1083a0 0x7f646c1087b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 --2- 172.21.15.38:0/1343442024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 0x7f646c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 -- 172.21.15.38:0/1343442024 >> 172.21.15.38:0/1343442024 conn(0x7f646c079730 msgr2=0x7f646c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 -- 172.21.15.38:0/1343442024 shutdown_connections 2024-09-21T06:19:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.610+0000 7f6472209640 1 -- 172.21.15.38:0/1343442024 wait complete. 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 Processor -- start 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 -- start start 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 0x7f646c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c1083a0 0x7f646c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f646c113ba0 con 0x7f646c108cf0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f646c113a20 con 0x7f646c1083a0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f6472209640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f646c113d20 con 0x7f646c102a60 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f646bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f646bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48368/0 (socket says 172.21.15.38:48368) 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f646bfff640 1 -- 172.21.15.38:0/3472139505 learned_addr learned my addr 172.21.15.38:0/3472139505 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.611+0000 7f646b7fe640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 0x7f646c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646affd640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c1083a0 0x7f646c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 -- 172.21.15.38:0/3472139505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 msgr2=0x7f646c10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 0x7f646c10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 -- 172.21.15.38:0/3472139505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c1083a0 msgr2=0x7f646c1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c1083a0 0x7f646c1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 -- 172.21.15.38:0/3472139505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c1a8890 con 0x7f646c108cf0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f646bfff640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f646400cad0 tx=0x7f646400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646400ae20 con 0x7f646c108cf0 2024-09-21T06:19:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c1a8b80 con 0x7f646c108cf0 2024-09-21T06:19:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6464005020 con 0x7f646c108cf0 2024-09-21T06:19:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646400f6b0 con 0x7f646c108cf0 2024-09-21T06:19:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.612+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c1a9040 con 0x7f646c108cf0 2024-09-21T06:19:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.613+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646c103ce0 con 0x7f646c108cf0 2024-09-21T06:19:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.616+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f64640051d0 con 0x7f646c108cf0 2024-09-21T06:19:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.616+0000 7f6468ff9640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 0x7f64540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.617+0000 7f646b7fe640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 0x7f64540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.617+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f64640e7950 con 0x7f646c108cf0 2024-09-21T06:19:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.617+0000 7f646b7fe640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 0x7f64540b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f645c0058c0 tx=0x7f645c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.620+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6464014030 con 0x7f646c108cf0 2024-09-21T06:19:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:11 smithi174 ceph-mon[34815]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:11 smithi174 ceph-mon[34815]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:11 smithi044 ceph-mon[34369]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:11 smithi044 ceph-mon[34369]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:11.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.814+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f646c063800 con 0x7f64540b65f0 2024-09-21T06:19:11.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.816+0000 7f6468ff9640 1 -- 172.21.15.38:0/3472139505 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f646c063800 con 0x7f64540b65f0 2024-09-21T06:19:11.818 INFO:teuthology.orchestra.run.smithi038.stdout:HOST ADDR LABELS STATUS 2024-09-21T06:19:11.818 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 172.21.15.38 2024-09-21T06:19:11.819 INFO:teuthology.orchestra.run.smithi038.stdout:smithi044 172.21.15.44 2024-09-21T06:19:11.819 INFO:teuthology.orchestra.run.smithi038.stdout:smithi174 172.21.15.174 2024-09-21T06:19:11.819 INFO:teuthology.orchestra.run.smithi038.stdout:3 hosts in cluster 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 msgr2=0x7f64540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 0x7f64540b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f645c0058c0 tx=0x7f645c00a250 comp rx=0 tx=0).stop 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 msgr2=0x7f646c110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f646400cad0 tx=0x7f646400cf90 comp rx=0 tx=0).stop 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 shutdown_connections 2024-09-21T06:19:11.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64540b65f0 0x7f64540b8b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f646c108cf0 0x7f646c110a30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f646c1083a0 0x7f646c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 --2- 172.21.15.38:0/3472139505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f646c102a60 0x7f646c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.818+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 >> 172.21.15.38:0/3472139505 conn(0x7f646c079730 msgr2=0x7f646c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.819+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 shutdown_connections 2024-09-21T06:19:11.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:11.819+0000 7f6472209640 1 -- 172.21.15.38:0/3472139505 wait complete. 2024-09-21T06:19:12.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T06:19:12.705 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2614206165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 msgr2=0x7f0e0c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2614206165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c102e80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009900 tx=0x7f0dfc02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2614206165 shutdown_connections 2024-09-21T06:19:13.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2614206165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c108d00 0x7f0e0c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2614206165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c1083b0 0x7f0e0c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2614206165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c102e80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2614206165 >> 172.21.15.38:0/2614206165 conn(0x7f0e0c079710 msgr2=0x7f0e0c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2614206165 shutdown_connections 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.151+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2614206165 wait complete. 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 Processor -- start 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 -- start start 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c1083b0 0x7f0e0c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 0x7f0e0c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c112ae0 con 0x7f0e0c102a70 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c112960 con 0x7f0e0c1083b0 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e12d8b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c112c60 con 0x7f0e0c108d00 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e10b27640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:13.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e10b27640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48388/0 (socket says 172.21.15.38:48388) 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e10b27640 1 -- 172.21.15.38:0/2695064851 learned_addr learned my addr 172.21.15.38:0/2695064851 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.152+0000 7f0e0bfff640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c1083b0 0x7f0e0c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 -- 172.21.15.38:0/2695064851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 msgr2=0x7f0e0c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e11328640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 0x7f0e0c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 0x7f0e0c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 -- 172.21.15.38:0/2695064851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c1083b0 msgr2=0x7f0e0c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c1083b0 0x7f0e0c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 -- 172.21.15.38:0/2695064851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c1a6720 con 0x7f0e0c102a70 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e11328640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 0x7f0e0c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e10b27640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006010 tx=0x7f0dfc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc03f070 con 0x7f0e0c102a70 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0dfc031e10 con 0x7f0e0c102a70 2024-09-21T06:19:13.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0c1a69b0 con 0x7f0e0c102a70 2024-09-21T06:19:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc035030 con 0x7f0e0c102a70 2024-09-21T06:19:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.153+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0c1a6ee0 con 0x7f0e0c102a70 2024-09-21T06:19:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.155+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0c103cf0 con 0x7f0e0c102a70 2024-09-21T06:19:13.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.156+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f0dfc042070 con 0x7f0e0c102a70 2024-09-21T06:19:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.157+0000 7f0e09ffb640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 0x7f0df40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.157+0000 7f0e0bfff640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 0x7f0df40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.157+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0dfc107fb0 con 0x7f0e0c102a70 2024-09-21T06:19:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.158+0000 7f0e0bfff640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 0x7f0df40b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c107f40 tx=0x7f0e0000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:13.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.162+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dfc0ce5e0 con 0x7f0e0c102a70 2024-09-21T06:19:13.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.359+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0e0c063800 con 0x7f0df40b6670 2024-09-21T06:19:13.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.361+0000 7f0e09ffb640 1 -- 172.21.15.38:0/2695064851 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f0e0c063800 con 0x7f0df40b6670 2024-09-21T06:19:13.363 INFO:teuthology.orchestra.run.smithi038.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T06:19:13.363 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN 3726G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:19:13.363 INFO:teuthology.orchestra.run.smithi038.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:19:13.363 INFO:teuthology.orchestra.run.smithi038.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:19:13.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.363+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 msgr2=0x7f0df40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:13.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.363+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 0x7f0df40b8b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c107f40 tx=0x7f0e0000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 msgr2=0x7f0e0c19b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc006010 tx=0x7f0dfc004430 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 shutdown_connections 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0df40b6670 0x7f0df40b8b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e0c108d00 0x7f0e0c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e0c1083b0 0x7f0e0c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 --2- 172.21.15.38:0/2695064851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e0c102a70 0x7f0e0c19b410 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 >> 172.21.15.38:0/2695064851 conn(0x7f0e0c079710 msgr2=0x7f0e0c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 shutdown_connections 2024-09-21T06:19:13.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:13.364+0000 7f0e12d8b640 1 -- 172.21.15.38:0/2695064851 wait complete. 2024-09-21T06:19:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:13 smithi174 ceph-mon[34815]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:13 smithi174 ceph-mon[34815]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:13.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:13 smithi044 ceph-mon[34369]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:13 smithi044 ceph-mon[34369]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:13.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:13 smithi038 ceph-mon[31215]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:19:13.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:13 smithi038 ceph-mon[31215]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.024 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:19:14.033 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:19:14.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T06:19:14.296 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:14.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:14 smithi174 ceph-mon[34815]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:14 smithi044 ceph-mon[34369]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:14 smithi038 ceph-mon[31215]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 -- 172.21.15.38:0/4156392753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc1094a0 msgr2=0x7f86bc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 --2- 172.21.15.38:0/4156392753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc1094a0 0x7f86bc1098b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009900 tx=0x7f86b002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 -- 172.21.15.38:0/4156392753 shutdown_connections 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 --2- 172.21.15.38:0/4156392753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc109df0 0x7f86bc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 --2- 172.21.15.38:0/4156392753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc1094a0 0x7f86bc1098b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 --2- 172.21.15.38:0/4156392753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 0x7f86bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 -- 172.21.15.38:0/4156392753 >> 172.21.15.38:0/4156392753 conn(0x7f86bc07b850 msgr2=0x7f86bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 -- 172.21.15.38:0/4156392753 shutdown_connections 2024-09-21T06:19:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.785+0000 7f86c2050640 1 -- 172.21.15.38:0/4156392753 wait complete. 2024-09-21T06:19:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 Processor -- start 2024-09-21T06:19:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 -- start start 2024-09-21T06:19:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 0x7f86bc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc1094a0 0x7f86bc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:14.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113bd0 con 0x7f86bc109df0 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113a50 con 0x7f86bc1094a0 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.786+0000 7f86c2050640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113d50 con 0x7f86bc103b60 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48412/0 (socket says 172.21.15.38:48412) 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 -- 172.21.15.38:0/499080135 learned_addr learned my addr 172.21.15.38:0/499080135 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86baffd640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc1094a0 0x7f86bc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bb7fe640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 0x7f86bc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 -- 172.21.15.38:0/499080135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 msgr2=0x7f86bc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 0x7f86bc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 -- 172.21.15.38:0/499080135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc1094a0 msgr2=0x7f86bc19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc1094a0 0x7f86bc19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:14.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 -- 172.21.15.38:0/499080135 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc1a0510 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86bbfff640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86b400d750 tx=0x7f86b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4017070 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86b40054f0 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4004cd0 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.787+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc1a0800 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.788+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc1a6f60 con 0x7f86bc109df0 2024-09-21T06:19:14.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.789+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc103f70 con 0x7f86bc109df0 2024-09-21T06:19:14.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.790+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f86b4009bd0 con 0x7f86bc109df0 2024-09-21T06:19:14.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.791+0000 7f86b8ff9640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 0x7f86a40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:14.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.792+0000 7f86bb7fe640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 0x7f86a40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:14.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.792+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f86b40e71c0 con 0x7f86bc109df0 2024-09-21T06:19:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.792+0000 7f86bb7fe640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 0x7f86a40b8af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86ac005fd0 tx=0x7f86ac009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:14.795+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86b40b1e10 con 0x7f86bc109df0 2024-09-21T06:19:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.020+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f86bc19b6d0 con 0x7f86bc109df0 2024-09-21T06:19:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.021+0000 7f86b8ff9640 1 -- 172.21.15.38:0/499080135 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3086 (secure 0 0 0) 0x7f86bc19b6d0 con 0x7f86bc109df0 2024-09-21T06:19:15.023 INFO:teuthology.orchestra.run.smithi038.stdout:e23 2024-09-21T06:19:15.023 INFO:teuthology.orchestra.run.smithi038.stdout:btime 2024-09-21T06:17:59:313524+0000 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 23 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-21T06:17:47.782150+0000 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-21T06:17:58.639191+0000 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-21T06:19:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 300 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 3 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1,2 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=24728,1=24695,2=24667} 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-21T06:19:15.025 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 0 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:qdb_cluster leader: 24728 members: 24728,24695,24667 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b{0:24728} state up:active seq 4 addr [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.e{0:24665} state up:standby-replay seq 1 addr [v2:172.21.15.44:6834/3535582137,v1:172.21.15.44:6835/3535582137] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.h{1:24695} state up:active seq 8 addr [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c{1:24649} state up:standby-replay seq 1 addr [v2:172.21.15.174:6836/2784474374,v1:172.21.15.174:6837/2784474374] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.i{2:24667} state up:active seq 8 addr [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.k{2:24641} state up:standby-replay seq 1 addr [v2:172.21.15.44:6832/3742968843,v1:172.21.15.44:6833/3742968843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:15.026 INFO:teuthology.orchestra.run.smithi038.stdout:Standby daemons: 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.j{-1:14793} state up:standby seq 1 addr [v2:172.21.15.38:6834/1987897049,v1:172.21.15.38:6835/1987897049] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d{-1:14805} state up:standby seq 1 addr [v2:172.21.15.38:6836/2771020933,v1:172.21.15.38:6837/2771020933] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.g{-1:14859} state up:standby seq 1 addr [v2:172.21.15.38:6838/3257072539,v1:172.21.15.38:6839/3257072539] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a{-1:14871} state up:standby seq 1 addr [v2:172.21.15.38:6840/959334651,v1:172.21.15.38:6841/959334651] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.l{-1:24604} state up:standby seq 1 addr [v2:172.21.15.174:6832/2480120484,v1:172.21.15.174:6833/2480120484] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.027 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.f{-1:24637} state up:standby seq 1 addr [v2:172.21.15.174:6834/1766511458,v1:172.21.15.174:6835/1766511458] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 msgr2=0x7f86a40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 0x7f86a40b8af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86ac005fd0 tx=0x7f86ac009680 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 msgr2=0x7f86bc19fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86b400d750 tx=0x7f86b400dc10 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 shutdown_connections 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f86a40b65e0 0x7f86a40b8af0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86bc109df0 0x7f86bc19fde0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f86bc1094a0 0x7f86bc19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 --2- 172.21.15.38:0/499080135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f86bc103b60 0x7f86bc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 >> 172.21.15.38:0/499080135 conn(0x7f86bc07b850 msgr2=0x7f86bc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 shutdown_connections 2024-09-21T06:19:15.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:15.023+0000 7f86c2050640 1 -- 172.21.15.38:0/499080135 wait complete. 2024-09-21T06:19:15.615 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:15 smithi038 ceph-mon[31215]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:19:15.616 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:15 smithi038 ceph-mon[31215]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:19:15.616 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:15 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/499080135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:19:15.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T06:19:15.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:15 smithi174 ceph-mon[34815]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:19:15.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:15 smithi174 ceph-mon[34815]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:19:15.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:15 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/499080135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:19:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:15 smithi044 ceph-mon[34369]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:19:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:15 smithi044 ceph-mon[34369]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:19:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:15 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/499080135' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:19:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 -- 172.21.15.38:0/2699930242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 msgr2=0x7f7490110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 --2- 172.21.15.38:0/2699930242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f7490110320 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7488009ca0 tx=0x7f748802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 -- 172.21.15.38:0/2699930242 shutdown_connections 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 --2- 172.21.15.38:0/2699930242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f7490110320 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 --2- 172.21.15.38:0/2699930242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 0x7f749010d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 --2- 172.21.15.38:0/2699930242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f7490104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 -- 172.21.15.38:0/2699930242 >> 172.21.15.38:0/2699930242 conn(0x7f7490079740 msgr2=0x7f7490079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 -- 172.21.15.38:0/2699930242 shutdown_connections 2024-09-21T06:19:16.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.326+0000 7f7498293640 1 -- 172.21.15.38:0/2699930242 wait complete. 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 Processor -- start 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 -- start start 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f749019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 0x7f749019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7490113bb0 con 0x7f749010de50 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7490113a30 con 0x7f74901052d0 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.327+0000 7f7498293640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7490113d30 con 0x7f74901048a0 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48426/0 (socket says 172.21.15.38:48426) 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 -- 172.21.15.38:0/2456094382 learned_addr learned my addr 172.21.15.38:0/2456094382 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f749582e640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 0x7f749019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f749602f640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f749019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:16.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 -- 172.21.15.38:0/2456094382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 msgr2=0x7f749019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f749019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 -- 172.21.15.38:0/2456094382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 msgr2=0x7f749019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 0x7f749019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 -- 172.21.15.38:0/2456094382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74901a0430 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f749602f640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f749019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7496830640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7488005e30 tx=0x7f7488003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488031650 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.328+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74901a06c0 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.329+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74901a6f40 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.329+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f74880317f0 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.329+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748802fb70 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.330+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74740052c0 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.331+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f748802fd10 con 0x7f749010de50 2024-09-21T06:19:16.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.332+0000 7f74877fe640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 0x7f747c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.332+0000 7f749602f640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 0x7f747c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.332+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7488108660 con 0x7f749010de50 2024-09-21T06:19:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.333+0000 7f749602f640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 0x7f747c0b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f749006c8a0 tx=0x7f748c00a5e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:16.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.335+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74880cee50 con 0x7f749010de50 2024-09-21T06:19:16.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.527+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f7474005880 con 0x7f749010de50 2024-09-21T06:19:16.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.528+0000 7f74877fe640 1 -- 172.21.15.38:0/2456094382 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5633 (secure 0 0 0) 0x7f74880d3230 con 0x7f749010de50 2024-09-21T06:19:16.530 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 77 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:fsid d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-21T06:09:10.509247+0000 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-21T06:18:13.392235+0000 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:crush_version 26 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:full_ratio 0.95 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:backfillfull_ratio 0.9 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:nearfull_ratio 0.85 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:require_min_compat_client luminous 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:min_compat_client luminous 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:require_osd_release squid 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:stretch_mode_enabled false 2024-09-21T06:19:16.531 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:max_osd 12 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 up in weight 1 up_from 9 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6802/1319599999,v1:172.21.15.38:6803/1319599999] [v2:172.21.15.38:6804/1319599999,v1:172.21.15.38:6805/1319599999] exists,up 0b14f970-8964-441c-94f3-4ab77aa6be8d 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 up in weight 1 up_from 14 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/375751782,v1:172.21.15.44:6801/375751782] [v2:172.21.15.44:6802/375751782,v1:172.21.15.44:6803/375751782] exists,up 4a3c3919-c745-4fab-9d95-d9a0671f12e5 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 up in weight 1 up_from 19 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/1341151207,v1:172.21.15.174:6801/1341151207] [v2:172.21.15.174:6802/1341151207,v1:172.21.15.174:6803/1341151207] exists,up e6daee57-622c-4b39-95f3-2e013ae4c531 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 up in weight 1 up_from 26 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6810/2396097926,v1:172.21.15.38:6811/2396097926] [v2:172.21.15.38:6812/2396097926,v1:172.21.15.38:6813/2396097926] exists,up 1ac42b28-351a-4ee8-aad9-baa87d419cea 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/1910802405,v1:172.21.15.44:6809/1910802405] [v2:172.21.15.44:6810/1910802405,v1:172.21.15.44:6811/1910802405] exists,up 7b694d72-2d22-4f2e-939e-1e8a56796bf5 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 up in weight 1 up_from 36 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6808/2947272530,v1:172.21.15.174:6809/2947272530] [v2:172.21.15.174:6810/2947272530,v1:172.21.15.174:6811/2947272530] exists,up f2331d76-8457-48ed-98b7-21d8a7289ae5 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.6 up in weight 1 up_from 42 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6818/1769685316,v1:172.21.15.38:6819/1769685316] [v2:172.21.15.38:6820/1769685316,v1:172.21.15.38:6821/1769685316] exists,up 8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.7 up in weight 1 up_from 47 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6816/1039773435,v1:172.21.15.44:6817/1039773435] [v2:172.21.15.44:6818/1039773435,v1:172.21.15.44:6819/1039773435] exists,up 326d922e-492f-4a69-93b0-f2861433f48d 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.8 up in weight 1 up_from 53 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6816/3305912414,v1:172.21.15.174:6817/3305912414] [v2:172.21.15.174:6818/3305912414,v1:172.21.15.174:6819/3305912414] exists,up c5cfb5b9-32ed-4457-8ba7-20cc22188450 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.9 up in weight 1 up_from 59 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.38:6826/2245140106,v1:172.21.15.38:6827/2245140106] [v2:172.21.15.38:6828/2245140106,v1:172.21.15.38:6829/2245140106] exists,up df485a7b-dc9a-4ee0-8c81-8f5aaed79c30 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.10 up in weight 1 up_from 64 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/2459414427,v1:172.21.15.44:6825/2459414427] [v2:172.21.15.44:6826/2459414427,v1:172.21.15.44:6827/2459414427] exists,up 65ea74b8-1f22-4471-82bc-46af8862d7ba 2024-09-21T06:19:16.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6824/1533000307,v1:172.21.15.174:6825/1533000307] [v2:172.21.15.174:6826/1533000307,v1:172.21.15.174:6827/1533000307] exists,up 5f96a5ad-c4d1-4a79-9d09-c302e723251d 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 2.a [2,11] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.5 [3,9] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.14 [4,6] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.21 [5,9] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.34 [4,9] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:pg_upmap_items 3.3a [4,8] 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6801/3616524215 expires 2024-09-22T06:11:11.566124+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/2830323983 expires 2024-09-22T06:09:44.936252+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6801/656404670 expires 2024-09-22T06:09:44.936252+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/4180047505 expires 2024-09-22T06:09:44.936252+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/4133136045 expires 2024-09-22T06:09:44.936252+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6801/1209175440 expires 2024-09-22T06:10:11.734481+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6800/656404670 expires 2024-09-22T06:09:44.936252+0000 2024-09-21T06:19:16.533 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/408464608 expires 2024-09-22T06:11:11.566124+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/487105377 expires 2024-09-22T06:10:11.734481+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6800/3616524215 expires 2024-09-22T06:11:11.566124+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:6800/1209175440 expires 2024-09-22T06:10:11.734481+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/3076275909 expires 2024-09-22T06:10:11.734481+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/3629682408 expires 2024-09-22T06:10:11.734481+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/3669181697 expires 2024-09-22T06:11:11.566124+0000 2024-09-21T06:19:16.534 INFO:teuthology.orchestra.run.smithi038.stdout:blocklist 172.21.15.38:0/2861151403 expires 2024-09-22T06:11:11.566124+0000 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 msgr2=0x7f747c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 0x7f747c0b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f749006c8a0 tx=0x7f748c00a5e0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 msgr2=0x7f749019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7488005e30 tx=0x7f7488003f90 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 shutdown_connections 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f747c0b6590 0x7f747c0b8aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f749010de50 0x7f749019fdc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74901052d0 0x7f749019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 --2- 172.21.15.38:0/2456094382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74901048a0 0x7f749019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.530+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 >> 172.21.15.38:0/2456094382 conn(0x7f7490079740 msgr2=0x7f7490105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.531+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 shutdown_connections 2024-09-21T06:19:16.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:16.531+0000 7f7498293640 1 -- 172.21.15.38:0/2456094382 wait complete. 2024-09-21T06:19:17.215 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T06:19:17.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:17.490 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:17 smithi044 ceph-mon[34369]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:19:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:17 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2456094382' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:19:17.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:17 smithi038 ceph-mon[31215]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:19:17.718 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:17 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2456094382' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:19:17.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:17 smithi174 ceph-mon[34815]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:19:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:17 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2456094382' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 -- 172.21.15.38:0/2528713280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 msgr2=0x7face810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 --2- 172.21.15.38:0/2528713280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face810fc50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7facdc009900 tx=0x7facdc02a480 comp rx=0 tx=0).stop 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 -- 172.21.15.38:0/2528713280 shutdown_connections 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 --2- 172.21.15.38:0/2528713280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 0x7face81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 --2- 172.21.15.38:0/2528713280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face810fc50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 --2- 172.21.15.38:0/2528713280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 0x7face81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 -- 172.21.15.38:0/2528713280 >> 172.21.15.38:0/2528713280 conn(0x7face8079710 msgr2=0x7face8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 -- 172.21.15.38:0/2528713280 shutdown_connections 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.942+0000 7facf00f1640 1 -- 172.21.15.38:0/2528713280 wait complete. 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 Processor -- start 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 -- start start 2024-09-21T06:19:17.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 0x7face819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 0x7face81a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7face8115e00 con 0x7face8102f30 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7face8115c80 con 0x7face81025e0 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facf00f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7face8115f80 con 0x7face8110190 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48448/0 (socket says 172.21.15.38:48448) 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 -- 172.21.15.38:0/3854225123 learned_addr learned my addr 172.21.15.38:0/3854225123 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facede8d640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 0x7face819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7facee68e640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 0x7face81a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 -- 172.21.15.38:0/3854225123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 msgr2=0x7face81a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 0x7face81a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:17.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 -- 172.21.15.38:0/3854225123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 msgr2=0x7face819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 0x7face819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.943+0000 7faced68c640 1 -- 172.21.15.38:0/3854225123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face81a26c0 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7faced68c640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7facdc005ab0 tx=0x7facdc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc03f030 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face81a2950 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facdc003cd0 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc035070 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.944+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face81a9110 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.945+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face806c280 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.947+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7facdc042030 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.948+0000 7facdaffd640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 0x7facd40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.948+0000 7facede8d640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 0x7facd40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.948+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7facdc107c20 con 0x7face8102f30 2024-09-21T06:19:17.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.949+0000 7facede8d640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 0x7facd40b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7face400bbe0 tx=0x7face400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:17.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:17.952+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facdc0ce3b0 con 0x7face8102f30 2024-09-21T06:19:18.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.181+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7face819d880 con 0x7face8102f30 2024-09-21T06:19:18.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.182+0000 7facdaffd640 1 -- 172.21.15.38:0/3854225123 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7face819d880 con 0x7face8102f30 2024-09-21T06:19:18.185 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:18.185 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:19:18.186 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:19:18.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 msgr2=0x7facd40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 0x7facd40b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7face400bbe0 tx=0x7face400b390 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 msgr2=0x7face819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7facdc005ab0 tx=0x7facdc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 shutdown_connections 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7facd40b6560 0x7facd40b8a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7face8110190 0x7face81a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face8102f30 0x7face819ccf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 --2- 172.21.15.38:0/3854225123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7face81025e0 0x7face819c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 >> 172.21.15.38:0/3854225123 conn(0x7face8079710 msgr2=0x7face8109ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 shutdown_connections 2024-09-21T06:19:18.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:18.185+0000 7facf00f1640 1 -- 172.21.15.38:0/3854225123 wait complete. 2024-09-21T06:19:18.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:18 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3854225123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:18.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:18.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:18 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3854225123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:18.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:18 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3854225123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:19.099 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:19.484 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:19 smithi038 ceph-mon[31215]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 -- 172.21.15.38:0/3361589152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46581094c0 msgr2=0x7f46581098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 --2- 172.21.15.38:0/3361589152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46581094c0 0x7f46581098d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4648009900 tx=0x7f464802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 -- 172.21.15.38:0/3361589152 shutdown_connections 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 --2- 172.21.15.38:0/3361589152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4658109e10 0x7f4658110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 --2- 172.21.15.38:0/3361589152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46581094c0 0x7f46581098d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 --2- 172.21.15.38:0/3361589152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 0x7f4658103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 -- 172.21.15.38:0/3361589152 >> 172.21.15.38:0/3361589152 conn(0x7f46580ff5d0 msgr2=0x7f4658101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 -- 172.21.15.38:0/3361589152 shutdown_connections 2024-09-21T06:19:19.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.700+0000 7f46607dc640 1 -- 172.21.15.38:0/3361589152 wait complete. 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 Processor -- start 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 -- start start 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 0x7f465819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46581094c0 0x7f465819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4658113bf0 con 0x7f4658109e10 2024-09-21T06:19:19.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4658113a70 con 0x7f46581094c0 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f46607dc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4658113d70 con 0x7f4658103b80 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465ed79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465ed79640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35636/0 (socket says 172.21.15.38:35636) 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465dd77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46581094c0 0x7f465819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465ed79640 1 -- 172.21.15.38:0/2185005695 learned_addr learned my addr 172.21.15.38:0/2185005695 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465e578640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 0x7f465819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.701+0000 7f465ed79640 1 -- 172.21.15.38:0/2185005695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 msgr2=0x7f465819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f465ed79640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 0x7f465819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f465ed79640 1 -- 172.21.15.38:0/2185005695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46581094c0 msgr2=0x7f465819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f465ed79640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46581094c0 0x7f465819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f465ed79640 1 -- 172.21.15.38:0/2185005695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46581a0510 con 0x7f4658109e10 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f465ed79640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f465000eaa0 tx=0x7f465000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465000cdb0 con 0x7f4658109e10 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4650005020 con 0x7f4658109e10 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46581a0800 con 0x7f4658109e10 2024-09-21T06:19:19.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500116d0 con 0x7f4658109e10 2024-09-21T06:19:19.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.702+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46581a6f60 con 0x7f4658109e10 2024-09-21T06:19:19.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.703+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4658104e00 con 0x7f4658109e10 2024-09-21T06:19:19.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.705+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f46500051d0 con 0x7f4658109e10 2024-09-21T06:19:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.705+0000 7f464f7fe640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 0x7f46440b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.705+0000 7f465e578640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 0x7f46440b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.706+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f46500e7520 con 0x7f4658109e10 2024-09-21T06:19:19.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.706+0000 7f465e578640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 0x7f46440b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4654005fd0 tx=0x7f465400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:19.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.710+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4650016030 con 0x7f4658109e10 2024-09-21T06:19:19.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:19 smithi174 ceph-mon[34815]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:19 smithi044 ceph-mon[34369]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:19.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.938+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f465802e640 con 0x7f4658109e10 2024-09-21T06:19:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:19.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.939+0000 7f464f7fe640 1 -- 172.21.15.38:0/2185005695 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11911 (secure 0 0 0) 0x7f46500b20f0 con 0x7f4658109e10 2024-09-21T06:19:19.942 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"btime":"2024-09-21T06:17:59:313524+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:17:58.639191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:19:19.943 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-21T06:19:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 msgr2=0x7f46440b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 0x7f46440b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4654005fd0 tx=0x7f465400b390 comp rx=0 tx=0).stop 2024-09-21T06:19:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 msgr2=0x7f465819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f465000eaa0 tx=0x7f465000ef60 comp rx=0 tx=0).stop 2024-09-21T06:19:19.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 shutdown_connections 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46440b65e0 0x7f46440b8af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4658109e10 0x7f465819fde0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46581094c0 0x7f465819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 --2- 172.21.15.38:0/2185005695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4658103b80 0x7f465819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 >> 172.21.15.38:0/2185005695 conn(0x7f46580ff5d0 msgr2=0x7f46581019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 shutdown_connections 2024-09-21T06:19:19.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:19.942+0000 7f46607dc640 1 -- 172.21.15.38:0/2185005695 wait complete. 2024-09-21T06:19:20.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:19:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:20 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2185005695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:20.829 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:20.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:20 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2185005695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:20.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:20 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2185005695' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/142642783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0102a60 msgr2=0x7fbaf0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/142642783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0102a60 0x7fbaf0102e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbae0009ca0 tx=0x7fbae002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/142642783 shutdown_connections 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/142642783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0108cf0 0x7fbaf010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/142642783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/142642783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0102a60 0x7fbaf0102e70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/142642783 >> 172.21.15.38:0/142642783 conn(0x7fbaf0079730 msgr2=0x7fbaf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/142642783 shutdown_connections 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.400+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/142642783 wait complete. 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 Processor -- start 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 -- start start 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0102a60 0x7fbaf019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112aa0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112920 con 0x7fbaf01083a0 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.401+0000 7fbaf4ebe640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112c20 con 0x7fbaf0102a60 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35652/0 (socket says 172.21.15.38:35652) 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 -- 172.21.15.38:0/2640298070 learned_addr learned my addr 172.21.15.38:0/2640298070 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaee59c640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0102a60 0x7fbaf019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaedd9b640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 -- 172.21.15.38:0/2640298070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0102a60 msgr2=0x7fbaf019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0102a60 0x7fbaf019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 -- 172.21.15.38:0/2640298070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 msgr2=0x7fbaf019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 -- 172.21.15.38:0/2640298070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01a65f0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaedd9b640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaeed9d640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d750 tx=0x7fbae800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8017070 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf01a68e0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbae80054f0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8004cd0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.402+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01a6e70 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.404+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf0102e70 con 0x7fbaf0108cf0 2024-09-21T06:19:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.405+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fbae8009bd0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.406+0000 7fbadf7fe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 0x7fbad80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.406+0000 7fbaee59c640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 0x7fbad80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.407+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbae80e72c0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.407+0000 7fbaee59c640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 0x7fbad80b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005e30 tx=0x7fbae0009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.410+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbae80adab0 con 0x7fbaf0108cf0 2024-09-21T06:19:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:21 smithi038 ceph-mon[31215]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:21.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.601+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaf006b290 con 0x7fbaf0108cf0 2024-09-21T06:19:21.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.602+0000 7fbadf7fe640 1 -- 172.21.15.38:0/2640298070 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7fbaf006b290 con 0x7fbaf0108cf0 2024-09-21T06:19:21.605 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:21.605 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 msgr2=0x7fbad80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 0x7fbad80b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005e30 tx=0x7fbae0009360 comp rx=0 tx=0).stop 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 msgr2=0x7fbaf019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d750 tx=0x7fbae800dc10 comp rx=0 tx=0).stop 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 shutdown_connections 2024-09-21T06:19:21.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbad80b6560 0x7fbad80b8a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbaf0108cf0 0x7fbaf019bdb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf01083a0 0x7fbaf019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 --2- 172.21.15.38:0/2640298070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbaf0102a60 0x7fbaf019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 >> 172.21.15.38:0/2640298070 conn(0x7fbaf0079730 msgr2=0x7fbaf0101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 shutdown_connections 2024-09-21T06:19:21.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:21.604+0000 7fbaf4ebe640 1 -- 172.21.15.38:0/2640298070 wait complete. 2024-09-21T06:19:21.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:21 smithi174 ceph-mon[34815]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:21.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:21 smithi044 ceph-mon[34369]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:22.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:17:47.782150+0000', 'modified': '2024-09-21T06:17:58.639191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24728, 'mds_1': 24695, 'mds_2': 24667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24641': {'gid': 24641, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6833/3742968843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3742968843}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 3742968843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/2784474374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 2784474374}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 2784474374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/3535582137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3535582137}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3535582137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/2335561806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 2335561806}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 2335561806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.44:6837/2962370729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 2962370729}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 2962370729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24728': {'gid': 24728, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6839/2983639005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2983639005}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2983639005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24728, 'qdb_cluster': [24728, 24695, 24667]} 2024-09-21T06:19:22.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:19:22.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:19:22.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:22 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2640298070' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:22.515 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:22.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:22 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2640298070' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:22.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:22 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2640298070' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 -- 172.21.15.38:0/3364690467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b81094f0 msgr2=0x7f82b8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 --2- 172.21.15.38:0/3364690467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b81094f0 0x7f82b8109900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009860 tx=0x7f82ac02a340 comp rx=0 tx=0).stop 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 -- 172.21.15.38:0/3364690467 shutdown_connections 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 --2- 172.21.15.38:0/3364690467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 --2- 172.21.15.38:0/3364690467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b81094f0 0x7f82b8109900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 --2- 172.21.15.38:0/3364690467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b8103bb0 0x7f82b8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 -- 172.21.15.38:0/3364690467 >> 172.21.15.38:0/3364690467 conn(0x7f82b80ff600 msgr2=0x7f82b8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 -- 172.21.15.38:0/3364690467 shutdown_connections 2024-09-21T06:19:23.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.002+0000 7f82bdb27640 1 -- 172.21.15.38:0/3364690467 wait complete. 2024-09-21T06:19:23.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.003+0000 7f82bdb27640 1 Processor -- start 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.003+0000 7f82bdb27640 1 -- start start 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b8103bb0 0x7f82b819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b81094f0 0x7f82b819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8113c20 con 0x7f82b8109e40 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8113aa0 con 0x7f82b8103bb0 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82bdb27640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82b8113da0 con 0x7f82b81094f0 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35680/0 (socket says 172.21.15.38:35680) 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 -- 172.21.15.38:0/1100320444 learned_addr learned my addr 172.21.15.38:0/1100320444 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b81094f0 0x7f82b819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b77fe640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b8103bb0 0x7f82b819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 -- 172.21.15.38:0/1100320444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b81094f0 msgr2=0x7f82b819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b81094f0 0x7f82b819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 -- 172.21.15.38:0/1100320444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b8103bb0 msgr2=0x7f82b819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b8103bb0 0x7f82b819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.004+0000 7f82b7fff640 1 -- 172.21.15.38:0/1100320444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b81a0500 con 0x7f82b8109e40 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82b7fff640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82b000efc0 tx=0x7f82b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82b4ff9640 1 -- 172.21.15.38:0/1100320444 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0003970 con 0x7f82b8109e40 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b81a07f0 con 0x7f82b8109e40 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82b4ff9640 1 -- 172.21.15.38:0/1100320444 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82b0004020 con 0x7f82b8109e40 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82b4ff9640 1 -- 172.21.15.38:0/1100320444 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b000b9b0 con 0x7f82b8109e40 2024-09-21T06:19:23.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.005+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b81a6f50 con 0x7f82b8109e40 2024-09-21T06:19:23.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.007+0000 7f82c409b740 1 Processor -- start 2024-09-21T06:19:23.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.007+0000 7f82b4ff9640 1 -- 172.21.15.38:0/1100320444 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f82b001d020 con 0x7f82b8109e40 2024-09-21T06:19:23.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 -- start start 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffe0f60 0x55a0c0386f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c0387440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c0387980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a0c02fec10 con 0x55a0bffc0280 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0c02ee040 con 0x55a0bffb80a0 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82c409b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0c02f1e50 con 0x55a0bffe0f60 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c0387980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c0387980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35694/0 (socket says 172.21.15.38:35694) 2024-09-21T06:19:23.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b6ffd640 1 -- 172.21.15.38:0/4212122632 learned_addr learned my addr 172.21.15.38:0/4212122632 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c0387440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffe0f60 0x55a0c0386f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 -- 172.21.15.38:0/4212122632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffe0f60 msgr2=0x55a0c0386f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffe0f60 0x55a0c0386f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 -- 172.21.15.38:0/4212122632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 msgr2=0x55a0c0387980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c0387980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.008+0000 7f82b77fe640 1 -- 172.21.15.38:0/4212122632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c004c540 con 0x55a0bffb80a0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f82b4ff9640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 0x7f82a00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f82b77fe640 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c0387440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009c00 tx=0x7f82a8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e86b6286228143b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 0x7f82a00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f82b4ff9640 1 -- 172.21.15.38:0/1100320444 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f82b00e7280 con 0x7f82b8109e40 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f829dffb640 1 -- 172.21.15.38:0/4212122632 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8004050 con 0x55a0bffb80a0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f829dffb640 1 -- 172.21.15.38:0/4212122632 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82a80054f0 con 0x55a0bffb80a0 2024-09-21T06:19:23.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.009+0000 7f829dffb640 1 -- 172.21.15.38:0/4212122632 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8004d40 con 0x55a0bffb80a0 2024-09-21T06:19:23.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- 172.21.15.38:0/4212122632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 msgr2=0x55a0c0387440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c0387440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009c00 tx=0x7f82a8011810 comp rx=0 tx=0).stop 2024-09-21T06:19:23.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 0x7f82a00b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f82ac02afa0 tx=0x7f82ac02c040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- 172.21.15.38:0/4212122632 shutdown_connections 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c0387980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c0387440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 --2- 172.21.15.38:0/4212122632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffe0f60 0x55a0c0386f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- 172.21.15.38:0/4212122632 >> 172.21.15.38:0/4212122632 conn(0x55a0bffd5350 msgr2=0x55a0c0384df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- 172.21.15.38:0/4212122632 shutdown_connections 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- 172.21.15.38:0/4212122632 wait complete. 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.010+0000 7f82c409b740 1 -- start start 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 Processor -- start 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c03926d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c0392c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a0c014f5f0 con 0x55a0bffe0f60 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0c0289010 con 0x55a0bffb80a0 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03956e0 con 0x55a0bffc0280 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82c409b740 10 client.0 _ll_register_callbacks cb 0x55a0c02e8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35702/0 (socket says 172.21.15.38:35702) 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82b7fff640 1 -- 172.21.15.38:0/3124438568 learned_addr learned my addr 172.21.15.38:0/3124438568 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82b77fe640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c03926d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.011+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c0392c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 -- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 msgr2=0x55a0c0392c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c0392c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 -- 172.21.15.38:0/3124438568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 msgr2=0x55a0c039ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 -- 172.21.15.38:0/3124438568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c02b6a00 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b7fff640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82b77fe640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c03926d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f82a801b040 tx=0x7f82a8005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81f04bfb8659fa07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f8296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8029070 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f82a8004ce0 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82a80054f0 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f82a8035050 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82c409b740 10 client.25091 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.012+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a0c03a1540 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82a80054f0 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f82a8003c00 con 0x55a0bffb80a0 2024-09-21T06:19:23.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 10 client.25091 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 10 client.25091 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 20 client.25091 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bff9f8e0 0x55a0c03a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 4 client.25091 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0c0300b60 con 0x55a0bff9f8e0 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.013+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bff9f8e0 0x55a0c03a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.014+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bff9f8e0 0x55a0c03a4cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5390c6e63da2ce72 server_cookie=acbb6c31d68d9ad3 in_seq=0 out_seq=0 2024-09-21T06:19:23.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.014+0000 7f8296ffd640 10 client.25091 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:23.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.014+0000 7f8296ffd640 1 -- 172.21.15.38:0/3124438568 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0c0300b60 con 0x55a0bff9f8e0 2024-09-21T06:19:23.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.014+0000 7f8296ffd640 10 client.25091 handle_command_reply: tid=0 2024-09-21T06:19:23.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 client.25091 shutdown 2024-09-21T06:19:23.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 msgr2=0x55a0c03926d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c03926d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f82a801b040 tx=0x7f82a8005db0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 shutdown_connections 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bff9f8e0 0x55a0c03a4cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffe0f60 0x55a0c039ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c0392c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f8296ffd640 0 client.25091 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 --2- 172.21.15.38:0/3124438568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bffb80a0 0x55a0c03926d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 >> 172.21.15.38:0/3124438568 conn(0x55a0bffd5350 msgr2=0x55a0c038a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 shutdown_connections 2024-09-21T06:19:23.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 1 -- 172.21.15.38:0/3124438568 wait complete. 2024-09-21T06:19:23.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.015+0000 7f82c409b740 20 client.25091 trim_cache size 0 max 16384 2024-09-21T06:19:23.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.033+0000 7f82c409b740 1 Processor -- start 2024-09-21T06:19:23.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.033+0000 7f82c409b740 1 -- start start 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c038cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffb80a0 0x55a0c0391bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a3010 con 0x55a0bffc0280 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a36e0 con 0x55a0bff9f8e0 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82c409b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a3db0 con 0x55a0bffb80a0 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35704/0 (socket says 172.21.15.38:35704) 2024-09-21T06:19:23.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 -- 172.21.15.38:0/2731297601 learned_addr learned my addr 172.21.15.38:0/2731297601 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffb80a0 0x55a0c0391bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b77fe640 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c038cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 -- 172.21.15.38:0/2731297601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffb80a0 msgr2=0x55a0c0391bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffb80a0 0x55a0c0391bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 -- 172.21.15.38:0/2731297601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 msgr2=0x55a0c038cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c038cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 -- 172.21.15.38:0/2731297601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c038df60 con 0x55a0bffc0280 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f82b7fff640 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f82b00e4d30 tx=0x7f82b00acd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e09d6335774f7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f829d7fa640 1 -- 172.21.15.38:0/2731297601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b00b1e50 con 0x55a0bffc0280 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f829d7fa640 1 -- 172.21.15.38:0/2731297601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82b00b6d90 con 0x55a0bffc0280 2024-09-21T06:19:23.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.034+0000 7f829d7fa640 1 -- 172.21.15.38:0/2731297601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0003b10 con 0x55a0bffc0280 2024-09-21T06:19:23.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 -- 172.21.15.38:0/2731297601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 msgr2=0x55a0c039e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f82b00e4d30 tx=0x7f82b00acd80 comp rx=0 tx=0).stop 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 -- 172.21.15.38:0/2731297601 shutdown_connections 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffc0280 0x55a0c039e970 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffb80a0 0x55a0c0391bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 --2- 172.21.15.38:0/2731297601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c038cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 -- 172.21.15.38:0/2731297601 >> 172.21.15.38:0/2731297601 conn(0x55a0bffd5350 msgr2=0x55a0c0390f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 -- 172.21.15.38:0/2731297601 shutdown_connections 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.035+0000 7f82c409b740 1 -- 172.21.15.38:0/2731297601 wait complete. 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 -- start start 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 Processor -- start 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c03ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c03a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a4b50 con 0x55a0bffb80a0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a4480 con 0x55a0bff9f8e0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0c03a5220 con 0x55a0bffc0280 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82c409b740 10 client.0 _ll_register_callbacks cb 0x7f82b0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82b6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35706/0 (socket says 172.21.15.38:35706) 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82b6ffd640 1 -- 172.21.15.38:0/952938739 learned_addr learned my addr 172.21.15.38:0/952938739 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.036+0000 7f82b7fff640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c03a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b77fe640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c03ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 -- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 msgr2=0x55a0c03a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c03a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 -- 172.21.15.38:0/952938739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 msgr2=0x55a0c03ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c03ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 -- 172.21.15.38:0/952938739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c03a7880 con 0x55a0bffb80a0 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b77fe640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c03ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:23.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82b6ffd640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009230 tx=0x7f82ac02a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3c87bde2f94bca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f8296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac05c060 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f82ac030600 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82b00b6d90 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f82ac037040 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82c409b740 10 client.15351 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.037+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a0c04101a0 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82b00b6d90 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f82ac03d040 con 0x55a0bffb80a0 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 10 client.15351 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 10 client.15351 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 20 client.15351 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bffe0f60 0x55a0c04139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:23.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 4 client.15351 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "status"}) -- 0x55a0c02fc610 con 0x55a0bffe0f60 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82b77fe640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bffe0f60 0x55a0c04139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f82b77fe640 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bffe0f60 0x55a0c04139d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d376d296ee27c2d server_cookie=dbe4364557c0b2a2 in_seq=0 out_seq=0 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.038+0000 7f8296ffd640 10 client.15351 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f8296ffd640 1 -- 172.21.15.38:0/952938739 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a0c02fc610 con 0x55a0bffe0f60 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f8296ffd640 10 client.15351 handle_command_reply: tid=0 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 client.15351 shutdown 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 msgr2=0x55a0c03a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009230 tx=0x7f82ac02a340 comp rx=0 tx=0).stop 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 shutdown_connections 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a0bffe0f60 0x55a0c04139d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0bffc0280 0x55a0c03a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a0bffb80a0 0x55a0c03a6bd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f8296ffd640 0 client.15351 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 --2- 172.21.15.38:0/952938739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a0bff9f8e0 0x55a0c03ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 >> 172.21.15.38:0/952938739 conn(0x55a0bffd5350 msgr2=0x55a0c0384600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 shutdown_connections 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 1 -- 172.21.15.38:0/952938739 wait complete. 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.039+0000 7f82c409b740 20 client.15351 trim_cache size 0 max 16384 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 2, 2024-09-21T06:19:23.046 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24667, 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 86.726228519000003, 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 113.120366283 2024-09-21T06:19:23.047 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 msgr2=0x7f82a00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 0x7f82a00b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f82ac02afa0 tx=0x7f82ac02c040 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 msgr2=0x7f82b819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82b000efc0 tx=0x7f82b000c800 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 shutdown_connections 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f82a00b6560 0x7f82a00b8a70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b8109e40 0x7f82b819fdd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82b81094f0 0x7f82b819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 --2- 172.21.15.38:0/1100320444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82b8103bb0 0x7f82b819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 >> 172.21.15.38:0/1100320444 conn(0x7f82b80ff600 msgr2=0x7f82b8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 shutdown_connections 2024-09-21T06:19:23.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:23.040+0000 7f82bdb27640 1 -- 172.21.15.38:0/1100320444 wait complete. 2024-09-21T06:19:23.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:23 smithi038 ceph-mon[31215]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:23.781 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T06:19:23.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:23 smithi174 ceph-mon[34815]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:23.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:23 smithi044 ceph-mon[34369]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T06:19:24.039 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 -- 172.21.15.38:0/2165867115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 msgr2=0x7f6af01125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 --2- 172.21.15.38:0/2165867115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01125c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009ca0 tx=0x7f6ae802a950 comp rx=0 tx=0).stop 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 -- 172.21.15.38:0/2165867115 shutdown_connections 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 --2- 172.21.15.38:0/2165867115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01125c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 --2- 172.21.15.38:0/2165867115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af0102f40 0x7f6af010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 --2- 172.21.15.38:0/2165867115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af01025f0 0x7f6af0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 -- 172.21.15.38:0/2165867115 >> 172.21.15.38:0/2165867115 conn(0x7f6af0079740 msgr2=0x7f6af0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 -- 172.21.15.38:0/2165867115 shutdown_connections 2024-09-21T06:19:24.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.502+0000 7f6af7375640 1 -- 172.21.15.38:0/2165867115 wait complete. 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 Processor -- start 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 -- start start 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af01025f0 0x7f6af019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af0102f40 0x7f6af019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0115df0 con 0x7f6af01101a0 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0115c70 con 0x7f6af01025f0 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af7375640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6af0115f70 con 0x7f6af0102f40 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af5912640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af5912640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35716/0 (socket says 172.21.15.38:35716) 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af5912640 1 -- 172.21.15.38:0/4234762224 learned_addr learned my addr 172.21.15.38:0/4234762224 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.503+0000 7f6af5111640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af01025f0 0x7f6af019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af4910640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af0102f40 0x7f6af019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 -- 172.21.15.38:0/4234762224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af0102f40 msgr2=0x7f6af019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af0102f40 0x7f6af019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 -- 172.21.15.38:0/4234762224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af01025f0 msgr2=0x7f6af019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af01025f0 0x7f6af019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 -- 172.21.15.38:0/4234762224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af01a2710 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af5912640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006010 tx=0x7f6ae802f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6ae67fc640 1 -- 172.21.15.38:0/4234762224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8034040 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af01a29a0 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6ae67fc640 1 -- 172.21.15.38:0/4234762224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ae8003e00 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6ae67fc640 1 -- 172.21.15.38:0/4234762224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8045480 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.504+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af01a9160 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.507+0000 7f6afd8e9740 1 Processor -- start 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6ae67fc640 1 -- 172.21.15.38:0/4234762224 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f6ae8037020 con 0x7f6af01101a0 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 -- start start 2024-09-21T06:19:24.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb88ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560eb8865c10 con 0x560eb8547f60 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560eb8855040 con 0x560eb8527280 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560eb8858e50 con 0x560eb851f0a0 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6af4910640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6af4910640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35726/0 (socket says 172.21.15.38:35726) 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.508+0000 7f6af4910640 1 -- 172.21.15.38:0/1131185376 learned_addr learned my addr 172.21.15.38:0/1131185376 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af5111640 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb88ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 -- 172.21.15.38:0/1131185376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 msgr2=0x560eb88ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb88ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 -- 172.21.15.38:0/1131185376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 msgr2=0x560eb88ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 -- 172.21.15.38:0/1131185376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb85b3540 con 0x560eb8547f60 2024-09-21T06:19:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af5111640 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb88ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af4910640 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cc60 tx=0x7f6ae0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668c4d17703752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6ae67fc640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 0x7f6adc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6af5111640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 0x7f6adc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6adb7fe640 1 -- 172.21.15.38:0/1131185376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0016070 con 0x560eb8547f60 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6ae67fc640 1 -- 172.21.15.38:0/4234762224 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6ae8108460 con 0x7f6af01101a0 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6adb7fe640 1 -- 172.21.15.38:0/1131185376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ae0012b50 con 0x560eb8547f60 2024-09-21T06:19:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.509+0000 7f6adb7fe640 1 -- 172.21.15.38:0/1131185376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0011b70 con 0x560eb8547f60 2024-09-21T06:19:24.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6af5111640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 0x7f6adc0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x560eb88ecb80 tx=0x7f6aec008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 -- 172.21.15.38:0/1131185376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 msgr2=0x560eb88edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cc60 tx=0x7f6ae0010740 comp rx=0 tx=0).stop 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 -- 172.21.15.38:0/1131185376 shutdown_connections 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb88ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/1131185376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88edf00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 -- 172.21.15.38:0/1131185376 >> 172.21.15.38:0/1131185376 conn(0x560eb853c350 msgr2=0x560eb88ebdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 -- 172.21.15.38:0/1131185376 shutdown_connections 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.510+0000 7f6afd8e9740 1 -- 172.21.15.38:0/1131185376 wait complete. 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 -- start start 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 Processor -- start 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8905a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560eb86b65f0 con 0x560eb851f0a0 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560eb87f0010 con 0x560eb8527280 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560eb88fc6e0 con 0x560eb8547f60 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6af5111640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6af5111640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35738/0 (socket says 172.21.15.38:35738) 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6af5111640 1 -- 172.21.15.38:0/2015921471 learned_addr learned my addr 172.21.15.38:0/2015921471 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.511+0000 7f6afd8e9740 10 client.0 _ll_register_callbacks cb 0x560eb884f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af4910640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5912640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8905a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 -- 172.21.15.38:0/2015921471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 msgr2=0x560eb8905a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8905a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 -- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 msgr2=0x560eb88f9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88f9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 -- 172.21.15.38:0/2015921471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb881da00 con 0x560eb851f0a0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af4910640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6af5111640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0093d0 tx=0x7f6aec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3edae0322e9549 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6ad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec01c050 con 0x560eb851f0a0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6aec016b20 con 0x560eb851f0a0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae0012b50 con 0x560eb851f0a0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6aec00f040 con 0x560eb851f0a0 2024-09-21T06:19:24.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6afd8e9740 10 client.15363 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.512+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560eb8908590 con 0x560eb851f0a0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ae0012b50 con 0x560eb851f0a0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6aec02a400 con 0x560eb851f0a0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 10 client.15363 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 10 client.15363 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 20 client.15363 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb85068e0 0x560eb890c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 4 client.15363 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb8867b60 con 0x560eb85068e0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.513+0000 7f6af4910640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb85068e0 0x560eb890c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.514+0000 7f6af4910640 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb85068e0 0x560eb890c060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b36ac8338152fe9d server_cookie=57a0f25b308c416f in_seq=0 out_seq=0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.514+0000 7f6ad8ff9640 10 client.15363 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.514+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/2015921471 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560eb8867b60 con 0x560eb85068e0 2024-09-21T06:19:24.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.514+0000 7f6ad8ff9640 10 client.15363 handle_command_reply: tid=0 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.514+0000 7f6afd8e9740 1 client.15363 shutdown 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 msgr2=0x560eb88f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0093d0 tx=0x7f6aec0046c0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 shutdown_connections 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb85068e0 0x560eb890c060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8905a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb88f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/2015921471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb851f0a0 0x560eb88f99e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6ad8ff9640 0 client.15363 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 >> 172.21.15.38:0/2015921471 conn(0x560eb853c350 msgr2=0x560eb88f10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 shutdown_connections 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 1 -- 172.21.15.38:0/2015921471 wait complete. 2024-09-21T06:19:24.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.515+0000 7f6afd8e9740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 Processor -- start 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 -- start start 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb89065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb8909a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560eb890a3a0 con 0x560eb8547f60 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560eb890aa70 con 0x560eb8527280 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560eb890b140 con 0x560eb851f0a0 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6af5912640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.533+0000 7f6af5912640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35750/0 (socket says 172.21.15.38:35750) 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 -- 172.21.15.38:0/699227285 learned_addr learned my addr 172.21.15.38:0/699227285 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5111640 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb89065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af4910640 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb8909a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 -- 172.21.15.38:0/699227285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 msgr2=0x560eb89065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb89065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 -- 172.21.15.38:0/699227285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 msgr2=0x560eb8909a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb8909a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 -- 172.21.15.38:0/699227285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb88f01f0 con 0x560eb8547f60 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6af5912640 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8105ec0 tx=0x7f6ae80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77be92ffa2514113 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6adaffd640 1 -- 172.21.15.38:0/699227285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80f5020 con 0x560eb8547f60 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6adaffd640 1 -- 172.21.15.38:0/699227285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ae80ce060 con 0x560eb8547f60 2024-09-21T06:19:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.534+0000 7f6adaffd640 1 -- 172.21.15.38:0/699227285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae802c020 con 0x560eb8547f60 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- 172.21.15.38:0/699227285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 msgr2=0x560eb88f99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8105ec0 tx=0x7f6ae80095c0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- 172.21.15.38:0/699227285 shutdown_connections 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8547f60 0x560eb88f99c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb8527280 0x560eb8909a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/699227285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb851f0a0 0x560eb89065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- 172.21.15.38:0/699227285 >> 172.21.15.38:0/699227285 conn(0x560eb853c350 msgr2=0x560eb8905b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- 172.21.15.38:0/699227285 shutdown_connections 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- 172.21.15.38:0/699227285 wait complete. 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 -- start start 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.535+0000 7f6afd8e9740 1 Processor -- start 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb851f0a0 0x560eb88fab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8975520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560eb890bee0 con 0x560eb8527280 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560eb890b810 con 0x560eb851f0a0 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560eb890c5b0 con 0x560eb8547f60 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6afd8e9740 10 client.0 _ll_register_callbacks cb 0x7f6aec009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35760/0 (socket says 172.21.15.38:35760) 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 -- 172.21.15.38:0/3132690477 learned_addr learned my addr 172.21.15.38:0/3132690477 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af5111640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb851f0a0 0x560eb88fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af5912640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8975520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 -- 172.21.15.38:0/3132690477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 msgr2=0x560eb8975520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8975520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 -- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb851f0a0 msgr2=0x560eb88fab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb851f0a0 0x560eb88fab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af4910640 1 -- 172.21.15.38:0/3132690477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb88fb8a0 con 0x560eb8527280 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.536+0000 7f6af5912640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8975520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6af4910640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cfd0 tx=0x7f6ae0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8481a5cfa5556ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0016040 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6ae0004020 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae80ce060 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6ae0004220 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 10 client.15369 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560eb8976a80 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ae80ce060 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6ae0012720 con 0x560eb8527280 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 10 client.15369 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 10 client.15369 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 20 client.15369 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.537+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb84dbc90 0x560eb897a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.538+0000 7f6afd8e9740 4 client.15369 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.538+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "status"}) -- 0x560eb8863610 con 0x560eb84dbc90 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.538+0000 7f6af5111640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb84dbc90 0x560eb897a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.538+0000 7f6ad8ff9640 10 client.15369 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.538+0000 7f6af5111640 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb84dbc90 0x560eb897a010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=881e602763fe5916 server_cookie=fd51376fc8dc2c5a in_seq=0 out_seq=0 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6ad8ff9640 1 -- 172.21.15.38:0/3132690477 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560eb8863610 con 0x560eb84dbc90 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6ad8ff9640 10 client.15369 handle_command_reply: tid=0 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 client.15369 shutdown 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 msgr2=0x560eb88fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cfd0 tx=0x7f6ae0005270 comp rx=0 tx=0).stop 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 shutdown_connections 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x560eb84dbc90 0x560eb897a010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560eb8547f60 0x560eb8975520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560eb8527280 0x560eb88fb090 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 --2- 172.21.15.38:0/3132690477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560eb851f0a0 0x560eb88fab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 >> 172.21.15.38:0/3132690477 conn(0x560eb853c350 msgr2=0x560eb8905b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6ad8ff9640 0 client.15369 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 shutdown_connections 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 1 -- 172.21.15.38:0/3132690477 wait complete. 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.539+0000 7f6afd8e9740 20 client.15369 trim_cache size 0 max 16384 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 1, 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24695, 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:24.547 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 89.239567129999998, 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 117.15290898799999 2024-09-21T06:19:24.548 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 msgr2=0x7f6adc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 0x7f6adc0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x560eb88ecb80 tx=0x7f6aec008040 comp rx=0 tx=0).stop 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 msgr2=0x7f6af01a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006010 tx=0x7f6ae802f6f0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 shutdown_connections 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6adc0b6560 0x7f6adc0b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6af01101a0 0x7f6af01a1fe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6af0102f40 0x7f6af019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 --2- 172.21.15.38:0/4234762224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6af01025f0 0x7f6af019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:24.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 >> 172.21.15.38:0/4234762224 conn(0x7f6af0079740 msgr2=0x7f6af0109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:24.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 shutdown_connections 2024-09-21T06:19:24.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:24.540+0000 7f6af7375640 1 -- 172.21.15.38:0/4234762224 wait complete. 2024-09-21T06:19:25.255 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:19:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:25 smithi038 ceph-mon[31215]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:25.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:25 smithi174 ceph-mon[34815]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:25.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:25 smithi044 ceph-mon[34369]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:19:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 -- 172.21.15.38:0/2517753475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 msgr2=0x7f2888103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 --2- 172.21.15.38:0/2517753475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f2888103f70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2884009900 tx=0x7f288402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 -- 172.21.15.38:0/2517753475 shutdown_connections 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 --2- 172.21.15.38:0/2517753475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2888109df0 0x7f2888110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 --2- 172.21.15.38:0/2517753475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28881094a0 0x7f28881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 --2- 172.21.15.38:0/2517753475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f2888103f70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 -- 172.21.15.38:0/2517753475 >> 172.21.15.38:0/2517753475 conn(0x7f288807b850 msgr2=0x7f288807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 -- 172.21.15.38:0/2517753475 shutdown_connections 2024-09-21T06:19:25.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 -- 172.21.15.38:0/2517753475 wait complete. 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.936+0000 7f289055e640 1 Processor -- start 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 -- start start 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28881094a0 0x7f288819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 0x7f288819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113bd0 con 0x7f2888103b60 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113a50 con 0x7f2888109df0 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f289055e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2888113d50 con 0x7f28881094a0 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35774/0 (socket says 172.21.15.38:35774) 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 -- 172.21.15.38:0/3784590651 learned_addr learned my addr 172.21.15.38:0/3784590651 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:25.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288eafb640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 0x7f288819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288daf9640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28881094a0 0x7f288819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 -- 172.21.15.38:0/3784590651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28881094a0 msgr2=0x7f288819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28881094a0 0x7f288819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 -- 172.21.15.38:0/3784590651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 msgr2=0x7f288819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 0x7f288819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288e2fa640 1 -- 172.21.15.38:0/3784590651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881a03f0 con 0x7f2888103b60 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.937+0000 7f288eafb640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 0x7f288819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2884005ab0 tx=0x7f28840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f287f7fe640 1 -- 172.21.15.38:0/3784590651 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288403f030 con 0x7f2888103b60 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f287f7fe640 1 -- 172.21.15.38:0/3784590651 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2884003cd0 con 0x7f2888103b60 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881a0680 con 0x7f2888103b60 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f287f7fe640 1 -- 172.21.15.38:0/3784590651 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2884035070 con 0x7f2888103b60 2024-09-21T06:19:25.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.938+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881a0b60 con 0x7f2888103b60 2024-09-21T06:19:25.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.940+0000 7f2896ad2740 1 Processor -- start 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 -- start start 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f287f7fe640 1 -- 172.21.15.38:0/3784590651 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f2884042030 con 0x7f2888103b60 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55ceb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55ceb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559b55c62c10 con 0x559b55944f60 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b55c52040 con 0x559b5591c0a0 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f2896ad2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b55c55e50 con 0x559b55924280 2024-09-21T06:19:25.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35782/0 (socket says 172.21.15.38:35782) 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 -- 172.21.15.38:0/3593903431 learned_addr learned my addr 172.21.15.38:0/3593903431 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55ceb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288daf9640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55ceb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 -- 172.21.15.38:0/3593903431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 msgr2=0x559b55ceb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55ceb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 -- 172.21.15.38:0/3593903431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 msgr2=0x559b55ceb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55ceb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288eafb640 1 -- 172.21.15.38:0/3593903431 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b559b0540 con 0x559b55944f60 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288daf9640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55ceb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.941+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55ceb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:25.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f288eafb640 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2880007f40 tx=0x7f288000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d79a852c650531 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f287cff9640 1 -- 172.21.15.38:0/3593903431 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880014070 con 0x559b55944f60 2024-09-21T06:19:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f287f7fe640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 0x7f28740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f287cff9640 1 -- 172.21.15.38:0/3593903431 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2880004d20 con 0x559b55944f60 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f287cff9640 1 -- 172.21.15.38:0/3593903431 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800055c0 con 0x559b55944f60 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 0x7f28740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.942+0000 7f287f7fe640 1 -- 172.21.15.38:0/3784590651 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f28841079d0 con 0x7f2888103b60 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 -- 172.21.15.38:0/3593903431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 msgr2=0x559b55ceaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f288e2fa640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 0x7f28740b8aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x559b55ce9b80 tx=0x7f288402a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2880007f40 tx=0x7f288000e7e0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 -- 172.21.15.38:0/3593903431 shutdown_connections 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55ceb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55ceb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 --2- 172.21.15.38:0/3593903431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55ceaf00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 -- 172.21.15.38:0/3593903431 >> 172.21.15.38:0/3593903431 conn(0x559b55939350 msgr2=0x559b55ce8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 -- 172.21.15.38:0/3593903431 shutdown_connections 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.943+0000 7f2896ad2740 1 -- 172.21.15.38:0/3593903431 wait complete. 2024-09-21T06:19:25.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 -- start start 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 Processor -- start 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b5591c0a0 0x559b55cf6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b55924280 0x559b55cf6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559b55ab35f0 con 0x559b55944f60 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b55bed010 con 0x559b55924280 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b55cf96e0 con 0x559b5591c0a0 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f2896ad2740 10 client.0 _ll_register_callbacks cb 0x559b55c4c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35790/0 (socket says 172.21.15.38:35790) 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f288eafb640 1 -- 172.21.15.38:0/1006048768 learned_addr learned my addr 172.21.15.38:0/1006048768 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:25.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f288daf9640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b55924280 0x559b55cf6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.944+0000 7f288eafb640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b5591c0a0 0x559b55cf6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 -- 172.21.15.38:0/1006048768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b5591c0a0 msgr2=0x559b55cf6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b5591c0a0 0x559b55cf6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 -- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b55924280 msgr2=0x559b55cf6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b55924280 0x559b55cf6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 -- 172.21.15.38:0/1006048768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b55c1aa00 con 0x559b55944f60 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f288eafb640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559b55cf9080 tx=0x7f2880005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54f180082288c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2871ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288001c070 con 0x559b55944f60 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2880010850 con 0x559b55944f60 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2880004d20 con 0x559b55944f60 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2880014040 con 0x559b55944f60 2024-09-21T06:19:25.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2896ad2740 10 client.15381 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559b55d05570 con 0x559b55944f60 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.945+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2880004d20 con 0x559b55944f60 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2880018980 con 0x559b55944f60 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 10 client.15381 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 10 client.15381 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 20 client.15381 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b559038e0 0x559b55d08c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 4 client.15381 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b55c64b60 con 0x559b559038e0 2024-09-21T06:19:25.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f288daf9640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b559038e0 0x559b55d08c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f288daf9640 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b559038e0 0x559b55d08c90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6d36341e4e935fc server_cookie=3839a899c1f2477d in_seq=0 out_seq=0 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.946+0000 7f2871ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2871ffb640 1 -- 172.21.15.38:0/1006048768 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b55c64b60 con 0x559b559038e0 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2871ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 client.15381 shutdown 2024-09-21T06:19:25.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 msgr2=0x559b55d029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x559b55cf9080 tx=0x7f2880005160 comp rx=0 tx=0).stop 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 shutdown_connections 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b55944f60 0x559b55d029d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b55924280 0x559b55cf6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.947+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b559038e0 0x559b55d08c90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2896ad2740 1 --2- 172.21.15.38:0/1006048768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b5591c0a0 0x559b55cf6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2871ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 >> 172.21.15.38:0/1006048768 conn(0x559b55939350 msgr2=0x559b55cee0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 shutdown_connections 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2896ad2740 1 -- 172.21.15.38:0/1006048768 wait complete. 2024-09-21T06:19:25.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.948+0000 7f2896ad2740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T06:19:25.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 Processor -- start 2024-09-21T06:19:25.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 -- start start 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 0x559b55cf5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55cf1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559b55d06fd0 con 0x559b5591c0a0 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b55d076a0 con 0x559b559038e0 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f2896ad2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b55d07d70 con 0x559b55924280 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f288daf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f288daf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35798/0 (socket says 172.21.15.38:35798) 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.966+0000 7f288daf9640 1 -- 172.21.15.38:0/2050684334 learned_addr learned my addr 172.21.15.38:0/2050684334 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288eafb640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55cf1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 -- 172.21.15.38:0/2050684334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 msgr2=0x559b55cf1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55cf1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 -- 172.21.15.38:0/2050684334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 msgr2=0x559b55cf5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288eafb640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 0x559b55cf5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 0x559b55cf5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 -- 172.21.15.38:0/2050684334 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b55ced420 con 0x559b5591c0a0 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288eafb640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 0x559b55cf5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f288daf9640 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f287800be90 tx=0x7f287800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe80d0217bd839c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f2873fff640 1 -- 172.21.15.38:0/2050684334 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878005220 con 0x559b5591c0a0 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f2873fff640 1 -- 172.21.15.38:0/2050684334 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f287801e070 con 0x559b5591c0a0 2024-09-21T06:19:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.967+0000 7f2873fff640 1 -- 172.21.15.38:0/2050684334 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28780227a0 con 0x559b5591c0a0 2024-09-21T06:19:25.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- 172.21.15.38:0/2050684334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 msgr2=0x559b55cf19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f287800be90 tx=0x7f287800b650 comp rx=0 tx=0).stop 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- 172.21.15.38:0/2050684334 shutdown_connections 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55cf1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b5591c0a0 0x559b55cf19e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2050684334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b559038e0 0x559b55cf5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- 172.21.15.38:0/2050684334 >> 172.21.15.38:0/2050684334 conn(0x559b55939350 msgr2=0x559b55cf6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- 172.21.15.38:0/2050684334 shutdown_connections 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- 172.21.15.38:0/2050684334 wait complete. 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.968+0000 7f2896ad2740 1 -- start start 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 Processor -- start 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55d0b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55d0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559b55d08b10 con 0x559b559038e0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b55d08440 con 0x559b5591c0a0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b55d091e0 con 0x559b55924280 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f2896ad2740 10 client.0 _ll_register_callbacks cb 0x7f2880007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35806/0 (socket says 172.21.15.38:35806) 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 -- 172.21.15.38:0/2864534068 learned_addr learned my addr 172.21.15.38:0/2864534068 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288daf9640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55d0b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55d0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 -- 172.21.15.38:0/2864534068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 msgr2=0x559b55d0bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55d0bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 -- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 msgr2=0x559b55d0b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55d0b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.969+0000 7f288eafb640 1 -- 172.21.15.38:0/2864534068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b55d106c0 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f288eafb640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2880007e60 tx=0x7f28800073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9cabf20f4896be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288003b060 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2880024040 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f287801e070 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f288001c070 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 10 client.15387 fetch_fsmap learned FSMap version 23 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559b55d11890 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f287801e070 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f2880018650 con 0x559b559038e0 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 10 client.15387 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 10 client.15387 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.970+0000 7f2896ad2740 20 client.15387 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b55944f60 0x559b55d773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2896ad2740 4 client.15387 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:19:25.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "status"}) -- 0x559b55cf14f0 con 0x559b55944f60 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f288daf9640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b55944f60 0x559b55d773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f288daf9640 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b55944f60 0x559b55d773e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acfbc17e54cc68b2 server_cookie=f770fc2bd7b738ab in_seq=0 out_seq=0 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2871ffb640 10 client.15387 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2871ffb640 1 -- 172.21.15.38:0/2864534068 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x559b55cf14f0 con 0x559b55944f60 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2871ffb640 10 client.15387 handle_command_reply: tid=0 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.971+0000 7f2896ad2740 1 client.15387 shutdown 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 msgr2=0x559b55d0b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2880007e60 tx=0x7f28800073c0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 shutdown_connections 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559b55944f60 0x559b55d773e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b55924280 0x559b55d0bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b5591c0a0 0x559b55d0b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 --2- 172.21.15.38:0/2864534068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559b559038e0 0x559b55d0b470 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 >> 172.21.15.38:0/2864534068 conn(0x559b55939350 msgr2=0x559b55cf6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2871ffb640 0 client.15387 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:25.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 shutdown_connections 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 1 -- 172.21.15.38:0/2864534068 wait complete. 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f2896ad2740 20 client.15387 trim_cache size 0 max 16384 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "d022e7d2-77df-11ef-baf5-efdc52797490", 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 24728, 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-09-21T06:19:25.978 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 97.722776943, 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 23, 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 77, 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 107.814843701 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 msgr2=0x7f28740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 0x7f28740b8aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x559b55ce9b80 tx=0x7f288402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 msgr2=0x7f288819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:25.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.972+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2884005ab0 tx=0x7f28840042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 shutdown_connections 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28740b6590 0x7f28740b8aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2888109df0 0x7f288819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28881094a0 0x7f288819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 --2- 172.21.15.38:0/3784590651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2888103b60 0x7f288819a540 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 >> 172.21.15.38:0/3784590651 conn(0x7f288807b850 msgr2=0x7f28881074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 shutdown_connections 2024-09-21T06:19:25.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:25.973+0000 7f289055e640 1 -- 172.21.15.38:0/3784590651 wait complete. 2024-09-21T06:19:26.638 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:19:26.662 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:19:26.662 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T06:19:26.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:26.663 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-21T06:19:26.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:26.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-21T06:19:26.749 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2024-09-21T06:19:26.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:26.751 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T06:19:26.751 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:19:26.751 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:26.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:19:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:27.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 -- 172.21.15.38:0/3409238101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd88102a60 msgr2=0x7efd88102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:27.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3409238101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd88102a60 0x7efd88102e70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efd80009900 tx=0x7efd8002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:27.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 -- 172.21.15.38:0/3409238101 shutdown_connections 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3409238101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 0x7efd8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3409238101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd881083a0 0x7efd881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3409238101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd88102a60 0x7efd88102e70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 -- 172.21.15.38:0/3409238101 >> 172.21.15.38:0/3409238101 conn(0x7efd88079730 msgr2=0x7efd88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 -- 172.21.15.38:0/3409238101 shutdown_connections 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.505+0000 7efd8ef62640 1 -- 172.21.15.38:0/3409238101 wait complete. 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 Processor -- start 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 -- start start 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 0x7efd8819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:27.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 0x7efd8819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7efd88113ba0 con 0x7efd881083a0 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd88113a20 con 0x7efd88102a60 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ef62640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efd88113d20 con 0x7efd88108cf0 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35820/0 (socket says 172.21.15.38:35820) 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 -- 172.21.15.38:0/3031405965 learned_addr learned my addr 172.21.15.38:0/3031405965 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ccfe640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 0x7efd8819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8d4ff640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 0x7efd8819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 -- 172.21.15.38:0/3031405965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 msgr2=0x7efd8819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 0x7efd8819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 -- 172.21.15.38:0/3031405965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 msgr2=0x7efd8819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 0x7efd8819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd87fff640 1 -- 172.21.15.38:0/3031405965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd881a0480 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.506+0000 7efd8ccfe640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 0x7efd8819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd87fff640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd7800ccb0 tx=0x7efd7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78004b20 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efd78004cc0 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd881a0770 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7800f7c0 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.507+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a6ed0 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.508+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd88102e70 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.510+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7efd78005580 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.510+0000 7efd85ffb640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 0x7efd740b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.510+0000 7efd8ccfe640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 0x7efd740b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.511+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efd780e7870 con 0x7efd881083a0 2024-09-21T06:19:27.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.511+0000 7efd8ccfe640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 0x7efd740b8af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd80000c00 tx=0x7efd80009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:27.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.515+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd78014030 con 0x7efd881083a0 2024-09-21T06:19:27.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:27 smithi038 ceph-mon[31215]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:19:27.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.744+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd8802e640 con 0x7efd881083a0 2024-09-21T06:19:27.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.745+0000 7efd85ffb640 1 -- 172.21.15.38:0/3031405965 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7efd780ae060 con 0x7efd881083a0 2024-09-21T06:19:27.747 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 msgr2=0x7efd740b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 0x7efd740b8af0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd80000c00 tx=0x7efd80009680 comp rx=0 tx=0).stop 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 msgr2=0x7efd8819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efd7800ccb0 tx=0x7efd7800a620 comp rx=0 tx=0).stop 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 shutdown_connections 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7efd740b65e0 0x7efd740b8af0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efd88108cf0 0x7efd8819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efd881083a0 0x7efd8819aab0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 --2- 172.21.15.38:0/3031405965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd88102a60 0x7efd8819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:27.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 >> 172.21.15.38:0/3031405965 conn(0x7efd88079730 msgr2=0x7efd88101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:27.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 shutdown_connections 2024-09-21T06:19:27.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:27.747+0000 7efd8ef62640 1 -- 172.21.15.38:0/3031405965 wait complete. 2024-09-21T06:19:27.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:27 smithi174 ceph-mon[34815]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:19:27.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:27 smithi044 ceph-mon[34369]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:19:28.466 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:19:28.466 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:19:28.466 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2024-09-21T06:19:28.466 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:19:28.466 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:28.467 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:19:28.467 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:19:28.467 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:19:28.467 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:19:28.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:28.467 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:19:28.484 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42108sec preferred_lft 42108sec 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:19:28.485 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2024-09-21T06:19:28.485 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:19:28.486 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-21T06:19:28.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:28.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:28 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3031405965' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:19:28.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:28.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:28.799 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:19:28.825 INFO:teuthology.orchestra.run.smithi038.stdout:1 2024-09-21T06:19:28.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:28.827 DEBUG:teuthology.orchestra.run.smithi038:> route 2024-09-21T06:19:28.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:28 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3031405965' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:19:28.902 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2024-09-21T06:19:28.902 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:19:28.902 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T06:19:28.902 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T06:19:28.902 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-21T06:19:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:28 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3031405965' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:19:28.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:29.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:29.208 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-21T06:19:29.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:29.225 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2024-09-21T06:19:29.281 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:19:29.281 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-21T06:19:29.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:19:29.281 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:19:29.281 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-21T06:19:29.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:29.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:29.400 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:19:29.401 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-21T06:19:29.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:29.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:29.532 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:19:29.532 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-21T06:19:29.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2024-09-21T06:19:29.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:19:29.532 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-21T06:19:29.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:29.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:29.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:19:29.613 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:29.629 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:19:29.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:19:29.629 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:29.685 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T06:19:29.685 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T06:19:29.685 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/29d3b5d9-7e45-4e21-81bd-d4adc88cf6d9 2024-09-21T06:19:29.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:29.685 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/29d3b5d9-7e45-4e21-81bd-d4adc88cf6d9 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T06:19:29.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:29 smithi038 ceph-mon[31215]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:19:29.806 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:29 smithi044 ceph-mon[34369]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:19:29.808 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T06:19:29.809 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T06:19:29.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:29 smithi174 ceph-mon[34815]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:19:29.945 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.44:3300,172.21.15.174:3300" 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with new device syntax: 0@d022e7d2-77df-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/29d3b5d9-7e45-4e21-81bd-d4adc88cf6d9 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.38:3300/172.21.15.44:3300/172.21.15.174:3300" will pass to kernel 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:19:29.946 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:19:29.947 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:19:29.947 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:19:29.947 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:19:29.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:19:29.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:19:29.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:30.017 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:19:30.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:19:30.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:30.114 INFO:teuthology.orchestra.run.smithi038.stdout:client15396 2024-09-21T06:19:30.115 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:19:30.115 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:19:30.132 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:19:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:19:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:30.229 INFO:teuthology.orchestra.run.smithi038.stdout:client15396 2024-09-21T06:19:30.230 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:19:30.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:19:30.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:30.287 INFO:teuthology.orchestra.run.smithi038.stdout:client15396 2024-09-21T06:19:30.288 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d022e7d2-77df-11ef-baf5-efdc52797490.client15396/status') 2024-09-21T06:19:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:19:30.348 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.15396 (3)192.168.0.1:0/1248945830 2024-09-21T06:19:30.348 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2024-09-21T06:19:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2024-09-21T06:19:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2024-09-21T06:19:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:70 bytes copied, 2.5342e-05 s, 2.8 MB/s 2024-09-21T06:19:30.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:19:30.355 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:19:30.372 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:19:30.372 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:19:30.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T06:19:30.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 -- 172.21.15.38:0/464878810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 msgr2=0x7fdbcc075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:30.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 --2- 172.21.15.38:0/464878810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc075bc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009900 tx=0x7fdbc802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 -- 172.21.15.38:0/464878810 shutdown_connections 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 --2- 172.21.15.38:0/464878810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc110050 0x7fdbcc1124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 --2- 172.21.15.38:0/464878810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc076100 0x7fdbcc10fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 --2- 172.21.15.38:0/464878810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc075bc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 -- 172.21.15.38:0/464878810 >> 172.21.15.38:0/464878810 conn(0x7fdbcc0ff500 msgr2=0x7fdbcc101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 -- 172.21.15.38:0/464878810 shutdown_connections 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.485+0000 7fdbd4751640 1 -- 172.21.15.38:0/464878810 wait complete. 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 Processor -- start 2024-09-21T06:19:30.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 -- start start 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc076100 0x7fdbcc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 0x7fdbcc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc115d80 con 0x7fdbcc0757b0 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc115c00 con 0x7fdbcc110050 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd4751640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc115f00 con 0x7fdbcc076100 2024-09-21T06:19:30.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd24ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd24ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58738/0 (socket says 172.21.15.38:58738) 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.486+0000 7fdbd24ed640 1 -- 172.21.15.38:0/1026629689 learned_addr learned my addr 172.21.15.38:0/1026629689 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd1cec640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc076100 0x7fdbcc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd2cee640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 0x7fdbcc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 -- 172.21.15.38:0/1026629689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc076100 msgr2=0x7fdbcc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc076100 0x7fdbcc19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 -- 172.21.15.38:0/1026629689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 msgr2=0x7fdbcc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 0x7fdbcc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 -- 172.21.15.38:0/1026629689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc1a2630 con 0x7fdbcc0757b0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd2cee640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 0x7fdbcc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd24ed640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8005ab0 tx=0x7fdbc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc803f030 con 0x7fdbcc0757b0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbc8003cd0 con 0x7fdbcc0757b0 2024-09-21T06:19:30.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc1a28c0 con 0x7fdbcc0757b0 2024-09-21T06:19:30.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8035070 con 0x7fdbcc0757b0 2024-09-21T06:19:30.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.487+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1a90b0 con 0x7fdbcc0757b0 2024-09-21T06:19:30.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.488+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc075bc0 con 0x7fdbcc0757b0 2024-09-21T06:19:30.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.490+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fdbc8042030 con 0x7fdbcc0757b0 2024-09-21T06:19:30.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.491+0000 7fdbc37fe640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 0x7fdbb80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:30.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.491+0000 7fdbd1cec640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 0x7fdbb80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:30.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.491+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdbc8107c70 con 0x7fdbcc0757b0 2024-09-21T06:19:30.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.491+0000 7fdbd1cec640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 0x7fdbb80b8af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:30.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.495+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbc80ce460 con 0x7fdbcc0757b0 2024-09-21T06:19:30.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:30.722+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fdbcc1a92e0 con 0x7fdbcc0757b0 2024-09-21T06:19:31.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.454+0000 7fdbc37fe640 1 -- 172.21.15.38:0/1026629689 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fdbc80d2840 con 0x7fdbcc0757b0 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 msgr2=0x7fdbb80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 0x7fdbb80b8af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005850 comp rx=0 tx=0).stop 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 msgr2=0x7fdbcc19c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8005ab0 tx=0x7fdbc80042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 shutdown_connections 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbb80b65e0 0x7fdbb80b8af0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbcc110050 0x7fdbcc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbcc076100 0x7fdbcc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 --2- 172.21.15.38:0/1026629689 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbcc0757b0 0x7fdbcc19c700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 >> 172.21.15.38:0/1026629689 conn(0x7fdbcc0ff500 msgr2=0x7fdbcc100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:31.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.457+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 shutdown_connections 2024-09-21T06:19:31.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.458+0000 7fdbd4751640 1 -- 172.21.15.38:0/1026629689 wait complete. 2024-09-21T06:19:31.474 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 -- 172.21.15.38:0/822072442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c105280 msgr2=0x7f1d8c10d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 --2- 172.21.15.38:0/822072442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c105280 0x7f1d8c10d7c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009900 tx=0x7f1d8002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 -- 172.21.15.38:0/822072442 shutdown_connections 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 --2- 172.21.15.38:0/822072442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c10dd90 0x7f1d8c110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 --2- 172.21.15.38:0/822072442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c105280 0x7f1d8c10d7c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 --2- 172.21.15.38:0/822072442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c104930 0x7f1d8c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 -- 172.21.15.38:0/822072442 >> 172.21.15.38:0/822072442 conn(0x7f1d8c0fe3c0 msgr2=0x7f1d8c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:31.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 -- 172.21.15.38:0/822072442 shutdown_connections 2024-09-21T06:19:31.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.595+0000 7f1d918f9640 1 -- 172.21.15.38:0/822072442 wait complete. 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 Processor -- start 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 -- start start 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 0x7f1d8c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c10dd90 0x7f1d8c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c113b10 con 0x7f1d8c104930 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c113990 con 0x7f1d8c10dd90 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.596+0000 7f1d918f9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c113c90 con 0x7f1d8c105280 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:31.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58758/0 (socket says 172.21.15.38:58758) 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 -- 172.21.15.38:0/3970728511 learned_addr learned my addr 172.21.15.38:0/3970728511 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8b7fe640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c10dd90 0x7f1d8c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8a7fc640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 0x7f1d8c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 -- 172.21.15.38:0/3970728511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 msgr2=0x7f1d8c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 0x7f1d8c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 -- 172.21.15.38:0/3970728511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c10dd90 msgr2=0x7f1d8c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c10dd90 0x7f1d8c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 -- 172.21.15.38:0/3970728511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c1a0420 con 0x7f1d8c104930 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8a7fc640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 0x7f1d8c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d8affd640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00e9f0 tx=0x7f1d7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c00cd80 con 0x7f1d8c104930 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d7c010900 con 0x7f1d8c104930 2024-09-21T06:19:31.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8c1a0710 con 0x7f1d8c104930 2024-09-21T06:19:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c018920 con 0x7f1d8c104930 2024-09-21T06:19:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.597+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8c1a6ea0 con 0x7f1d8c104930 2024-09-21T06:19:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.598+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8c06c080 con 0x7f1d8c104930 2024-09-21T06:19:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.600+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f1d7c010ab0 con 0x7f1d8c104930 2024-09-21T06:19:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.601+0000 7f1d908f7640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 0x7f1d740b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.601+0000 7f1d8a7fc640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 0x7f1d740b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.601+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d7c0e7d30 con 0x7f1d8c104930 2024-09-21T06:19:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.601+0000 7f1d8a7fc640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 0x7f1d740b8af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1d80000c00 tx=0x7f1d80032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.604+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d7c0ae520 con 0x7f1d8c104930 2024-09-21T06:19:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-mon[31215]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T06:19:31.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.825+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f1d8c100540 con 0x7f1d740b65e0 2024-09-21T06:19:31.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.841+0000 7f1d908f7640 1 -- 172.21.15.38:0/3970728511 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f1d8c100540 con 0x7f1d740b65e0 2024-09-21T06:19:31.843 INFO:teuthology.orchestra.run.smithi038.stdout:{} 2024-09-21T06:19:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 msgr2=0x7f1d740b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 0x7f1d740b8af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1d80000c00 tx=0x7f1d80032c70 comp rx=0 tx=0).stop 2024-09-21T06:19:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 msgr2=0x7f1d8c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:31.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00e9f0 tx=0x7f1d7c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 shutdown_connections 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d740b65e0 0x7f1d740b8af0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d8c10dd90 0x7f1d8c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d8c105280 0x7f1d8c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 --2- 172.21.15.38:0/3970728511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d8c104930 0x7f1d8c19a4f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.843+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 >> 172.21.15.38:0/3970728511 conn(0x7f1d8c0fe3c0 msgr2=0x7f1d8c0ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.844+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 shutdown_connections 2024-09-21T06:19:31.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.844+0000 7f1d918f9640 1 -- 172.21.15.38:0/3970728511 wait complete. 2024-09-21T06:19:31.856 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T06:19:31.867 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T06:19:31.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:19:31.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:31 smithi174 ceph-mon[34815]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:31.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:31 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T06:19:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:31 smithi044 ceph-mon[34369]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:19:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:31 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T06:19:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 -- 172.21.15.38:0/2469908955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb614102990 msgr2=0x7fb614102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 --2- 172.21.15.38:0/2469908955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb614102990 0x7fb614102da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb604009900 tx=0x7fb60402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 -- 172.21.15.38:0/2469908955 shutdown_connections 2024-09-21T06:19:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 --2- 172.21.15.38:0/2469908955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614108c10 0x7fb61410f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 --2- 172.21.15.38:0/2469908955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6141082c0 0x7fb6141086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 --2- 172.21.15.38:0/2469908955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb614102990 0x7fb614102da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 -- 172.21.15.38:0/2469908955 >> 172.21.15.38:0/2469908955 conn(0x7fb6140fe350 msgr2=0x7fb6141007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 -- 172.21.15.38:0/2469908955 shutdown_connections 2024-09-21T06:19:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.998+0000 7fb61a663640 1 -- 172.21.15.38:0/2469908955 wait complete. 2024-09-21T06:19:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.999+0000 7fb61a663640 1 Processor -- start 2024-09-21T06:19:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:31.999+0000 7fb61a663640 1 -- start start 2024-09-21T06:19:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614102990 0x7fb61419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb614108c10 0x7fb61419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb6141129f0 con 0x7fb6141082c0 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb614112870 con 0x7fb614102990 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb614112b70 con 0x7fb614108c10 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58796/0 (socket says 172.21.15.38:58796) 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 -- 172.21.15.38:0/336507079 learned_addr learned my addr 172.21.15.38:0/336507079 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb613fff640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614102990 0x7fb61419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb618c00640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb614108c10 0x7fb61419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 -- 172.21.15.38:0/336507079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb614108c10 msgr2=0x7fb61419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb614108c10 0x7fb61419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 -- 172.21.15.38:0/336507079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614102990 msgr2=0x7fb61419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614102990 0x7fb61419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 -- 172.21.15.38:0/336507079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6141a0510 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6137fe640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d950 tx=0x7fb5fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc017070 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb5fc009c30 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6141a0800 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.000+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0047a0 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.001+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6141a6f90 con 0x7fb6141082c0 2024-09-21T06:19:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.002+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb614102da0 con 0x7fb6141082c0 2024-09-21T06:19:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.003+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fb5fc004020 con 0x7fb6141082c0 2024-09-21T06:19:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.004+0000 7fb6117fa640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 0x7fb6000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.004+0000 7fb613fff640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 0x7fb6000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.004+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb5fc0e74a0 con 0x7fb6141082c0 2024-09-21T06:19:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.005+0000 7fb613fff640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 0x7fb6000b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb604009230 tx=0x7fb6040058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.007+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5fc020020 con 0x7fb6141082c0 2024-09-21T06:19:32.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.198+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb61402e640 con 0x7fb6141082c0 2024-09-21T06:19:32.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.199+0000 7fb6117fa640 1 -- 172.21.15.38:0/336507079 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7fb5fc0adc90 con 0x7fb6141082c0 2024-09-21T06:19:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:32.201 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:19:32.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 msgr2=0x7fb6000b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 0x7fb6000b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb604009230 tx=0x7fb6040058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 msgr2=0x7fb61419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d950 tx=0x7fb5fc00de10 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 shutdown_connections 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb6000b6560 0x7fb6000b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb614108c10 0x7fb61419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb6141082c0 0x7fb61419ab80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 --2- 172.21.15.38:0/336507079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb614102990 0x7fb61419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 >> 172.21.15.38:0/336507079 conn(0x7fb6140fe350 msgr2=0x7fb61406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 shutdown_connections 2024-09-21T06:19:32.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.202+0000 7fb61a663640 1 -- 172.21.15.38:0/336507079 wait complete. 2024-09-21T06:19:32.214 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:19:31.831+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:19:32.214 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:19:31.831+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:19:32.214 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:19:31.831+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:19:32.214 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:19:31.831+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:19:32.214 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:19:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:19:31.831+0000 7fe61c288640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:19:32.216 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:13:12.045212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:17:43.494293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:17:45.824173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:19:32.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:19:32.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 -- 172.21.15.38:0/813401436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56101061c0 msgr2=0x7f56101065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 --2- 172.21.15.38:0/813401436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56101061c0 0x7f56101065d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5604009900 tx=0x7f560402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:32.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 -- 172.21.15.38:0/813401436 shutdown_connections 2024-09-21T06:19:32.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 --2- 172.21.15.38:0/813401436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5610106b10 0x7f56101105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 --2- 172.21.15.38:0/813401436 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f56101061c0 0x7f56101065d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 --2- 172.21.15.38:0/813401436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610101fe0 0x7f56101023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.331+0000 7f5615eec640 1 -- 172.21.15.38:0/813401436 >> 172.21.15.38:0/813401436 conn(0x7f5610079e10 msgr2=0x7f561007a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.332+0000 7f5615eec640 1 -- 172.21.15.38:0/813401436 shutdown_connections 2024-09-21T06:19:32.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.332+0000 7f5615eec640 1 -- 172.21.15.38:0/813401436 wait complete. 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.332+0000 7f5615eec640 1 Processor -- start 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.332+0000 7f5615eec640 1 -- start start 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56101061c0 0x7f561019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 0x7f561019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5610113b00 con 0x7f5610101fe0 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5610113980 con 0x7f5610106b10 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f5615eec640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5610113c80 con 0x7f56101061c0 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58806/0 (socket says 172.21.15.38:58806) 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 -- 172.21.15.38:0/2839477615 learned_addr learned my addr 172.21.15.38:0/2839477615 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560effd640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56101061c0 0x7f561019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560ffff640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 0x7f561019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 -- 172.21.15.38:0/2839477615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56101061c0 msgr2=0x7f561019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56101061c0 0x7f561019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 -- 172.21.15.38:0/2839477615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 msgr2=0x7f561019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 0x7f561019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 -- 172.21.15.38:0/2839477615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56101a0440 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560ffff640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 0x7f561019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560f7fe640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f560000c970 tx=0x7f560000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.333+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600007c10 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.334+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5600007db0 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.334+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56101a0730 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.334+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560000f910 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.334+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56101a6f50 con 0x7f5610101fe0 2024-09-21T06:19:32.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.335+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561006b590 con 0x7f5610101fe0 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.336+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f560000fab0 con 0x7f5610101fe0 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.337+0000 7f560cff9640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 0x7f55f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.337+0000 7f560effd640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 0x7f55f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.337+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f56000e7b50 con 0x7f5610101fe0 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.338+0000 7f560effd640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 0x7f55f80b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5604005940 tx=0x7f56040058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.340+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56000ae3d0 con 0x7f5610101fe0 2024-09-21T06:19:32.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.529+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f561002e640 con 0x7f5610101fe0 2024-09-21T06:19:32.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.530+0000 7f560cff9640 1 -- 172.21.15.38:0/2839477615 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f56000b27b0 con 0x7f5610101fe0 2024-09-21T06:19:32.531 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 msgr2=0x7f55f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 0x7f55f80b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5604005940 tx=0x7f56040058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 msgr2=0x7f561019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f560000c970 tx=0x7f560000ce30 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 shutdown_connections 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55f80b6560 0x7f55f80b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5610106b10 0x7f561019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56101061c0 0x7f561019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 --2- 172.21.15.38:0/2839477615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5610101fe0 0x7f561019a5a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 >> 172.21.15.38:0/2839477615 conn(0x7f5610079e10 msgr2=0x7f5610109580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 shutdown_connections 2024-09-21T06:19:32.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.532+0000 7f5615eec640 1 -- 172.21.15.38:0/2839477615 wait complete. 2024-09-21T06:19:32.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:19:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.660+0000 7f6ad0a25640 1 -- 172.21.15.38:0/1550369734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1082f0 msgr2=0x7f6acc108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.660+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/1550369734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1082f0 0x7f6acc108700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009900 tx=0x7f6ab402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 -- 172.21.15.38:0/1550369734 shutdown_connections 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/1550369734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 0x7f6acc10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/1550369734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1082f0 0x7f6acc108700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/1550369734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1029c0 0x7f6acc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 -- 172.21.15.38:0/1550369734 >> 172.21.15.38:0/1550369734 conn(0x7f6acc0fe400 msgr2=0x7f6acc100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 -- 172.21.15.38:0/1550369734 shutdown_connections 2024-09-21T06:19:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 -- 172.21.15.38:0/1550369734 wait complete. 2024-09-21T06:19:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.661+0000 7f6ad0a25640 1 Processor -- start 2024-09-21T06:19:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 -- start start 2024-09-21T06:19:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 0x7f6acc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 0x7f6acc19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc112a20 con 0x7f6acc1029c0 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc1128a0 con 0x7f6acc108c40 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ad0a25640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc112ba0 con 0x7f6acc1082f0 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58814/0 (socket says 172.21.15.38:58814) 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 -- 172.21.15.38:0/3966114599 learned_addr learned my addr 172.21.15.38:0/3966114599 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ac9d9b640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 0x7f6acc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6acad9d640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 0x7f6acc19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 -- 172.21.15.38:0/3966114599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 msgr2=0x7f6acc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 0x7f6acc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 -- 172.21.15.38:0/3966114599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 msgr2=0x7f6acc19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 0x7f6acc19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 -- 172.21.15.38:0/3966114599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc1a04e0 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6ac9d9b640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 0x7f6acc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.662+0000 7f6aca59c640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00e9f0 tx=0x7f6abc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.663+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00cd80 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.663+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc1a07d0 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.663+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6abc010900 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.663+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc018920 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.663+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1a6f60 con 0x7f6acc1029c0 2024-09-21T06:19:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.664+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc103c30 con 0x7f6acc1029c0 2024-09-21T06:19:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.665+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f6abc010ab0 con 0x7f6acc1029c0 2024-09-21T06:19:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.666+0000 7f6ac37fe640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 0x7f6ab80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.666+0000 7f6ac9d9b640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 0x7f6ab80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.666+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6abc0e7dc0 con 0x7f6acc1029c0 2024-09-21T06:19:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.667+0000 7f6ac9d9b640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 0x7f6ab80b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000c00 tx=0x7f6ab4032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.669+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6abc0ae550 con 0x7f6acc1029c0 2024-09-21T06:19:32.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:32 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T06:19:32.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:32 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:19:32.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:32 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/336507079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:32.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.858+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6acc19b6d0 con 0x7f6acc1029c0 2024-09-21T06:19:32.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.858+0000 7f6ac37fe640 1 -- 172.21.15.38:0/3966114599 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f6abc0b2930 con 0x7f6acc1029c0 2024-09-21T06:19:32.860 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 msgr2=0x7f6ab80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 0x7f6ab80b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000c00 tx=0x7f6ab4032c70 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 msgr2=0x7f6acc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00e9f0 tx=0x7f6abc00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 shutdown_connections 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6ab80b6560 0x7f6ab80b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6acc108c40 0x7f6acc19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6acc1082f0 0x7f6acc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 --2- 172.21.15.38:0/3966114599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6acc1029c0 0x7f6acc19a5b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 >> 172.21.15.38:0/3966114599 conn(0x7f6acc0fe400 msgr2=0x7f6acc06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 shutdown_connections 2024-09-21T06:19:32.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.861+0000 7f6ad0a25640 1 -- 172.21.15.38:0/3966114599 wait complete. 2024-09-21T06:19:32.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:19:32.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:32 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T06:19:32.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:32 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:19:32.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:32 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/336507079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:32.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:32 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1026629689' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T06:19:32.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:32 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:19:32.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:32 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/336507079' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:32.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.988+0000 7f4f66e4a640 1 -- 172.21.15.38:0/4184546268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60102140 msgr2=0x7f4f60102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.988+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/4184546268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60102140 0x7f4f60102550 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009900 tx=0x7f4f5402a410 comp rx=0 tx=0).stop 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 -- 172.21.15.38:0/4184546268 shutdown_connections 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/4184546268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 0x7f4f6010ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/4184546268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60107a70 0x7f4f60107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/4184546268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60102140 0x7f4f60102550 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 -- 172.21.15.38:0/4184546268 >> 172.21.15.38:0/4184546268 conn(0x7f4f60079e50 msgr2=0x7f4f6007a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 -- 172.21.15.38:0/4184546268 shutdown_connections 2024-09-21T06:19:32.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 -- 172.21.15.38:0/4184546268 wait complete. 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 Processor -- start 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.989+0000 7f4f66e4a640 1 -- start start 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60102140 0x7f4f6019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 0x7f4f6019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4f60111910 con 0x7f4f60107a70 2024-09-21T06:19:32.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f60111790 con 0x7f4f60102140 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f66e4a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4f60111a90 con 0x7f4f601083c0 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58838/0 (socket says 172.21.15.38:58838) 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 -- 172.21.15.38:0/2158006311 learned_addr learned my addr 172.21.15.38:0/2158006311 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f64be6640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60102140 0x7f4f6019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f653e7640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 0x7f4f6019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 -- 172.21.15.38:0/2158006311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 msgr2=0x7f4f6019fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 0x7f4f6019fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 -- 172.21.15.38:0/2158006311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60102140 msgr2=0x7f4f6019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60102140 0x7f4f6019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 -- 172.21.15.38:0/2158006311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f601a0570 con 0x7f4f60107a70 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.990+0000 7f4f5ffff640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00d740 tx=0x7f4f4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.991+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c017070 con 0x7f4f60107a70 2024-09-21T06:19:32.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.991+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f601a0860 con 0x7f4f60107a70 2024-09-21T06:19:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.991+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f4c00de50 con 0x7f4f60107a70 2024-09-21T06:19:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.991+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00f620 con 0x7f4f60107a70 2024-09-21T06:19:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.991+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f601a6ff0 con 0x7f4f60107a70 2024-09-21T06:19:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.992+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f60102550 con 0x7f4f60107a70 2024-09-21T06:19:32.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.994+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f4f4c01a070 con 0x7f4f60107a70 2024-09-21T06:19:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.994+0000 7f4f5dffb640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 0x7f4f500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.994+0000 7f4f64be6640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 0x7f4f500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.994+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4f4c0e6d30 con 0x7f4f60107a70 2024-09-21T06:19:32.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.995+0000 7f4f64be6640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 0x7f4f500b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009230 tx=0x7f4f540058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:32.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:32.997+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f4c0b1900 con 0x7f4f60107a70 2024-09-21T06:19:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.187+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f6010a190 con 0x7f4f60107a70 2024-09-21T06:19:33.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.188+0000 7f4f5dffb640 1 -- 172.21.15.38:0/2158006311 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7f4f4c0b6840 con 0x7f4f60107a70 2024-09-21T06:19:33.189 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-09-21T06:19:33.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 msgr2=0x7f4f500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 0x7f4f500b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009230 tx=0x7f4f540058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 msgr2=0x7f4f6019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00d740 tx=0x7f4f4c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 shutdown_connections 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4f500b6560 0x7f4f500b8a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4f601083c0 0x7f4f6019fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f60107a70 0x7f4f6019abe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 --2- 172.21.15.38:0/2158006311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f60102140 0x7f4f6019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 >> 172.21.15.38:0/2158006311 conn(0x7f4f60079e50 msgr2=0x7f4f60105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 shutdown_connections 2024-09-21T06:19:33.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.190+0000 7f4f66e4a640 1 -- 172.21.15.38:0/2158006311 wait complete. 2024-09-21T06:19:33.203 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T06:19:33.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:33.462 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:33.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:33 smithi038 ceph-mon[31215]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:33.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:33 smithi038 ceph-mon[31215]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:33.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:33 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2839477615' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:33 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3966114599' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.733 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:33 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2158006311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:33 smithi174 ceph-mon[34815]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:33 smithi174 ceph-mon[34815]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:33 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2839477615' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:33 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3966114599' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:33 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2158006311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:33 smithi044 ceph-mon[34369]: pgmap v315: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:33 smithi044 ceph-mon[34369]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:33 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2839477615' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:33 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3966114599' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:33 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2158006311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:19:33.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 -- 172.21.15.38:0/2324448854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd588105320 msgr2=0x7fd58810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 --2- 172.21.15.38:0/2324448854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd588105320 0x7fd58810d870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009900 tx=0x7fd57c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 -- 172.21.15.38:0/2324448854 shutdown_connections 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 --2- 172.21.15.38:0/2324448854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd58810de30 0x7fd588110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 --2- 172.21.15.38:0/2324448854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd588105320 0x7fd58810d870 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 --2- 172.21.15.38:0/2324448854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5881049d0 0x7fd588104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 -- 172.21.15.38:0/2324448854 >> 172.21.15.38:0/2324448854 conn(0x7fd588079740 msgr2=0x7fd588079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 -- 172.21.15.38:0/2324448854 shutdown_connections 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.930+0000 7fd58e9be640 1 -- 172.21.15.38:0/2324448854 wait complete. 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.931+0000 7fd58e9be640 1 Processor -- start 2024-09-21T06:19:33.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.931+0000 7fd58e9be640 1 -- start start 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588105320 0x7fd58819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd58810de30 0x7fd58819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd588113bb0 con 0x7fd5881049d0 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd588113a30 con 0x7fd588105320 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58e9be640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd588113d30 con 0x7fd58810de30 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58860/0 (socket says 172.21.15.38:58860) 2024-09-21T06:19:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 -- 172.21.15.38:0/1447556973 learned_addr learned my addr 172.21.15.38:0/1447556973 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd5877fe640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588105320 0x7fd58819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd58cf5b640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd58810de30 0x7fd58819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 -- 172.21.15.38:0/1447556973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd58810de30 msgr2=0x7fd58819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd58810de30 0x7fd58819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 -- 172.21.15.38:0/1447556973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588105320 msgr2=0x7fd58819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588105320 0x7fd58819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 -- 172.21.15.38:0/1447556973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5881a0450 con 0x7fd5881049d0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.932+0000 7fd587fff640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c970 tx=0x7fd57800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.933+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578007c10 con 0x7fd5881049d0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.933+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd578007db0 con 0x7fd5881049d0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.933+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57800f910 con 0x7fd5881049d0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.933+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5881a0740 con 0x7fd5881049d0 2024-09-21T06:19:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.933+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881a6f60 con 0x7fd5881049d0 2024-09-21T06:19:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.934+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58806c240 con 0x7fd5881049d0 2024-09-21T06:19:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.935+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd57800fab0 con 0x7fd5881049d0 2024-09-21T06:19:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.936+0000 7fd5857fa640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 0x7fd5700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.936+0000 7fd5877fe640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 0x7fd5700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.936+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd5780e79f0 con 0x7fd5881049d0 2024-09-21T06:19:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.937+0000 7fd5877fe640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 0x7fd5700b8aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005940 tx=0x7fd57c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:33.939+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5780ae2a0 con 0x7fd5881049d0 2024-09-21T06:19:34.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.163+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd588104de0 con 0x7fd5881049d0 2024-09-21T06:19:34.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.164+0000 7fd5857fa640 1 -- 172.21.15.38:0/1447556973 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7fd588104de0 con 0x7fd5881049d0 2024-09-21T06:19:34.166 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:34.166 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"btime":"2024-09-21T06:19:31:452263+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:19:30.723218+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:19:34.166 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 msgr2=0x7fd5700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 0x7fd5700b8aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005940 tx=0x7fd57c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 msgr2=0x7fd58819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c970 tx=0x7fd57800ce30 comp rx=0 tx=0).stop 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 shutdown_connections 2024-09-21T06:19:34.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd5700b6590 0x7fd5700b8aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd58810de30 0x7fd58819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd588105320 0x7fd58819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.166+0000 7fd58e9be640 1 --2- 172.21.15.38:0/1447556973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5881049d0 0x7fd58819a5a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.167+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 >> 172.21.15.38:0/1447556973 conn(0x7fd588079740 msgr2=0x7fd5880ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.167+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 shutdown_connections 2024-09-21T06:19:34.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.167+0000 7fd58e9be640 1 -- 172.21.15.38:0/1447556973 wait complete. 2024-09-21T06:19:34.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:34 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1447556973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:34.843 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T06:19:34.843 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T06:19:34.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:19:34.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:34 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1447556973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:34.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:34 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1447556973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 -- 172.21.15.38:0/1029261492 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c102020 msgr2=0x7f0f9c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 --2- 172.21.15.38:0/1029261492 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c102020 0x7f0f9c102430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 -- 172.21.15.38:0/1029261492 shutdown_connections 2024-09-21T06:19:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 --2- 172.21.15.38:0/1029261492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c109d40 0x7f0f9c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 --2- 172.21.15.38:0/1029261492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c1093f0 0x7f0f9c109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 --2- 172.21.15.38:0/1029261492 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c102020 0x7f0f9c102430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.959+0000 7f0fa162e640 1 -- 172.21.15.38:0/1029261492 >> 172.21.15.38:0/1029261492 conn(0x7f0f9c079e50 msgr2=0x7f0f9c07a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.960+0000 7f0fa162e640 1 -- 172.21.15.38:0/1029261492 shutdown_connections 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.960+0000 7f0fa162e640 1 -- 172.21.15.38:0/1029261492 wait complete. 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.960+0000 7f0fa162e640 1 Processor -- start 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.960+0000 7f0fa162e640 1 -- start start 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c102020 0x7f0f9c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c1093f0 0x7f0f9c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:34.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113b20 con 0x7f0f9c109d40 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1139a0 con 0x7f0f9c102020 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0fa162e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113ca0 con 0x7f0f9c1093f0 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58886/0 (socket says 172.21.15.38:58886) 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 -- 172.21.15.38:0/993708184 learned_addr learned my addr 172.21.15.38:0/993708184 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9affd640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c102020 0x7f0f9c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:34.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9a7fc640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c1093f0 0x7f0f9c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 -- 172.21.15.38:0/993708184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c1093f0 msgr2=0x7f0f9c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c1093f0 0x7f0f9c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 -- 172.21.15.38:0/993708184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c102020 msgr2=0x7f0f9c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c102020 0x7f0f9c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 -- 172.21.15.38:0/993708184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c1a0430 con 0x7f0f9c109d40 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.961+0000 7f0f9b7fe640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400cad0 tx=0x7f0f9400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.962+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400ae20 con 0x7f0f9c109d40 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.962+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0f94005020 con 0x7f0f9c109d40 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.962+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c1a0720 con 0x7f0f9c109d40 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.962+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400f6b0 con 0x7f0f9c109d40 2024-09-21T06:19:34.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.962+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1a6eb0 con 0x7f0f9c109d40 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.963+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c102430 con 0x7f0f9c109d40 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.964+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f0f940051d0 con 0x7f0f9c109d40 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.965+0000 7f0f83fff640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 0x7f0f840b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.965+0000 7f0f9affd640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 0x7f0f840b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.965+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0f940e7540 con 0x7f0f9c109d40 2024-09-21T06:19:34.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.966+0000 7f0f9affd640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 0x7f0f840b8b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009230 tx=0x7f0f8c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:34.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:34.969+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f94014030 con 0x7f0f9c109d40 2024-09-21T06:19:35.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.155+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f9c10bb40 con 0x7f0f840b6670 2024-09-21T06:19:35.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.159+0000 7f0f83fff640 1 -- 172.21.15.38:0/993708184 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258813 (secure 0 0 0) 0x7f0f9c10bb40 con 0x7f0f840b6670 2024-09-21T06:19:35.163 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:35.164 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.162+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 msgr2=0x7f0f840b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.162+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 0x7f0f840b8b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009230 tx=0x7f0f8c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 msgr2=0x7f0f9c19fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400cad0 tx=0x7f0f9400cf90 comp rx=0 tx=0).stop 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 shutdown_connections 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0f840b6670 0x7f0f840b8b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f9c109d40 0x7f0f9c19fd30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0f9c1093f0 0x7f0f9c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 --2- 172.21.15.38:0/993708184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f9c102020 0x7f0f9c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 >> 172.21.15.38:0/993708184 conn(0x7f0f9c079e50 msgr2=0x7f0f9c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 shutdown_connections 2024-09-21T06:19:35.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.163+0000 7f0fa162e640 1 -- 172.21.15.38:0/993708184 wait complete. 2024-09-21T06:19:35.176 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-21T06:19:33.685054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661191,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":681,"num_read_kb":442,"num_write":297,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":740,"ondisk_log_size":740,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394564,"kb_used_data":12036,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547260,"statfs":{"total":1151940427776,"available":1151536394240,"internally_reserved":0,"allocated":12324864,"data_stored":6967881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003185"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073459+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:19:12.073459+0000","last_peered":"2024-09-21T06:19:12.073459+0000","last_clean":"2024-09-21T06:19:12.073459+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:19:12.073459+0000","last_undegraded":"2024-09-21T06:19:12.073459+0000","last_fullsized":"2024-09-21T06:19:12.073459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070763+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:19:12.070763+0000","last_peered":"2024-09-21T06:19:12.070763+0000","last_clean":"2024-09-21T06:19:12.070763+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:19:12.070763+0000","last_undegraded":"2024-09-21T06:19:12.070763+0000","last_fullsized":"2024-09-21T06:19:12.070763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075065+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:19:12.075065+0000","last_peered":"2024-09-21T06:19:12.075065+0000","last_clean":"2024-09-21T06:19:12.075065+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:19:12.075065+0000","last_undegraded":"2024-09-21T06:19:12.075065+0000","last_fullsized":"2024-09-21T06:19:12.075065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.053794+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:19:12.053794+0000","last_peered":"2024-09-21T06:19:12.053794+0000","last_clean":"2024-09-21T06:19:12.053794+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:19:12.053794+0000","last_undegraded":"2024-09-21T06:19:12.053794+0000","last_fullsized":"2024-09-21T06:19:12.053794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058155+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:19:12.058155+0000","last_peered":"2024-09-21T06:19:12.058155+0000","last_clean":"2024-09-21T06:19:12.058155+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:19:12.058155+0000","last_undegraded":"2024-09-21T06:19:12.058155+0000","last_fullsized":"2024-09-21T06:19:12.058155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080731+0000","last_change":"2024-09-21T06:18:13.404093+0000","last_active":"2024-09-21T06:19:12.080731+0000","last_peered":"2024-09-21T06:19:12.080731+0000","last_clean":"2024-09-21T06:19:12.080731+0000","last_became_active":"2024-09-21T06:18:13.403608+0000","last_became_peered":"2024-09-21T06:18:13.403608+0000","last_unstale":"2024-09-21T06:19:12.080731+0000","last_undegraded":"2024-09-21T06:19:12.080731+0000","last_fullsized":"2024-09-21T06:19:12.080731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:54.362457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070503+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:19:12.070503+0000","last_peered":"2024-09-21T06:19:12.070503+0000","last_clean":"2024-09-21T06:19:12.070503+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:19:12.070503+0000","last_undegraded":"2024-09-21T06:19:12.070503+0000","last_fullsized":"2024-09-21T06:19:12.070503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080883+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:19:12.080883+0000","last_peered":"2024-09-21T06:19:12.080883+0000","last_clean":"2024-09-21T06:19:12.080883+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:19:12.080883+0000","last_undegraded":"2024-09-21T06:19:12.080883+0000","last_fullsized":"2024-09-21T06:19:12.080883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077668+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:19:12.077668+0000","last_peered":"2024-09-21T06:19:12.077668+0000","last_clean":"2024-09-21T06:19:12.077668+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:19:12.077668+0000","last_undegraded":"2024-09-21T06:19:12.077668+0000","last_fullsized":"2024-09-21T06:19:12.077668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.076128+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:19:12.076128+0000","last_peered":"2024-09-21T06:19:12.076128+0000","last_clean":"2024-09-21T06:19:12.076128+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:19:12.076128+0000","last_undegraded":"2024-09-21T06:19:12.076128+0000","last_fullsized":"2024-09-21T06:19:12.076128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077334+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:19:12.077334+0000","last_peered":"2024-09-21T06:19:12.077334+0000","last_clean":"2024-09-21T06:19:12.077334+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:19:12.077334+0000","last_undegraded":"2024-09-21T06:19:12.077334+0000","last_fullsized":"2024-09-21T06:19:12.077334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073676+0000","last_change":"2024-09-21T06:18:13.404172+0000","last_active":"2024-09-21T06:19:12.073676+0000","last_peered":"2024-09-21T06:19:12.073676+0000","last_clean":"2024-09-21T06:19:12.073676+0000","last_became_active":"2024-09-21T06:18:13.403643+0000","last_became_peered":"2024-09-21T06:18:13.403643+0000","last_unstale":"2024-09-21T06:19:12.073676+0000","last_undegraded":"2024-09-21T06:19:12.073676+0000","last_fullsized":"2024-09-21T06:19:12.073676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:12.264818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069060+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:19:12.069060+0000","last_peered":"2024-09-21T06:19:12.069060+0000","last_clean":"2024-09-21T06:19:12.069060+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:19:12.069060+0000","last_undegraded":"2024-09-21T06:19:12.069060+0000","last_fullsized":"2024-09-21T06:19:12.069060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070690+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:19:12.070690+0000","last_peered":"2024-09-21T06:19:12.070690+0000","last_clean":"2024-09-21T06:19:12.070690+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:19:12.070690+0000","last_undegraded":"2024-09-21T06:19:12.070690+0000","last_fullsized":"2024-09-21T06:19:12.070690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071321+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:19:12.071321+0000","last_peered":"2024-09-21T06:19:12.071321+0000","last_clean":"2024-09-21T06:19:12.071321+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:19:12.071321+0000","last_undegraded":"2024-09-21T06:19:12.071321+0000","last_fullsized":"2024-09-21T06:19:12.071321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078351+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:19:12.078351+0000","last_peered":"2024-09-21T06:19:12.078351+0000","last_clean":"2024-09-21T06:19:12.078351+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:19:12.078351+0000","last_undegraded":"2024-09-21T06:19:12.078351+0000","last_fullsized":"2024-09-21T06:19:12.078351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073590+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:19:12.073590+0000","last_peered":"2024-09-21T06:19:12.073590+0000","last_clean":"2024-09-21T06:19:12.073590+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:19:12.073590+0000","last_undegraded":"2024-09-21T06:19:12.073590+0000","last_fullsized":"2024-09-21T06:19:12.073590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073908+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:19:12.073908+0000","last_peered":"2024-09-21T06:19:12.073908+0000","last_clean":"2024-09-21T06:19:12.073908+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:19:12.073908+0000","last_undegraded":"2024-09-21T06:19:12.073908+0000","last_fullsized":"2024-09-21T06:19:12.073908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069518+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:19:12.069518+0000","last_peered":"2024-09-21T06:19:12.069518+0000","last_clean":"2024-09-21T06:19:12.069518+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:19:12.069518+0000","last_undegraded":"2024-09-21T06:19:12.069518+0000","last_fullsized":"2024-09-21T06:19:12.069518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069304+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:19:12.069304+0000","last_peered":"2024-09-21T06:19:12.069304+0000","last_clean":"2024-09-21T06:19:12.069304+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:19:12.069304+0000","last_undegraded":"2024-09-21T06:19:12.069304+0000","last_fullsized":"2024-09-21T06:19:12.069304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.081113+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:19:12.081113+0000","last_peered":"2024-09-21T06:19:12.081113+0000","last_clean":"2024-09-21T06:19:12.081113+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:19:12.081113+0000","last_undegraded":"2024-09-21T06:19:12.081113+0000","last_fullsized":"2024-09-21T06:19:12.081113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080630+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:19:12.080630+0000","last_peered":"2024-09-21T06:19:12.080630+0000","last_clean":"2024-09-21T06:19:12.080630+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:19:12.080630+0000","last_undegraded":"2024-09-21T06:19:12.080630+0000","last_fullsized":"2024-09-21T06:19:12.080630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067299+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:19:12.067299+0000","last_peered":"2024-09-21T06:19:12.067299+0000","last_clean":"2024-09-21T06:19:12.067299+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:19:12.067299+0000","last_undegraded":"2024-09-21T06:19:12.067299+0000","last_fullsized":"2024-09-21T06:19:12.067299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063067+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:19:12.063067+0000","last_peered":"2024-09-21T06:19:12.063067+0000","last_clean":"2024-09-21T06:19:12.063067+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:19:12.063067+0000","last_undegraded":"2024-09-21T06:19:12.063067+0000","last_fullsized":"2024-09-21T06:19:12.063067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064430+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:19:12.064430+0000","last_peered":"2024-09-21T06:19:12.064430+0000","last_clean":"2024-09-21T06:19:12.064430+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:19:12.064430+0000","last_undegraded":"2024-09-21T06:19:12.064430+0000","last_fullsized":"2024-09-21T06:19:12.064430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.056558+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:19:12.056558+0000","last_peered":"2024-09-21T06:19:12.056558+0000","last_clean":"2024-09-21T06:19:12.056558+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:19:12.056558+0000","last_undegraded":"2024-09-21T06:19:12.056558+0000","last_fullsized":"2024-09-21T06:19:12.056558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.062141+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:19:12.062141+0000","last_peered":"2024-09-21T06:19:12.062141+0000","last_clean":"2024-09-21T06:19:12.062141+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:19:12.062141+0000","last_undegraded":"2024-09-21T06:19:12.062141+0000","last_fullsized":"2024-09-21T06:19:12.062141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071624+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:19:12.071624+0000","last_peered":"2024-09-21T06:19:12.071624+0000","last_clean":"2024-09-21T06:19:12.071624+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:19:12.071624+0000","last_undegraded":"2024-09-21T06:19:12.071624+0000","last_fullsized":"2024-09-21T06:19:12.071624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069474+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:19:12.069474+0000","last_peered":"2024-09-21T06:19:12.069474+0000","last_clean":"2024-09-21T06:19:12.069474+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:19:12.069474+0000","last_undegraded":"2024-09-21T06:19:12.069474+0000","last_fullsized":"2024-09-21T06:19:12.069474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070568+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:19:12.070568+0000","last_peered":"2024-09-21T06:19:12.070568+0000","last_clean":"2024-09-21T06:19:12.070568+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:19:12.070568+0000","last_undegraded":"2024-09-21T06:19:12.070568+0000","last_fullsized":"2024-09-21T06:19:12.070568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.054687+0000","last_change":"2024-09-21T06:18:13.500386+0000","last_active":"2024-09-21T06:19:12.054687+0000","last_peered":"2024-09-21T06:19:12.054687+0000","last_clean":"2024-09-21T06:19:12.054687+0000","last_became_active":"2024-09-21T06:18:13.499861+0000","last_became_peered":"2024-09-21T06:18:13.499861+0000","last_unstale":"2024-09-21T06:19:12.054687+0000","last_undegraded":"2024-09-21T06:19:12.054687+0000","last_fullsized":"2024-09-21T06:19:12.054687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:05.084576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063803+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:19:12.063803+0000","last_peered":"2024-09-21T06:19:12.063803+0000","last_clean":"2024-09-21T06:19:12.063803+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:19:12.063803+0000","last_undegraded":"2024-09-21T06:19:12.063803+0000","last_fullsized":"2024-09-21T06:19:12.063803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058613+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:19:12.058613+0000","last_peered":"2024-09-21T06:19:12.058613+0000","last_clean":"2024-09-21T06:19:12.058613+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:19:12.058613+0000","last_undegraded":"2024-09-21T06:19:12.058613+0000","last_fullsized":"2024-09-21T06:19:12.058613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099862+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:19:30.099862+0000","last_peered":"2024-09-21T06:19:30.099862+0000","last_clean":"2024-09-21T06:19:30.099862+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:19:30.099862+0000","last_undegraded":"2024-09-21T06:19:30.099862+0000","last_fullsized":"2024-09-21T06:19:30.099862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.060366+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:19:12.060366+0000","last_peered":"2024-09-21T06:19:12.060366+0000","last_clean":"2024-09-21T06:19:12.060366+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:19:12.060366+0000","last_undegraded":"2024-09-21T06:19:12.060366+0000","last_fullsized":"2024-09-21T06:19:12.060366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400475+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:18:13.400475+0000","last_peered":"2024-09-21T06:18:13.400475+0000","last_clean":"2024-09-21T06:18:13.400475+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:18:13.400475+0000","last_undegraded":"2024-09-21T06:18:13.400475+0000","last_fullsized":"2024-09-21T06:18:13.400475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397823+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:18:13.397823+0000","last_peered":"2024-09-21T06:18:13.397823+0000","last_clean":"2024-09-21T06:18:13.397823+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:18:13.397823+0000","last_undegraded":"2024-09-21T06:18:13.397823+0000","last_fullsized":"2024-09-21T06:18:13.397823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067249+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:19:12.067249+0000","last_peered":"2024-09-21T06:19:12.067249+0000","last_clean":"2024-09-21T06:19:12.067249+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:19:12.067249+0000","last_undegraded":"2024-09-21T06:19:12.067249+0000","last_fullsized":"2024-09-21T06:19:12.067249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498355+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:18:13.498355+0000","last_peered":"2024-09-21T06:18:13.498355+0000","last_clean":"2024-09-21T06:18:13.498355+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:18:13.498355+0000","last_undegraded":"2024-09-21T06:18:13.498355+0000","last_fullsized":"2024-09-21T06:18:13.498355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.074138+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:19:12.074138+0000","last_peered":"2024-09-21T06:19:12.074138+0000","last_clean":"2024-09-21T06:19:12.074138+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:19:12.074138+0000","last_undegraded":"2024-09-21T06:19:12.074138+0000","last_fullsized":"2024-09-21T06:19:12.074138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099246+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:19:30.099246+0000","last_peered":"2024-09-21T06:19:30.099246+0000","last_clean":"2024-09-21T06:19:30.099246+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:19:30.099246+0000","last_undegraded":"2024-09-21T06:19:30.099246+0000","last_fullsized":"2024-09-21T06:19:30.099246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082060+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:19:12.082060+0000","last_peered":"2024-09-21T06:19:12.082060+0000","last_clean":"2024-09-21T06:19:12.082060+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:19:12.082060+0000","last_undegraded":"2024-09-21T06:19:12.082060+0000","last_fullsized":"2024-09-21T06:19:12.082060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070382+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:19:12.070382+0000","last_peered":"2024-09-21T06:19:12.070382+0000","last_clean":"2024-09-21T06:19:12.070382+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:19:12.070382+0000","last_undegraded":"2024-09-21T06:19:12.070382+0000","last_fullsized":"2024-09-21T06:19:12.070382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498383+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:18:13.498383+0000","last_peered":"2024-09-21T06:18:13.498383+0000","last_clean":"2024-09-21T06:18:13.498383+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:18:13.498383+0000","last_undegraded":"2024-09-21T06:18:13.498383+0000","last_fullsized":"2024-09-21T06:18:13.498383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075341+0000","last_change":"2024-09-21T06:18:13.405270+0000","last_active":"2024-09-21T06:19:12.075341+0000","last_peered":"2024-09-21T06:19:12.075341+0000","last_clean":"2024-09-21T06:19:12.075341+0000","last_became_active":"2024-09-21T06:18:13.404759+0000","last_became_peered":"2024-09-21T06:18:13.404759+0000","last_unstale":"2024-09-21T06:19:12.075341+0000","last_undegraded":"2024-09-21T06:19:12.075341+0000","last_fullsized":"2024-09-21T06:19:12.075341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.678457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'33","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.110004+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:19:31.110004+0000","last_peered":"2024-09-21T06:19:31.110004+0000","last_clean":"2024-09-21T06:19:31.110004+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:19:31.110004+0000","last_undegraded":"2024-09-21T06:19:31.110004+0000","last_fullsized":"2024-09-21T06:19:31.110004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058041+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:19:12.058041+0000","last_peered":"2024-09-21T06:19:12.058041+0000","last_clean":"2024-09-21T06:19:12.058041+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:19:12.058041+0000","last_undegraded":"2024-09-21T06:19:12.058041+0000","last_fullsized":"2024-09-21T06:19:12.058041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400650+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:18:13.400650+0000","last_peered":"2024-09-21T06:18:13.400650+0000","last_clean":"2024-09-21T06:18:13.400650+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:18:13.400650+0000","last_undegraded":"2024-09-21T06:18:13.400650+0000","last_fullsized":"2024-09-21T06:18:13.400650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080657+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:19:12.080657+0000","last_peered":"2024-09-21T06:19:12.080657+0000","last_clean":"2024-09-21T06:19:12.080657+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:19:12.080657+0000","last_undegraded":"2024-09-21T06:19:12.080657+0000","last_fullsized":"2024-09-21T06:19:12.080657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498259+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:18:13.498259+0000","last_peered":"2024-09-21T06:18:13.498259+0000","last_clean":"2024-09-21T06:18:13.498259+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:18:13.498259+0000","last_undegraded":"2024-09-21T06:18:13.498259+0000","last_fullsized":"2024-09-21T06:18:13.498259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.079530+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:19:12.079530+0000","last_peered":"2024-09-21T06:19:12.079530+0000","last_clean":"2024-09-21T06:19:12.079530+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:19:12.079530+0000","last_undegraded":"2024-09-21T06:19:12.079530+0000","last_fullsized":"2024-09-21T06:19:12.079530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":128,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.115768+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:19:31.115768+0000","last_peered":"2024-09-21T06:19:31.115768+0000","last_clean":"2024-09-21T06:19:31.115768+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:19:31.115768+0000","last_undegraded":"2024-09-21T06:19:31.115768+0000","last_fullsized":"2024-09-21T06:19:31.115768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075482+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:19:12.075482+0000","last_peered":"2024-09-21T06:19:12.075482+0000","last_clean":"2024-09-21T06:19:12.075482+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:19:12.075482+0000","last_undegraded":"2024-09-21T06:19:12.075482+0000","last_fullsized":"2024-09-21T06:19:12.075482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399100+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:13.399100+0000","last_peered":"2024-09-21T06:18:13.399100+0000","last_clean":"2024-09-21T06:18:13.399100+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:13.399100+0000","last_undegraded":"2024-09-21T06:18:13.399100+0000","last_fullsized":"2024-09-21T06:18:13.399100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068187+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:19:12.068187+0000","last_peered":"2024-09-21T06:19:12.068187+0000","last_clean":"2024-09-21T06:19:12.068187+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:19:12.068187+0000","last_undegraded":"2024-09-21T06:19:12.068187+0000","last_fullsized":"2024-09-21T06:19:12.068187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399604+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:13.399604+0000","last_peered":"2024-09-21T06:18:13.399604+0000","last_clean":"2024-09-21T06:18:13.399604+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:13.399604+0000","last_undegraded":"2024-09-21T06:18:13.399604+0000","last_fullsized":"2024-09-21T06:18:13.399604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068626+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:19:12.068626+0000","last_peered":"2024-09-21T06:19:12.068626+0000","last_clean":"2024-09-21T06:19:12.068626+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:19:12.068626+0000","last_undegraded":"2024-09-21T06:19:12.068626+0000","last_fullsized":"2024-09-21T06:19:12.068626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397973+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:18:13.397973+0000","last_peered":"2024-09-21T06:18:13.397973+0000","last_clean":"2024-09-21T06:18:13.397973+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:18:13.397973+0000","last_undegraded":"2024-09-21T06:18:13.397973+0000","last_fullsized":"2024-09-21T06:18:13.397973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077987+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:19:12.077987+0000","last_peered":"2024-09-21T06:19:12.077987+0000","last_clean":"2024-09-21T06:19:12.077987+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:19:12.077987+0000","last_undegraded":"2024-09-21T06:19:12.077987+0000","last_fullsized":"2024-09-21T06:19:12.077987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498457+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:18:13.498457+0000","last_peered":"2024-09-21T06:18:13.498457+0000","last_clean":"2024-09-21T06:18:13.498457+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:18:13.498457+0000","last_undegraded":"2024-09-21T06:18:13.498457+0000","last_fullsized":"2024-09-21T06:18:13.498457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075186+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:19:12.075186+0000","last_peered":"2024-09-21T06:19:12.075186+0000","last_clean":"2024-09-21T06:19:12.075186+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:19:12.075186+0000","last_undegraded":"2024-09-21T06:19:12.075186+0000","last_fullsized":"2024-09-21T06:19:12.075186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400818+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:18:13.400818+0000","last_peered":"2024-09-21T06:18:13.400818+0000","last_clean":"2024-09-21T06:18:13.400818+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:18:13.400818+0000","last_undegraded":"2024-09-21T06:18:13.400818+0000","last_fullsized":"2024-09-21T06:18:13.400818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077808+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:19:12.077808+0000","last_peered":"2024-09-21T06:19:12.077808+0000","last_clean":"2024-09-21T06:19:12.077808+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:19:12.077808+0000","last_undegraded":"2024-09-21T06:19:12.077808+0000","last_fullsized":"2024-09-21T06:19:12.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498537+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498537+0000","last_peered":"2024-09-21T06:18:13.498537+0000","last_clean":"2024-09-21T06:18:13.498537+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498537+0000","last_undegraded":"2024-09-21T06:18:13.498537+0000","last_fullsized":"2024-09-21T06:18:13.498537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498500+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:18:13.498500+0000","last_peered":"2024-09-21T06:18:13.498500+0000","last_clean":"2024-09-21T06:18:13.498500+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:18:13.498500+0000","last_undegraded":"2024-09-21T06:18:13.498500+0000","last_fullsized":"2024-09-21T06:18:13.498500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075160+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:19:12.075160+0000","last_peered":"2024-09-21T06:19:12.075160+0000","last_clean":"2024-09-21T06:19:12.075160+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:19:12.075160+0000","last_undegraded":"2024-09-21T06:19:12.075160+0000","last_fullsized":"2024-09-21T06:19:12.075160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.061681+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:19:12.061681+0000","last_peered":"2024-09-21T06:19:12.061681+0000","last_clean":"2024-09-21T06:19:12.061681+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:19:12.061681+0000","last_undegraded":"2024-09-21T06:19:12.061681+0000","last_fullsized":"2024-09-21T06:19:12.061681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":120,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:27.108913+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:19:27.108913+0000","last_peered":"2024-09-21T06:19:27.108913+0000","last_clean":"2024-09-21T06:19:27.108913+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:19:27.108913+0000","last_undegraded":"2024-09-21T06:19:27.108913+0000","last_fullsized":"2024-09-21T06:19:27.108913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.065031+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:19:12.065031+0000","last_peered":"2024-09-21T06:19:12.065031+0000","last_clean":"2024-09-21T06:19:12.065031+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:19:12.065031+0000","last_undegraded":"2024-09-21T06:19:12.065031+0000","last_fullsized":"2024-09-21T06:19:12.065031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069879+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:19:12.069879+0000","last_peered":"2024-09-21T06:19:12.069879+0000","last_clean":"2024-09-21T06:19:12.069879+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:19:12.069879+0000","last_undegraded":"2024-09-21T06:19:12.069879+0000","last_fullsized":"2024-09-21T06:19:12.069879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499061+0000","last_change":"2024-09-21T06:18:13.498949+0000","last_active":"2024-09-21T06:18:13.499061+0000","last_peered":"2024-09-21T06:18:13.499061+0000","last_clean":"2024-09-21T06:18:13.499061+0000","last_became_active":"2024-09-21T06:18:13.498496+0000","last_became_peered":"2024-09-21T06:18:13.498496+0000","last_unstale":"2024-09-21T06:18:13.499061+0000","last_undegraded":"2024-09-21T06:18:13.499061+0000","last_fullsized":"2024-09-21T06:18:13.499061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:42.982233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080593+0000","last_change":"2024-09-21T06:18:13.407681+0000","last_active":"2024-09-21T06:19:12.080593+0000","last_peered":"2024-09-21T06:19:12.080593+0000","last_clean":"2024-09-21T06:19:12.080593+0000","last_became_active":"2024-09-21T06:18:13.403705+0000","last_became_peered":"2024-09-21T06:18:13.403705+0000","last_unstale":"2024-09-21T06:19:12.080593+0000","last_undegraded":"2024-09-21T06:19:12.080593+0000","last_fullsized":"2024-09-21T06:19:12.080593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:09.176309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399933+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:13.399933+0000","last_peered":"2024-09-21T06:18:13.399933+0000","last_clean":"2024-09-21T06:18:13.399933+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:13.399933+0000","last_undegraded":"2024-09-21T06:18:13.399933+0000","last_fullsized":"2024-09-21T06:18:13.399933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.059503+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:19:12.059503+0000","last_peered":"2024-09-21T06:19:12.059503+0000","last_clean":"2024-09-21T06:19:12.059503+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:19:12.059503+0000","last_undegraded":"2024-09-21T06:19:12.059503+0000","last_fullsized":"2024-09-21T06:19:12.059503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'12","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.266851+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:19:12.266851+0000","last_peered":"2024-09-21T06:19:12.266851+0000","last_clean":"2024-09-21T06:19:12.266851+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:19:12.266851+0000","last_undegraded":"2024-09-21T06:19:12.266851+0000","last_fullsized":"2024-09-21T06:19:12.266851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080385+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:19:12.080385+0000","last_peered":"2024-09-21T06:19:12.080385+0000","last_clean":"2024-09-21T06:19:12.080385+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:19:12.080385+0000","last_undegraded":"2024-09-21T06:19:12.080385+0000","last_fullsized":"2024-09-21T06:19:12.080385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498978+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:18:13.498978+0000","last_peered":"2024-09-21T06:18:13.498978+0000","last_clean":"2024-09-21T06:18:13.498978+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:18:13.498978+0000","last_undegraded":"2024-09-21T06:18:13.498978+0000","last_fullsized":"2024-09-21T06:18:13.498978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071837+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:19:12.071837+0000","last_peered":"2024-09-21T06:19:12.071837+0000","last_clean":"2024-09-21T06:19:12.071837+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:19:12.071837+0000","last_undegraded":"2024-09-21T06:19:12.071837+0000","last_fullsized":"2024-09-21T06:19:12.071837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402231+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:18:13.402231+0000","last_peered":"2024-09-21T06:18:13.402231+0000","last_clean":"2024-09-21T06:18:13.402231+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:18:13.402231+0000","last_undegraded":"2024-09-21T06:18:13.402231+0000","last_fullsized":"2024-09-21T06:18:13.402231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.029978+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:19:12.029978+0000","last_peered":"2024-09-21T06:19:12.029978+0000","last_clean":"2024-09-21T06:19:12.029978+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:19:12.029978+0000","last_undegraded":"2024-09-21T06:19:12.029978+0000","last_fullsized":"2024-09-21T06:19:12.029978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398885+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:18:13.398885+0000","last_peered":"2024-09-21T06:18:13.398885+0000","last_clean":"2024-09-21T06:18:13.398885+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:18:13.398885+0000","last_undegraded":"2024-09-21T06:18:13.398885+0000","last_fullsized":"2024-09-21T06:18:13.398885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070437+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:19:12.070437+0000","last_peered":"2024-09-21T06:19:12.070437+0000","last_clean":"2024-09-21T06:19:12.070437+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:19:12.070437+0000","last_undegraded":"2024-09-21T06:19:12.070437+0000","last_fullsized":"2024-09-21T06:19:12.070437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.406158+0000","last_change":"2024-09-21T06:18:13.405449+0000","last_active":"2024-09-21T06:18:13.406158+0000","last_peered":"2024-09-21T06:18:13.406158+0000","last_clean":"2024-09-21T06:18:13.406158+0000","last_became_active":"2024-09-21T06:18:13.400865+0000","last_became_peered":"2024-09-21T06:18:13.400865+0000","last_unstale":"2024-09-21T06:18:13.406158+0000","last_undegraded":"2024-09-21T06:18:13.406158+0000","last_fullsized":"2024-09-21T06:18:13.406158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:59.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080710+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:19:12.080710+0000","last_peered":"2024-09-21T06:19:12.080710+0000","last_clean":"2024-09-21T06:19:12.080710+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:19:12.080710+0000","last_undegraded":"2024-09-21T06:19:12.080710+0000","last_fullsized":"2024-09-21T06:19:12.080710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399293+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:13.399293+0000","last_peered":"2024-09-21T06:18:13.399293+0000","last_clean":"2024-09-21T06:18:13.399293+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:13.399293+0000","last_undegraded":"2024-09-21T06:18:13.399293+0000","last_fullsized":"2024-09-21T06:18:13.399293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078959+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:19:12.078959+0000","last_peered":"2024-09-21T06:19:12.078959+0000","last_clean":"2024-09-21T06:19:12.078959+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:19:12.078959+0000","last_undegraded":"2024-09-21T06:19:12.078959+0000","last_fullsized":"2024-09-21T06:19:12.078959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068036+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:19:12.068036+0000","last_peered":"2024-09-21T06:19:12.068036+0000","last_clean":"2024-09-21T06:19:12.068036+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:19:12.068036+0000","last_undegraded":"2024-09-21T06:19:12.068036+0000","last_fullsized":"2024-09-21T06:19:12.068036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399760+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:13.399760+0000","last_peered":"2024-09-21T06:18:13.399760+0000","last_clean":"2024-09-21T06:18:13.399760+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:13.399760+0000","last_undegraded":"2024-09-21T06:18:13.399760+0000","last_fullsized":"2024-09-21T06:18:13.399760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082433+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:19:12.082433+0000","last_peered":"2024-09-21T06:19:12.082433+0000","last_clean":"2024-09-21T06:19:12.082433+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:19:12.082433+0000","last_undegraded":"2024-09-21T06:19:12.082433+0000","last_fullsized":"2024-09-21T06:19:12.082433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399746+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:13.399746+0000","last_peered":"2024-09-21T06:18:13.399746+0000","last_clean":"2024-09-21T06:18:13.399746+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:13.399746+0000","last_undegraded":"2024-09-21T06:18:13.399746+0000","last_fullsized":"2024-09-21T06:18:13.399746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075256+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:19:12.075256+0000","last_peered":"2024-09-21T06:19:12.075256+0000","last_clean":"2024-09-21T06:19:12.075256+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:19:12.075256+0000","last_undegraded":"2024-09-21T06:19:12.075256+0000","last_fullsized":"2024-09-21T06:19:12.075256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399443+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:18:13.399443+0000","last_peered":"2024-09-21T06:18:13.399443+0000","last_clean":"2024-09-21T06:18:13.399443+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:18:13.399443+0000","last_undegraded":"2024-09-21T06:18:13.399443+0000","last_fullsized":"2024-09-21T06:18:13.399443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064716+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:19:12.064716+0000","last_peered":"2024-09-21T06:19:12.064716+0000","last_clean":"2024-09-21T06:19:12.064716+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:19:12.064716+0000","last_undegraded":"2024-09-21T06:19:12.064716+0000","last_fullsized":"2024-09-21T06:19:12.064716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401798+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:18:13.401798+0000","last_peered":"2024-09-21T06:18:13.401798+0000","last_clean":"2024-09-21T06:18:13.401798+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:18:13.401798+0000","last_undegraded":"2024-09-21T06:18:13.401798+0000","last_fullsized":"2024-09-21T06:18:13.401798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70589,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":600,"num_read_kb":373,"num_write":172,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":217601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36856,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708296,"statfs":{"total":95995035648,"available":95957295104,"internally_reserved":0,"allocated":1548288,"data_stored":1074401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":416294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1008168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":415566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1007320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":416535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":415760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":483156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":481806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":416837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:19:35.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 -- 172.21.15.38:0/2987584988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 msgr2=0x7f32c41086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 --2- 172.21.15.38:0/2987584988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41086f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009900 tx=0x7f32ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 -- 172.21.15.38:0/2987584988 shutdown_connections 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 --2- 172.21.15.38:0/2987584988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c4108c30 0x7f32c410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 --2- 172.21.15.38:0/2987584988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41086f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 --2- 172.21.15.38:0/2987584988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c41029b0 0x7f32c4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 -- 172.21.15.38:0/2987584988 >> 172.21.15.38:0/2987584988 conn(0x7f32c40fe3b0 msgr2=0x7f32c4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 -- 172.21.15.38:0/2987584988 shutdown_connections 2024-09-21T06:19:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.328+0000 7f32c99f1640 1 -- 172.21.15.38:0/2987584988 wait complete. 2024-09-21T06:19:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 Processor -- start 2024-09-21T06:19:35.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 -- start start 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 0x7f32c4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c4108c30 0x7f32c419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4112a10 con 0x7f32c41082e0 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4112890 con 0x7f32c41029b0 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c99f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4112b90 con 0x7f32c4108c30 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58904/0 (socket says 172.21.15.38:58904) 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 -- 172.21.15.38:0/329740163 learned_addr learned my addr 172.21.15.38:0/329740163 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:35.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c37fe640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c4108c30 0x7f32c419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c2ffd640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 0x7f32c4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 -- 172.21.15.38:0/329740163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c4108c30 msgr2=0x7f32c419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c4108c30 0x7f32c419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 -- 172.21.15.38:0/329740163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 msgr2=0x7f32c4199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 0x7f32c4199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32bbfff640 1 -- 172.21.15.38:0/329740163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c419f340 con 0x7f32c41082e0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.329+0000 7f32c2ffd640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 0x7f32c4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32bbfff640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f32ac005940 tx=0x7f32ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac03f030 con 0x7f32c41082e0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f32ac031910 con 0x7f32c41082e0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c419f5d0 con 0x7f32c41082e0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac035070 con 0x7f32c41082e0 2024-09-21T06:19:35.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.330+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c41a5dc0 con 0x7f32c41082e0 2024-09-21T06:19:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.331+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c4102dc0 con 0x7f32c41082e0 2024-09-21T06:19:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.332+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f32ac042030 con 0x7f32c41082e0 2024-09-21T06:19:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.333+0000 7f32c89ef640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 0x7f32b00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.334+0000 7f32c2ffd640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 0x7f32b00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.334+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f32ac107a00 con 0x7f32c41082e0 2024-09-21T06:19:35.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.334+0000 7f32c2ffd640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 0x7f32b00b8b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009b40 tx=0x7f32b4005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:35.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.338+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32ac109e20 con 0x7f32c41082e0 2024-09-21T06:19:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.526+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32c4063800 con 0x7f32b00b6670 2024-09-21T06:19:35.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.531+0000 7f32c89ef640 1 -- 172.21.15.38:0/329740163 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258813 (secure 0 0 0) 0x7f32c4063800 con 0x7f32b00b6670 2024-09-21T06:19:35.536 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:35.538 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:19:35.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 msgr2=0x7f32b00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 0x7f32b00b8b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009b40 tx=0x7f32b4005e50 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 msgr2=0x7f32c41999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f32ac005940 tx=0x7f32ac0042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 shutdown_connections 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f32b00b6670 0x7f32b00b8b80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32c4108c30 0x7f32c419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f32c41082e0 0x7f32c41999b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 --2- 172.21.15.38:0/329740163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32c41029b0 0x7f32c4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 >> 172.21.15.38:0/329740163 conn(0x7f32c40fe3b0 msgr2=0x7f32c4107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 shutdown_connections 2024-09-21T06:19:35.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.534+0000 7f32c99f1640 1 -- 172.21.15.38:0/329740163 wait complete. 2024-09-21T06:19:35.547 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-21T06:19:33.685054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661191,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":681,"num_read_kb":442,"num_write":297,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":740,"ondisk_log_size":740,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394564,"kb_used_data":12036,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547260,"statfs":{"total":1151940427776,"available":1151536394240,"internally_reserved":0,"allocated":12324864,"data_stored":6967881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003185"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073459+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:19:12.073459+0000","last_peered":"2024-09-21T06:19:12.073459+0000","last_clean":"2024-09-21T06:19:12.073459+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:19:12.073459+0000","last_undegraded":"2024-09-21T06:19:12.073459+0000","last_fullsized":"2024-09-21T06:19:12.073459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070763+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:19:12.070763+0000","last_peered":"2024-09-21T06:19:12.070763+0000","last_clean":"2024-09-21T06:19:12.070763+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:19:12.070763+0000","last_undegraded":"2024-09-21T06:19:12.070763+0000","last_fullsized":"2024-09-21T06:19:12.070763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075065+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:19:12.075065+0000","last_peered":"2024-09-21T06:19:12.075065+0000","last_clean":"2024-09-21T06:19:12.075065+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:19:12.075065+0000","last_undegraded":"2024-09-21T06:19:12.075065+0000","last_fullsized":"2024-09-21T06:19:12.075065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.053794+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:19:12.053794+0000","last_peered":"2024-09-21T06:19:12.053794+0000","last_clean":"2024-09-21T06:19:12.053794+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:19:12.053794+0000","last_undegraded":"2024-09-21T06:19:12.053794+0000","last_fullsized":"2024-09-21T06:19:12.053794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058155+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:19:12.058155+0000","last_peered":"2024-09-21T06:19:12.058155+0000","last_clean":"2024-09-21T06:19:12.058155+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:19:12.058155+0000","last_undegraded":"2024-09-21T06:19:12.058155+0000","last_fullsized":"2024-09-21T06:19:12.058155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080731+0000","last_change":"2024-09-21T06:18:13.404093+0000","last_active":"2024-09-21T06:19:12.080731+0000","last_peered":"2024-09-21T06:19:12.080731+0000","last_clean":"2024-09-21T06:19:12.080731+0000","last_became_active":"2024-09-21T06:18:13.403608+0000","last_became_peered":"2024-09-21T06:18:13.403608+0000","last_unstale":"2024-09-21T06:19:12.080731+0000","last_undegraded":"2024-09-21T06:19:12.080731+0000","last_fullsized":"2024-09-21T06:19:12.080731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:54.362457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070503+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:19:12.070503+0000","last_peered":"2024-09-21T06:19:12.070503+0000","last_clean":"2024-09-21T06:19:12.070503+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:19:12.070503+0000","last_undegraded":"2024-09-21T06:19:12.070503+0000","last_fullsized":"2024-09-21T06:19:12.070503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080883+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:19:12.080883+0000","last_peered":"2024-09-21T06:19:12.080883+0000","last_clean":"2024-09-21T06:19:12.080883+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:19:12.080883+0000","last_undegraded":"2024-09-21T06:19:12.080883+0000","last_fullsized":"2024-09-21T06:19:12.080883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077668+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:19:12.077668+0000","last_peered":"2024-09-21T06:19:12.077668+0000","last_clean":"2024-09-21T06:19:12.077668+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:19:12.077668+0000","last_undegraded":"2024-09-21T06:19:12.077668+0000","last_fullsized":"2024-09-21T06:19:12.077668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.076128+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:19:12.076128+0000","last_peered":"2024-09-21T06:19:12.076128+0000","last_clean":"2024-09-21T06:19:12.076128+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:19:12.076128+0000","last_undegraded":"2024-09-21T06:19:12.076128+0000","last_fullsized":"2024-09-21T06:19:12.076128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077334+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:19:12.077334+0000","last_peered":"2024-09-21T06:19:12.077334+0000","last_clean":"2024-09-21T06:19:12.077334+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:19:12.077334+0000","last_undegraded":"2024-09-21T06:19:12.077334+0000","last_fullsized":"2024-09-21T06:19:12.077334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073676+0000","last_change":"2024-09-21T06:18:13.404172+0000","last_active":"2024-09-21T06:19:12.073676+0000","last_peered":"2024-09-21T06:19:12.073676+0000","last_clean":"2024-09-21T06:19:12.073676+0000","last_became_active":"2024-09-21T06:18:13.403643+0000","last_became_peered":"2024-09-21T06:18:13.403643+0000","last_unstale":"2024-09-21T06:19:12.073676+0000","last_undegraded":"2024-09-21T06:19:12.073676+0000","last_fullsized":"2024-09-21T06:19:12.073676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:12.264818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069060+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:19:12.069060+0000","last_peered":"2024-09-21T06:19:12.069060+0000","last_clean":"2024-09-21T06:19:12.069060+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:19:12.069060+0000","last_undegraded":"2024-09-21T06:19:12.069060+0000","last_fullsized":"2024-09-21T06:19:12.069060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070690+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:19:12.070690+0000","last_peered":"2024-09-21T06:19:12.070690+0000","last_clean":"2024-09-21T06:19:12.070690+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:19:12.070690+0000","last_undegraded":"2024-09-21T06:19:12.070690+0000","last_fullsized":"2024-09-21T06:19:12.070690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071321+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:19:12.071321+0000","last_peered":"2024-09-21T06:19:12.071321+0000","last_clean":"2024-09-21T06:19:12.071321+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:19:12.071321+0000","last_undegraded":"2024-09-21T06:19:12.071321+0000","last_fullsized":"2024-09-21T06:19:12.071321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078351+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:19:12.078351+0000","last_peered":"2024-09-21T06:19:12.078351+0000","last_clean":"2024-09-21T06:19:12.078351+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:19:12.078351+0000","last_undegraded":"2024-09-21T06:19:12.078351+0000","last_fullsized":"2024-09-21T06:19:12.078351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073590+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:19:12.073590+0000","last_peered":"2024-09-21T06:19:12.073590+0000","last_clean":"2024-09-21T06:19:12.073590+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:19:12.073590+0000","last_undegraded":"2024-09-21T06:19:12.073590+0000","last_fullsized":"2024-09-21T06:19:12.073590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073908+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:19:12.073908+0000","last_peered":"2024-09-21T06:19:12.073908+0000","last_clean":"2024-09-21T06:19:12.073908+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:19:12.073908+0000","last_undegraded":"2024-09-21T06:19:12.073908+0000","last_fullsized":"2024-09-21T06:19:12.073908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069518+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:19:12.069518+0000","last_peered":"2024-09-21T06:19:12.069518+0000","last_clean":"2024-09-21T06:19:12.069518+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:19:12.069518+0000","last_undegraded":"2024-09-21T06:19:12.069518+0000","last_fullsized":"2024-09-21T06:19:12.069518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069304+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:19:12.069304+0000","last_peered":"2024-09-21T06:19:12.069304+0000","last_clean":"2024-09-21T06:19:12.069304+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:19:12.069304+0000","last_undegraded":"2024-09-21T06:19:12.069304+0000","last_fullsized":"2024-09-21T06:19:12.069304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.081113+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:19:12.081113+0000","last_peered":"2024-09-21T06:19:12.081113+0000","last_clean":"2024-09-21T06:19:12.081113+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:19:12.081113+0000","last_undegraded":"2024-09-21T06:19:12.081113+0000","last_fullsized":"2024-09-21T06:19:12.081113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080630+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:19:12.080630+0000","last_peered":"2024-09-21T06:19:12.080630+0000","last_clean":"2024-09-21T06:19:12.080630+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:19:12.080630+0000","last_undegraded":"2024-09-21T06:19:12.080630+0000","last_fullsized":"2024-09-21T06:19:12.080630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067299+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:19:12.067299+0000","last_peered":"2024-09-21T06:19:12.067299+0000","last_clean":"2024-09-21T06:19:12.067299+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:19:12.067299+0000","last_undegraded":"2024-09-21T06:19:12.067299+0000","last_fullsized":"2024-09-21T06:19:12.067299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063067+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:19:12.063067+0000","last_peered":"2024-09-21T06:19:12.063067+0000","last_clean":"2024-09-21T06:19:12.063067+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:19:12.063067+0000","last_undegraded":"2024-09-21T06:19:12.063067+0000","last_fullsized":"2024-09-21T06:19:12.063067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064430+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:19:12.064430+0000","last_peered":"2024-09-21T06:19:12.064430+0000","last_clean":"2024-09-21T06:19:12.064430+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:19:12.064430+0000","last_undegraded":"2024-09-21T06:19:12.064430+0000","last_fullsized":"2024-09-21T06:19:12.064430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.056558+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:19:12.056558+0000","last_peered":"2024-09-21T06:19:12.056558+0000","last_clean":"2024-09-21T06:19:12.056558+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:19:12.056558+0000","last_undegraded":"2024-09-21T06:19:12.056558+0000","last_fullsized":"2024-09-21T06:19:12.056558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.062141+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:19:12.062141+0000","last_peered":"2024-09-21T06:19:12.062141+0000","last_clean":"2024-09-21T06:19:12.062141+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:19:12.062141+0000","last_undegraded":"2024-09-21T06:19:12.062141+0000","last_fullsized":"2024-09-21T06:19:12.062141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071624+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:19:12.071624+0000","last_peered":"2024-09-21T06:19:12.071624+0000","last_clean":"2024-09-21T06:19:12.071624+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:19:12.071624+0000","last_undegraded":"2024-09-21T06:19:12.071624+0000","last_fullsized":"2024-09-21T06:19:12.071624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069474+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:19:12.069474+0000","last_peered":"2024-09-21T06:19:12.069474+0000","last_clean":"2024-09-21T06:19:12.069474+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:19:12.069474+0000","last_undegraded":"2024-09-21T06:19:12.069474+0000","last_fullsized":"2024-09-21T06:19:12.069474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070568+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:19:12.070568+0000","last_peered":"2024-09-21T06:19:12.070568+0000","last_clean":"2024-09-21T06:19:12.070568+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:19:12.070568+0000","last_undegraded":"2024-09-21T06:19:12.070568+0000","last_fullsized":"2024-09-21T06:19:12.070568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.054687+0000","last_change":"2024-09-21T06:18:13.500386+0000","last_active":"2024-09-21T06:19:12.054687+0000","last_peered":"2024-09-21T06:19:12.054687+0000","last_clean":"2024-09-21T06:19:12.054687+0000","last_became_active":"2024-09-21T06:18:13.499861+0000","last_became_peered":"2024-09-21T06:18:13.499861+0000","last_unstale":"2024-09-21T06:19:12.054687+0000","last_undegraded":"2024-09-21T06:19:12.054687+0000","last_fullsized":"2024-09-21T06:19:12.054687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:05.084576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063803+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:19:12.063803+0000","last_peered":"2024-09-21T06:19:12.063803+0000","last_clean":"2024-09-21T06:19:12.063803+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:19:12.063803+0000","last_undegraded":"2024-09-21T06:19:12.063803+0000","last_fullsized":"2024-09-21T06:19:12.063803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058613+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:19:12.058613+0000","last_peered":"2024-09-21T06:19:12.058613+0000","last_clean":"2024-09-21T06:19:12.058613+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:19:12.058613+0000","last_undegraded":"2024-09-21T06:19:12.058613+0000","last_fullsized":"2024-09-21T06:19:12.058613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099862+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:19:30.099862+0000","last_peered":"2024-09-21T06:19:30.099862+0000","last_clean":"2024-09-21T06:19:30.099862+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:19:30.099862+0000","last_undegraded":"2024-09-21T06:19:30.099862+0000","last_fullsized":"2024-09-21T06:19:30.099862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.060366+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:19:12.060366+0000","last_peered":"2024-09-21T06:19:12.060366+0000","last_clean":"2024-09-21T06:19:12.060366+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:19:12.060366+0000","last_undegraded":"2024-09-21T06:19:12.060366+0000","last_fullsized":"2024-09-21T06:19:12.060366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400475+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:18:13.400475+0000","last_peered":"2024-09-21T06:18:13.400475+0000","last_clean":"2024-09-21T06:18:13.400475+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:18:13.400475+0000","last_undegraded":"2024-09-21T06:18:13.400475+0000","last_fullsized":"2024-09-21T06:18:13.400475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397823+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:18:13.397823+0000","last_peered":"2024-09-21T06:18:13.397823+0000","last_clean":"2024-09-21T06:18:13.397823+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:18:13.397823+0000","last_undegraded":"2024-09-21T06:18:13.397823+0000","last_fullsized":"2024-09-21T06:18:13.397823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067249+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:19:12.067249+0000","last_peered":"2024-09-21T06:19:12.067249+0000","last_clean":"2024-09-21T06:19:12.067249+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:19:12.067249+0000","last_undegraded":"2024-09-21T06:19:12.067249+0000","last_fullsized":"2024-09-21T06:19:12.067249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498355+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:18:13.498355+0000","last_peered":"2024-09-21T06:18:13.498355+0000","last_clean":"2024-09-21T06:18:13.498355+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:18:13.498355+0000","last_undegraded":"2024-09-21T06:18:13.498355+0000","last_fullsized":"2024-09-21T06:18:13.498355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.074138+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:19:12.074138+0000","last_peered":"2024-09-21T06:19:12.074138+0000","last_clean":"2024-09-21T06:19:12.074138+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:19:12.074138+0000","last_undegraded":"2024-09-21T06:19:12.074138+0000","last_fullsized":"2024-09-21T06:19:12.074138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099246+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:19:30.099246+0000","last_peered":"2024-09-21T06:19:30.099246+0000","last_clean":"2024-09-21T06:19:30.099246+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:19:30.099246+0000","last_undegraded":"2024-09-21T06:19:30.099246+0000","last_fullsized":"2024-09-21T06:19:30.099246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082060+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:19:12.082060+0000","last_peered":"2024-09-21T06:19:12.082060+0000","last_clean":"2024-09-21T06:19:12.082060+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:19:12.082060+0000","last_undegraded":"2024-09-21T06:19:12.082060+0000","last_fullsized":"2024-09-21T06:19:12.082060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070382+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:19:12.070382+0000","last_peered":"2024-09-21T06:19:12.070382+0000","last_clean":"2024-09-21T06:19:12.070382+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:19:12.070382+0000","last_undegraded":"2024-09-21T06:19:12.070382+0000","last_fullsized":"2024-09-21T06:19:12.070382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498383+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:18:13.498383+0000","last_peered":"2024-09-21T06:18:13.498383+0000","last_clean":"2024-09-21T06:18:13.498383+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:18:13.498383+0000","last_undegraded":"2024-09-21T06:18:13.498383+0000","last_fullsized":"2024-09-21T06:18:13.498383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075341+0000","last_change":"2024-09-21T06:18:13.405270+0000","last_active":"2024-09-21T06:19:12.075341+0000","last_peered":"2024-09-21T06:19:12.075341+0000","last_clean":"2024-09-21T06:19:12.075341+0000","last_became_active":"2024-09-21T06:18:13.404759+0000","last_became_peered":"2024-09-21T06:18:13.404759+0000","last_unstale":"2024-09-21T06:19:12.075341+0000","last_undegraded":"2024-09-21T06:19:12.075341+0000","last_fullsized":"2024-09-21T06:19:12.075341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.678457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'33","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.110004+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:19:31.110004+0000","last_peered":"2024-09-21T06:19:31.110004+0000","last_clean":"2024-09-21T06:19:31.110004+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:19:31.110004+0000","last_undegraded":"2024-09-21T06:19:31.110004+0000","last_fullsized":"2024-09-21T06:19:31.110004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058041+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:19:12.058041+0000","last_peered":"2024-09-21T06:19:12.058041+0000","last_clean":"2024-09-21T06:19:12.058041+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:19:12.058041+0000","last_undegraded":"2024-09-21T06:19:12.058041+0000","last_fullsized":"2024-09-21T06:19:12.058041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400650+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:18:13.400650+0000","last_peered":"2024-09-21T06:18:13.400650+0000","last_clean":"2024-09-21T06:18:13.400650+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:18:13.400650+0000","last_undegraded":"2024-09-21T06:18:13.400650+0000","last_fullsized":"2024-09-21T06:18:13.400650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080657+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:19:12.080657+0000","last_peered":"2024-09-21T06:19:12.080657+0000","last_clean":"2024-09-21T06:19:12.080657+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:19:12.080657+0000","last_undegraded":"2024-09-21T06:19:12.080657+0000","last_fullsized":"2024-09-21T06:19:12.080657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498259+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:18:13.498259+0000","last_peered":"2024-09-21T06:18:13.498259+0000","last_clean":"2024-09-21T06:18:13.498259+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:18:13.498259+0000","last_undegraded":"2024-09-21T06:18:13.498259+0000","last_fullsized":"2024-09-21T06:18:13.498259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.079530+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:19:12.079530+0000","last_peered":"2024-09-21T06:19:12.079530+0000","last_clean":"2024-09-21T06:19:12.079530+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:19:12.079530+0000","last_undegraded":"2024-09-21T06:19:12.079530+0000","last_fullsized":"2024-09-21T06:19:12.079530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":128,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.115768+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:19:31.115768+0000","last_peered":"2024-09-21T06:19:31.115768+0000","last_clean":"2024-09-21T06:19:31.115768+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:19:31.115768+0000","last_undegraded":"2024-09-21T06:19:31.115768+0000","last_fullsized":"2024-09-21T06:19:31.115768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075482+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:19:12.075482+0000","last_peered":"2024-09-21T06:19:12.075482+0000","last_clean":"2024-09-21T06:19:12.075482+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:19:12.075482+0000","last_undegraded":"2024-09-21T06:19:12.075482+0000","last_fullsized":"2024-09-21T06:19:12.075482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399100+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:13.399100+0000","last_peered":"2024-09-21T06:18:13.399100+0000","last_clean":"2024-09-21T06:18:13.399100+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:13.399100+0000","last_undegraded":"2024-09-21T06:18:13.399100+0000","last_fullsized":"2024-09-21T06:18:13.399100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068187+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:19:12.068187+0000","last_peered":"2024-09-21T06:19:12.068187+0000","last_clean":"2024-09-21T06:19:12.068187+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:19:12.068187+0000","last_undegraded":"2024-09-21T06:19:12.068187+0000","last_fullsized":"2024-09-21T06:19:12.068187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399604+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:13.399604+0000","last_peered":"2024-09-21T06:18:13.399604+0000","last_clean":"2024-09-21T06:18:13.399604+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:13.399604+0000","last_undegraded":"2024-09-21T06:18:13.399604+0000","last_fullsized":"2024-09-21T06:18:13.399604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068626+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:19:12.068626+0000","last_peered":"2024-09-21T06:19:12.068626+0000","last_clean":"2024-09-21T06:19:12.068626+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:19:12.068626+0000","last_undegraded":"2024-09-21T06:19:12.068626+0000","last_fullsized":"2024-09-21T06:19:12.068626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397973+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:18:13.397973+0000","last_peered":"2024-09-21T06:18:13.397973+0000","last_clean":"2024-09-21T06:18:13.397973+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:18:13.397973+0000","last_undegraded":"2024-09-21T06:18:13.397973+0000","last_fullsized":"2024-09-21T06:18:13.397973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077987+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:19:12.077987+0000","last_peered":"2024-09-21T06:19:12.077987+0000","last_clean":"2024-09-21T06:19:12.077987+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:19:12.077987+0000","last_undegraded":"2024-09-21T06:19:12.077987+0000","last_fullsized":"2024-09-21T06:19:12.077987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498457+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:18:13.498457+0000","last_peered":"2024-09-21T06:18:13.498457+0000","last_clean":"2024-09-21T06:18:13.498457+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:18:13.498457+0000","last_undegraded":"2024-09-21T06:18:13.498457+0000","last_fullsized":"2024-09-21T06:18:13.498457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075186+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:19:12.075186+0000","last_peered":"2024-09-21T06:19:12.075186+0000","last_clean":"2024-09-21T06:19:12.075186+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:19:12.075186+0000","last_undegraded":"2024-09-21T06:19:12.075186+0000","last_fullsized":"2024-09-21T06:19:12.075186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400818+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:18:13.400818+0000","last_peered":"2024-09-21T06:18:13.400818+0000","last_clean":"2024-09-21T06:18:13.400818+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:18:13.400818+0000","last_undegraded":"2024-09-21T06:18:13.400818+0000","last_fullsized":"2024-09-21T06:18:13.400818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077808+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:19:12.077808+0000","last_peered":"2024-09-21T06:19:12.077808+0000","last_clean":"2024-09-21T06:19:12.077808+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:19:12.077808+0000","last_undegraded":"2024-09-21T06:19:12.077808+0000","last_fullsized":"2024-09-21T06:19:12.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498537+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498537+0000","last_peered":"2024-09-21T06:18:13.498537+0000","last_clean":"2024-09-21T06:18:13.498537+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498537+0000","last_undegraded":"2024-09-21T06:18:13.498537+0000","last_fullsized":"2024-09-21T06:18:13.498537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498500+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:18:13.498500+0000","last_peered":"2024-09-21T06:18:13.498500+0000","last_clean":"2024-09-21T06:18:13.498500+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:18:13.498500+0000","last_undegraded":"2024-09-21T06:18:13.498500+0000","last_fullsized":"2024-09-21T06:18:13.498500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075160+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:19:12.075160+0000","last_peered":"2024-09-21T06:19:12.075160+0000","last_clean":"2024-09-21T06:19:12.075160+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:19:12.075160+0000","last_undegraded":"2024-09-21T06:19:12.075160+0000","last_fullsized":"2024-09-21T06:19:12.075160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.061681+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:19:12.061681+0000","last_peered":"2024-09-21T06:19:12.061681+0000","last_clean":"2024-09-21T06:19:12.061681+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:19:12.061681+0000","last_undegraded":"2024-09-21T06:19:12.061681+0000","last_fullsized":"2024-09-21T06:19:12.061681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":120,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:27.108913+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:19:27.108913+0000","last_peered":"2024-09-21T06:19:27.108913+0000","last_clean":"2024-09-21T06:19:27.108913+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:19:27.108913+0000","last_undegraded":"2024-09-21T06:19:27.108913+0000","last_fullsized":"2024-09-21T06:19:27.108913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.065031+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:19:12.065031+0000","last_peered":"2024-09-21T06:19:12.065031+0000","last_clean":"2024-09-21T06:19:12.065031+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:19:12.065031+0000","last_undegraded":"2024-09-21T06:19:12.065031+0000","last_fullsized":"2024-09-21T06:19:12.065031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069879+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:19:12.069879+0000","last_peered":"2024-09-21T06:19:12.069879+0000","last_clean":"2024-09-21T06:19:12.069879+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:19:12.069879+0000","last_undegraded":"2024-09-21T06:19:12.069879+0000","last_fullsized":"2024-09-21T06:19:12.069879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499061+0000","last_change":"2024-09-21T06:18:13.498949+0000","last_active":"2024-09-21T06:18:13.499061+0000","last_peered":"2024-09-21T06:18:13.499061+0000","last_clean":"2024-09-21T06:18:13.499061+0000","last_became_active":"2024-09-21T06:18:13.498496+0000","last_became_peered":"2024-09-21T06:18:13.498496+0000","last_unstale":"2024-09-21T06:18:13.499061+0000","last_undegraded":"2024-09-21T06:18:13.499061+0000","last_fullsized":"2024-09-21T06:18:13.499061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:42.982233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080593+0000","last_change":"2024-09-21T06:18:13.407681+0000","last_active":"2024-09-21T06:19:12.080593+0000","last_peered":"2024-09-21T06:19:12.080593+0000","last_clean":"2024-09-21T06:19:12.080593+0000","last_became_active":"2024-09-21T06:18:13.403705+0000","last_became_peered":"2024-09-21T06:18:13.403705+0000","last_unstale":"2024-09-21T06:19:12.080593+0000","last_undegraded":"2024-09-21T06:19:12.080593+0000","last_fullsized":"2024-09-21T06:19:12.080593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:09.176309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399933+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:13.399933+0000","last_peered":"2024-09-21T06:18:13.399933+0000","last_clean":"2024-09-21T06:18:13.399933+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:13.399933+0000","last_undegraded":"2024-09-21T06:18:13.399933+0000","last_fullsized":"2024-09-21T06:18:13.399933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.059503+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:19:12.059503+0000","last_peered":"2024-09-21T06:19:12.059503+0000","last_clean":"2024-09-21T06:19:12.059503+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:19:12.059503+0000","last_undegraded":"2024-09-21T06:19:12.059503+0000","last_fullsized":"2024-09-21T06:19:12.059503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'12","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.266851+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:19:12.266851+0000","last_peered":"2024-09-21T06:19:12.266851+0000","last_clean":"2024-09-21T06:19:12.266851+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:19:12.266851+0000","last_undegraded":"2024-09-21T06:19:12.266851+0000","last_fullsized":"2024-09-21T06:19:12.266851+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080385+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:19:12.080385+0000","last_peered":"2024-09-21T06:19:12.080385+0000","last_clean":"2024-09-21T06:19:12.080385+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:19:12.080385+0000","last_undegraded":"2024-09-21T06:19:12.080385+0000","last_fullsized":"2024-09-21T06:19:12.080385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498978+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:18:13.498978+0000","last_peered":"2024-09-21T06:18:13.498978+0000","last_clean":"2024-09-21T06:18:13.498978+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:18:13.498978+0000","last_undegraded":"2024-09-21T06:18:13.498978+0000","last_fullsized":"2024-09-21T06:18:13.498978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071837+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:19:12.071837+0000","last_peered":"2024-09-21T06:19:12.071837+0000","last_clean":"2024-09-21T06:19:12.071837+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:19:12.071837+0000","last_undegraded":"2024-09-21T06:19:12.071837+0000","last_fullsized":"2024-09-21T06:19:12.071837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402231+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:18:13.402231+0000","last_peered":"2024-09-21T06:18:13.402231+0000","last_clean":"2024-09-21T06:18:13.402231+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:18:13.402231+0000","last_undegraded":"2024-09-21T06:18:13.402231+0000","last_fullsized":"2024-09-21T06:18:13.402231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.029978+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:19:12.029978+0000","last_peered":"2024-09-21T06:19:12.029978+0000","last_clean":"2024-09-21T06:19:12.029978+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:19:12.029978+0000","last_undegraded":"2024-09-21T06:19:12.029978+0000","last_fullsized":"2024-09-21T06:19:12.029978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398885+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:18:13.398885+0000","last_peered":"2024-09-21T06:18:13.398885+0000","last_clean":"2024-09-21T06:18:13.398885+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:18:13.398885+0000","last_undegraded":"2024-09-21T06:18:13.398885+0000","last_fullsized":"2024-09-21T06:18:13.398885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070437+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:19:12.070437+0000","last_peered":"2024-09-21T06:19:12.070437+0000","last_clean":"2024-09-21T06:19:12.070437+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:19:12.070437+0000","last_undegraded":"2024-09-21T06:19:12.070437+0000","last_fullsized":"2024-09-21T06:19:12.070437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.406158+0000","last_change":"2024-09-21T06:18:13.405449+0000","last_active":"2024-09-21T06:18:13.406158+0000","last_peered":"2024-09-21T06:18:13.406158+0000","last_clean":"2024-09-21T06:18:13.406158+0000","last_became_active":"2024-09-21T06:18:13.400865+0000","last_became_peered":"2024-09-21T06:18:13.400865+0000","last_unstale":"2024-09-21T06:18:13.406158+0000","last_undegraded":"2024-09-21T06:18:13.406158+0000","last_fullsized":"2024-09-21T06:18:13.406158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:59.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080710+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:19:12.080710+0000","last_peered":"2024-09-21T06:19:12.080710+0000","last_clean":"2024-09-21T06:19:12.080710+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:19:12.080710+0000","last_undegraded":"2024-09-21T06:19:12.080710+0000","last_fullsized":"2024-09-21T06:19:12.080710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399293+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:13.399293+0000","last_peered":"2024-09-21T06:18:13.399293+0000","last_clean":"2024-09-21T06:18:13.399293+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:13.399293+0000","last_undegraded":"2024-09-21T06:18:13.399293+0000","last_fullsized":"2024-09-21T06:18:13.399293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078959+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:19:12.078959+0000","last_peered":"2024-09-21T06:19:12.078959+0000","last_clean":"2024-09-21T06:19:12.078959+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:19:12.078959+0000","last_undegraded":"2024-09-21T06:19:12.078959+0000","last_fullsized":"2024-09-21T06:19:12.078959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068036+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:19:12.068036+0000","last_peered":"2024-09-21T06:19:12.068036+0000","last_clean":"2024-09-21T06:19:12.068036+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:19:12.068036+0000","last_undegraded":"2024-09-21T06:19:12.068036+0000","last_fullsized":"2024-09-21T06:19:12.068036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399760+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:13.399760+0000","last_peered":"2024-09-21T06:18:13.399760+0000","last_clean":"2024-09-21T06:18:13.399760+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:13.399760+0000","last_undegraded":"2024-09-21T06:18:13.399760+0000","last_fullsized":"2024-09-21T06:18:13.399760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082433+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:19:12.082433+0000","last_peered":"2024-09-21T06:19:12.082433+0000","last_clean":"2024-09-21T06:19:12.082433+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:19:12.082433+0000","last_undegraded":"2024-09-21T06:19:12.082433+0000","last_fullsized":"2024-09-21T06:19:12.082433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399746+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:13.399746+0000","last_peered":"2024-09-21T06:18:13.399746+0000","last_clean":"2024-09-21T06:18:13.399746+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:13.399746+0000","last_undegraded":"2024-09-21T06:18:13.399746+0000","last_fullsized":"2024-09-21T06:18:13.399746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075256+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:19:12.075256+0000","last_peered":"2024-09-21T06:19:12.075256+0000","last_clean":"2024-09-21T06:19:12.075256+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:19:12.075256+0000","last_undegraded":"2024-09-21T06:19:12.075256+0000","last_fullsized":"2024-09-21T06:19:12.075256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399443+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:18:13.399443+0000","last_peered":"2024-09-21T06:18:13.399443+0000","last_clean":"2024-09-21T06:18:13.399443+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:18:13.399443+0000","last_undegraded":"2024-09-21T06:18:13.399443+0000","last_fullsized":"2024-09-21T06:18:13.399443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064716+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:19:12.064716+0000","last_peered":"2024-09-21T06:19:12.064716+0000","last_clean":"2024-09-21T06:19:12.064716+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:19:12.064716+0000","last_undegraded":"2024-09-21T06:19:12.064716+0000","last_fullsized":"2024-09-21T06:19:12.064716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401798+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:18:13.401798+0000","last_peered":"2024-09-21T06:18:13.401798+0000","last_clean":"2024-09-21T06:18:13.401798+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:18:13.401798+0000","last_undegraded":"2024-09-21T06:18:13.401798+0000","last_fullsized":"2024-09-21T06:18:13.401798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70589,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":600,"num_read_kb":373,"num_write":172,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":217601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36856,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708296,"statfs":{"total":95995035648,"available":95957295104,"internally_reserved":0,"allocated":1548288,"data_stored":1074401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":416294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1008168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":415566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1007320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":416535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":415760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":483156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542229,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":481806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":416837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:19:35.551 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T06:19:35.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 -- 172.21.15.38:0/2087039639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 msgr2=0x7f9b18109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2087039639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b18109810 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009900 tx=0x7f9b0002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 -- 172.21.15.38:0/2087039639 shutdown_connections 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2087039639 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18109d50 0x7f9b18110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2087039639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b18109810 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2087039639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18103ad0 0x7f9b18103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 -- 172.21.15.38:0/2087039639 >> 172.21.15.38:0/2087039639 conn(0x7f9b180ff510 msgr2=0x7f9b18101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 -- 172.21.15.38:0/2087039639 shutdown_connections 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.699+0000 7f9b1da84640 1 -- 172.21.15.38:0/2087039639 wait complete. 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 Processor -- start 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 -- start start 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 0x7f9b1819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 0x7f9b1819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18113b30 con 0x7f9b18109400 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181139b0 con 0x7f9b18109d50 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b1da84640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18113cb0 con 0x7f9b18103ad0 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58920/0 (socket says 172.21.15.38:58920) 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b0effd640 1 -- 172.21.15.38:0/2849214533 learned_addr learned my addr 172.21.15.38:0/2849214533 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.700+0000 7f9b177fe640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 0x7f9b1819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b17fff640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 0x7f9b1819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 -- 172.21.15.38:0/2849214533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 msgr2=0x7f9b1819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 0x7f9b1819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 -- 172.21.15.38:0/2849214533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 msgr2=0x7f9b1819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 0x7f9b1819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 -- 172.21.15.38:0/2849214533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b181a0480 con 0x7f9b18109400 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b17fff640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 0x7f9b1819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b177fe640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 0x7f9b1819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b0effd640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005940 tx=0x7f9b000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0003f030 con 0x7f9b18109400 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b181a0710 con 0x7f9b18109400 2024-09-21T06:19:35.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9b00031910 con 0x7f9b18109400 2024-09-21T06:19:35.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00035070 con 0x7f9b18109400 2024-09-21T06:19:35.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.701+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181a6f00 con 0x7f9b18109400 2024-09-21T06:19:35.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.702+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b18104d40 con 0x7f9b18109400 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.704+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f9b00042030 con 0x7f9b18109400 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.704+0000 7f9b157fa640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 0x7f9b040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.704+0000 7f9b177fe640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 0x7f9b040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.704+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9b00107da0 con 0x7f9b18109400 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.705+0000 7f9b177fe640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 0x7f9b040b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b0800b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:35.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.707+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b000ce430 con 0x7f9b18109400 2024-09-21T06:19:35.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:35 smithi038 ceph-mon[31215]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:35.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:35 smithi038 ceph-mon[31215]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:19:35.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:35 smithi174 ceph-mon[34815]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:35.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:35 smithi174 ceph-mon[34815]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:19:35.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.896+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b18063800 con 0x7f9b040b65f0 2024-09-21T06:19:35.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.901+0000 7f9b157fa640 1 -- 172.21.15.38:0/2849214533 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258813 (secure 0 0 0) 0x7f9b18063800 con 0x7f9b040b65f0 2024-09-21T06:19:35.905 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:35.907 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 msgr2=0x7f9b040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 0x7f9b040b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b0800b5f0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 msgr2=0x7f9b1819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9b00005940 tx=0x7f9b000042f0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 shutdown_connections 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9b040b65f0 0x7f9b040b8b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b18109d50 0x7f9b1819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b18109400 0x7f9b1819aaf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 --2- 172.21.15.38:0/2849214533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b18103ad0 0x7f9b1819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:35.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 >> 172.21.15.38:0/2849214533 conn(0x7f9b180ff510 msgr2=0x7f9b18108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:35.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 shutdown_connections 2024-09-21T06:19:35.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:35.904+0000 7f9b1da84640 1 -- 172.21.15.38:0/2849214533 wait complete. 2024-09-21T06:19:35.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:35 smithi044 ceph-mon[34369]: pgmap v316: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:19:35.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:35 smithi044 ceph-mon[34369]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:19:35.917 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-21T06:19:35.685612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661191,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":686,"num_read_kb":447,"num_write":299,"num_write_kb":2276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394572,"kb_used_data":12044,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547252,"statfs":{"total":1151940427776,"available":1151536386048,"internally_reserved":0,"allocated":12333056,"data_stored":6976235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073459+0000","last_change":"2024-09-21T06:17:47.242398+0000","last_active":"2024-09-21T06:19:12.073459+0000","last_peered":"2024-09-21T06:19:12.073459+0000","last_clean":"2024-09-21T06:19:12.073459+0000","last_became_active":"2024-09-21T06:17:47.242020+0000","last_became_peered":"2024-09-21T06:17:47.242020+0000","last_unstale":"2024-09-21T06:19:12.073459+0000","last_undegraded":"2024-09-21T06:19:12.073459+0000","last_fullsized":"2024-09-21T06:19:12.073459+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:06.516876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070763+0000","last_change":"2024-09-21T06:17:47.240004+0000","last_active":"2024-09-21T06:19:12.070763+0000","last_peered":"2024-09-21T06:19:12.070763+0000","last_clean":"2024-09-21T06:19:12.070763+0000","last_became_active":"2024-09-21T06:17:47.239671+0000","last_became_peered":"2024-09-21T06:17:47.239671+0000","last_unstale":"2024-09-21T06:19:12.070763+0000","last_undegraded":"2024-09-21T06:19:12.070763+0000","last_fullsized":"2024-09-21T06:19:12.070763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:47.737018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075065+0000","last_change":"2024-09-21T06:17:47.238211+0000","last_active":"2024-09-21T06:19:12.075065+0000","last_peered":"2024-09-21T06:19:12.075065+0000","last_clean":"2024-09-21T06:19:12.075065+0000","last_became_active":"2024-09-21T06:17:47.237855+0000","last_became_peered":"2024-09-21T06:17:47.237855+0000","last_unstale":"2024-09-21T06:19:12.075065+0000","last_undegraded":"2024-09-21T06:19:12.075065+0000","last_fullsized":"2024-09-21T06:19:12.075065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:02.182280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.053794+0000","last_change":"2024-09-21T06:17:47.251222+0000","last_active":"2024-09-21T06:19:12.053794+0000","last_peered":"2024-09-21T06:19:12.053794+0000","last_clean":"2024-09-21T06:19:12.053794+0000","last_became_active":"2024-09-21T06:17:47.250782+0000","last_became_peered":"2024-09-21T06:17:47.250782+0000","last_unstale":"2024-09-21T06:19:12.053794+0000","last_undegraded":"2024-09-21T06:19:12.053794+0000","last_fullsized":"2024-09-21T06:19:12.053794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:21.255002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058155+0000","last_change":"2024-09-21T06:17:47.239935+0000","last_active":"2024-09-21T06:19:12.058155+0000","last_peered":"2024-09-21T06:19:12.058155+0000","last_clean":"2024-09-21T06:19:12.058155+0000","last_became_active":"2024-09-21T06:17:47.239448+0000","last_became_peered":"2024-09-21T06:17:47.239448+0000","last_unstale":"2024-09-21T06:19:12.058155+0000","last_undegraded":"2024-09-21T06:19:12.058155+0000","last_fullsized":"2024-09-21T06:19:12.058155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:23.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080731+0000","last_change":"2024-09-21T06:18:13.404093+0000","last_active":"2024-09-21T06:19:12.080731+0000","last_peered":"2024-09-21T06:19:12.080731+0000","last_clean":"2024-09-21T06:19:12.080731+0000","last_became_active":"2024-09-21T06:18:13.403608+0000","last_became_peered":"2024-09-21T06:18:13.403608+0000","last_unstale":"2024-09-21T06:19:12.080731+0000","last_undegraded":"2024-09-21T06:19:12.080731+0000","last_fullsized":"2024-09-21T06:19:12.080731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:54.362457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070503+0000","last_change":"2024-09-21T06:17:47.230213+0000","last_active":"2024-09-21T06:19:12.070503+0000","last_peered":"2024-09-21T06:19:12.070503+0000","last_clean":"2024-09-21T06:19:12.070503+0000","last_became_active":"2024-09-21T06:17:47.229751+0000","last_became_peered":"2024-09-21T06:17:47.229751+0000","last_unstale":"2024-09-21T06:19:12.070503+0000","last_undegraded":"2024-09-21T06:19:12.070503+0000","last_fullsized":"2024-09-21T06:19:12.070503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:48.592488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080883+0000","last_change":"2024-09-21T06:17:47.240431+0000","last_active":"2024-09-21T06:19:12.080883+0000","last_peered":"2024-09-21T06:19:12.080883+0000","last_clean":"2024-09-21T06:19:12.080883+0000","last_became_active":"2024-09-21T06:17:47.240081+0000","last_became_peered":"2024-09-21T06:17:47.240081+0000","last_unstale":"2024-09-21T06:19:12.080883+0000","last_undegraded":"2024-09-21T06:19:12.080883+0000","last_fullsized":"2024-09-21T06:19:12.080883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:58.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077668+0000","last_change":"2024-09-21T06:17:47.245188+0000","last_active":"2024-09-21T06:19:12.077668+0000","last_peered":"2024-09-21T06:19:12.077668+0000","last_clean":"2024-09-21T06:19:12.077668+0000","last_became_active":"2024-09-21T06:17:47.244751+0000","last_became_peered":"2024-09-21T06:17:47.244751+0000","last_unstale":"2024-09-21T06:19:12.077668+0000","last_undegraded":"2024-09-21T06:19:12.077668+0000","last_fullsized":"2024-09-21T06:19:12.077668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:28.912182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.076128+0000","last_change":"2024-09-21T06:17:47.251595+0000","last_active":"2024-09-21T06:19:12.076128+0000","last_peered":"2024-09-21T06:19:12.076128+0000","last_clean":"2024-09-21T06:19:12.076128+0000","last_became_active":"2024-09-21T06:17:47.251217+0000","last_became_peered":"2024-09-21T06:17:47.251217+0000","last_unstale":"2024-09-21T06:19:12.076128+0000","last_undegraded":"2024-09-21T06:19:12.076128+0000","last_fullsized":"2024-09-21T06:19:12.076128+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:45.471156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077334+0000","last_change":"2024-09-21T06:17:47.246451+0000","last_active":"2024-09-21T06:19:12.077334+0000","last_peered":"2024-09-21T06:19:12.077334+0000","last_clean":"2024-09-21T06:19:12.077334+0000","last_became_active":"2024-09-21T06:17:47.246066+0000","last_became_peered":"2024-09-21T06:17:47.246066+0000","last_unstale":"2024-09-21T06:19:12.077334+0000","last_undegraded":"2024-09-21T06:19:12.077334+0000","last_fullsized":"2024-09-21T06:19:12.077334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:56.397082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073676+0000","last_change":"2024-09-21T06:18:13.404172+0000","last_active":"2024-09-21T06:19:12.073676+0000","last_peered":"2024-09-21T06:19:12.073676+0000","last_clean":"2024-09-21T06:19:12.073676+0000","last_became_active":"2024-09-21T06:18:13.403643+0000","last_became_peered":"2024-09-21T06:18:13.403643+0000","last_unstale":"2024-09-21T06:19:12.073676+0000","last_undegraded":"2024-09-21T06:19:12.073676+0000","last_fullsized":"2024-09-21T06:19:12.073676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:12.264818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069060+0000","last_change":"2024-09-21T06:17:47.236571+0000","last_active":"2024-09-21T06:19:12.069060+0000","last_peered":"2024-09-21T06:19:12.069060+0000","last_clean":"2024-09-21T06:19:12.069060+0000","last_became_active":"2024-09-21T06:17:47.236192+0000","last_became_peered":"2024-09-21T06:17:47.236192+0000","last_unstale":"2024-09-21T06:19:12.069060+0000","last_undegraded":"2024-09-21T06:19:12.069060+0000","last_fullsized":"2024-09-21T06:19:12.069060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:47.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070690+0000","last_change":"2024-09-21T06:17:47.239378+0000","last_active":"2024-09-21T06:19:12.070690+0000","last_peered":"2024-09-21T06:19:12.070690+0000","last_clean":"2024-09-21T06:19:12.070690+0000","last_became_active":"2024-09-21T06:17:47.239038+0000","last_became_peered":"2024-09-21T06:17:47.239038+0000","last_unstale":"2024-09-21T06:19:12.070690+0000","last_undegraded":"2024-09-21T06:19:12.070690+0000","last_fullsized":"2024-09-21T06:19:12.070690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:47.694017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071321+0000","last_change":"2024-09-21T06:17:47.246429+0000","last_active":"2024-09-21T06:19:12.071321+0000","last_peered":"2024-09-21T06:19:12.071321+0000","last_clean":"2024-09-21T06:19:12.071321+0000","last_became_active":"2024-09-21T06:17:47.245940+0000","last_became_peered":"2024-09-21T06:17:47.245940+0000","last_unstale":"2024-09-21T06:19:12.071321+0000","last_undegraded":"2024-09-21T06:19:12.071321+0000","last_fullsized":"2024-09-21T06:19:12.071321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:16.489460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078351+0000","last_change":"2024-09-21T06:17:47.242418+0000","last_active":"2024-09-21T06:19:12.078351+0000","last_peered":"2024-09-21T06:19:12.078351+0000","last_clean":"2024-09-21T06:19:12.078351+0000","last_became_active":"2024-09-21T06:17:47.241933+0000","last_became_peered":"2024-09-21T06:17:47.241933+0000","last_unstale":"2024-09-21T06:19:12.078351+0000","last_undegraded":"2024-09-21T06:19:12.078351+0000","last_fullsized":"2024-09-21T06:19:12.078351+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:58.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073590+0000","last_change":"2024-09-21T06:17:47.247290+0000","last_active":"2024-09-21T06:19:12.073590+0000","last_peered":"2024-09-21T06:19:12.073590+0000","last_clean":"2024-09-21T06:19:12.073590+0000","last_became_active":"2024-09-21T06:17:47.246844+0000","last_became_peered":"2024-09-21T06:17:47.246844+0000","last_unstale":"2024-09-21T06:19:12.073590+0000","last_undegraded":"2024-09-21T06:19:12.073590+0000","last_fullsized":"2024-09-21T06:19:12.073590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:13.276412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.073908+0000","last_change":"2024-09-21T06:17:47.238599+0000","last_active":"2024-09-21T06:19:12.073908+0000","last_peered":"2024-09-21T06:19:12.073908+0000","last_clean":"2024-09-21T06:19:12.073908+0000","last_became_active":"2024-09-21T06:17:47.238196+0000","last_became_peered":"2024-09-21T06:17:47.238196+0000","last_unstale":"2024-09-21T06:19:12.073908+0000","last_undegraded":"2024-09-21T06:19:12.073908+0000","last_fullsized":"2024-09-21T06:19:12.073908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:28.537931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069518+0000","last_change":"2024-09-21T06:17:47.239744+0000","last_active":"2024-09-21T06:19:12.069518+0000","last_peered":"2024-09-21T06:19:12.069518+0000","last_clean":"2024-09-21T06:19:12.069518+0000","last_became_active":"2024-09-21T06:17:47.239388+0000","last_became_peered":"2024-09-21T06:17:47.239388+0000","last_unstale":"2024-09-21T06:19:12.069518+0000","last_undegraded":"2024-09-21T06:19:12.069518+0000","last_fullsized":"2024-09-21T06:19:12.069518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:18.056510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069304+0000","last_change":"2024-09-21T06:17:47.253322+0000","last_active":"2024-09-21T06:19:12.069304+0000","last_peered":"2024-09-21T06:19:12.069304+0000","last_clean":"2024-09-21T06:19:12.069304+0000","last_became_active":"2024-09-21T06:17:47.252929+0000","last_became_peered":"2024-09-21T06:17:47.252929+0000","last_unstale":"2024-09-21T06:19:12.069304+0000","last_undegraded":"2024-09-21T06:19:12.069304+0000","last_fullsized":"2024-09-21T06:19:12.069304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:23.840889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.081113+0000","last_change":"2024-09-21T06:17:47.230041+0000","last_active":"2024-09-21T06:19:12.081113+0000","last_peered":"2024-09-21T06:19:12.081113+0000","last_clean":"2024-09-21T06:19:12.081113+0000","last_became_active":"2024-09-21T06:17:47.229698+0000","last_became_peered":"2024-09-21T06:17:47.229698+0000","last_unstale":"2024-09-21T06:19:12.081113+0000","last_undegraded":"2024-09-21T06:19:12.081113+0000","last_fullsized":"2024-09-21T06:19:12.081113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:21.095481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080630+0000","last_change":"2024-09-21T06:17:47.243611+0000","last_active":"2024-09-21T06:19:12.080630+0000","last_peered":"2024-09-21T06:19:12.080630+0000","last_clean":"2024-09-21T06:19:12.080630+0000","last_became_active":"2024-09-21T06:17:47.243247+0000","last_became_peered":"2024-09-21T06:17:47.243247+0000","last_unstale":"2024-09-21T06:19:12.080630+0000","last_undegraded":"2024-09-21T06:19:12.080630+0000","last_fullsized":"2024-09-21T06:19:12.080630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:02.752713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067299+0000","last_change":"2024-09-21T06:17:47.248176+0000","last_active":"2024-09-21T06:19:12.067299+0000","last_peered":"2024-09-21T06:19:12.067299+0000","last_clean":"2024-09-21T06:19:12.067299+0000","last_became_active":"2024-09-21T06:17:47.247785+0000","last_became_peered":"2024-09-21T06:17:47.247785+0000","last_unstale":"2024-09-21T06:19:12.067299+0000","last_undegraded":"2024-09-21T06:19:12.067299+0000","last_fullsized":"2024-09-21T06:19:12.067299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.997545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063067+0000","last_change":"2024-09-21T06:17:47.240886+0000","last_active":"2024-09-21T06:19:12.063067+0000","last_peered":"2024-09-21T06:19:12.063067+0000","last_clean":"2024-09-21T06:19:12.063067+0000","last_became_active":"2024-09-21T06:17:47.240215+0000","last_became_peered":"2024-09-21T06:17:47.240215+0000","last_unstale":"2024-09-21T06:19:12.063067+0000","last_undegraded":"2024-09-21T06:19:12.063067+0000","last_fullsized":"2024-09-21T06:19:12.063067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:41.828017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064430+0000","last_change":"2024-09-21T06:17:47.247730+0000","last_active":"2024-09-21T06:19:12.064430+0000","last_peered":"2024-09-21T06:19:12.064430+0000","last_clean":"2024-09-21T06:19:12.064430+0000","last_became_active":"2024-09-21T06:17:47.247300+0000","last_became_peered":"2024-09-21T06:17:47.247300+0000","last_unstale":"2024-09-21T06:19:12.064430+0000","last_undegraded":"2024-09-21T06:19:12.064430+0000","last_fullsized":"2024-09-21T06:19:12.064430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:30.230772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.056558+0000","last_change":"2024-09-21T06:17:47.238555+0000","last_active":"2024-09-21T06:19:12.056558+0000","last_peered":"2024-09-21T06:19:12.056558+0000","last_clean":"2024-09-21T06:19:12.056558+0000","last_became_active":"2024-09-21T06:17:47.238087+0000","last_became_peered":"2024-09-21T06:17:47.238087+0000","last_unstale":"2024-09-21T06:19:12.056558+0000","last_undegraded":"2024-09-21T06:19:12.056558+0000","last_fullsized":"2024-09-21T06:19:12.056558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:42.747161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.062141+0000","last_change":"2024-09-21T06:17:47.238197+0000","last_active":"2024-09-21T06:19:12.062141+0000","last_peered":"2024-09-21T06:19:12.062141+0000","last_clean":"2024-09-21T06:19:12.062141+0000","last_became_active":"2024-09-21T06:17:47.237822+0000","last_became_peered":"2024-09-21T06:17:47.237822+0000","last_unstale":"2024-09-21T06:19:12.062141+0000","last_undegraded":"2024-09-21T06:19:12.062141+0000","last_fullsized":"2024-09-21T06:19:12.062141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:08.838225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071624+0000","last_change":"2024-09-21T06:17:47.242925+0000","last_active":"2024-09-21T06:19:12.071624+0000","last_peered":"2024-09-21T06:19:12.071624+0000","last_clean":"2024-09-21T06:19:12.071624+0000","last_became_active":"2024-09-21T06:17:47.242570+0000","last_became_peered":"2024-09-21T06:17:47.242570+0000","last_unstale":"2024-09-21T06:19:12.071624+0000","last_undegraded":"2024-09-21T06:19:12.071624+0000","last_fullsized":"2024-09-21T06:19:12.071624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:30.057194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069474+0000","last_change":"2024-09-21T06:17:47.245161+0000","last_active":"2024-09-21T06:19:12.069474+0000","last_peered":"2024-09-21T06:19:12.069474+0000","last_clean":"2024-09-21T06:19:12.069474+0000","last_became_active":"2024-09-21T06:17:47.244747+0000","last_became_peered":"2024-09-21T06:17:47.244747+0000","last_unstale":"2024-09-21T06:19:12.069474+0000","last_undegraded":"2024-09-21T06:19:12.069474+0000","last_fullsized":"2024-09-21T06:19:12.069474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:45.483860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070568+0000","last_change":"2024-09-21T06:17:47.242740+0000","last_active":"2024-09-21T06:19:12.070568+0000","last_peered":"2024-09-21T06:19:12.070568+0000","last_clean":"2024-09-21T06:19:12.070568+0000","last_became_active":"2024-09-21T06:17:47.242336+0000","last_became_peered":"2024-09-21T06:17:47.242336+0000","last_unstale":"2024-09-21T06:19:12.070568+0000","last_undegraded":"2024-09-21T06:19:12.070568+0000","last_fullsized":"2024-09-21T06:19:12.070568+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:05.602943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.054687+0000","last_change":"2024-09-21T06:18:13.500386+0000","last_active":"2024-09-21T06:19:12.054687+0000","last_peered":"2024-09-21T06:19:12.054687+0000","last_clean":"2024-09-21T06:19:12.054687+0000","last_became_active":"2024-09-21T06:18:13.499861+0000","last_became_peered":"2024-09-21T06:18:13.499861+0000","last_unstale":"2024-09-21T06:19:12.054687+0000","last_undegraded":"2024-09-21T06:19:12.054687+0000","last_fullsized":"2024-09-21T06:19:12.054687+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:05.084576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.063803+0000","last_change":"2024-09-21T06:17:47.236443+0000","last_active":"2024-09-21T06:19:12.063803+0000","last_peered":"2024-09-21T06:19:12.063803+0000","last_clean":"2024-09-21T06:19:12.063803+0000","last_became_active":"2024-09-21T06:17:47.235359+0000","last_became_peered":"2024-09-21T06:17:47.235359+0000","last_unstale":"2024-09-21T06:19:12.063803+0000","last_undegraded":"2024-09-21T06:19:12.063803+0000","last_fullsized":"2024-09-21T06:19:12.063803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:04.233562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058613+0000","last_change":"2024-09-21T06:17:47.239969+0000","last_active":"2024-09-21T06:19:12.058613+0000","last_peered":"2024-09-21T06:19:12.058613+0000","last_clean":"2024-09-21T06:19:12.058613+0000","last_became_active":"2024-09-21T06:17:47.239571+0000","last_became_peered":"2024-09-21T06:17:47.239571+0000","last_unstale":"2024-09-21T06:19:12.058613+0000","last_undegraded":"2024-09-21T06:19:12.058613+0000","last_fullsized":"2024-09-21T06:19:12.058613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:17.107399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099862+0000","last_change":"2024-09-21T06:17:45.223160+0000","last_active":"2024-09-21T06:19:30.099862+0000","last_peered":"2024-09-21T06:19:30.099862+0000","last_clean":"2024-09-21T06:19:30.099862+0000","last_became_active":"2024-09-21T06:17:45.222562+0000","last_became_peered":"2024-09-21T06:17:45.222562+0000","last_unstale":"2024-09-21T06:19:30.099862+0000","last_undegraded":"2024-09-21T06:19:30.099862+0000","last_fullsized":"2024-09-21T06:19:30.099862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:24.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.060366+0000","last_change":"2024-09-21T06:17:47.241859+0000","last_active":"2024-09-21T06:19:12.060366+0000","last_peered":"2024-09-21T06:19:12.060366+0000","last_clean":"2024-09-21T06:19:12.060366+0000","last_became_active":"2024-09-21T06:17:47.241459+0000","last_became_peered":"2024-09-21T06:17:47.241459+0000","last_unstale":"2024-09-21T06:19:12.060366+0000","last_undegraded":"2024-09-21T06:19:12.060366+0000","last_fullsized":"2024-09-21T06:19:12.060366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:09.520479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400475+0000","last_change":"2024-09-21T06:17:45.222806+0000","last_active":"2024-09-21T06:18:13.400475+0000","last_peered":"2024-09-21T06:18:13.400475+0000","last_clean":"2024-09-21T06:18:13.400475+0000","last_became_active":"2024-09-21T06:17:45.222337+0000","last_became_peered":"2024-09-21T06:17:45.222337+0000","last_unstale":"2024-09-21T06:18:13.400475+0000","last_undegraded":"2024-09-21T06:18:13.400475+0000","last_fullsized":"2024-09-21T06:18:13.400475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:44.111083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397823+0000","last_change":"2024-09-21T06:17:45.214430+0000","last_active":"2024-09-21T06:18:13.397823+0000","last_peered":"2024-09-21T06:18:13.397823+0000","last_clean":"2024-09-21T06:18:13.397823+0000","last_became_active":"2024-09-21T06:17:45.213996+0000","last_became_peered":"2024-09-21T06:17:45.213996+0000","last_unstale":"2024-09-21T06:18:13.397823+0000","last_undegraded":"2024-09-21T06:18:13.397823+0000","last_fullsized":"2024-09-21T06:18:13.397823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:36.433941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.067249+0000","last_change":"2024-09-21T06:17:47.241683+0000","last_active":"2024-09-21T06:19:12.067249+0000","last_peered":"2024-09-21T06:19:12.067249+0000","last_clean":"2024-09-21T06:19:12.067249+0000","last_became_active":"2024-09-21T06:17:47.241303+0000","last_became_peered":"2024-09-21T06:17:47.241303+0000","last_unstale":"2024-09-21T06:19:12.067249+0000","last_undegraded":"2024-09-21T06:19:12.067249+0000","last_fullsized":"2024-09-21T06:19:12.067249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:21.893273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498355+0000","last_change":"2024-09-21T06:17:45.220067+0000","last_active":"2024-09-21T06:18:13.498355+0000","last_peered":"2024-09-21T06:18:13.498355+0000","last_clean":"2024-09-21T06:18:13.498355+0000","last_became_active":"2024-09-21T06:17:45.219762+0000","last_became_peered":"2024-09-21T06:17:45.219762+0000","last_unstale":"2024-09-21T06:18:13.498355+0000","last_undegraded":"2024-09-21T06:18:13.498355+0000","last_fullsized":"2024-09-21T06:18:13.498355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:40.050030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.074138+0000","last_change":"2024-09-21T06:17:47.239910+0000","last_active":"2024-09-21T06:19:12.074138+0000","last_peered":"2024-09-21T06:19:12.074138+0000","last_clean":"2024-09-21T06:19:12.074138+0000","last_became_active":"2024-09-21T06:17:47.239557+0000","last_became_peered":"2024-09-21T06:17:47.239557+0000","last_unstale":"2024-09-21T06:19:12.074138+0000","last_undegraded":"2024-09-21T06:19:12.074138+0000","last_fullsized":"2024-09-21T06:19:12.074138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:34.091018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":121,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.099246+0000","last_change":"2024-09-21T06:17:45.226563+0000","last_active":"2024-09-21T06:19:30.099246+0000","last_peered":"2024-09-21T06:19:30.099246+0000","last_clean":"2024-09-21T06:19:30.099246+0000","last_became_active":"2024-09-21T06:17:45.226063+0000","last_became_peered":"2024-09-21T06:17:45.226063+0000","last_unstale":"2024-09-21T06:19:30.099246+0000","last_undegraded":"2024-09-21T06:19:30.099246+0000","last_fullsized":"2024-09-21T06:19:30.099246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:51:03.221595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082060+0000","last_change":"2024-09-21T06:17:47.240849+0000","last_active":"2024-09-21T06:19:12.082060+0000","last_peered":"2024-09-21T06:19:12.082060+0000","last_clean":"2024-09-21T06:19:12.082060+0000","last_became_active":"2024-09-21T06:17:47.238868+0000","last_became_peered":"2024-09-21T06:17:47.238868+0000","last_unstale":"2024-09-21T06:19:12.082060+0000","last_undegraded":"2024-09-21T06:19:12.082060+0000","last_fullsized":"2024-09-21T06:19:12.082060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:19.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499140+0000","last_change":"2024-09-21T06:17:45.223284+0000","last_active":"2024-09-21T06:18:13.499140+0000","last_peered":"2024-09-21T06:18:13.499140+0000","last_clean":"2024-09-21T06:18:13.499140+0000","last_became_active":"2024-09-21T06:17:45.222600+0000","last_became_peered":"2024-09-21T06:17:45.222600+0000","last_unstale":"2024-09-21T06:18:13.499140+0000","last_undegraded":"2024-09-21T06:18:13.499140+0000","last_fullsized":"2024-09-21T06:18:13.499140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:13.504136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070382+0000","last_change":"2024-09-21T06:17:47.247101+0000","last_active":"2024-09-21T06:19:12.070382+0000","last_peered":"2024-09-21T06:19:12.070382+0000","last_clean":"2024-09-21T06:19:12.070382+0000","last_became_active":"2024-09-21T06:17:47.246723+0000","last_became_peered":"2024-09-21T06:17:47.246723+0000","last_unstale":"2024-09-21T06:19:12.070382+0000","last_undegraded":"2024-09-21T06:19:12.070382+0000","last_fullsized":"2024-09-21T06:19:12.070382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:27.977473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498383+0000","last_change":"2024-09-21T06:17:45.224233+0000","last_active":"2024-09-21T06:18:13.498383+0000","last_peered":"2024-09-21T06:18:13.498383+0000","last_clean":"2024-09-21T06:18:13.498383+0000","last_became_active":"2024-09-21T06:17:45.223741+0000","last_became_peered":"2024-09-21T06:17:45.223741+0000","last_unstale":"2024-09-21T06:18:13.498383+0000","last_undegraded":"2024-09-21T06:18:13.498383+0000","last_fullsized":"2024-09-21T06:18:13.498383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:19:10.391954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075341+0000","last_change":"2024-09-21T06:18:13.405270+0000","last_active":"2024-09-21T06:19:12.075341+0000","last_peered":"2024-09-21T06:19:12.075341+0000","last_clean":"2024-09-21T06:19:12.075341+0000","last_became_active":"2024-09-21T06:18:13.404759+0000","last_became_peered":"2024-09-21T06:18:13.404759+0000","last_unstale":"2024-09-21T06:19:12.075341+0000","last_undegraded":"2024-09-21T06:19:12.075341+0000","last_fullsized":"2024-09-21T06:19:12.075341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.678457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'33","reported_seq":258,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.110004+0000","last_change":"2024-09-21T06:17:45.223495+0000","last_active":"2024-09-21T06:19:31.110004+0000","last_peered":"2024-09-21T06:19:31.110004+0000","last_clean":"2024-09-21T06:19:31.110004+0000","last_became_active":"2024-09-21T06:17:45.222476+0000","last_became_peered":"2024-09-21T06:17:45.222476+0000","last_unstale":"2024-09-21T06:19:31.110004+0000","last_undegraded":"2024-09-21T06:19:31.110004+0000","last_fullsized":"2024-09-21T06:19:31.110004+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:21.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66447,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.058041+0000","last_change":"2024-09-21T06:17:47.248857+0000","last_active":"2024-09-21T06:19:12.058041+0000","last_peered":"2024-09-21T06:19:12.058041+0000","last_clean":"2024-09-21T06:19:12.058041+0000","last_became_active":"2024-09-21T06:17:47.248267+0000","last_became_peered":"2024-09-21T06:17:47.248267+0000","last_unstale":"2024-09-21T06:19:12.058041+0000","last_undegraded":"2024-09-21T06:19:12.058041+0000","last_fullsized":"2024-09-21T06:19:12.058041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:52.018931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400650+0000","last_change":"2024-09-21T06:17:45.215452+0000","last_active":"2024-09-21T06:18:13.400650+0000","last_peered":"2024-09-21T06:18:13.400650+0000","last_clean":"2024-09-21T06:18:13.400650+0000","last_became_active":"2024-09-21T06:17:45.215095+0000","last_became_peered":"2024-09-21T06:17:45.215095+0000","last_unstale":"2024-09-21T06:18:13.400650+0000","last_undegraded":"2024-09-21T06:18:13.400650+0000","last_fullsized":"2024-09-21T06:18:13.400650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:08:23.136595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080657+0000","last_change":"2024-09-21T06:17:47.241075+0000","last_active":"2024-09-21T06:19:12.080657+0000","last_peered":"2024-09-21T06:19:12.080657+0000","last_clean":"2024-09-21T06:19:12.080657+0000","last_became_active":"2024-09-21T06:17:47.240764+0000","last_became_peered":"2024-09-21T06:17:47.240764+0000","last_unstale":"2024-09-21T06:19:12.080657+0000","last_undegraded":"2024-09-21T06:19:12.080657+0000","last_fullsized":"2024-09-21T06:19:12.080657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:21.158564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498259+0000","last_change":"2024-09-21T06:17:45.219408+0000","last_active":"2024-09-21T06:18:13.498259+0000","last_peered":"2024-09-21T06:18:13.498259+0000","last_clean":"2024-09-21T06:18:13.498259+0000","last_became_active":"2024-09-21T06:17:45.219086+0000","last_became_peered":"2024-09-21T06:17:45.219086+0000","last_unstale":"2024-09-21T06:18:13.498259+0000","last_undegraded":"2024-09-21T06:18:13.498259+0000","last_fullsized":"2024-09-21T06:18:13.498259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:11.834537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.079530+0000","last_change":"2024-09-21T06:17:47.238644+0000","last_active":"2024-09-21T06:19:12.079530+0000","last_peered":"2024-09-21T06:19:12.079530+0000","last_clean":"2024-09-21T06:19:12.079530+0000","last_became_active":"2024-09-21T06:17:47.238217+0000","last_became_peered":"2024-09-21T06:17:47.238217+0000","last_unstale":"2024-09-21T06:19:12.079530+0000","last_undegraded":"2024-09-21T06:19:12.079530+0000","last_fullsized":"2024-09-21T06:19:12.079530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:39.661569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":128,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:31.115768+0000","last_change":"2024-09-21T06:17:45.217157+0000","last_active":"2024-09-21T06:19:31.115768+0000","last_peered":"2024-09-21T06:19:31.115768+0000","last_clean":"2024-09-21T06:19:31.115768+0000","last_became_active":"2024-09-21T06:17:45.216697+0000","last_became_peered":"2024-09-21T06:17:45.216697+0000","last_unstale":"2024-09-21T06:19:31.115768+0000","last_undegraded":"2024-09-21T06:19:31.115768+0000","last_fullsized":"2024-09-21T06:19:31.115768+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:46.295986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075482+0000","last_change":"2024-09-21T06:17:47.245090+0000","last_active":"2024-09-21T06:19:12.075482+0000","last_peered":"2024-09-21T06:19:12.075482+0000","last_clean":"2024-09-21T06:19:12.075482+0000","last_became_active":"2024-09-21T06:17:47.239689+0000","last_became_peered":"2024-09-21T06:17:47.239689+0000","last_unstale":"2024-09-21T06:19:12.075482+0000","last_undegraded":"2024-09-21T06:19:12.075482+0000","last_fullsized":"2024-09-21T06:19:12.075482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:50.395951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399100+0000","last_change":"2024-09-21T06:17:45.221671+0000","last_active":"2024-09-21T06:18:13.399100+0000","last_peered":"2024-09-21T06:18:13.399100+0000","last_clean":"2024-09-21T06:18:13.399100+0000","last_became_active":"2024-09-21T06:17:45.221279+0000","last_became_peered":"2024-09-21T06:17:45.221279+0000","last_unstale":"2024-09-21T06:18:13.399100+0000","last_undegraded":"2024-09-21T06:18:13.399100+0000","last_fullsized":"2024-09-21T06:18:13.399100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:59.619638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068187+0000","last_change":"2024-09-21T06:17:47.245699+0000","last_active":"2024-09-21T06:19:12.068187+0000","last_peered":"2024-09-21T06:19:12.068187+0000","last_clean":"2024-09-21T06:19:12.068187+0000","last_became_active":"2024-09-21T06:17:47.245250+0000","last_became_peered":"2024-09-21T06:17:47.245250+0000","last_unstale":"2024-09-21T06:19:12.068187+0000","last_undegraded":"2024-09-21T06:19:12.068187+0000","last_fullsized":"2024-09-21T06:19:12.068187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:59.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399604+0000","last_change":"2024-09-21T06:17:45.221622+0000","last_active":"2024-09-21T06:18:13.399604+0000","last_peered":"2024-09-21T06:18:13.399604+0000","last_clean":"2024-09-21T06:18:13.399604+0000","last_became_active":"2024-09-21T06:17:45.221195+0000","last_became_peered":"2024-09-21T06:17:45.221195+0000","last_unstale":"2024-09-21T06:18:13.399604+0000","last_undegraded":"2024-09-21T06:18:13.399604+0000","last_fullsized":"2024-09-21T06:18:13.399604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:51.558109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068626+0000","last_change":"2024-09-21T06:17:47.253411+0000","last_active":"2024-09-21T06:19:12.068626+0000","last_peered":"2024-09-21T06:19:12.068626+0000","last_clean":"2024-09-21T06:19:12.068626+0000","last_became_active":"2024-09-21T06:17:47.252996+0000","last_became_peered":"2024-09-21T06:17:47.252996+0000","last_unstale":"2024-09-21T06:19:12.068626+0000","last_undegraded":"2024-09-21T06:19:12.068626+0000","last_fullsized":"2024-09-21T06:19:12.068626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:37:46.561275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.397973+0000","last_change":"2024-09-21T06:17:45.217299+0000","last_active":"2024-09-21T06:18:13.397973+0000","last_peered":"2024-09-21T06:18:13.397973+0000","last_clean":"2024-09-21T06:18:13.397973+0000","last_became_active":"2024-09-21T06:17:45.216851+0000","last_became_peered":"2024-09-21T06:17:45.216851+0000","last_unstale":"2024-09-21T06:18:13.397973+0000","last_undegraded":"2024-09-21T06:18:13.397973+0000","last_fullsized":"2024-09-21T06:18:13.397973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:19.090284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077987+0000","last_change":"2024-09-21T06:17:47.237680+0000","last_active":"2024-09-21T06:19:12.077987+0000","last_peered":"2024-09-21T06:19:12.077987+0000","last_clean":"2024-09-21T06:19:12.077987+0000","last_became_active":"2024-09-21T06:17:47.237227+0000","last_became_peered":"2024-09-21T06:17:47.237227+0000","last_unstale":"2024-09-21T06:19:12.077987+0000","last_undegraded":"2024-09-21T06:19:12.077987+0000","last_fullsized":"2024-09-21T06:19:12.077987+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:13.682182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498457+0000","last_change":"2024-09-21T06:17:45.218202+0000","last_active":"2024-09-21T06:18:13.498457+0000","last_peered":"2024-09-21T06:18:13.498457+0000","last_clean":"2024-09-21T06:18:13.498457+0000","last_became_active":"2024-09-21T06:17:45.217831+0000","last_became_peered":"2024-09-21T06:17:45.217831+0000","last_unstale":"2024-09-21T06:18:13.498457+0000","last_undegraded":"2024-09-21T06:18:13.498457+0000","last_fullsized":"2024-09-21T06:18:13.498457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:01.781161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075186+0000","last_change":"2024-09-21T06:17:47.240721+0000","last_active":"2024-09-21T06:19:12.075186+0000","last_peered":"2024-09-21T06:19:12.075186+0000","last_clean":"2024-09-21T06:19:12.075186+0000","last_became_active":"2024-09-21T06:17:47.239583+0000","last_became_peered":"2024-09-21T06:17:47.239583+0000","last_unstale":"2024-09-21T06:19:12.075186+0000","last_undegraded":"2024-09-21T06:19:12.075186+0000","last_fullsized":"2024-09-21T06:19:12.075186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:39.957755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.400818+0000","last_change":"2024-09-21T06:17:45.539869+0000","last_active":"2024-09-21T06:18:13.400818+0000","last_peered":"2024-09-21T06:18:13.400818+0000","last_clean":"2024-09-21T06:18:13.400818+0000","last_became_active":"2024-09-21T06:17:45.539372+0000","last_became_peered":"2024-09-21T06:17:45.539372+0000","last_unstale":"2024-09-21T06:18:13.400818+0000","last_undegraded":"2024-09-21T06:18:13.400818+0000","last_fullsized":"2024-09-21T06:18:13.400818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:26.941987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.077808+0000","last_change":"2024-09-21T06:17:47.245500+0000","last_active":"2024-09-21T06:19:12.077808+0000","last_peered":"2024-09-21T06:19:12.077808+0000","last_clean":"2024-09-21T06:19:12.077808+0000","last_became_active":"2024-09-21T06:17:47.240124+0000","last_became_peered":"2024-09-21T06:17:47.240124+0000","last_unstale":"2024-09-21T06:19:12.077808+0000","last_undegraded":"2024-09-21T06:19:12.077808+0000","last_fullsized":"2024-09-21T06:19:12.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:16.231070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498537+0000","last_change":"2024-09-21T06:16:37.027639+0000","last_active":"2024-09-21T06:18:13.498537+0000","last_peered":"2024-09-21T06:18:13.498537+0000","last_clean":"2024-09-21T06:18:13.498537+0000","last_became_active":"2024-09-21T06:16:37.021449+0000","last_became_peered":"2024-09-21T06:16:37.021449+0000","last_unstale":"2024-09-21T06:18:13.498537+0000","last_undegraded":"2024-09-21T06:18:13.498537+0000","last_fullsized":"2024-09-21T06:18:13.498537+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:13:12.363658+0000","last_clean_scrub_stamp":"2024-09-21T06:13:12.363658+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:33.592048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498500+0000","last_change":"2024-09-21T06:17:45.214674+0000","last_active":"2024-09-21T06:18:13.498500+0000","last_peered":"2024-09-21T06:18:13.498500+0000","last_clean":"2024-09-21T06:18:13.498500+0000","last_became_active":"2024-09-21T06:17:45.213905+0000","last_became_peered":"2024-09-21T06:17:45.213905+0000","last_unstale":"2024-09-21T06:18:13.498500+0000","last_undegraded":"2024-09-21T06:18:13.498500+0000","last_fullsized":"2024-09-21T06:18:13.498500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:40:05.044596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075160+0000","last_change":"2024-09-21T06:17:47.240109+0000","last_active":"2024-09-21T06:19:12.075160+0000","last_peered":"2024-09-21T06:19:12.075160+0000","last_clean":"2024-09-21T06:19:12.075160+0000","last_became_active":"2024-09-21T06:17:47.239452+0000","last_became_peered":"2024-09-21T06:17:47.239452+0000","last_unstale":"2024-09-21T06:19:12.075160+0000","last_undegraded":"2024-09-21T06:19:12.075160+0000","last_fullsized":"2024-09-21T06:19:12.075160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:59:34.935330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498334+0000","last_change":"2024-09-21T06:17:45.223674+0000","last_active":"2024-09-21T06:18:13.498334+0000","last_peered":"2024-09-21T06:18:13.498334+0000","last_clean":"2024-09-21T06:18:13.498334+0000","last_became_active":"2024-09-21T06:17:45.222682+0000","last_became_peered":"2024-09-21T06:17:45.222682+0000","last_unstale":"2024-09-21T06:18:13.498334+0000","last_undegraded":"2024-09-21T06:18:13.498334+0000","last_fullsized":"2024-09-21T06:18:13.498334+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:52.221731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.061681+0000","last_change":"2024-09-21T06:17:47.239553+0000","last_active":"2024-09-21T06:19:12.061681+0000","last_peered":"2024-09-21T06:19:12.061681+0000","last_clean":"2024-09-21T06:19:12.061681+0000","last_became_active":"2024-09-21T06:17:47.239197+0000","last_became_peered":"2024-09-21T06:17:47.239197+0000","last_unstale":"2024-09-21T06:19:12.061681+0000","last_undegraded":"2024-09-21T06:19:12.061681+0000","last_fullsized":"2024-09-21T06:19:12.061681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:50.197496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:32.116515+0000","last_change":"2024-09-21T06:17:45.221533+0000","last_active":"2024-09-21T06:19:32.116515+0000","last_peered":"2024-09-21T06:19:32.116515+0000","last_clean":"2024-09-21T06:19:32.116515+0000","last_became_active":"2024-09-21T06:17:45.221143+0000","last_became_peered":"2024-09-21T06:17:45.221143+0000","last_unstale":"2024-09-21T06:19:32.116515+0000","last_undegraded":"2024-09-21T06:19:32.116515+0000","last_fullsized":"2024-09-21T06:19:32.116515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:53:15.966258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.065031+0000","last_change":"2024-09-21T06:17:47.239487+0000","last_active":"2024-09-21T06:19:12.065031+0000","last_peered":"2024-09-21T06:19:12.065031+0000","last_clean":"2024-09-21T06:19:12.065031+0000","last_became_active":"2024-09-21T06:17:47.239113+0000","last_became_peered":"2024-09-21T06:17:47.239113+0000","last_unstale":"2024-09-21T06:19:12.065031+0000","last_undegraded":"2024-09-21T06:19:12.065031+0000","last_fullsized":"2024-09-21T06:19:12.065031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:52.056757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.500072+0000","last_change":"2024-09-21T06:17:45.218445+0000","last_active":"2024-09-21T06:18:13.500072+0000","last_peered":"2024-09-21T06:18:13.500072+0000","last_clean":"2024-09-21T06:18:13.500072+0000","last_became_active":"2024-09-21T06:17:45.218069+0000","last_became_peered":"2024-09-21T06:17:45.218069+0000","last_unstale":"2024-09-21T06:18:13.500072+0000","last_undegraded":"2024-09-21T06:18:13.500072+0000","last_fullsized":"2024-09-21T06:18:13.500072+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:47.715094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.069879+0000","last_change":"2024-09-21T06:17:47.245667+0000","last_active":"2024-09-21T06:19:12.069879+0000","last_peered":"2024-09-21T06:19:12.069879+0000","last_clean":"2024-09-21T06:19:12.069879+0000","last_became_active":"2024-09-21T06:17:47.245247+0000","last_became_peered":"2024-09-21T06:17:47.245247+0000","last_unstale":"2024-09-21T06:19:12.069879+0000","last_undegraded":"2024-09-21T06:19:12.069879+0000","last_fullsized":"2024-09-21T06:19:12.069879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:25.414701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.499061+0000","last_change":"2024-09-21T06:18:13.498949+0000","last_active":"2024-09-21T06:18:13.499061+0000","last_peered":"2024-09-21T06:18:13.499061+0000","last_clean":"2024-09-21T06:18:13.499061+0000","last_became_active":"2024-09-21T06:18:13.498496+0000","last_became_peered":"2024-09-21T06:18:13.498496+0000","last_unstale":"2024-09-21T06:18:13.499061+0000","last_undegraded":"2024-09-21T06:18:13.499061+0000","last_fullsized":"2024-09-21T06:18:13.499061+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:42.982233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080593+0000","last_change":"2024-09-21T06:18:13.407681+0000","last_active":"2024-09-21T06:19:12.080593+0000","last_peered":"2024-09-21T06:19:12.080593+0000","last_clean":"2024-09-21T06:19:12.080593+0000","last_became_active":"2024-09-21T06:18:13.403705+0000","last_became_peered":"2024-09-21T06:18:13.403705+0000","last_unstale":"2024-09-21T06:19:12.080593+0000","last_undegraded":"2024-09-21T06:19:12.080593+0000","last_fullsized":"2024-09-21T06:19:12.080593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:09.176309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399933+0000","last_change":"2024-09-21T06:17:45.224472+0000","last_active":"2024-09-21T06:18:13.399933+0000","last_peered":"2024-09-21T06:18:13.399933+0000","last_clean":"2024-09-21T06:18:13.399933+0000","last_became_active":"2024-09-21T06:17:45.224079+0000","last_became_peered":"2024-09-21T06:17:45.224079+0000","last_unstale":"2024-09-21T06:18:13.399933+0000","last_undegraded":"2024-09-21T06:18:13.399933+0000","last_fullsized":"2024-09-21T06:18:13.399933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:19.619952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.059503+0000","last_change":"2024-09-21T06:17:47.235961+0000","last_active":"2024-09-21T06:19:12.059503+0000","last_peered":"2024-09-21T06:19:12.059503+0000","last_clean":"2024-09-21T06:19:12.059503+0000","last_became_active":"2024-09-21T06:17:47.235573+0000","last_became_peered":"2024-09-21T06:17:47.235573+0000","last_unstale":"2024-09-21T06:19:12.059503+0000","last_undegraded":"2024-09-21T06:19:12.059503+0000","last_fullsized":"2024-09-21T06:19:12.059503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:01.088569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'13","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:30.269906+0000","last_change":"2024-09-21T06:17:45.214328+0000","last_active":"2024-09-21T06:19:30.269906+0000","last_peered":"2024-09-21T06:19:30.269906+0000","last_clean":"2024-09-21T06:19:30.269906+0000","last_became_active":"2024-09-21T06:17:45.213659+0000","last_became_peered":"2024-09-21T06:17:45.213659+0000","last_unstale":"2024-09-21T06:19:30.269906+0000","last_undegraded":"2024-09-21T06:19:30.269906+0000","last_fullsized":"2024-09-21T06:19:30.269906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:44.858980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080385+0000","last_change":"2024-09-21T06:17:47.250672+0000","last_active":"2024-09-21T06:19:12.080385+0000","last_peered":"2024-09-21T06:19:12.080385+0000","last_clean":"2024-09-21T06:19:12.080385+0000","last_became_active":"2024-09-21T06:17:47.250434+0000","last_became_peered":"2024-09-21T06:17:47.250434+0000","last_unstale":"2024-09-21T06:19:12.080385+0000","last_undegraded":"2024-09-21T06:19:12.080385+0000","last_fullsized":"2024-09-21T06:19:12.080385+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:58.779618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.498978+0000","last_change":"2024-09-21T06:17:45.540185+0000","last_active":"2024-09-21T06:18:13.498978+0000","last_peered":"2024-09-21T06:18:13.498978+0000","last_clean":"2024-09-21T06:18:13.498978+0000","last_became_active":"2024-09-21T06:17:45.539652+0000","last_became_peered":"2024-09-21T06:17:45.539652+0000","last_unstale":"2024-09-21T06:18:13.498978+0000","last_undegraded":"2024-09-21T06:18:13.498978+0000","last_fullsized":"2024-09-21T06:18:13.498978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:38.735340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.071837+0000","last_change":"2024-09-21T06:17:47.245797+0000","last_active":"2024-09-21T06:19:12.071837+0000","last_peered":"2024-09-21T06:19:12.071837+0000","last_clean":"2024-09-21T06:19:12.071837+0000","last_became_active":"2024-09-21T06:17:47.245450+0000","last_became_peered":"2024-09-21T06:17:47.245450+0000","last_unstale":"2024-09-21T06:19:12.071837+0000","last_undegraded":"2024-09-21T06:19:12.071837+0000","last_fullsized":"2024-09-21T06:19:12.071837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:38.677630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.402231+0000","last_change":"2024-09-21T06:17:45.221412+0000","last_active":"2024-09-21T06:18:13.402231+0000","last_peered":"2024-09-21T06:18:13.402231+0000","last_clean":"2024-09-21T06:18:13.402231+0000","last_became_active":"2024-09-21T06:17:45.221054+0000","last_became_peered":"2024-09-21T06:17:45.221054+0000","last_unstale":"2024-09-21T06:18:13.402231+0000","last_undegraded":"2024-09-21T06:18:13.402231+0000","last_fullsized":"2024-09-21T06:18:13.402231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.446043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.029978+0000","last_change":"2024-09-21T06:17:47.241267+0000","last_active":"2024-09-21T06:19:12.029978+0000","last_peered":"2024-09-21T06:19:12.029978+0000","last_clean":"2024-09-21T06:19:12.029978+0000","last_became_active":"2024-09-21T06:17:47.240611+0000","last_became_peered":"2024-09-21T06:17:47.240611+0000","last_unstale":"2024-09-21T06:19:12.029978+0000","last_undegraded":"2024-09-21T06:19:12.029978+0000","last_fullsized":"2024-09-21T06:19:12.029978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:21.826566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.398885+0000","last_change":"2024-09-21T06:17:45.214174+0000","last_active":"2024-09-21T06:18:13.398885+0000","last_peered":"2024-09-21T06:18:13.398885+0000","last_clean":"2024-09-21T06:18:13.398885+0000","last_became_active":"2024-09-21T06:17:45.213778+0000","last_became_peered":"2024-09-21T06:17:45.213778+0000","last_unstale":"2024-09-21T06:18:13.398885+0000","last_undegraded":"2024-09-21T06:18:13.398885+0000","last_fullsized":"2024-09-21T06:18:13.398885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:36.210475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.070437+0000","last_change":"2024-09-21T06:17:47.246043+0000","last_active":"2024-09-21T06:19:12.070437+0000","last_peered":"2024-09-21T06:19:12.070437+0000","last_clean":"2024-09-21T06:19:12.070437+0000","last_became_active":"2024-09-21T06:17:47.245677+0000","last_became_peered":"2024-09-21T06:17:47.245677+0000","last_unstale":"2024-09-21T06:19:12.070437+0000","last_undegraded":"2024-09-21T06:19:12.070437+0000","last_fullsized":"2024-09-21T06:19:12.070437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:21.538949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.406158+0000","last_change":"2024-09-21T06:18:13.405449+0000","last_active":"2024-09-21T06:18:13.406158+0000","last_peered":"2024-09-21T06:18:13.406158+0000","last_clean":"2024-09-21T06:18:13.406158+0000","last_became_active":"2024-09-21T06:18:13.400865+0000","last_became_peered":"2024-09-21T06:18:13.400865+0000","last_unstale":"2024-09-21T06:18:13.406158+0000","last_undegraded":"2024-09-21T06:18:13.406158+0000","last_fullsized":"2024-09-21T06:18:13.406158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:59.412986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.080710+0000","last_change":"2024-09-21T06:17:47.253144+0000","last_active":"2024-09-21T06:19:12.080710+0000","last_peered":"2024-09-21T06:19:12.080710+0000","last_clean":"2024-09-21T06:19:12.080710+0000","last_became_active":"2024-09-21T06:17:47.252763+0000","last_became_peered":"2024-09-21T06:17:47.252763+0000","last_unstale":"2024-09-21T06:19:12.080710+0000","last_undegraded":"2024-09-21T06:19:12.080710+0000","last_fullsized":"2024-09-21T06:19:12.080710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:44.963384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399293+0000","last_change":"2024-09-21T06:17:45.224406+0000","last_active":"2024-09-21T06:18:13.399293+0000","last_peered":"2024-09-21T06:18:13.399293+0000","last_clean":"2024-09-21T06:18:13.399293+0000","last_became_active":"2024-09-21T06:17:45.224005+0000","last_became_peered":"2024-09-21T06:17:45.224005+0000","last_unstale":"2024-09-21T06:18:13.399293+0000","last_undegraded":"2024-09-21T06:18:13.399293+0000","last_fullsized":"2024-09-21T06:18:13.399293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:41.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.078959+0000","last_change":"2024-09-21T06:17:47.240932+0000","last_active":"2024-09-21T06:19:12.078959+0000","last_peered":"2024-09-21T06:19:12.078959+0000","last_clean":"2024-09-21T06:19:12.078959+0000","last_became_active":"2024-09-21T06:17:47.239700+0000","last_became_peered":"2024-09-21T06:17:47.239700+0000","last_unstale":"2024-09-21T06:19:12.078959+0000","last_undegraded":"2024-09-21T06:19:12.078959+0000","last_fullsized":"2024-09-21T06:19:12.078959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:28.697253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.068036+0000","last_change":"2024-09-21T06:17:47.244768+0000","last_active":"2024-09-21T06:19:12.068036+0000","last_peered":"2024-09-21T06:19:12.068036+0000","last_clean":"2024-09-21T06:19:12.068036+0000","last_became_active":"2024-09-21T06:17:47.244379+0000","last_became_peered":"2024-09-21T06:17:47.244379+0000","last_unstale":"2024-09-21T06:19:12.068036+0000","last_undegraded":"2024-09-21T06:19:12.068036+0000","last_fullsized":"2024-09-21T06:19:12.068036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:32.822008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399760+0000","last_change":"2024-09-21T06:17:45.217523+0000","last_active":"2024-09-21T06:18:13.399760+0000","last_peered":"2024-09-21T06:18:13.399760+0000","last_clean":"2024-09-21T06:18:13.399760+0000","last_became_active":"2024-09-21T06:17:45.217066+0000","last_became_peered":"2024-09-21T06:17:45.217066+0000","last_unstale":"2024-09-21T06:18:13.399760+0000","last_undegraded":"2024-09-21T06:18:13.399760+0000","last_fullsized":"2024-09-21T06:18:13.399760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:32.345649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.082433+0000","last_change":"2024-09-21T06:17:47.253331+0000","last_active":"2024-09-21T06:19:12.082433+0000","last_peered":"2024-09-21T06:19:12.082433+0000","last_clean":"2024-09-21T06:19:12.082433+0000","last_became_active":"2024-09-21T06:17:47.252960+0000","last_became_peered":"2024-09-21T06:17:47.252960+0000","last_unstale":"2024-09-21T06:19:12.082433+0000","last_undegraded":"2024-09-21T06:19:12.082433+0000","last_fullsized":"2024-09-21T06:19:12.082433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:03.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399746+0000","last_change":"2024-09-21T06:17:45.223244+0000","last_active":"2024-09-21T06:18:13.399746+0000","last_peered":"2024-09-21T06:18:13.399746+0000","last_clean":"2024-09-21T06:18:13.399746+0000","last_became_active":"2024-09-21T06:17:45.222329+0000","last_became_peered":"2024-09-21T06:17:45.222329+0000","last_unstale":"2024-09-21T06:18:13.399746+0000","last_undegraded":"2024-09-21T06:18:13.399746+0000","last_fullsized":"2024-09-21T06:18:13.399746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:47.246720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.075256+0000","last_change":"2024-09-21T06:17:47.238118+0000","last_active":"2024-09-21T06:19:12.075256+0000","last_peered":"2024-09-21T06:19:12.075256+0000","last_clean":"2024-09-21T06:19:12.075256+0000","last_became_active":"2024-09-21T06:17:47.237318+0000","last_became_peered":"2024-09-21T06:17:47.237318+0000","last_unstale":"2024-09-21T06:19:12.075256+0000","last_undegraded":"2024-09-21T06:19:12.075256+0000","last_fullsized":"2024-09-21T06:19:12.075256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:35:44.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.399443+0000","last_change":"2024-09-21T06:17:45.221516+0000","last_active":"2024-09-21T06:18:13.399443+0000","last_peered":"2024-09-21T06:18:13.399443+0000","last_clean":"2024-09-21T06:18:13.399443+0000","last_became_active":"2024-09-21T06:17:45.221122+0000","last_became_peered":"2024-09-21T06:17:45.221122+0000","last_unstale":"2024-09-21T06:18:13.399443+0000","last_undegraded":"2024-09-21T06:18:13.399443+0000","last_fullsized":"2024-09-21T06:18:13.399443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:34.848724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:19:12.064716+0000","last_change":"2024-09-21T06:17:47.249076+0000","last_active":"2024-09-21T06:19:12.064716+0000","last_peered":"2024-09-21T06:19:12.064716+0000","last_clean":"2024-09-21T06:19:12.064716+0000","last_became_active":"2024-09-21T06:17:47.248649+0000","last_became_peered":"2024-09-21T06:17:47.248649+0000","last_unstale":"2024-09-21T06:19:12.064716+0000","last_undegraded":"2024-09-21T06:19:12.064716+0000","last_fullsized":"2024-09-21T06:19:12.064716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:46.211345+0000","last_clean_scrub_stamp":"2024-09-21T06:17:46.211345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:04.188201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:18:13.401798+0000","last_change":"2024-09-21T06:17:45.218668+0000","last_active":"2024-09-21T06:18:13.401798+0000","last_peered":"2024-09-21T06:18:13.401798+0000","last_clean":"2024-09-21T06:18:13.401798+0000","last_became_active":"2024-09-21T06:17:45.218220+0000","last_became_peered":"2024-09-21T06:17:45.218220+0000","last_unstale":"2024-09-21T06:18:13.401798+0000","last_undegraded":"2024-09-21T06:18:13.401798+0000","last_fullsized":"2024-09-21T06:18:13.401798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:17:44.189875+0000","last_clean_scrub_stamp":"2024-09-21T06:17:44.189875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:00.755825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70589,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":605,"num_read_kb":378,"num_write":174,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":225955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":415941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36856,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708296,"statfs":{"total":95995035648,"available":95957295104,"internally_reserved":0,"allocated":1548288,"data_stored":1074401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":36174274},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":416294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1008168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":415566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28456,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716696,"statfs":{"total":95995035648,"available":95965896704,"internally_reserved":0,"allocated":1466368,"data_stored":1007320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":416535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":860160,"data_stored":415760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":483156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":490160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":416837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:19:35.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:19:36.214 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:36.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:36 smithi038 ceph-mon[31215]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:36 smithi038 ceph-mon[31215]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:36 smithi038 ceph-mon[31215]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:19:36.659 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:36 smithi038 ceph-mon[31215]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 -- 172.21.15.38:0/2749573425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c102a60 msgr2=0x7f2a5c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 --2- 172.21.15.38:0/2749573425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c102a60 0x7f2a5c102e70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009900 tx=0x7f2a4c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 -- 172.21.15.38:0/2749573425 shutdown_connections 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 --2- 172.21.15.38:0/2749573425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 --2- 172.21.15.38:0/2749573425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 --2- 172.21.15.38:0/2749573425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c102a60 0x7f2a5c102e70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 -- 172.21.15.38:0/2749573425 >> 172.21.15.38:0/2749573425 conn(0x7f2a5c079730 msgr2=0x7f2a5c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 -- 172.21.15.38:0/2749573425 shutdown_connections 2024-09-21T06:19:36.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.668+0000 7f2a618e2640 1 -- 172.21.15.38:0/2749573425 wait complete. 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 Processor -- start 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 -- start start 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 0x7f2a5c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:36.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c113ba0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c113a20 con 0x7f2a5c102a60 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a618e2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c113d20 con 0x7f2a5c1083a0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a5b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a5b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58930/0 (socket says 172.21.15.38:58930) 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.669+0000 7f2a5b7fe640 1 -- 172.21.15.38:0/921721591 learned_addr learned my addr 172.21.15.38:0/921721591 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5affd640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 0x7f2a5c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5a7fc640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 -- 172.21.15.38:0/921721591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 msgr2=0x7f2a5c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 -- 172.21.15.38:0/921721591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 msgr2=0x7f2a5c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 0x7f2a5c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 -- 172.21.15.38:0/921721591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c1a0500 con 0x7f2a5c108cf0 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5a7fc640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5affd640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 0x7f2a5c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:36.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a5b7fe640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400eaa0 tx=0x7f2a5400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400cdb0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2a54005020 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c1a07f0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a540116d0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.670+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c1a6f50 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.671+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c102e70 con 0x7f2a5c108cf0 2024-09-21T06:19:36.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.673+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f2a540051d0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.674+0000 7f2a608e0640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 0x7f2a440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:36.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.674+0000 7f2a5affd640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 0x7f2a440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:36.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.674+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2a540e7c40 con 0x7f2a5c108cf0 2024-09-21T06:19:36.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.674+0000 7f2a5affd640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 0x7f2a440b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005ab0 tx=0x7f2a4c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:36.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.677+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a54016030 con 0x7f2a5c108cf0 2024-09-21T06:19:36.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:36 smithi174 ceph-mon[34815]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:36 smithi174 ceph-mon[34815]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:36 smithi174 ceph-mon[34815]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:19:36.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:36 smithi174 ceph-mon[34815]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.901+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a5c19b6c0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.901+0000 7f2a608e0640 1 -- 172.21.15.38:0/921721591 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7f2a5c19b6c0 con 0x7f2a5c108cf0 2024-09-21T06:19:36.904 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:36.904 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"btime":"2024-09-21T06:19:31:452263+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:19:30.723218+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:19:36.904 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-21T06:19:36.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:36 smithi044 ceph-mon[34369]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:36 smithi044 ceph-mon[34369]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:36 smithi044 ceph-mon[34369]: pgmap v317: 97 pgs: 97 active+clean; 646 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:19:36.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:36 smithi044 ceph-mon[34369]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:19:36.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.903+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 msgr2=0x7f2a440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:36.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.903+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 0x7f2a440b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c005ab0 tx=0x7f2a4c005a20 comp rx=0 tx=0).stop 2024-09-21T06:19:36.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.903+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 msgr2=0x7f2a5c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:36.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.903+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400eaa0 tx=0x7f2a5400ef60 comp rx=0 tx=0).stop 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 shutdown_connections 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2a440b65f0 0x7f2a440b8b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a5c108cf0 0x7f2a5c19fdd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a5c1083a0 0x7f2a5c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 --2- 172.21.15.38:0/921721591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a5c102a60 0x7f2a5c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 >> 172.21.15.38:0/921721591 conn(0x7f2a5c079730 msgr2=0x7f2a5c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 shutdown_connections 2024-09-21T06:19:36.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:36.904+0000 7f2a618e2640 1 -- 172.21.15.38:0/921721591 wait complete. 2024-09-21T06:19:37.577 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:37 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/921721591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:37.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:19:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:37.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:37 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/921721591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:37.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:37 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/921721591' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:19:38.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 -- 172.21.15.38:0/2493396134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1052b0 msgr2=0x7f8b1c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:38.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 --2- 172.21.15.38:0/2493396134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c10d8f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009900 tx=0x7f8b1002a410 comp rx=0 tx=0).stop 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 -- 172.21.15.38:0/2493396134 shutdown_connections 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 --2- 172.21.15.38:0/2493396134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 0x7f8b1c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 --2- 172.21.15.38:0/2493396134 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c10d8f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 --2- 172.21.15.38:0/2493396134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c104880 0x7f8b1c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 -- 172.21.15.38:0/2493396134 >> 172.21.15.38:0/2493396134 conn(0x7f8b1c079730 msgr2=0x7f8b1c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 -- 172.21.15.38:0/2493396134 shutdown_connections 2024-09-21T06:19:38.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.394+0000 7f8b215c8640 1 -- 172.21.15.38:0/2493396134 wait complete. 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.395+0000 7f8b215c8640 1 Processor -- start 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.395+0000 7f8b215c8640 1 -- start start 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 0x7f8b1c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c113b90 con 0x7f8b1c104880 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c113a10 con 0x7f8b1c10de30 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b215c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c113d10 con 0x7f8b1c1052b0 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:38.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58948/0 (socket says 172.21.15.38:58948) 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 -- 172.21.15.38:0/217400704 learned_addr learned my addr 172.21.15.38:0/217400704 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1b7fe640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 0x7f8b1c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1a7fc640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 -- 172.21.15.38:0/217400704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c1052b0 msgr2=0x7f8b1c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 -- 172.21.15.38:0/217400704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 msgr2=0x7f8b1c1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 0x7f8b1c1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 -- 172.21.15.38:0/217400704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c1a26b0 con 0x7f8b1c104880 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.396+0000 7f8b1affd640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d950 tx=0x7f8b0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.397+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c017070 con 0x7f8b1c104880 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.397+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c1a29a0 con 0x7f8b1c104880 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.397+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b0c009c30 con 0x7f8b1c104880 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.397+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c00f620 con 0x7f8b1c104880 2024-09-21T06:19:38.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.397+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c1a9100 con 0x7f8b1c104880 2024-09-21T06:19:38.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.398+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b080052c0 con 0x7f8b1c104880 2024-09-21T06:19:38.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.399+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f8b0c01a070 con 0x7f8b1c104880 2024-09-21T06:19:38.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.401+0000 7f8b03fff640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 0x7f8b040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:38.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.401+0000 7f8b1a7fc640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 0x7f8b040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:38.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.401+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8b0c0e6d80 con 0x7f8b1c104880 2024-09-21T06:19:38.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.401+0000 7f8b1a7fc640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 0x7f8b040b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b100314b0 tx=0x7f8b100058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:38.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.404+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b0c009de0 con 0x7f8b1c104880 2024-09-21T06:19:38.596 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:38 smithi038 ceph-mon[31215]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:19:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.594+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b08005880 con 0x7f8b1c104880 2024-09-21T06:19:38.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.596+0000 7f8b03fff640 1 -- 172.21.15.38:0/217400704 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22911 (secure 0 0 0) 0x7f8b0c0b17f0 con 0x7f8b1c104880 2024-09-21T06:19:38.598 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:19:38.598 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":77,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:18:13.392235+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:19:38.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 msgr2=0x7f8b040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:38.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 0x7f8b040b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b100314b0 tx=0x7f8b100058d0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 msgr2=0x7f8b1c19c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d950 tx=0x7f8b0c00de10 comp rx=0 tx=0).stop 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 shutdown_connections 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8b040b65f0 0x7f8b040b8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b1c10de30 0x7f8b1c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b1c1052b0 0x7f8b1c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 --2- 172.21.15.38:0/217400704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b1c104880 0x7f8b1c19c740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.598+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 >> 172.21.15.38:0/217400704 conn(0x7f8b1c079730 msgr2=0x7f8b1c105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.599+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 shutdown_connections 2024-09-21T06:19:38.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:38.599+0000 7f8b215c8640 1 -- 172.21.15.38:0/217400704 wait complete. 2024-09-21T06:19:38.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:38 smithi174 ceph-mon[34815]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:19:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:38 smithi044 ceph-mon[34369]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:19:39.396 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T06:19:39.397 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:19:39.409 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:19:39.409 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:19:39.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T06:19:39.410 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T06:19:39.410 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:19:39.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 -- 172.21.15.38:0/3758984171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108300 msgr2=0x7fa5c4108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/3758984171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108300 0x7fa5c4108710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009900 tx=0x7fa5b802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 -- 172.21.15.38:0/3758984171 shutdown_connections 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/3758984171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4108c50 0x7fa5c410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/3758984171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108300 0x7fa5c4108710 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/3758984171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c41029d0 0x7fa5c4102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 -- 172.21.15.38:0/3758984171 >> 172.21.15.38:0/3758984171 conn(0x7fa5c407a6f0 msgr2=0x7fa5c407ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 -- 172.21.15.38:0/3758984171 shutdown_connections 2024-09-21T06:19:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.531+0000 7fa5c93ad640 1 -- 172.21.15.38:0/3758984171 wait complete. 2024-09-21T06:19:39.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 Processor -- start 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 -- start start 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 0x7fa5c419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4108300 0x7fa5c419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4112a80 con 0x7fa5c4108c50 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4112900 con 0x7fa5c41029d0 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c93ad640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4112c00 con 0x7fa5c4108300 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 0x7fa5c419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37976/0 (socket says 172.21.15.38:37976) 2024-09-21T06:19:39.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.532+0000 7fa5c37fe640 1 -- 172.21.15.38:0/688064593 learned_addr learned my addr 172.21.15.38:0/688064593 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c27fc640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4108300 0x7fa5c419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 -- 172.21.15.38:0/688064593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4108300 msgr2=0x7fa5c419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4108300 0x7fa5c419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 -- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 msgr2=0x7fa5c419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 -- 172.21.15.38:0/688064593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c41a6580 con 0x7fa5c41029d0 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c37fe640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:39.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c2ffd640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 0x7fa5c419b2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e9f0 tx=0x7fa5b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:39.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b400ccc0 con 0x7fa5c41029d0 2024-09-21T06:19:39.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c41a6870 con 0x7fa5c41029d0 2024-09-21T06:19:39.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5b4005020 con 0x7fa5c41029d0 2024-09-21T06:19:39.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40049c0 con 0x7fa5c41029d0 2024-09-21T06:19:39.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.533+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c41a6d90 con 0x7fa5c41029d0 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.535+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c4102de0 con 0x7fa5c41029d0 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.536+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fa5b4004c60 con 0x7fa5c41029d0 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.537+0000 7fa5abfff640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 0x7fa5ac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.537+0000 7fa5c27fc640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 0x7fa5ac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.537+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa5b40e75b0 con 0x7fa5c41029d0 2024-09-21T06:19:39.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.537+0000 7fa5c27fc640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 0x7fa5ac0b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5b802aa00 tx=0x7fa5b8000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:39.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.542+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5b40adc40 con 0x7fa5c41029d0 2024-09-21T06:19:39.685 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:39 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/217400704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:39.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.769+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa5c4063800 con 0x7fa5ac0b65f0 2024-09-21T06:19:39.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:39 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/217400704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:39.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:39 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/217400704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:19:39.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.943+0000 7fa5abfff640 1 -- 172.21.15.38:0/688064593 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa5c4063800 con 0x7fa5ac0b65f0 2024-09-21T06:19:39.945 INFO:teuthology.orchestra.run.smithi038.stdout:Schedule set for path / 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 msgr2=0x7fa5ac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 0x7fa5ac0b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa5b802aa00 tx=0x7fa5b8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 msgr2=0x7fa5c419b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 0x7fa5c419b2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400e9f0 tx=0x7fa5b400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 shutdown_connections 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b65f0 0x7fa5ac0b8b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c4108c50 0x7fa5c419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4108300 0x7fa5c419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 --2- 172.21.15.38:0/688064593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c41029d0 0x7fa5c419b2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 >> 172.21.15.38:0/688064593 conn(0x7fa5c407a6f0 msgr2=0x7fa5c4106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:39.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 shutdown_connections 2024-09-21T06:19:39.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:39.945+0000 7fa5c93ad640 1 -- 172.21.15.38:0/688064593 wait complete. 2024-09-21T06:19:39.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 -- 172.21.15.38:0/1564042017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109d50 msgr2=0x7fafd8110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1564042017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109d50 0x7fafd8110580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009ca0 tx=0x7fafd002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 -- 172.21.15.38:0/1564042017 shutdown_connections 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1564042017 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109d50 0x7fafd8110580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1564042017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8109400 0x7fafd8109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1564042017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8103ad0 0x7fafd8103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 -- 172.21.15.38:0/1564042017 >> 172.21.15.38:0/1564042017 conn(0x7fafd80ff510 msgr2=0x7fafd8101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 -- 172.21.15.38:0/1564042017 shutdown_connections 2024-09-21T06:19:40.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.075+0000 7fafde7ba640 1 -- 172.21.15.38:0/1564042017 wait complete. 2024-09-21T06:19:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 Processor -- start 2024-09-21T06:19:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 -- start start 2024-09-21T06:19:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8103ad0 0x7fafd819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 0x7fafd819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8113b50 con 0x7fafd8109400 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81139d0 con 0x7fafd8109d50 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafde7ba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8113cd0 con 0x7fafd8103ad0 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.076+0000 7fafd77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37990/0 (socket says 172.21.15.38:37990) 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 -- 172.21.15.38:0/1820582533 learned_addr learned my addr 172.21.15.38:0/1820582533 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafdcd57640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 0x7fafd819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd7fff640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8103ad0 0x7fafd819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 -- 172.21.15.38:0/1820582533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8103ad0 msgr2=0x7fafd819a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8103ad0 0x7fafd819a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 -- 172.21.15.38:0/1820582533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 msgr2=0x7fafd819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 0x7fafd819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 -- 172.21.15.38:0/1820582533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd81a04a0 con 0x7fafd8109400 2024-09-21T06:19:40.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafdcd57640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 0x7fafd819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.077+0000 7fafd77fe640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9c0 tx=0x7fafc000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.078+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc000ccc0 con 0x7fafd8109400 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.078+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd81a0790 con 0x7fafd8109400 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.078+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81a6f20 con 0x7fafd8109400 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.079+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafc00054f0 con 0x7fafd8109400 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.079+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0010430 con 0x7fafd8109400 2024-09-21T06:19:40.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.080+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb80052c0 con 0x7fafd8109400 2024-09-21T06:19:40.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.081+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fafc0010710 con 0x7fafd8109400 2024-09-21T06:19:40.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.082+0000 7fafd57fa640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 0x7fafc40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.082+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fafc00e7660 con 0x7fafd8109400 2024-09-21T06:19:40.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.082+0000 7fafd7fff640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 0x7fafc40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.083+0000 7fafd7fff640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 0x7fafc40b8b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafc800bbe0 tx=0x7fafc800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.087+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafc00adcf0 con 0x7fafd8109400 2024-09-21T06:19:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1336390221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 msgr2=0x7f8c84103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1336390221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c84103fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009900 tx=0x7f8c7802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1336390221 shutdown_connections 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1336390221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c84109e20 0x7f8c84110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1336390221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c841094d0 0x7f8c841098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1336390221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c84103fa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1336390221 >> 172.21.15.38:0/1336390221 conn(0x7f8c840ff600 msgr2=0x7f8c84101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1336390221 shutdown_connections 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.190+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1336390221 wait complete. 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 Processor -- start 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 -- start start 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c841094d0 0x7f8c8419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c84109e20 0x7f8c8419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84113c20 con 0x7f8c84103b90 2024-09-21T06:19:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84113aa0 con 0x7f8c84109e20 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c8ae58640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84113da0 con 0x7f8c841094d0 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38006/0 (socket says 172.21.15.38:38006) 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c88bf4640 1 -- 172.21.15.38:0/1490627402 learned_addr learned my addr 172.21.15.38:0/1490627402 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c893f5640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c84109e20 0x7f8c8419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.191+0000 7f8c83fff640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c841094d0 0x7f8c8419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 -- 172.21.15.38:0/1490627402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c841094d0 msgr2=0x7f8c8419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c841094d0 0x7f8c8419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 -- 172.21.15.38:0/1490627402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c84109e20 msgr2=0x7f8c8419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c84109e20 0x7f8c8419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 -- 172.21.15.38:0/1490627402 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c841a04c0 con 0x7f8c84103b90 2024-09-21T06:19:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c78005ab0 tx=0x7f8c780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c81ffb640 1 -- 172.21.15.38:0/1490627402 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7803f030 con 0x7f8c84103b90 2024-09-21T06:19:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c81ffb640 1 -- 172.21.15.38:0/1490627402 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c78003ac0 con 0x7f8c84103b90 2024-09-21T06:19:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c841a0750 con 0x7f8c84103b90 2024-09-21T06:19:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c81ffb640 1 -- 172.21.15.38:0/1490627402 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78035070 con 0x7f8c84103b90 2024-09-21T06:19:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.192+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c840755f0 con 0x7f8c84103b90 2024-09-21T06:19:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.195+0000 7f8c81ffb640 1 -- 172.21.15.38:0/1490627402 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f8c78042030 con 0x7f8c84103b90 2024-09-21T06:19:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.195+0000 7f8c913cc740 1 Processor -- start 2024-09-21T06:19:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.195+0000 7f8c913cc740 1 -- start start 2024-09-21T06:19:40.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 0x5642d8e25430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a55490 0x5642d8e25970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d9be60 con 0x5642d8a7e350 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d8b290 con 0x5642d8a5d670 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c913cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d8f0a0 con 0x5642d8a55490 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c893f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 0x5642d8e25430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c893f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 0x5642d8e25430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38008/0 (socket says 172.21.15.38:38008) 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c893f5640 1 -- 172.21.15.38:0/2259421144 learned_addr learned my addr 172.21.15.38:0/2259421144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a55490 0x5642d8e25970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c81ffb640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 0x7f8c740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 -- 172.21.15.38:0/2259421144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a55490 msgr2=0x5642d8e25970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a55490 0x5642d8e25970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 -- 172.21.15.38:0/2259421144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 msgr2=0x5642d8e25430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 0x5642d8e25430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c83fff640 1 -- 172.21.15.38:0/2259421144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d8ae9930 con 0x5642d8a5d670 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.196+0000 7f8c893f5640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 0x7f8c740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c81ffb640 1 -- 172.21.15.38:0/1490627402 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8c78107cc0 con 0x7f8c84103b90 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c83fff640 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e25eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406bab0 tx=0x7f8c70011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb36d4852ca0e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c6effd640 1 -- 172.21.15.38:0/2259421144 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70004050 con 0x5642d8a5d670 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c893f5640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 0x7f8c740b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c003b10 tx=0x7f8c7c004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c6effd640 1 -- 172.21.15.38:0/2259421144 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c700054f0 con 0x5642d8a5d670 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.197+0000 7f8c6effd640 1 -- 172.21.15.38:0/2259421144 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70004d00 con 0x5642d8a5d670 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- 172.21.15.38:0/2259421144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 msgr2=0x5642d8e25eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e25eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406bab0 tx=0x7f8c70011810 comp rx=0 tx=0).stop 2024-09-21T06:19:40.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- 172.21.15.38:0/2259421144 shutdown_connections 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e25eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a55490 0x5642d8e25970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 --2- 172.21.15.38:0/2259421144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a7e350 0x5642d8e25430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- 172.21.15.38:0/2259421144 >> 172.21.15.38:0/2259421144 conn(0x5642d8a72740 msgr2=0x5642d8e23320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- 172.21.15.38:0/2259421144 shutdown_connections 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- 172.21.15.38:0/2259421144 wait complete. 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.198+0000 7f8c913cc740 1 -- start start 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 Processor -- start 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a7e350 0x5642d8e3cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5642d8bec890 con 0x5642d8a55490 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5642d8d25d40 con 0x5642d8a5d670 2024-09-21T06:19:40.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5642d8e33c10 con 0x5642d8a7e350 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c913cc740 10 client.0 _ll_register_callbacks cb 0x5642d8d89c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38014/0 (socket says 172.21.15.38:38014) 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c88bf4640 1 -- 172.21.15.38:0/4145367889 learned_addr learned my addr 172.21.15.38:0/4145367889 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c83fff640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.199+0000 7f8c893f5640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a7e350 0x5642d8e3cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 -- 172.21.15.38:0/4145367889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a7e350 msgr2=0x5642d8e3cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a7e350 0x5642d8e3cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 -- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 msgr2=0x5642d8e31600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e31600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 -- 172.21.15.38:0/4145367889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d8e3d540 con 0x5642d8a55490 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c83fff640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e31600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8c780cdc90 tx=0x7f8c78105a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b19793cde8f5fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c63fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78049070 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8c780c9f70 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c700054f0 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8c780cd650 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c913cc740 10 client.15504 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.200+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5642d8e3fe70 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c700054f0 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8c78105be0 con 0x5642d8a55490 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 10 client.15504 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 20 client.15504 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a3ccd0 0x5642d8e43480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 4 client.15504 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642d8d9ddb0 con 0x5642d8a3ccd0 2024-09-21T06:19:40.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.201+0000 7f8c83fff640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a3ccd0 0x5642d8e43480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.202+0000 7f8c83fff640 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a3ccd0 0x5642d8e43480 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca200bf2d39a8a9 server_cookie=905e250d682efe08 in_seq=0 out_seq=0 2024-09-21T06:19:40.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.202+0000 7f8c63fff640 10 client.15504 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:40.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.202+0000 7f8c63fff640 1 -- 172.21.15.38:0/4145367889 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642d8d9ddb0 con 0x5642d8a3ccd0 2024-09-21T06:19:40.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.202+0000 7f8c63fff640 10 client.15504 handle_command_reply: tid=0 2024-09-21T06:19:40.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.202+0000 7f8c913cc740 1 client.15504 shutdown 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 msgr2=0x5642d8e31060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8c780cdc90 tx=0x7f8c78105a50 comp rx=0 tx=0).stop 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 shutdown_connections 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a3ccd0 0x5642d8e43480 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c63fff640 0 client.15504 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a7e350 0x5642d8e3cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a5d670 0x5642d8e31600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 --2- 172.21.15.38:0/4145367889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a55490 0x5642d8e31060 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 >> 172.21.15.38:0/4145367889 conn(0x5642d8a72740 msgr2=0x5642d8e28610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 shutdown_connections 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 1 -- 172.21.15.38:0/4145367889 wait complete. 2024-09-21T06:19:40.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.203+0000 7f8c913cc740 20 client.15504 trim_cache size 0 max 16384 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 Processor -- start 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 -- start start 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a3ccd0 0x5642d8e2a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e2aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b4040 con 0x5642d8a5d670 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b1910 con 0x5642d8a55490 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c913cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841af760 con 0x5642d8a3ccd0 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c893f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c893f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38018/0 (socket says 172.21.15.38:38018) 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c893f5640 1 -- 172.21.15.38:0/157048047 learned_addr learned my addr 172.21.15.38:0/157048047 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a3ccd0 0x5642d8e2a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.221+0000 7f8c83fff640 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e2aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 -- 172.21.15.38:0/157048047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a3ccd0 msgr2=0x5642d8e2a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a3ccd0 0x5642d8e2a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 -- 172.21.15.38:0/157048047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 msgr2=0x5642d8e2aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e2aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 -- 172.21.15.38:0/157048047 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d8e2c6f0 con 0x5642d8a5d670 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c893f5640 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0042c0 tx=0x7f8c7c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e34323270c7c153 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c6e7fc640 1 -- 172.21.15.38:0/157048047 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c01a070 con 0x5642d8a5d670 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c6e7fc640 1 -- 172.21.15.38:0/157048047 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c7c021d80 con 0x5642d8a5d670 2024-09-21T06:19:40.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.222+0000 7f8c6e7fc640 1 -- 172.21.15.38:0/157048047 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c01ed90 con 0x5642d8a5d670 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- 172.21.15.38:0/157048047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 msgr2=0x5642d8e22860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0042c0 tx=0x7f8c7c009cd0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- 172.21.15.38:0/157048047 shutdown_connections 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a5d670 0x5642d8e22860 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e2aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 --2- 172.21.15.38:0/157048047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a3ccd0 0x5642d8e2a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- 172.21.15.38:0/157048047 >> 172.21.15.38:0/157048047 conn(0x5642d8a72740 msgr2=0x5642d8e2f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- 172.21.15.38:0/157048047 shutdown_connections 2024-09-21T06:19:40.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- 172.21.15.38:0/157048047 wait complete. 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 -- start start 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.223+0000 7f8c913cc740 1 Processor -- start 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e35c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 0x5642d8eace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841afdd0 con 0x5642d8a3ccd0 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b1240 con 0x5642d8a55490 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b04a0 con 0x5642d8a5d670 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c913cc740 10 client.0 _ll_register_callbacks cb 0x7f8c780c9c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 0x5642d8eace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c88bf4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38020/0 (socket says 172.21.15.38:38020) 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c88bf4640 1 -- 172.21.15.38:0/3430567559 learned_addr learned my addr 172.21.15.38:0/3430567559 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c83fff640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e35c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 -- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 msgr2=0x5642d8e35c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e35c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 -- 172.21.15.38:0/3430567559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 msgr2=0x5642d8e356b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c893f5640 1 -- 172.21.15.38:0/3430567559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d8ead4b0 con 0x5642d8a5d670 2024-09-21T06:19:40.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c83fff640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e35c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.224+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c893f5640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 0x5642d8eace40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c014040 tx=0x7f8c7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb63646fa72377d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c63fff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c021be0 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8c7c01ece0 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c021d80 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8c7c003fd0 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c913cc740 10 client.25165 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5642d8eae770 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.225+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c7c021d80 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8c7c032070 con 0x5642d8a5d670 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 10 client.25165 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 10 client.25165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:40.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 20 client.25165 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a7e350 0x5642d8eb0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 4 client.25165 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5642d8d99860 con 0x5642d8a7e350 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a7e350 0x5642d8eb0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c63fff640 10 client.25165 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:40.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.226+0000 7f8c88bf4640 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a7e350 0x5642d8eb0eb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86854ee219e8c8db server_cookie=acf19cbda10f05dd in_seq=0 out_seq=0 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c63fff640 1 -- 172.21.15.38:0/3430567559 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5642d8d99860 con 0x5642d8a7e350 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c63fff640 10 client.25165 handle_command_reply: tid=0 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 client.25165 shutdown 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 msgr2=0x5642d8eace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 0x5642d8eace40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c014040 tx=0x7f8c7c004a40 comp rx=0 tx=0).stop 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 shutdown_connections 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5642d8a7e350 0x5642d8eb0eb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5642d8a5d670 0x5642d8eace40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642d8a55490 0x5642d8e35c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 --2- 172.21.15.38:0/3430567559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5642d8a3ccd0 0x5642d8e356b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 >> 172.21.15.38:0/3430567559 conn(0x5642d8a72740 msgr2=0x5642d8e2a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.228+0000 7f8c63fff640 0 client.25165 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 shutdown_connections 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c913cc740 1 -- 172.21.15.38:0/3430567559 wait complete. 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c913cc740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "944b1ed9-2cab-4266-b8ac-235a1b44fbfb", 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:19:40.235 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:40.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 msgr2=0x7f8c740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 0x7f8c740b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c003b10 tx=0x7f8c7c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 msgr2=0x7f8c8419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c78005ab0 tx=0x7f8c780040c0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 shutdown_connections 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8c740b65f0 0x7f8c740b8b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c84109e20 0x7f8c8419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c841094d0 0x7f8c8419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 --2- 172.21.15.38:0/1490627402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c84103b90 0x7f8c8419a550 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 >> 172.21.15.38:0/1490627402 conn(0x7f8c840ff600 msgr2=0x7f8c84108b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.229+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 shutdown_connections 2024-09-21T06:19:40.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.230+0000 7f8c8ae58640 1 -- 172.21.15.38:0/1490627402 wait complete. 2024-09-21T06:19:40.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.333+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fafb8000c90 con 0x7fafc40b6670 2024-09-21T06:19:40.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.400+0000 7fafd57fa640 1 -- 172.21.15.38:0/1820582533 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fafb8000c90 con 0x7fafc40b6670 2024-09-21T06:19:40.401 INFO:teuthology.orchestra.run.smithi038.stdout:Retention added to path / 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 msgr2=0x7fafc40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 0x7fafc40b8b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafc800bbe0 tx=0x7fafc800b390 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 msgr2=0x7fafd819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9c0 tx=0x7fafc000ee80 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 shutdown_connections 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fafc40b6670 0x7fafc40b8b80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd8109d50 0x7fafd819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fafd8109400 0x7fafd819ab10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 --2- 172.21.15.38:0/1820582533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fafd8103ad0 0x7fafd819a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 >> 172.21.15.38:0/1820582533 conn(0x7fafd80ff510 msgr2=0x7fafd8108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 shutdown_connections 2024-09-21T06:19:40.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.402+0000 7fafde7ba640 1 -- 172.21.15.38:0/1820582533 wait complete. 2024-09-21T06:19:40.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- 172.21.15.38:0/3635212091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b70105280 msgr2=0x7f2b7010d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 --2- 172.21.15.38:0/3635212091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b70105280 0x7f2b7010d7c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009900 tx=0x7f2b5c02a410 comp rx=0 tx=0).stop 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- 172.21.15.38:0/3635212091 shutdown_connections 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 --2- 172.21.15.38:0/3635212091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b7010dd90 0x7f2b70110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 --2- 172.21.15.38:0/3635212091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b70105280 0x7f2b7010d7c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 --2- 172.21.15.38:0/3635212091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 0x7f2b70104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- 172.21.15.38:0/3635212091 >> 172.21.15.38:0/3635212091 conn(0x7f2b700fe3c0 msgr2=0x7f2b70100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- 172.21.15.38:0/3635212091 shutdown_connections 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- 172.21.15.38:0/3635212091 wait complete. 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 Processor -- start 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.533+0000 7f2b76b69640 1 -- start start 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 0x7f2b7019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70105280 0x7f2b7019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113b10 con 0x7f2b7010dd90 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113990 con 0x7f2b70105280 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b76b69640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70113c90 con 0x7f2b70104930 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38044/0 (socket says 172.21.15.38:38044) 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 -- 172.21.15.38:0/2100449883 learned_addr learned my addr 172.21.15.38:0/2100449883 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b74905640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 0x7f2b7019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b6ffff640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70105280 0x7f2b7019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 -- 172.21.15.38:0/2100449883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 msgr2=0x7f2b7019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 0x7f2b7019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 -- 172.21.15.38:0/2100449883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70105280 msgr2=0x7f2b7019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70105280 0x7f2b7019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 -- 172.21.15.38:0/2100449883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b701a0460 con 0x7f2b7010dd90 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b75106640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800cad0 tx=0x7f2b6800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.534+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800ae20 con 0x7f2b7010dd90 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.535+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b68005020 con 0x7f2b7010dd90 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.535+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800f6b0 con 0x7f2b7010dd90 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.535+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b701a0750 con 0x7f2b7010dd90 2024-09-21T06:19:40.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.535+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701a6ee0 con 0x7f2b7010dd90 2024-09-21T06:19:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.536+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b7006c080 con 0x7f2b7010dd90 2024-09-21T06:19:40.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.537+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f2b680051d0 con 0x7f2b7010dd90 2024-09-21T06:19:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.538+0000 7f2b6dffb640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 0x7f2b600b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.539+0000 7f2b74905640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 0x7f2b600b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.539+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2b680e7540 con 0x7f2b7010dd90 2024-09-21T06:19:40.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.539+0000 7f2b74905640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 0x7f2b600b8b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005fd0 tx=0x7f2b6400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.543+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b68014030 con 0x7f2b7010dd90 2024-09-21T06:19:40.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:40 smithi038 ceph-mon[31215]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:19:40.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:40 smithi038 ceph-mon[31215]: from='client.25187 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:40.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:40 smithi038 ceph-mon[31215]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:40.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.753+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2b70107fb0 con 0x7f2b600b6670 2024-09-21T06:19:40.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.761+0000 7f2b6dffb640 1 -- 172.21.15.38:0/2100449883 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f2b70107fb0 con 0x7f2b600b6670 2024-09-21T06:19:40.762 INFO:teuthology.orchestra.run.smithi038.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:19:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 msgr2=0x7f2b600b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 0x7f2b600b8b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2b64005fd0 tx=0x7f2b6400b390 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 msgr2=0x7f2b7019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800cad0 tx=0x7f2b6800cf90 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 shutdown_connections 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2b600b6670 0x7f2b600b8b80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b7010dd90 0x7f2b7019fd60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70105280 0x7f2b7019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 --2- 172.21.15.38:0/2100449883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b70104930 0x7f2b7019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 >> 172.21.15.38:0/2100449883 conn(0x7f2b700fe3c0 msgr2=0x7f2b701078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 shutdown_connections 2024-09-21T06:19:40.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.763+0000 7f2b76b69640 1 -- 172.21.15.38:0/2100449883 wait complete. 2024-09-21T06:19:40.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 -- 172.21.15.38:0/1302523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b81029e0 msgr2=0x7fc3b8102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 --2- 172.21.15.38:0/1302523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b81029e0 0x7fc3b8102df0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009900 tx=0x7fc3a802a410 comp rx=0 tx=0).stop 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 -- 172.21.15.38:0/1302523620 shutdown_connections 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 --2- 172.21.15.38:0/1302523620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108c60 0x7fc3b810f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 --2- 172.21.15.38:0/1302523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b8108310 0x7fc3b8108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 --2- 172.21.15.38:0/1302523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b81029e0 0x7fc3b8102df0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 -- 172.21.15.38:0/1302523620 >> 172.21.15.38:0/1302523620 conn(0x7fc3b80fe3e0 msgr2=0x7fc3b8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:40.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 -- 172.21.15.38:0/1302523620 shutdown_connections 2024-09-21T06:19:40.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.889+0000 7fc3be389640 1 -- 172.21.15.38:0/1302523620 wait complete. 2024-09-21T06:19:40.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 Processor -- start 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 -- start start 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b81029e0 0x7fc3b819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108310 0x7fc3b819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8112a40 con 0x7fc3b8108c60 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81128c0 con 0x7fc3b81029e0 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3be389640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8112bc0 con 0x7fc3b8108310 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3bc926640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3bc926640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38054/0 (socket says 172.21.15.38:38054) 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.890+0000 7fc3bc926640 1 -- 172.21.15.38:0/4248295000 learned_addr learned my addr 172.21.15.38:0/4248295000 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3b77fe640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108310 0x7fc3b819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3b7fff640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b81029e0 0x7fc3b819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 -- 172.21.15.38:0/4248295000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108310 msgr2=0x7fc3b819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108310 0x7fc3b819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 -- 172.21.15.38:0/4248295000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b81029e0 msgr2=0x7fc3b819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b81029e0 0x7fc3b819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 -- 172.21.15.38:0/4248295000 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81a03f0 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3bc926640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000eaa0 tx=0x7fc3b000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0004d20 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3b0005020 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81a06e0 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00116d0 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.891+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a6f00 con 0x7fc3b8108c60 2024-09-21T06:19:40.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.892+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8102df0 con 0x7fc3b8108c60 2024-09-21T06:19:40.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:40 smithi174 ceph-mon[34815]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:19:40.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:40 smithi174 ceph-mon[34815]: from='client.25187 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:40.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:40 smithi174 ceph-mon[34815]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:40.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.894+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fc3b00051d0 con 0x7fc3b8108c60 2024-09-21T06:19:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.895+0000 7fc3b57fa640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 0x7fc3a00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.895+0000 7fc3b7fff640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 0x7fc3a00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.895+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc3b00e7c60 con 0x7fc3b8108c60 2024-09-21T06:19:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.895+0000 7fc3b7fff640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 0x7fc3a00b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80096c0 tx=0x7fc3a8009630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:40.898+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3b0016030 con 0x7fc3b8108c60 2024-09-21T06:19:40.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:40 smithi044 ceph-mon[34369]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:19:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:40 smithi044 ceph-mon[34369]: from='client.25187 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:40.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:40 smithi044 ceph-mon[34369]: from='client.15492 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:19:41.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.110+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc3b8100a00 con 0x7fc3a00b65f0 2024-09-21T06:19:41.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.118+0000 7fc3b57fa640 1 -- 172.21.15.38:0/4248295000 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc3b8100a00 con 0x7fc3a00b65f0 2024-09-21T06:19:41.119 INFO:teuthology.orchestra.run.smithi038.stdout:/ 1m 6m3h 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 msgr2=0x7fc3a00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 0x7fc3a00b8b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80096c0 tx=0x7fc3a8009630 comp rx=0 tx=0).stop 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 msgr2=0x7fc3b819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000eaa0 tx=0x7fc3b000eea0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 shutdown_connections 2024-09-21T06:19:41.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc3a00b65f0 0x7fc3a00b8b00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3b8108c60 0x7fc3b819fd80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3b8108310 0x7fc3b819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 --2- 172.21.15.38:0/4248295000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3b81029e0 0x7fc3b819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 >> 172.21.15.38:0/4248295000 conn(0x7fc3b80fe3e0 msgr2=0x7fc3b8107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 shutdown_connections 2024-09-21T06:19:41.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.120+0000 7fc3be389640 1 -- 172.21.15.38:0/4248295000 wait complete. 2024-09-21T06:19:41.133 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T06:19:41.160 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T06:19:41.169 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T06:19:41.177 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:19:41.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T06:19:41.202 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T06:19:41.215 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:19:41.215 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T06:19:41.215 INFO:tasks.workunit:timeout=3h 2024-09-21T06:19:41.216 INFO:tasks.workunit:cleanup=True 2024-09-21T06:19:41.216 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-21 06:18:05.778567398 +0000 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-21 06:18:05.778567398 +0000 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-21 06:19:30.011651748 +0000 2024-09-21T06:19:41.232 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-21 06:18:05.778567398 +0000 2024-09-21T06:19:41.233 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T06:19:41.233 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T06:19:41.308 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:19:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:19:41.335 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.601 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:41 smithi038 ceph-mon[31215]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 -- 172.21.15.38:0/3926053048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed3810e5c0 msgr2=0x7fed3810e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 --2- 172.21.15.38:0/3926053048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed3810e5c0 0x7fed3810e9d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fed28009900 tx=0x7fed2802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 -- 172.21.15.38:0/3926053048 shutdown_connections 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 --2- 172.21.15.38:0/3926053048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 0x7fed3811b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 --2- 172.21.15.38:0/3926053048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed38113eb0 0x7fed381142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 --2- 172.21.15.38:0/3926053048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed3810e5c0 0x7fed3810e9d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 -- 172.21.15.38:0/3926053048 >> 172.21.15.38:0/3926053048 conn(0x7fed3810a3c0 msgr2=0x7fed3810c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 -- 172.21.15.38:0/3926053048 shutdown_connections 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.835+0000 7fed3ea62640 1 -- 172.21.15.38:0/3926053048 wait complete. 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.836+0000 7fed3ea62640 1 Processor -- start 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.836+0000 7fed3ea62640 1 -- start start 2024-09-21T06:19:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed3810e5c0 0x7fed381a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 0x7fed381aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fed3811e5e0 con 0x7fed38113eb0 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed3811e460 con 0x7fed3810e5c0 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3ea62640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed3811e760 con 0x7fed38114800 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38082/0 (socket says 172.21.15.38:38082) 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 -- 172.21.15.38:0/2146613911 learned_addr learned my addr 172.21.15.38:0/2146613911 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 0x7fed381aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed37fff640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed3810e5c0 0x7fed381a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 -- 172.21.15.38:0/2146613911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 msgr2=0x7fed381aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 0x7fed381aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 -- 172.21.15.38:0/2146613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed3810e5c0 msgr2=0x7fed381a4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed3810e5c0 0x7fed381a4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 -- 172.21.15.38:0/2146613911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed381aae60 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.837+0000 7fed377fe640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00d740 tx=0x7fed2c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.838+0000 7fed357fa640 1 -- 172.21.15.38:0/2146613911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c017070 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.838+0000 7fed357fa640 1 -- 172.21.15.38:0/2146613911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed2c00de50 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.838+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed381ab150 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.838+0000 7fed357fa640 1 -- 172.21.15.38:0/2146613911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00f620 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.838+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed381b1970 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.840+0000 7fed44fd6740 1 Processor -- start 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.840+0000 7fed357fa640 1 -- 172.21.15.38:0/2146613911 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fed2c01a070 con 0x7fed38113eb0 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 -- start start 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e7d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e7dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5645d3df3e50 con 0x5645d3ad6070 2024-09-21T06:19:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5645d3de3280 con 0x5645d3aad1b0 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed44fd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5645d3de7090 con 0x5645d3ab5390 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38096/0 (socket says 172.21.15.38:38096) 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 -- 172.21.15.38:0/2368446376 learned_addr learned my addr 172.21.15.38:0/2368446376 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed37fff640 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e7d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 -- 172.21.15.38:0/2368446376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 msgr2=0x5645d3e7dcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed357fa640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e7dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 -- 172.21.15.38:0/2368446376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 msgr2=0x5645d3e7d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.841+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e7d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed3cfff640 1 -- 172.21.15.38:0/2368446376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d3b41650 con 0x5645d3ad6070 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed357fa640 1 -- 172.21.15.38:0/2146613911 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fed2c0e6f60 con 0x7fed38113eb0 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fed30007f40 tx=0x7fed3000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6752dab0c3dd3abf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed1e7fc640 1 -- 172.21.15.38:0/2368446376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30010b20 con 0x5645d3ad6070 2024-09-21T06:19:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed1e7fc640 1 -- 172.21.15.38:0/2368446376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed3001adf0 con 0x5645d3ad6070 2024-09-21T06:19:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.842+0000 7fed1e7fc640 1 -- 172.21.15.38:0/2368446376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30019c80 con 0x5645d3ad6070 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 -- 172.21.15.38:0/2368446376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 msgr2=0x5645d3e7d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fed30007f40 tx=0x7fed3000f850 comp rx=0 tx=0).stop 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 0x7fed200b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed3001e000 tx=0x7fed3001f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 -- 172.21.15.38:0/2368446376 shutdown_connections 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e7dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e7d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2368446376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e7d270 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 -- 172.21.15.38:0/2368446376 >> 172.21.15.38:0/2368446376 conn(0x5645d3aca460 msgr2=0x5645d3e7b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 -- 172.21.15.38:0/2368446376 shutdown_connections 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.843+0000 7fed44fd6740 1 -- 172.21.15.38:0/2368446376 wait complete. 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 -- start start 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 Processor -- start 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e88a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 0x5645d3e94d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5645d3c44700 con 0x5645d3ab5390 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5645d3d7e110 con 0x5645d3aad1b0 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5645d3e8ba50 con 0x5645d3ad6070 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed44fd6740 10 client.0 _ll_register_callbacks cb 0x5645d3d97990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38108/0 (socket says 172.21.15.38:38108) 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.844+0000 7fed377fe640 1 -- 172.21.15.38:0/3709735629 learned_addr learned my addr 172.21.15.38:0/3709735629 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed37fff640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e88a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed3cfff640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 0x5645d3e94d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 -- 172.21.15.38:0/3709735629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 msgr2=0x5645d3e94d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 0x5645d3e94d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 -- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 msgr2=0x5645d3e88a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e88a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 -- 172.21.15.38:0/3709735629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d3dabc40 con 0x5645d3ab5390 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed3cfff640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 0x5645d3e94d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed377fe640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0a94c0 tx=0x7fed2c0ac660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c772cbe565a2212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed177fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c021030 con 0x5645d3ab5390 2024-09-21T06:19:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fed2c094310 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed3001adf0 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed2c0b19d0 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed44fd6740 10 client.15534 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.845+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5645d3e977c0 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed3001adf0 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed2c0b2b60 con 0x5645d3ab5390 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 10 client.15534 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 20 client.15534 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a949f0 0x5645d3e9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 4 client.15534 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645d3df5da0 con 0x5645d3a949f0 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.846+0000 7fed37fff640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a949f0 0x5645d3e9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.847+0000 7fed37fff640 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a949f0 0x5645d3e9abe0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a419b09c967c5b server_cookie=f1fc28f1fbdbb80 in_seq=0 out_seq=0 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.847+0000 7fed177fe640 10 client.15534 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.847+0000 7fed177fe640 1 -- 172.21.15.38:0/3709735629 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645d3df5da0 con 0x5645d3a949f0 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed177fe640 10 client.15534 handle_command_reply: tid=0 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 client.15534 shutdown 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 msgr2=0x5645d3e88fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0a94c0 tx=0x7fed2c0ac660 comp rx=0 tx=0).stop 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 shutdown_connections 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a949f0 0x5645d3e9abe0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ad6070 0x5645d3e94d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ab5390 0x5645d3e88fb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed177fe640 0 client.15534 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 --2- 172.21.15.38:0/3709735629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e88a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 >> 172.21.15.38:0/3709735629 conn(0x5645d3aca460 msgr2=0x5645d3e80450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 shutdown_connections 2024-09-21T06:19:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 1 -- 172.21.15.38:0/3709735629 wait complete. 2024-09-21T06:19:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.848+0000 7fed44fd6740 20 client.15534 trim_cache size 0 max 16384 2024-09-21T06:19:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.865+0000 7fed44fd6740 1 Processor -- start 2024-09-21T06:19:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.865+0000 7fed44fd6740 1 -- start start 2024-09-21T06:19:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e94c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fed381bc900 con 0x5645d3ad6070 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed381ba1d0 con 0x5645d3aad1b0 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed44fd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b8020 con 0x5645d3ab5390 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed37fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38122/0 (socket says 172.21.15.38:38122) 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 -- 172.21.15.38:0/2023194351 learned_addr learned my addr 172.21.15.38:0/2023194351 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed377fe640 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e94c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 -- 172.21.15.38:0/2023194351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 msgr2=0x5645d3e94c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e94c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 -- 172.21.15.38:0/2023194351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 msgr2=0x5645d3e8a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed3cfff640 1 -- 172.21.15.38:0/2023194351 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d3e7f790 con 0x5645d3ad6070 2024-09-21T06:19:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.866+0000 7fed37fff640 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:19:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.867+0000 7fed3cfff640 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fed30024000 tx=0x7fed30025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c8f229780296fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.867+0000 7fed1dffb640 1 -- 172.21.15.38:0/2023194351 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3002c040 con 0x5645d3ad6070 2024-09-21T06:19:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.867+0000 7fed1dffb640 1 -- 172.21.15.38:0/2023194351 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed30035070 con 0x5645d3ad6070 2024-09-21T06:19:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.867+0000 7fed1dffb640 1 -- 172.21.15.38:0/2023194351 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30019600 con 0x5645d3ad6070 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- 172.21.15.38:0/2023194351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 msgr2=0x5645d3e85c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fed30024000 tx=0x7fed30025000 comp rx=0 tx=0).stop 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- 172.21.15.38:0/2023194351 shutdown_connections 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3e85c60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e94c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 --2- 172.21.15.38:0/2023194351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- 172.21.15.38:0/2023194351 >> 172.21.15.38:0/2023194351 conn(0x5645d3aca460 msgr2=0x5645d3e89f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- 172.21.15.38:0/2023194351 shutdown_connections 2024-09-21T06:19:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- 172.21.15.38:0/2023194351 wait complete. 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.868+0000 7fed44fd6740 1 -- start start 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 Processor -- start 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e8dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b8690 con 0x5645d3ad6070 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b9b00 con 0x5645d3aad1b0 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed381b8d60 con 0x5645d3ab5390 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed44fd6740 10 client.0 _ll_register_callbacks cb 0x7fed2c010c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed3cfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38124/0 (socket says 172.21.15.38:38124) 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed3cfff640 1 -- 172.21.15.38:0/346365265 learned_addr learned my addr 172.21.15.38:0/346365265 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed377fe640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e8dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.869+0000 7fed37fff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 -- 172.21.15.38:0/346365265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 msgr2=0x5645d3e8dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e8dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 -- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 msgr2=0x5645d3e8d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 -- 172.21.15.38:0/346365265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d3f07390 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed37fff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed3cfff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fed3000fd50 tx=0x7fed3001ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af079881fb3f5c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed177fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3003f030 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fed30020050 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed30035070 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed30049050 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed44fd6740 10 client.15540 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.870+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5645d3f0e770 con 0x5645d3ad6070 2024-09-21T06:19:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed30035070 con 0x5645d3ad6070 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed3002f070 con 0x5645d3ad6070 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 10 client.15540 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 20 client.15540 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a69da0 0x5645d3f10d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 4 client.15540 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5645d3df1850 con 0x5645d3a69da0 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.871+0000 7fed37fff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a69da0 0x5645d3f10d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed177fe640 10 client.15540 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed37fff640 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a69da0 0x5645d3f10d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ac25eacb2a44f4c server_cookie=58a65b60c0da6e92 in_seq=0 out_seq=0 2024-09-21T06:19:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed177fe640 1 -- 172.21.15.38:0/346365265 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5645d3df1850 con 0x5645d3a69da0 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed177fe640 10 client.15540 handle_command_reply: tid=0 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 client.15540 shutdown 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 msgr2=0x5645d3f06d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fed3000fd50 tx=0x7fed3001ae30 comp rx=0 tx=0).stop 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 shutdown_connections 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5645d3ad6070 0x5645d3f06d20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5645d3a69da0 0x5645d3f10d80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5645d3ab5390 0x5645d3e8dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed177fe640 0 client.15540 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 --2- 172.21.15.38:0/346365265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5645d3aad1b0 0x5645d3e8d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 >> 172.21.15.38:0/346365265 conn(0x5645d3aca460 msgr2=0x5645d3e80b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 shutdown_connections 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 1 -- 172.21.15.38:0/346365265 wait complete. 2024-09-21T06:19:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.872+0000 7fed44fd6740 20 client.15540 trim_cache size 0 max 16384 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "944b1ed9-2cab-4266-b8ac-235a1b44fbfb", 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:19:41.878 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:19:41.879 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 msgr2=0x7fed200b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 0x7fed200b8b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed3001e000 tx=0x7fed3001f000 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 msgr2=0x7fed381a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00d740 tx=0x7fed2c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 shutdown_connections 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fed200b6620 0x7fed200b8b30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed38114800 0x7fed381aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed38113eb0 0x7fed381a5550 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 --2- 172.21.15.38:0/2146613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed3810e5c0 0x7fed381a4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 >> 172.21.15.38:0/2146613911 conn(0x7fed3810a3c0 msgr2=0x7fed381134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 shutdown_connections 2024-09-21T06:19:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:19:41.873+0000 7fed3ea62640 1 -- 172.21.15.38:0/2146613911 wait complete. 2024-09-21T06:19:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:19:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:19:41.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:41 smithi174 ceph-mon[34815]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:41 smithi044 ceph-mon[34369]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:19:42.511 INFO:tasks.cephfs.filesystem:scrub status for tag:944b1ed9-2cab-4266-b8ac-235a1b44fbfb - {'path': '/', 'tag': '944b1ed9-2cab-4266-b8ac-235a1b44fbfb', 'options': 'recursive,force'} 2024-09-21T06:19:42.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:42 smithi038 ceph-mon[31215]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 102 KiB/s wr, 39 op/s 2024-09-21T06:19:42.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:42 smithi174 ceph-mon[34815]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 102 KiB/s wr, 39 op/s 2024-09-21T06:19:42.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:42 smithi044 ceph-mon[34369]: pgmap v320: 97 pgs: 97 active+clean; 1.0 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 102 KiB/s wr, 39 op/s 2024-09-21T06:19:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:43 smithi174 ceph-mon[34815]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T06:19:43.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:43 smithi044 ceph-mon[34369]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T06:19:43.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:43 smithi038 ceph-mon[31215]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T06:19:44.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:44 smithi174 ceph-mon[34815]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 175 KiB/s wr, 46 op/s 2024-09-21T06:19:44.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:44 smithi044 ceph-mon[34369]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 175 KiB/s wr, 46 op/s 2024-09-21T06:19:44.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:44 smithi038 ceph-mon[31215]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 175 KiB/s wr, 46 op/s 2024-09-21T06:19:47.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:46 smithi174 ceph-mon[34815]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:47.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:46 smithi044 ceph-mon[34369]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:46 smithi038 ceph-mon[31215]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:49.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:48 smithi174 ceph-mon[34815]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:19:49.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:48 smithi044 ceph-mon[34369]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:19:49.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:48 smithi038 ceph-mon[31215]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:19:51.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:50 smithi174 ceph-mon[34815]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:51.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:50 smithi044 ceph-mon[34369]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:51.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:50 smithi038 ceph-mon[31215]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:19:53.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:52 smithi174 ceph-mon[34815]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:19:53.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:52 smithi044 ceph-mon[34369]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:19:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:52 smithi038 ceph-mon[31215]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:19:53.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:53 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:53.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:53 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:19:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:53 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:53 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:19:54.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:53 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:19:54.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:53 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:19:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 -- 172.21.15.38:0/1253072238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 msgr2=0x7ff3bc10f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.351 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1253072238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc10f460 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009ca0 tx=0x7ff3b402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 -- 172.21.15.38:0/1253072238 shutdown_connections 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1253072238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc10f460 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1253072238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1082e0 0x7ff3bc1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1253072238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1029b0 0x7ff3bc102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.349+0000 7ff3c4357640 1 -- 172.21.15.38:0/1253072238 >> 172.21.15.38:0/1253072238 conn(0x7ff3bc07a740 msgr2=0x7ff3bc07ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.350+0000 7ff3c4357640 1 -- 172.21.15.38:0/1253072238 shutdown_connections 2024-09-21T06:19:54.352 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.350+0000 7ff3c4357640 1 -- 172.21.15.38:0/1253072238 wait complete. 2024-09-21T06:19:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.350+0000 7ff3c4357640 1 Processor -- start 2024-09-21T06:19:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.350+0000 7ff3c4357640 1 -- start start 2024-09-21T06:19:54.354 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1029b0 0x7ff3bc19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1082e0 0x7ff3bc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc112a30 con 0x7ff3bc108c30 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1128b0 con 0x7ff3bc1082e0 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c4357640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc112bb0 con 0x7ff3bc1029b0 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36610/0 (socket says 172.21.15.38:36610) 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 -- 172.21.15.38:0/1323774883 learned_addr learned my addr 172.21.15.38:0/1323774883 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1029b0 0x7ff3bc19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.355 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1082e0 0x7ff3bc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 -- 172.21.15.38:0/1323774883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1029b0 msgr2=0x7ff3bc19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1029b0 0x7ff3bc19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 -- 172.21.15.38:0/1323774883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1082e0 msgr2=0x7ff3bc19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1082e0 0x7ff3bc19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 -- 172.21.15.38:0/1323774883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc1a04f0 con 0x7ff3bc108c30 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.351+0000 7ff3c28f4640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4033040 tx=0x7ff3b4003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.352+0000 7ff3b37fe640 1 -- 172.21.15.38:0/1323774883 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4031650 con 0x7ff3bc108c30 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.352+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc1a0780 con 0x7ff3bc108c30 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.352+0000 7ff3b37fe640 1 -- 172.21.15.38:0/1323774883 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3b40317f0 con 0x7ff3bc108c30 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.352+0000 7ff3b37fe640 1 -- 172.21.15.38:0/1323774883 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b402fa80 con 0x7ff3bc108c30 2024-09-21T06:19:54.356 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.352+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc1a6f70 con 0x7ff3bc108c30 2024-09-21T06:19:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 Processor -- start 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3b37fe640 1 -- 172.21.15.38:0/1323774883 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) ==== 154637+0+0 (secure 0 0 0) 0x7ff3b402fc20 con 0x7ff3bc108c30 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 -- start start 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f69f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f662b4d0 0x5562f69f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5562f69666f0 con 0x5562f662b4d0 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562f6955b20 con 0x5562f664c1b0 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.355+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5562f6959930 con 0x5562f66232f0 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:46286/0 (socket says 172.21.15.38:46286) 2024-09-21T06:19:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c20f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f69f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 -- 172.21.15.38:0/2149208988 learned_addr learned my addr 172.21.15.38:0/2149208988 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f662b4d0 0x5562f69f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3b37fe640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 0x7ff3a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 -- 172.21.15.38:0/2149208988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 msgr2=0x5562f69f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f69f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 -- 172.21.15.38:0/2149208988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f662b4d0 msgr2=0x5562f69f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f662b4d0 0x5562f69f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 -- 172.21.15.38:0/2149208988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f691b530 con 0x5562f664c1b0 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c28f4640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 0x7ff3a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3b37fe640 1 -- 172.21.15.38:0/1323774883 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff3b41088a0 con 0x7ff3bc108c30 2024-09-21T06:19:54.360 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009710 tx=0x7ff3ac0096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd85f1f05389d735 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.361 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.356+0000 7ff3b0bfe640 1 -- 172.21.15.38:0/2149208988 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac004050 con 0x5562f664c1b0 2024-09-21T06:19:54.361 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.357+0000 7ff3b0bfe640 1 -- 172.21.15.38:0/2149208988 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3ac0054f0 con 0x5562f664c1b0 2024-09-21T06:19:54.361 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.357+0000 7ff3b0bfe640 1 -- 172.21.15.38:0/2149208988 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac004c60 con 0x5562f664c1b0 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/2149208988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 msgr2=0x5562f69f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3c28f4640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 0x7ff3a80b8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40ce6a0 tx=0x7ff3b409bb00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009710 tx=0x7ff3ac0096a0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/2149208988 shutdown_connections 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f662b4d0 0x5562f69f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f69f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/2149208988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f664c1b0 0x5562f69f19b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/2149208988 >> 172.21.15.38:0/2149208988 conn(0x5562f6640300 msgr2=0x5562f69ef8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/2149208988 shutdown_connections 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.358+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/2149208988 wait complete. 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 -- start start 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 Processor -- start 2024-09-21T06:19:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a01960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f664c1b0 0x5562f6a0d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5562f688dab0 con 0x5562f66232f0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562f68fb730 con 0x5562f662b4d0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5562f6a04510 con 0x5562f664c1b0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3cb2c3740 10 client.0 _ll_register_callbacks cb 0x5562f694f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36626/0 (socket says 172.21.15.38:36626) 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3c18f2640 1 -- 172.21.15.38:0/3649482301 learned_addr learned my addr 172.21.15.38:0/3649482301 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.359+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a01960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f664c1b0 0x5562f6a0d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.367 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 -- 172.21.15.38:0/3649482301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f664c1b0 msgr2=0x5562f6a0d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f664c1b0 0x5562f6a0d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 -- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 msgr2=0x5562f6a01960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a01960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 -- 172.21.15.38:0/3649482301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f66b7790 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009bf0 tx=0x7ff3ac0048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf764b2ce0e3746 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac0049e0 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff3ac004b80 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3ac0054f0 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff3ac004d80 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3cb2c3740 10 client.15552 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.360+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5562f6730620 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3ac0054f0 con 0x5562f66232f0 2024-09-21T06:19:54.368 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff3ac01f560 con 0x5562f66232f0 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 10 client.15552 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 20 client.15552 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f660ad80 0x5562f6a13440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 4 client.15552 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562f6968640 con 0x5562f660ad80 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f660ad80 0x5562f6a13440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f660ad80 0x5562f6a13440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee71c80326773c7 server_cookie=212af50111cafa9c in_seq=0 out_seq=0 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.361+0000 7ff3a5ffb640 10 client.15552 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/3649482301 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562f6968640 con 0x5562f660ad80 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3a5ffb640 10 client.15552 handle_command_reply: tid=0 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 client.15552 shutdown 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 msgr2=0x5562f6a01420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009bf0 tx=0x7ff3ac0048e0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 shutdown_connections 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f660ad80 0x5562f6a13440 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f664c1b0 0x5562f6a0d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a01960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/3649482301 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f66232f0 0x5562f6a01420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3a5ffb640 0 client.15552 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.362+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 >> 172.21.15.38:0/3649482301 conn(0x5562f6640300 msgr2=0x5562f69f33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.363+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 shutdown_connections 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.363+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/3649482301 wait complete. 2024-09-21T06:19:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.363+0000 7ff3cb2c3740 20 client.15552 trim_cache size 0 max 16384 2024-09-21T06:19:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.377+0000 7ff3cb2c3740 1 Processor -- start 2024-09-21T06:19:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 -- start start 2024-09-21T06:19:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f66232f0 0x5562f69fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f662b4d0 0x5562f69f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1afcc0 con 0x5562f664c1b0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1ad590 con 0x5562f66232f0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1ab3e0 con 0x5562f662b4d0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36628/0 (socket says 172.21.15.38:36628) 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 -- 172.21.15.38:0/1342950955 learned_addr learned my addr 172.21.15.38:0/1342950955 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f662b4d0 0x5562f69f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f66232f0 0x5562f69fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 -- 172.21.15.38:0/1342950955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f662b4d0 msgr2=0x5562f69f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f662b4d0 0x5562f69f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 -- 172.21.15.38:0/1342950955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f66232f0 msgr2=0x5562f69fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f66232f0 0x5562f69fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.378+0000 7ff3c18f2640 1 -- 172.21.15.38:0/1342950955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562f69ff900 con 0x5562f664c1b0 2024-09-21T06:19:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.379+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009a60 tx=0x7ff3ac005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82faa98a2166559 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.379+0000 7ff3a7fff640 1 -- 172.21.15.38:0/1342950955 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac035040 con 0x5562f664c1b0 2024-09-21T06:19:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.379+0000 7ff3a7fff640 1 -- 172.21.15.38:0/1342950955 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3ac004610 con 0x5562f664c1b0 2024-09-21T06:19:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.379+0000 7ff3a7fff640 1 -- 172.21.15.38:0/1342950955 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00f790 con 0x5562f664c1b0 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1342950955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 msgr2=0x5562f69eeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009a60 tx=0x7ff3ac005330 comp rx=0 tx=0).stop 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1342950955 shutdown_connections 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f69eeeb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f662b4d0 0x5562f69f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1342950955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f66232f0 0x5562f69fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1342950955 >> 172.21.15.38:0/1342950955 conn(0x5562f6640300 msgr2=0x5562f69f29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1342950955 shutdown_connections 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1342950955 wait complete. 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 -- start start 2024-09-21T06:19:54.385 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.380+0000 7ff3cb2c3740 1 Processor -- start 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f6a09f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f6a05900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1aba50 con 0x5562f664c1b0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1acec0 con 0x5562f662b4d0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1ac120 con 0x5562f66232f0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3cb2c3740 10 client.0 _ll_register_callbacks cb 0x7ff3ac009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c18f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f6a05900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:46318/0 (socket says 172.21.15.38:46318) 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 -- 172.21.15.38:0/1723154765 learned_addr learned my addr 172.21.15.38:0/1723154765 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f6a09f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 -- 172.21.15.38:0/1723154765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 msgr2=0x5562f6a09f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f6a09f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 -- 172.21.15.38:0/1723154765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 msgr2=0x5562f6a05900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f6a05900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.381+0000 7ff3c20f3640 1 -- 172.21.15.38:0/1723154765 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562f6a05ff0 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3c20f3640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004700 tx=0x7ff3b8010b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289d05a29746756e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8028030 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff3b8004240 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3ac004610 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff3b8032050 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 10 client.25259 fetch_fsmap learned FSMap version 24 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5562f6a7da90 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3ac004610 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff3b80038c0 con 0x5562f662b4d0 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 10 client.25259 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:19:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 20 client.25259 populate_metadata read hostname 'smithi038' 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.382+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f65e01c0 0x5562f6a80280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.383+0000 7ff3cb2c3740 4 client.25259 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.383+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562f69640f0 con 0x5562f65e01c0 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.383+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f65e01c0 0x5562f6a80280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.383+0000 7ff3a5ffb640 10 client.25259 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.383+0000 7ff3c18f2640 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f65e01c0 0x5562f6a80280 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a26be7602ab253d server_cookie=f784d6a0863dfbec in_seq=0 out_seq=0 2024-09-21T06:19:54.395 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.393+0000 7ff3a5ffb640 1 -- 172.21.15.38:0/1723154765 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562f69640f0 con 0x5562f65e01c0 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.393+0000 7ff3a5ffb640 10 client.25259 handle_command_reply: tid=0 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.393+0000 7ff3cb2c3740 1 client.25259 shutdown 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 msgr2=0x5562f6a053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8004700 tx=0x7ff3b8010b60 comp rx=0 tx=0).stop 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 shutdown_connections 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562f664c1b0 0x5562f6a05900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562f662b4d0 0x5562f6a053c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562f65e01c0 0x5562f6a80280 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 --2- 172.21.15.38:0/1723154765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562f66232f0 0x5562f6a09f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 >> 172.21.15.38:0/1723154765 conn(0x5562f6640300 msgr2=0x5562f69f3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3a5ffb640 0 client.25259 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 shutdown_connections 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 1 -- 172.21.15.38:0/1723154765 wait complete. 2024-09-21T06:19:54.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3cb2c3740 20 client.25259 trim_cache size 0 max 16384 2024-09-21T06:19:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:19:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:19:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:19:54.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 msgr2=0x7ff3a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 0x7ff3a80b8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40ce6a0 tx=0x7ff3b409bb00 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 msgr2=0x7ff3bc19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4033040 tx=0x7ff3b4003c90 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.394+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 shutdown_connections 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3a80b6680 0x7ff3a80b8b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3bc108c30 0x7ff3bc19fdf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3bc1082e0 0x7ff3bc19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 --2- 172.21.15.38:0/1323774883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3bc1029b0 0x7ff3bc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 >> 172.21.15.38:0/1323774883 conn(0x7ff3bc07a740 msgr2=0x7ff3bc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:19:54.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 shutdown_connections 2024-09-21T06:19:54.399 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:19:54.395+0000 7ff3c4357640 1 -- 172.21.15.38:0/1323774883 wait complete. 2024-09-21T06:19:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 73 KiB/s wr, 21 op/s 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 73 KiB/s wr, 21 op/s 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:55.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:55.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 73 KiB/s wr, 21 op/s 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:19:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:19:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:57 smithi174 ceph-mon[34815]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T06:19:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:57 smithi044 ceph-mon[34369]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T06:19:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:57 smithi038 ceph-mon[31215]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-21T06:19:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:19:59 smithi174 ceph-mon[34815]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:19:59.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:19:59 smithi044 ceph-mon[34369]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:19:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:19:59 smithi038 ceph-mon[31215]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:20:00.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:00 smithi174 ceph-mon[34815]: overall HEALTH_OK 2024-09-21T06:20:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:00 smithi044 ceph-mon[34369]: overall HEALTH_OK 2024-09-21T06:20:00.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-mon[31215]: overall HEALTH_OK 2024-09-21T06:20:00.736 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:20:00.410+0000 7fe5fb64d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:20:00.410+0000 7fe5fb64d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:20:00.410+0000 7fe5fb64d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:20:00.410+0000 7fe5fb64d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:20:00.737 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:20:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x[31441]: 2024-09-21T06:20:00.410+0000 7fe5fb64d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:20:01.637 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:01 smithi038 ceph-mon[31215]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:20:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:01 smithi174 ceph-mon[34815]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:20:01.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:01 smithi044 ceph-mon[34369]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:20:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:03 smithi174 ceph-mon[34815]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:20:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:03 smithi174 ceph-mon[34815]: mgrmap e26: x(active, since 8m), standbys: z, y 2024-09-21T06:20:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:03 smithi044 ceph-mon[34369]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:20:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:03 smithi044 ceph-mon[34369]: mgrmap e26: x(active, since 8m), standbys: z, y 2024-09-21T06:20:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:03 smithi038 ceph-mon[31215]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T06:20:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:03 smithi038 ceph-mon[31215]: mgrmap e26: x(active, since 8m), standbys: z, y 2024-09-21T06:20:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:05 smithi174 ceph-mon[34815]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:20:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:05 smithi044 ceph-mon[34369]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:20:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:05 smithi038 ceph-mon[31215]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 -- 172.21.15.38:0/2950662009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881029b0 msgr2=0x7fbd88102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/2950662009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881029b0 0x7fbd88102dc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009900 tx=0x7fbd7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 -- 172.21.15.38:0/2950662009 shutdown_connections 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/2950662009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd88108c30 0x7fbd8810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/2950662009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd881082e0 0x7fbd881086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/2950662009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881029b0 0x7fbd88102dc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 -- 172.21.15.38:0/2950662009 >> 172.21.15.38:0/2950662009 conn(0x7fbd8807a740 msgr2=0x7fbd8807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 -- 172.21.15.38:0/2950662009 shutdown_connections 2024-09-21T06:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.497+0000 7fbd8f09b640 1 -- 172.21.15.38:0/2950662009 wait complete. 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.498+0000 7fbd8f09b640 1 Processor -- start 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.498+0000 7fbd8f09b640 1 -- start start 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd881029b0 0x7fbd88199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd88108c30 0x7fbd8819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbd88112a30 con 0x7fbd881082e0 2024-09-21T06:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881128b0 con 0x7fbd881029b0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8f09b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd88112bb0 con 0x7fbd88108c30 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32950/0 (socket says 172.21.15.38:32950) 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 -- 172.21.15.38:0/4148562968 learned_addr learned my addr 172.21.15.38:0/4148562968 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8d638640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd88108c30 0x7fbd8819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd881029b0 0x7fbd88199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 -- 172.21.15.38:0/4148562968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd88108c30 msgr2=0x7fbd8819ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd88108c30 0x7fbd8819ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 -- 172.21.15.38:0/4148562968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd881029b0 msgr2=0x7fbd88199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd881029b0 0x7fbd88199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.499+0000 7fbd87fff640 1 -- 172.21.15.38:0/4148562968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8819f380 con 0x7fbd881082e0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd87fff640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400ead0 tx=0x7fbd7400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd85ffb640 1 -- 172.21.15.38:0/4148562968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400bb70 con 0x7fbd881082e0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd85ffb640 1 -- 172.21.15.38:0/4148562968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd7400bd10 con 0x7fbd881082e0 2024-09-21T06:20:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8819f670 con 0x7fbd881082e0 2024-09-21T06:20:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd85ffb640 1 -- 172.21.15.38:0/4148562968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74017410 con 0x7fbd881082e0 2024-09-21T06:20:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.500+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8806abe0 con 0x7fbd881082e0 2024-09-21T06:20:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd85ffb640 1 -- 172.21.15.38:0/4148562968 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fbd740175b0 con 0x7fbd881082e0 2024-09-21T06:20:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 Processor -- start 2024-09-21T06:20:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 -- start start 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab341e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab341eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556ab33936f0 con 0x556ab30584d0 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ab3382b20 con 0x556ab30791b0 2024-09-21T06:20:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd9600c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ab3386930 con 0x556ab30502f0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32958/0 (socket says 172.21.15.38:32958) 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.503+0000 7fbd87fff640 1 -- 172.21.15.38:0/1710020265 learned_addr learned my addr 172.21.15.38:0/1710020265 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd8d638640 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab341e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab341eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 -- 172.21.15.38:0/1710020265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 msgr2=0x556ab341eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab341eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 -- 172.21.15.38:0/1710020265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 msgr2=0x556ab341e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab341e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 -- 172.21.15.38:0/1710020265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab3348530 con 0x556ab30584d0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd85ffb640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 0x7fbd780b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e6600 tx=0x7fbd740ed820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a1783b03365a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd8d638640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 0x7fbd780b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd72ffd640 1 -- 172.21.15.38:0/1710020265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ab3b0 con 0x556ab30584d0 2024-09-21T06:20:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd85ffb640 1 -- 172.21.15.38:0/4148562968 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbd740e8f50 con 0x7fbd881082e0 2024-09-21T06:20:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd72ffd640 1 -- 172.21.15.38:0/1710020265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd740056a0 con 0x556ab30584d0 2024-09-21T06:20:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.504+0000 7fbd72ffd640 1 -- 172.21.15.38:0/1710020265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740aeb30 con 0x556ab30584d0 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 -- 172.21.15.38:0/1710020265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 msgr2=0x556ab341f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd8d638640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 0x7fbd780b8ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd80005fd0 tx=0x7fbd80009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e6600 tx=0x7fbd740ed820 comp rx=0 tx=0).stop 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 -- 172.21.15.38:0/1710020265 shutdown_connections 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab341f430 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab341eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1710020265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab341e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 -- 172.21.15.38:0/1710020265 >> 172.21.15.38:0/1710020265 conn(0x556ab306d300 msgr2=0x556ab341c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.505+0000 7fbd9600c740 1 -- 172.21.15.38:0/1710020265 shutdown_connections 2024-09-21T06:20:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.506+0000 7fbd9600c740 1 -- 172.21.15.38:0/1710020265 wait complete. 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.506+0000 7fbd9600c740 1 -- start start 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.506+0000 7fbd9600c740 1 Processor -- start 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab342e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab343a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556ab32baab0 con 0x556ab30584d0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ab3328730 con 0x556ab30791b0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ab3431510 con 0x556ab30502f0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd9600c740 10 client.0 _ll_register_callbacks cb 0x556ab337c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32962/0 (socket says 172.21.15.38:32962) 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 -- 172.21.15.38:0/1110967362 learned_addr learned my addr 172.21.15.38:0/1110967362 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab342e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd8d638640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab343a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 -- 172.21.15.38:0/1110967362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 msgr2=0x556ab342e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab342e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 -- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 msgr2=0x556ab343a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab343a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 -- 172.21.15.38:0/1110967362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab30e4790 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e6740 tx=0x7fbd740ea2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2b0be19f872a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.507+0000 7fbd67fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ae4d0 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbd7400e2e0 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd740056a0 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd740ae6b0 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 10 client.15576 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ab315d620 con 0x556ab30584d0 2024-09-21T06:20:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd740056a0 con 0x556ab30584d0 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd740ed110 con 0x556ab30584d0 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 10 client.15576 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 20 client.15576 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab3037d80 0x556ab34403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 4 client.15576 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.508+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ab3395640 con 0x556ab3037d80 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.509+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab3037d80 0x556ab34403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.509+0000 7fbd67fff640 10 client.15576 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.509+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab3037d80 0x556ab34403d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c388bf5d7f91ec6 server_cookie=1d6000ca9e287b77 in_seq=0 out_seq=0 2024-09-21T06:20:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd67fff640 1 -- 172.21.15.38:0/1110967362 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ab3395640 con 0x556ab3037d80 2024-09-21T06:20:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd67fff640 10 client.15576 handle_command_reply: tid=0 2024-09-21T06:20:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 client.15576 shutdown 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 msgr2=0x556ab342e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e6740 tx=0x7fbd740ea2c0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 shutdown_connections 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab343a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab342e990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab3037d80 0x556ab34403d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1110967362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab342e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd67fff640 0 client.15576 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.510+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 >> 172.21.15.38:0/1110967362 conn(0x556ab306d300 msgr2=0x556ab341aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.511+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 shutdown_connections 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.511+0000 7fbd9600c740 1 -- 172.21.15.38:0/1110967362 wait complete. 2024-09-21T06:20:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.511+0000 7fbd9600c740 20 client.15576 trim_cache size 0 max 16384 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.525+0000 7fbd9600c740 1 Processor -- start 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.525+0000 7fbd9600c740 1 -- start start 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 0x556ab342d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab3429800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881afda0 con 0x556ab30502f0 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881ad670 con 0x556ab30791b0 2024-09-21T06:20:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd9600c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881ab4e0 con 0x556ab30584d0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32976/0 (socket says 172.21.15.38:32976) 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 -- 172.21.15.38:0/1576574058 learned_addr learned my addr 172.21.15.38:0/1576574058 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8d638640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab3429800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 0x556ab342d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 -- 172.21.15.38:0/1576574058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 msgr2=0x556ab342d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 0x556ab342d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 -- 172.21.15.38:0/1576574058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 msgr2=0x556ab3429800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab3429800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 -- 172.21.15.38:0/1576574058 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab3417f50 con 0x556ab30502f0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd87fff640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 0x556ab342d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.526+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c02a930 tx=0x7fbd7c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4464fcb8f285053b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.527+0000 7fbd727fc640 1 -- 172.21.15.38:0/1576574058 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c049070 con 0x556ab30502f0 2024-09-21T06:20:07.530 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.527+0000 7fbd727fc640 1 -- 172.21.15.38:0/1576574058 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd7c005510 con 0x556ab30502f0 2024-09-21T06:20:07.531 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.527+0000 7fbd727fc640 1 -- 172.21.15.38:0/1576574058 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035040 con 0x556ab30502f0 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- 172.21.15.38:0/1576574058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 msgr2=0x556ab342e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c02a930 tx=0x7fbd7c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- 172.21.15.38:0/1576574058 shutdown_connections 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab3429800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30584d0 0x556ab342d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 --2- 172.21.15.38:0/1576574058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30502f0 0x556ab342e930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- 172.21.15.38:0/1576574058 >> 172.21.15.38:0/1576574058 conn(0x556ab306d300 msgr2=0x556ab34290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- 172.21.15.38:0/1576574058 shutdown_connections 2024-09-21T06:20:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- 172.21.15.38:0/1576574058 wait complete. 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 -- start start 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.528+0000 7fbd9600c740 1 Processor -- start 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab3440ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab34a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881abb30 con 0x556ab30584d0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881acfa0 con 0x556ab30791b0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbd881ac200 con 0x556ab30502f0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 10 client.0 _ll_register_callbacks cb 0x7fbd80009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32978/0 (socket says 172.21.15.38:32978) 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 -- 172.21.15.38:0/557808067 learned_addr learned my addr 172.21.15.38:0/557808067 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab3440ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd8d638640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab34a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 -- 172.21.15.38:0/557808067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 msgr2=0x556ab3440ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab3440ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 -- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 msgr2=0x556ab34a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab34a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 -- 172.21.15.38:0/557808067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab34a31b0 con 0x556ab30584d0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd87fff640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e66f0 tx=0x7fbd740ae870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74339ef28143c909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd67fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ae4d0 con 0x556ab30584d0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbd7400e2e0 con 0x556ab30584d0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.529+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c005510 con 0x556ab30584d0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd740ab3b0 con 0x556ab30584d0 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 10 client.15582 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ab34aa4d0 con 0x556ab30584d0 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd7c005510 con 0x556ab30584d0 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd740e6910 con 0x556ab30584d0 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 10 client.15582 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 20 client.15582 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab300d1c0 0x556ab34ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 4 client.15582 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ab33910f0 con 0x556ab300d1c0 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.530+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab300d1c0 0x556ab34ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.531+0000 7fbd67fff640 10 client.15582 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.531+0000 7fbd8ce37640 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab300d1c0 0x556ab34ac9d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10c2c0cc00f471d0 server_cookie=5e940e0119f8388c in_seq=0 out_seq=0 2024-09-21T06:20:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd67fff640 1 -- 172.21.15.38:0/557808067 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ab33910f0 con 0x556ab300d1c0 2024-09-21T06:20:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd67fff640 10 client.15582 handle_command_reply: tid=0 2024-09-21T06:20:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 client.15582 shutdown 2024-09-21T06:20:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 msgr2=0x556ab34412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd740e66f0 tx=0x7fbd740ae870 comp rx=0 tx=0).stop 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 shutdown_connections 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ab30791b0 0x556ab34a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ab30584d0 0x556ab34412c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x556ab300d1c0 0x556ab34ac9d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 --2- 172.21.15.38:0/557808067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ab30502f0 0x556ab3440ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 >> 172.21.15.38:0/557808067 conn(0x556ab306d300 msgr2=0x556ab342f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd67fff640 0 client.15582 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 shutdown_connections 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.539+0000 7fbd9600c740 1 -- 172.21.15.38:0/557808067 wait complete. 2024-09-21T06:20:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd9600c740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T06:20:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:20:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:20:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:20:07.544 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 msgr2=0x7fbd780b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 0x7fbd780b8ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbd80005fd0 tx=0x7fbd80009600 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 msgr2=0x7fbd881999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400ead0 tx=0x7fbd7400ef90 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 shutdown_connections 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbd780b6790 0x7fbd780b8ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbd88108c30 0x7fbd8819ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd881082e0 0x7fbd881999f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 --2- 172.21.15.38:0/4148562968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd881029b0 0x7fbd88199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 >> 172.21.15.38:0/4148562968 conn(0x7fbd8807a740 msgr2=0x7fbd88106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 shutdown_connections 2024-09-21T06:20:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:07.540+0000 7fbd8f09b640 1 -- 172.21.15.38:0/4148562968 wait complete. 2024-09-21T06:20:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:07 smithi174 ceph-mon[34815]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:20:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:07 smithi044 ceph-mon[34369]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:20:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:07 smithi038 ceph-mon[31215]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:20:09.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:09 smithi174 ceph-mon[34815]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:20:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:09 smithi044 ceph-mon[34369]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:20:09.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:09 smithi038 ceph-mon[31215]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:20:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:11 smithi174 ceph-mon[34815]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T06:20:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:11 smithi044 ceph-mon[34369]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T06:20:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:11 smithi038 ceph-mon[31215]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T06:20:12.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:20:12.848 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 -- 172.21.15.38:0/2112546267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc174105300 msgr2=0x7fc17410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 --2- 172.21.15.38:0/2112546267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc174105300 0x7fc17410d850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc16402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 -- 172.21.15.38:0/2112546267 shutdown_connections 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 --2- 172.21.15.38:0/2112546267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 0x7fc174110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 --2- 172.21.15.38:0/2112546267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc174105300 0x7fc17410d850 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 --2- 172.21.15.38:0/2112546267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1741049b0 0x7fc174104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 -- 172.21.15.38:0/2112546267 >> 172.21.15.38:0/2112546267 conn(0x7fc174079730 msgr2=0x7fc174079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 -- 172.21.15.38:0/2112546267 shutdown_connections 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.322+0000 7fc17bc88640 1 -- 172.21.15.38:0/2112546267 wait complete. 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.323+0000 7fc17bc88640 1 Processor -- start 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.323+0000 7fc17bc88640 1 -- start start 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.323+0000 7fc17bc88640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17bc88640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc174105300 0x7fc17419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17bc88640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 0x7fc17419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17bc88640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc174113b90 con 0x7fc1741049b0 2024-09-21T06:20:13.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17bc88640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc174113a10 con 0x7fc17410de10 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17bc88640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc174113d10 con 0x7fc174105300 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39440/0 (socket says 172.21.15.38:39440) 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 -- 172.21.15.38:0/3090685176 learned_addr learned my addr 172.21.15.38:0/3090685176 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179223640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc174105300 0x7fc17419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc17a225640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 0x7fc17419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 -- 172.21.15.38:0/3090685176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc174105300 msgr2=0x7fc17419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc174105300 0x7fc17419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 -- 172.21.15.38:0/3090685176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 msgr2=0x7fc17419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 0x7fc17419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.324+0000 7fc179a24640 1 -- 172.21.15.38:0/3090685176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1741a04d0 con 0x7fc1741049b0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc179a24640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc17000d770 tx=0x7fc17000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc16affd640 1 -- 172.21.15.38:0/3090685176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170018070 con 0x7fc1741049b0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1741a07c0 con 0x7fc1741049b0 2024-09-21T06:20:13.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc16affd640 1 -- 172.21.15.38:0/3090685176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc170009c30 con 0x7fc1741049b0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc16affd640 1 -- 172.21.15.38:0/3090685176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1700035f0 con 0x7fc1741049b0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.325+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1741025d0 con 0x7fc1741049b0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 Processor -- start 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 -- start start 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc16affd640 1 -- 172.21.15.38:0/3090685176 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fc170025440 con 0x7fc1741049b0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c79598b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555c7950ee50 con 0x555c791f1070 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c794fe280 con 0x555c791d0390 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.329+0000 7fc1821fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555c79502090 con 0x555c791c81b0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39444/0 (socket says 172.21.15.38:39444) 2024-09-21T06:20:13.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 -- 172.21.15.38:0/3361142615 learned_addr learned my addr 172.21.15.38:0/3361142615 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc179a24640 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c79598b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc179223640 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 -- 172.21.15.38:0/3361142615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 msgr2=0x555c79598b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c79598b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 -- 172.21.15.38:0/3361142615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 msgr2=0x555c795990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 -- 172.21.15.38:0/3361142615 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c7925c650 con 0x555c791f1070 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc16affd640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 0x7fc1600b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.330+0000 7fc17a225640 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00ae90 tx=0x7fc16c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154647c89d0cb0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.331+0000 7fc15ffff640 1 -- 172.21.15.38:0/3361142615 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c003b70 con 0x555c791f1070 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.331+0000 7fc16affd640 1 -- 172.21.15.38:0/3090685176 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc1700eb200 con 0x7fc1741049b0 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.331+0000 7fc179a24640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 0x7fc1600b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.331+0000 7fc15ffff640 1 -- 172.21.15.38:0/3361142615 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc16c003d10 con 0x555c791f1070 2024-09-21T06:20:13.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.331+0000 7fc15ffff640 1 -- 172.21.15.38:0/3361142615 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c010ca0 con 0x555c791f1070 2024-09-21T06:20:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 -- 172.21.15.38:0/3361142615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 msgr2=0x555c79598650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc179a24640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 0x7fc1600b8ca0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1700e8970 tx=0x7fc170000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00ae90 tx=0x7fc16c00f790 comp rx=0 tx=0).stop 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 -- 172.21.15.38:0/3361142615 shutdown_connections 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c79598b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 --2- 172.21.15.38:0/3361142615 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79598650 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 -- 172.21.15.38:0/3361142615 >> 172.21.15.38:0/3361142615 conn(0x555c791e5460 msgr2=0x555c79596540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.332+0000 7fc1821fc740 1 -- 172.21.15.38:0/3361142615 shutdown_connections 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.333+0000 7fc1821fc740 1 -- 172.21.15.38:0/3361142615 wait complete. 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.333+0000 7fc1821fc740 1 -- start start 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.334+0000 7fc1821fc740 1 Processor -- start 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.334+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791c81b0 0x555c795a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 0x555c795a4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc179223640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 0x555c795a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39448/0 (socket says 172.21.15.38:39448) 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc179223640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 0x555c795a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42466/0 (socket says 172.21.15.38:42466) 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc17a225640 1 -- 172.21.15.38:0/2087476549 learned_addr learned my addr 172.21.15.38:0/2087476549 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555c7935f700 con 0x555c791f1070 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c79499110 con 0x555c791c81b0 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.335+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555c795a6e30 con 0x555c791d0390 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 -- 172.21.15.38:0/2087476549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 msgr2=0x555c795a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 0x555c795a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 -- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791c81b0 msgr2=0x555c795a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791c81b0 0x555c795a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c794c6c40 con 0x555c791f1070 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc17a225640 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc16c010980 tx=0x7fc16c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7f940be3a45806 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc1821fc740 10 client.0 _ll_register_callbacks cb 0x555c794b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c003d10 con 0x555c791f1070 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.336+0000 7fc15d7fa640 10 client.15594 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.337+0000 7fc15d7fa640 1 -- 172.21.15.38:0/2087476549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c029af0 con 0x555c791f1070 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.337+0000 7fc15d7fa640 1 -- 172.21.15.38:0/2087476549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc16c01d070 con 0x555c791f1070 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.337+0000 7fc15d7fa640 1 -- 172.21.15.38:0/2087476549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc16c029c90 con 0x555c791f1070 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.337+0000 7fc1821fc740 10 client.15594 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:13.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.337+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x555c795b2930 con 0x555c791f1070 2024-09-21T06:20:13.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc15d7fa640 1 -- 172.21.15.38:0/2087476549 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc16c004a40 con 0x555c791f1070 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 10 client.15594 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 20 client.15594 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c791af9f0 0x555c795b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 4 client.15594 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.345+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c79510da0 con 0x555c791af9f0 2024-09-21T06:20:13.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.346+0000 7fc179223640 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c791af9f0 0x555c795b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.346+0000 7fc15d7fa640 10 client.15594 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:13.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.346+0000 7fc179223640 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c791af9f0 0x555c795b5c90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d590e5a0e17dc03 server_cookie=40e17cdba413b319 in_seq=0 out_seq=0 2024-09-21T06:20:13.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc15d7fa640 1 -- 172.21.15.38:0/2087476549 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c79510da0 con 0x555c791af9f0 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc15d7fa640 10 client.15594 handle_command_reply: tid=0 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 client.15594 shutdown 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 msgr2=0x555c795b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc16c010980 tx=0x7fc16c003c80 comp rx=0 tx=0).stop 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 shutdown_connections 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c795b0120 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.347+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c791af9f0 0x555c795b5c90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791d0390 0x555c795a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2087476549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791c81b0 0x555c795a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc15d7fa640 0 client.15594 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 >> 172.21.15.38:0/2087476549 conn(0x555c791e5460 msgr2=0x555c7959b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 shutdown_connections 2024-09-21T06:20:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 1 -- 172.21.15.38:0/2087476549 wait complete. 2024-09-21T06:20:13.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.348+0000 7fc1821fc740 20 client.15594 trim_cache size 0 max 16384 2024-09-21T06:20:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 Processor -- start 2024-09-21T06:20:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 -- start start 2024-09-21T06:20:13.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741afee0 con 0x555c791f1070 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741ad7b0 con 0x555c791d0390 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.370+0000 7fc1821fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741ab600 con 0x555c791c81b0 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39456/0 (socket says 172.21.15.38:39456) 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 -- 172.21.15.38:0/2249792418 learned_addr learned my addr 172.21.15.38:0/2249792418 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc179223640 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 -- 172.21.15.38:0/2249792418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 msgr2=0x555c795a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 -- 172.21.15.38:0/2249792418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 msgr2=0x555c795b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 -- 172.21.15.38:0/2249792418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c795a4fd0 con 0x555c791f1070 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.371+0000 7fc17a225640 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004f40 tx=0x7fc16c02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7beabc42f42830 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.372+0000 7fc15f7fe640 1 -- 172.21.15.38:0/2249792418 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0109b0 con 0x555c791f1070 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.372+0000 7fc15f7fe640 1 -- 172.21.15.38:0/2249792418 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc16c003d10 con 0x555c791f1070 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.372+0000 7fc15f7fe640 1 -- 172.21.15.38:0/2249792418 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c004530 con 0x555c791f1070 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- 172.21.15.38:0/2249792418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 msgr2=0x555c79599d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004f40 tx=0x7fc16c02b000 comp rx=0 tx=0).stop 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- 172.21.15.38:0/2249792418 shutdown_connections 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791f1070 0x555c79599d70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791d0390 0x555c795b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 --2- 172.21.15.38:0/2249792418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- 172.21.15.38:0/2249792418 >> 172.21.15.38:0/2249792418 conn(0x555c791e5460 msgr2=0x555c79599660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- 172.21.15.38:0/2249792418 shutdown_connections 2024-09-21T06:20:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- 172.21.15.38:0/2249792418 wait complete. 2024-09-21T06:20:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.373+0000 7fc1821fc740 1 -- start start 2024-09-21T06:20:13.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 Processor -- start 2024-09-21T06:20:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 0x555c7961f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741abc70 con 0x555c791d0390 2024-09-21T06:20:13.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741ad0e0 con 0x555c791f1070 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741ac340 con 0x555c791c81b0 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc1821fc740 10 client.0 _ll_register_callbacks cb 0x7fc16c00ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc179223640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc179223640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39470/0 (socket says 172.21.15.38:39470) 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.374+0000 7fc179223640 1 -- 172.21.15.38:0/780872796 learned_addr learned my addr 172.21.15.38:0/780872796 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc17a225640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc17a225640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 0x555c7961f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 -- 172.21.15.38:0/780872796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 msgr2=0x555c795b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 -- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 msgr2=0x555c7961f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 0x555c7961f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 -- 172.21.15.38:0/780872796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c7961f950 con 0x555c791d0390 2024-09-21T06:20:13.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc17a225640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 0x555c7961f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc179223640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc164005f70 tx=0x7fc164031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc286cdd1368a551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc15d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164035040 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc164004450 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.375+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c003d10 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.376+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc164005040 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.376+0000 7fc1821fc740 10 client.15600 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.376+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c79620ab0 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.376+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc16c003d10 con 0x555c791d0390 2024-09-21T06:20:13.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc1640035f0 con 0x555c791d0390 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 10 client.15600 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 20 client.15600 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c79184da0 0x555c796232a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 4 client.15600 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.377+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c7950c850 con 0x555c79184da0 2024-09-21T06:20:13.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.378+0000 7fc17a225640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c79184da0 0x555c796232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.378+0000 7fc15d7fa640 10 client.15600 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.378+0000 7fc17a225640 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c79184da0 0x555c796232a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637de2ab2d62b4ba server_cookie=c264615f0edb1a59 in_seq=0 out_seq=0 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc15d7fa640 1 -- 172.21.15.38:0/780872796 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x555c7950c850 con 0x555c79184da0 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc15d7fa640 10 client.15600 handle_command_reply: tid=0 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 client.15600 shutdown 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 msgr2=0x555c795b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc164005f70 tx=0x7fc164031950 comp rx=0 tx=0).stop 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 shutdown_connections 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c791f1070 0x555c7961f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555c791d0390 0x555c795b7570 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555c79184da0 0x555c796232a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 --2- 172.21.15.38:0/780872796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555c791c81b0 0x555c795b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 >> 172.21.15.38:0/780872796 conn(0x555c791e5460 msgr2=0x555c795a5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc15d7fa640 0 client.15600 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:13.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 shutdown_connections 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.379+0000 7fc1821fc740 1 -- 172.21.15.38:0/780872796 wait complete. 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.380+0000 7fc1821fc740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:13.385 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:13.386 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:13.386 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:20:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.380+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 msgr2=0x7fc1600b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.380+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 0x7fc1600b8ca0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1700e8970 tx=0x7fc170000bc0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 msgr2=0x7fc17419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc17000d770 tx=0x7fc17000dc30 comp rx=0 tx=0).stop 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 shutdown_connections 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1600b6790 0x7fc1600b8ca0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17410de10 0x7fc17419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc174105300 0x7fc17419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 --2- 172.21.15.38:0/3090685176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1741049b0 0x7fc17419a560 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 >> 172.21.15.38:0/3090685176 conn(0x7fc174079730 msgr2=0x7fc174100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 shutdown_connections 2024-09-21T06:20:13.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:13.381+0000 7fc17bc88640 1 -- 172.21.15.38:0/3090685176 wait complete. 2024-09-21T06:20:13.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:13 smithi038 ceph-mon[31215]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:13 smithi174 ceph-mon[34815]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:13 smithi044 ceph-mon[34369]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:14.319 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:20:14.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:20:14.649 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 -- 172.21.15.38:0/2581263950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 msgr2=0x7f62f810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 --2- 172.21.15.38:0/2581263950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f810d850 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009900 tx=0x7f62e802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 -- 172.21.15.38:0/2581263950 shutdown_connections 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 --2- 172.21.15.38:0/2581263950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 0x7f62f8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 --2- 172.21.15.38:0/2581263950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f810d850 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 --2- 172.21.15.38:0/2581263950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f81049b0 0x7f62f8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.144+0000 7f62ff50f640 1 -- 172.21.15.38:0/2581263950 >> 172.21.15.38:0/2581263950 conn(0x7f62f8079730 msgr2=0x7f62f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.145+0000 7f62ff50f640 1 -- 172.21.15.38:0/2581263950 shutdown_connections 2024-09-21T06:20:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.145+0000 7f62ff50f640 1 -- 172.21.15.38:0/2581263950 wait complete. 2024-09-21T06:20:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 Processor -- start 2024-09-21T06:20:15.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 -- start start 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f81049b0 0x7f62f819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 0x7f62f81a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8113be0 con 0x7f62f8105300 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8113a60 con 0x7f62f810de10 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62ff50f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8113d60 con 0x7f62f81049b0 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62fcaaa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62fcaaa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39478/0 (socket says 172.21.15.38:39478) 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62fcaaa640 1 -- 172.21.15.38:0/164373140 learned_addr learned my addr 172.21.15.38:0/164373140 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:15.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.146+0000 7f62fdaac640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 0x7f62f81a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 -- 172.21.15.38:0/164373140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f81049b0 msgr2=0x7f62f819c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f81049b0 0x7f62f819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 -- 172.21.15.38:0/164373140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 msgr2=0x7f62f81a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 0x7f62f81a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 -- 172.21.15.38:0/164373140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81a2780 con 0x7f62f8105300 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62fcaaa640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f62e802aa00 tx=0x7f62e8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e803f070 con 0x7f62f8105300 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62e8031be0 con 0x7f62f8105300 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8035030 con 0x7f62f8105300 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.147+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f81a2a10 con 0x7f62f8105300 2024-09-21T06:20:15.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.148+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a91d0 con 0x7f62f8105300 2024-09-21T06:20:15.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.149+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f8104dc0 con 0x7f62f8105300 2024-09-21T06:20:15.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.151+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f62e8042070 con 0x7f62f8105300 2024-09-21T06:20:15.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.152+0000 7f62ee7fc640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 0x7f62e40b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:15.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.152+0000 7f62fd2ab640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 0x7f62e40b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:15.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.152+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f62e8107c50 con 0x7f62f8105300 2024-09-21T06:20:15.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.153+0000 7f62fd2ab640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 0x7f62e40b8d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005fd0 tx=0x7f62f400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:15.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.161+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62e80ce050 con 0x7f62f8105300 2024-09-21T06:20:15.347 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:15 smithi038 ceph-mon[31215]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.426+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62f81a93d0 con 0x7f62f8105300 2024-09-21T06:20:15.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.427+0000 7f62ee7fc640 1 -- 172.21.15.38:0/164373140 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7f62e80d2430 con 0x7f62f8105300 2024-09-21T06:20:15.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:20:15.430 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"btime":"2024-09-21T06:19:31:452263+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:19:30.723218+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:20:15.430 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-21T06:20:15.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 msgr2=0x7f62e40b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:15.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 0x7f62e40b8d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005fd0 tx=0x7f62f400b410 comp rx=0 tx=0).stop 2024-09-21T06:20:15.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 msgr2=0x7f62f819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:15.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f62e802aa00 tx=0x7f62e8003b90 comp rx=0 tx=0).stop 2024-09-21T06:20:15.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 shutdown_connections 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f62e40b6860 0x7f62e40b8d70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f810de10 0x7f62f81a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f8105300 0x7f62f819cdb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 --2- 172.21.15.38:0/164373140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f81049b0 0x7f62f819c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.429+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 >> 172.21.15.38:0/164373140 conn(0x7f62f8079730 msgr2=0x7f62f81036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.430+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 shutdown_connections 2024-09-21T06:20:15.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:15.430+0000 7f62ff50f640 1 -- 172.21.15.38:0/164373140 wait complete. 2024-09-21T06:20:15.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:15 smithi174 ceph-mon[34815]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:15 smithi044 ceph-mon[34369]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:20:16.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:20:16.354 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:16 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/164373140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:16.367 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:16 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/164373140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:16.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:16 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/164373140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 -- 172.21.15.38:0/2991755348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 msgr2=0x7f6f50102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 --2- 172.21.15.38:0/2991755348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f50102e70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009900 tx=0x7f6f4002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 -- 172.21.15.38:0/2991755348 shutdown_connections 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 --2- 172.21.15.38:0/2991755348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 --2- 172.21.15.38:0/2991755348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 0x7f6f501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 --2- 172.21.15.38:0/2991755348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f50102e70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 -- 172.21.15.38:0/2991755348 >> 172.21.15.38:0/2991755348 conn(0x7f6f50079730 msgr2=0x7f6f50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.826+0000 7f6f569f5640 1 -- 172.21.15.38:0/2991755348 shutdown_connections 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.827+0000 7f6f569f5640 1 -- 172.21.15.38:0/2991755348 wait complete. 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.827+0000 7f6f569f5640 1 Processor -- start 2024-09-21T06:20:16.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 -- start start 2024-09-21T06:20:16.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 0x7f6f5019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50112aa0 con 0x7f6f50102a60 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50112920 con 0x7f6f50108cf0 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f569f5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50112c20 con 0x7f6f501083a0 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39490/0 (socket says 172.21.15.38:39490) 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f4ffff640 1 -- 172.21.15.38:0/735717627 learned_addr learned my addr 172.21.15.38:0/735717627 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.828+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 0x7f6f5019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f54f92640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 -- 172.21.15.38:0/735717627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 msgr2=0x7f6f5019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 0x7f6f5019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 -- 172.21.15.38:0/735717627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 msgr2=0x7f6f5019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 -- 172.21.15.38:0/735717627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f501a6680 con 0x7f6f50102a60 2024-09-21T06:20:16.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f54f92640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4ffff640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005ab0 tx=0x7f6f400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4d7fa640 1 -- 172.21.15.38:0/735717627 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4003f030 con 0x7f6f50102a60 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501a6910 con 0x7f6f50102a60 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f4d7fa640 1 -- 172.21.15.38:0/735717627 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f40003cd0 con 0x7f6f50102a60 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.829+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f501a6e40 con 0x7f6f50102a60 2024-09-21T06:20:16.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.831+0000 7f6f4d7fa640 1 -- 172.21.15.38:0/735717627 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40049060 con 0x7f6f50102a60 2024-09-21T06:20:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.832+0000 7f6f5cf69740 1 Processor -- start 2024-09-21T06:20:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.832+0000 7f6f5cf69740 1 -- start start 2024-09-21T06:20:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a33f1b0 0x559d7a70f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a70fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d7a685ea0 con 0x559d7a33f1b0 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d7a6752d0 con 0x559d7a368070 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d7a6790e0 con 0x559d7a347390 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:45538/0 (socket says 172.21.15.38:45538) 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f54f92640 1 -- 172.21.15.38:0/793784230 learned_addr learned my addr 172.21.15.38:0/793784230 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.833+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a70fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 -- 172.21.15.38:0/793784230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 msgr2=0x559d7a70fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a70fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 -- 172.21.15.38:0/793784230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a33f1b0 msgr2=0x559d7a70f7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a33f1b0 0x559d7a70f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 -- 172.21.15.38:0/793784230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a3d3650 con 0x559d7a368070 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f4d7fa640 1 -- 172.21.15.38:0/735717627 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f6f40042030 con 0x7f6f50102a60 2024-09-21T06:20:16.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f54f92640 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009f30 tx=0x7f6f48010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4675f2de39611d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f367fc640 1 -- 172.21.15.38:0/793784230 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48016070 con 0x559d7a368070 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f367fc640 1 -- 172.21.15.38:0/793784230 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f4801bb30 con 0x559d7a368070 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.834+0000 7f6f367fc640 1 -- 172.21.15.38:0/793784230 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48012ca0 con 0x559d7a368070 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f4d7fa640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 0x7f6f380b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f4ffff640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 0x7f6f380b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f4d7fa640 1 -- 172.21.15.38:0/735717627 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f401081e0 con 0x7f6f50102a60 2024-09-21T06:20:16.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f5cf69740 1 -- 172.21.15.38:0/793784230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 msgr2=0x559d7a70f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009f30 tx=0x7f6f48010800 comp rx=0 tx=0).stop 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.835+0000 7f6f4ffff640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 0x7f6f380b8c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f401058f0 tx=0x7f6f4002a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 -- 172.21.15.38:0/793784230 shutdown_connections 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a70fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a33f1b0 0x559d7a70f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/793784230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a70f290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 -- 172.21.15.38:0/793784230 >> 172.21.15.38:0/793784230 conn(0x559d7a35c460 msgr2=0x559d7a70d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 -- 172.21.15.38:0/793784230 shutdown_connections 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.836+0000 7f6f5cf69740 1 -- 172.21.15.38:0/793784230 wait complete. 2024-09-21T06:20:16.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.837+0000 7f6f5cf69740 1 -- start start 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.837+0000 7f6f5cf69740 1 Processor -- start 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a71f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a72b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:45540/0 (socket says 172.21.15.38:45540) 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a71f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.838+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a71f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42552/0 (socket says 172.21.15.38:42552) 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 -- 172.21.15.38:0/754358858 learned_addr learned my addr 172.21.15.38:0/754358858 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d7a4d6700 con 0x559d7a368070 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d7a610160 con 0x559d7a33f1b0 2024-09-21T06:20:16.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d7a721d70 con 0x559d7a347390 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a72b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 -- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 msgr2=0x559d7a71f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a71f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 -- 172.21.15.38:0/754358858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 msgr2=0x559d7a72b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a72b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.839+0000 7f6f54f92640 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7a63dc90 con 0x559d7a33f1b0 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f5cf69740 10 client.0 _ll_register_callbacks cb 0x559d7a6299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f4801bb30 con 0x559d7a33f1b0 2024-09-21T06:20:16.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f54f92640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f80 tx=0x7f6f480126c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c62def22cce3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f2f7fe640 10 client.25304 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/754358858 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48032060 con 0x559d7a33f1b0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/754358858 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f4802da00 con 0x559d7a33f1b0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/754358858 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6f48016070 con 0x559d7a33f1b0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f5cf69740 10 client.25304 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.840+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=24}) -- 0x559d7a717870 con 0x559d7a33f1b0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/754358858 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6f48012ce0 con 0x559d7a33f1b0 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f5cf69740 10 client.25304 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f5cf69740 10 client.25304 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f5cf69740 20 client.25304 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a3269f0 0x559d7a718c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.841+0000 7f6f5cf69740 4 client.25304 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:16.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.842+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d7a687df0 con 0x559d7a3269f0 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.842+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a3269f0 0x559d7a718c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.842+0000 7f6f2f7fe640 10 client.25304 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.842+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a3269f0 0x559d7a718c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d20781d88da0ba02 server_cookie=3392378abab0e761 in_seq=0 out_seq=0 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.843+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/754358858 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d7a687df0 con 0x559d7a3269f0 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.843+0000 7f6f2f7fe640 10 client.25304 handle_command_reply: tid=0 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.843+0000 7f6f5cf69740 1 client.25304 shutdown 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 msgr2=0x559d7a71ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000f80 tx=0x7f6f480126c0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 shutdown_connections 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a3269f0 0x559d7a718c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a72b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a71f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f2f7fe640 0 client.25304 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:16.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/754358858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a71ed90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 >> 172.21.15.38:0/754358858 conn(0x559d7a35c460 msgr2=0x559d7a70b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 shutdown_connections 2024-09-21T06:20:16.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 1 -- 172.21.15.38:0/754358858 wait complete. 2024-09-21T06:20:16.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.844+0000 7f6f5cf69740 20 client.25304 trim_cache size 0 max 16384 2024-09-21T06:20:16.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.870+0000 7f6f5cf69740 1 Processor -- start 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.870+0000 7f6f5cf69740 1 -- start start 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 0x559d7a71f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 0x559d7a71bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a71c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501afda0 con 0x559d7a347390 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501ad670 con 0x559d7a368070 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501ab4c0 con 0x559d7a33f1b0 2024-09-21T06:20:16.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 0x559d7a71bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 0x559d7a71f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 0x559d7a71f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42554/0 (socket says 172.21.15.38:42554) 2024-09-21T06:20:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f54f92640 1 -- 172.21.15.38:0/4107109893 learned_addr learned my addr 172.21.15.38:0/4107109893 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:16.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.871+0000 7f6f54f92640 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a71c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/4107109893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 msgr2=0x559d7a71f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 0x559d7a71f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/4107109893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 msgr2=0x559d7a71c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a71c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/4107109893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7a710080 con 0x559d7a347390 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 0x559d7a71bf80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x559d7a610260 tx=0x7f6f44010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda1f7c4929ef230 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.872+0000 7f6f35ffb640 1 -- 172.21.15.38:0/4107109893 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44010e20 con 0x559d7a347390 2024-09-21T06:20:16.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.873+0000 7f6f35ffb640 1 -- 172.21.15.38:0/4107109893 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f440054f0 con 0x559d7a347390 2024-09-21T06:20:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.873+0000 7f6f35ffb640 1 -- 172.21.15.38:0/4107109893 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4401c430 con 0x559d7a347390 2024-09-21T06:20:16.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 -- 172.21.15.38:0/4107109893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 msgr2=0x559d7a71bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 0x559d7a71bf80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x559d7a610260 tx=0x7f6f44010800 comp rx=0 tx=0).stop 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 -- 172.21.15.38:0/4107109893 shutdown_connections 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a368070 0x559d7a71c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a347390 0x559d7a71bf80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/4107109893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a33f1b0 0x559d7a71f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 -- 172.21.15.38:0/4107109893 >> 172.21.15.38:0/4107109893 conn(0x559d7a35c460 msgr2=0x559d7a71eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 -- 172.21.15.38:0/4107109893 shutdown_connections 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.874+0000 7f6f5cf69740 1 -- 172.21.15.38:0/4107109893 wait complete. 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.875+0000 7f6f5cf69740 1 -- start start 2024-09-21T06:20:16.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.875+0000 7f6f5cf69740 1 Processor -- start 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a7274e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a724ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501abb30 con 0x559d7a368070 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501acfa0 con 0x559d7a33f1b0 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f501ac200 con 0x559d7a347390 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f54f92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a7274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42564/0 (socket says 172.21.15.38:42564) 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/3653806397 learned_addr learned my addr 172.21.15.38:0/3653806397 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f5cf69740 10 client.0 _ll_register_callbacks cb 0x7f6f4400c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.876+0000 7f6f54f92640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a724ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/3653806397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 msgr2=0x559d7a7274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a7274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/3653806397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 msgr2=0x559d7a724ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a724ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 -- 172.21.15.38:0/3653806397 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7a725430 con 0x559d7a347390 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f4f7fe640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400cc00 tx=0x7f6f44005020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4fc1c633370809 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44030060 con 0x559d7a347390 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f440046c0 con 0x559d7a347390 2024-09-21T06:20:16.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.877+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f440054f0 con 0x559d7a347390 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6f440048c0 con 0x559d7a347390 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f5cf69740 10 client.25267 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559d7a797450 con 0x559d7a347390 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f440054f0 con 0x559d7a347390 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6f44023630 con 0x559d7a347390 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f5cf69740 10 client.25267 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f5cf69740 10 client.25267 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.878+0000 7f6f5cf69740 20 client.25267 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a2fbda0 0x559d7a799a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f5cf69740 4 client.25267 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d7a6838a0 con 0x559d7a2fbda0 2024-09-21T06:20:16.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f54f92640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a2fbda0 0x559d7a799a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f2f7fe640 10 client.25267 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.879+0000 7f6f54f92640 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a2fbda0 0x559d7a799a60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81f6da9a633a4f5e server_cookie=904ed0000b3a7f91 in_seq=0 out_seq=0 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f2f7fe640 1 -- 172.21.15.38:0/3653806397 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d7a6838a0 con 0x559d7a2fbda0 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f2f7fe640 10 client.25267 handle_command_reply: tid=0 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 client.25267 shutdown 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 msgr2=0x559d7a7249b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400cc00 tx=0x7f6f44005020 comp rx=0 tx=0).stop 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 shutdown_connections 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x559d7a2fbda0 0x559d7a799a60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d7a368070 0x559d7a724ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f2f7fe640 0 client.25267 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.880+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d7a347390 0x559d7a7249b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.881+0000 7f6f5cf69740 1 --2- 172.21.15.38:0/3653806397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d7a33f1b0 0x559d7a7274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.881+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 >> 172.21.15.38:0/3653806397 conn(0x559d7a35c460 msgr2=0x559d7a714370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.881+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 shutdown_connections 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.881+0000 7f6f5cf69740 1 -- 172.21.15.38:0/3653806397 wait complete. 2024-09-21T06:20:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.881+0000 7f6f5cf69740 20 client.25267 trim_cache size 0 max 16384 2024-09-21T06:20:16.888 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 msgr2=0x7f6f380b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 0x7f6f380b8c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f401058f0 tx=0x7f6f4002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 msgr2=0x7f6f5019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005ab0 tx=0x7f6f400042f0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 shutdown_connections 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6f380b6740 0x7f6f380b8c50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f50108cf0 0x7f6f5019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f501083a0 0x7f6f5019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 --2- 172.21.15.38:0/735717627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6f50102a60 0x7f6f5019b3f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.882+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 >> 172.21.15.38:0/735717627 conn(0x7f6f50079730 msgr2=0x7f6f50101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.883+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 shutdown_connections 2024-09-21T06:20:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:16.883+0000 7f6f569f5640 1 -- 172.21.15.38:0/735717627 wait complete. 2024-09-21T06:20:17.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:20:17.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:17 smithi174 ceph-mon[34815]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-21T06:20:17.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:17 smithi044 ceph-mon[34369]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-21T06:20:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:17 smithi038 ceph-mon[31215]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 20 op/s 2024-09-21T06:20:17.799 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 -- 172.21.15.38:0/3299858468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 msgr2=0x7f96c8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 --2- 172.21.15.38:0/3299858468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c8102ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009900 tx=0x7f96c402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 -- 172.21.15.38:0/3299858468 shutdown_connections 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 --2- 172.21.15.38:0/3299858468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8108d20 0x7f96c810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 --2- 172.21.15.38:0/3299858468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c81083d0 0x7f96c81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 --2- 172.21.15.38:0/3299858468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c8102ef0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 -- 172.21.15.38:0/3299858468 >> 172.21.15.38:0/3299858468 conn(0x7f96c8079760 msgr2=0x7f96c8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 -- 172.21.15.38:0/3299858468 shutdown_connections 2024-09-21T06:20:18.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.350+0000 7f96cfac6640 1 -- 172.21.15.38:0/3299858468 wait complete. 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.351+0000 7f96cfac6640 1 Processor -- start 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.351+0000 7f96cfac6640 1 -- start start 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.351+0000 7f96cfac6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cfac6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c81083d0 0x7f96c819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cfac6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8108d20 0x7f96c819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cfac6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113c00 con 0x7f96c8102ae0 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cfac6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113a80 con 0x7f96c8108d20 2024-09-21T06:20:18.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39528/0 (socket says 172.21.15.38:39528) 2024-09-21T06:20:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cfac6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113d80 con 0x7f96c81083d0 2024-09-21T06:20:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 -- 172.21.15.38:0/975615058 learned_addr learned my addr 172.21.15.38:0/975615058 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96ce063640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8108d20 0x7f96c819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd061640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c81083d0 0x7f96c819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 -- 172.21.15.38:0/975615058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c81083d0 msgr2=0x7f96c819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c81083d0 0x7f96c819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 -- 172.21.15.38:0/975615058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8108d20 msgr2=0x7f96c819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8108d20 0x7f96c819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.352+0000 7f96cd862640 1 -- 172.21.15.38:0/975615058 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c81a0420 con 0x7f96c8102ae0 2024-09-21T06:20:18.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.353+0000 7f96cd862640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f96c40314b0 tx=0x7f96c4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.353+0000 7f96beffd640 1 -- 172.21.15.38:0/975615058 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c403f070 con 0x7f96c8102ae0 2024-09-21T06:20:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.353+0000 7f96beffd640 1 -- 172.21.15.38:0/975615058 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96c4031bf0 con 0x7f96c8102ae0 2024-09-21T06:20:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.353+0000 7f96beffd640 1 -- 172.21.15.38:0/975615058 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4035030 con 0x7f96c8102ae0 2024-09-21T06:20:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.354+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c81a06b0 con 0x7f96c8102ae0 2024-09-21T06:20:18.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.354+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a0a80 con 0x7f96c8102ae0 2024-09-21T06:20:18.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.358+0000 7f96d603a740 1 Processor -- start 2024-09-21T06:20:18.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.358+0000 7f96d603a740 1 -- start start 2024-09-21T06:20:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.359+0000 7f96d603a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 0x559d98554100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.359+0000 7f96d603a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981861b0 0x559d98554680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.359+0000 7f96d603a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.359+0000 7f96cd061640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.359+0000 7f96cd061640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39540/0 (socket says 172.21.15.38:39540) 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96d603a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d984ccea0 con 0x559d9818e390 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96d603a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d984bc2d0 con 0x559d981af070 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96d603a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d984c00e0 con 0x559d981861b0 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 -- 172.21.15.38:0/1542902096 learned_addr learned my addr 172.21.15.38:0/1542902096 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96ce063640 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 0x559d98554100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 -- 172.21.15.38:0/1542902096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981861b0 msgr2=0x559d98554680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981861b0 0x559d98554680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 -- 172.21.15.38:0/1542902096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 msgr2=0x559d98554100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 0x559d98554100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96cd061640 1 -- 172.21.15.38:0/1542902096 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d9821a650 con 0x559d9818e390 2024-09-21T06:20:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.360+0000 7f96ce063640 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 0x559d98554100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.361+0000 7f96cd061640 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009c40 tx=0x7f96b80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c348b603282b7eab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.361+0000 7f96b3fff640 1 -- 172.21.15.38:0/1542902096 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8004030 con 0x559d9818e390 2024-09-21T06:20:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.361+0000 7f96b3fff640 1 -- 172.21.15.38:0/1542902096 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b80041d0 con 0x559d9818e390 2024-09-21T06:20:18.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.361+0000 7f96b3fff640 1 -- 172.21.15.38:0/1542902096 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b80237e0 con 0x559d9818e390 2024-09-21T06:20:18.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 -- 172.21.15.38:0/1542902096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 msgr2=0x559d98566a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009c40 tx=0x7f96b80117b0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 -- 172.21.15.38:0/1542902096 shutdown_connections 2024-09-21T06:20:18.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9818e390 0x559d98566a50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981861b0 0x559d98554680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 --2- 172.21.15.38:0/1542902096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d981af070 0x559d98554100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.362+0000 7f96d603a740 1 -- 172.21.15.38:0/1542902096 >> 172.21.15.38:0/1542902096 conn(0x559d981a3460 msgr2=0x559d98556620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.363+0000 7f96beffd640 1 -- 172.21.15.38:0/975615058 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f96c4042070 con 0x7f96c8102ae0 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.363+0000 7f96d603a740 1 -- 172.21.15.38:0/1542902096 shutdown_connections 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.363+0000 7f96d603a740 1 -- 172.21.15.38:0/1542902096 wait complete. 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.364+0000 7f96d603a740 1 -- start start 2024-09-21T06:20:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.364+0000 7f96beffd640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 0x7f96b40b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.364+0000 7f96ce063640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 0x7f96b40b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.364+0000 7f96d603a740 1 Processor -- start 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.364+0000 7f96beffd640 1 -- 172.21.15.38:0/975615058 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96c4107f10 con 0x7f96c8102ae0 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.365+0000 7f96ce063640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 0x7f96b40b8cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007f40 tx=0x7f96c0007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.365+0000 7f96d603a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.365+0000 7f96d603a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 0x559d9856b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.365+0000 7f96d603a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96ce063640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96cd061640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 0x559d9856b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96ce063640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39550/0 (socket says 172.21.15.38:39550) 2024-09-21T06:20:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96cd862640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96cd061640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 0x559d9856b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42586/0 (socket says 172.21.15.38:42586) 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96cd862640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:45590/0 (socket says 172.21.15.38:45590) 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96ce063640 1 -- 172.21.15.38:0/1830217522 learned_addr learned my addr 172.21.15.38:0/1830217522 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d9831d700 con 0x559d9816d9f0 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d98457160 con 0x559d9818e390 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.366+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d98567550 con 0x559d981af070 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 -- 172.21.15.38:0/1830217522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 msgr2=0x559d9856b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 0x559d9856b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 -- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 msgr2=0x559d9856ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d98484c90 con 0x559d9816d9f0 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96d603a740 10 client.0 _ll_register_callbacks cb 0x559d984709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b80041d0 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96cd862640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96ce063640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f96c001ee50 tx=0x7f96c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c3cb5b4fd1170 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96b17fa640 10 client.15633 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96b17fa640 1 -- 172.21.15.38:0/1830217522 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c002b060 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.367+0000 7f96b17fa640 1 -- 172.21.15.38:0/1830217522 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96c0016030 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96b17fa640 1 -- 172.21.15.38:0/1830217522 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96c000fe30 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 10 client.15633 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x559d985793f0 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96b17fa640 1 -- 172.21.15.38:0/1830217522 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f96c001b3f0 con 0x559d9816d9f0 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 10 client.15633 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 10 client.15633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 20 client.15633 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d98142da0 0x559d9857c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 4 client.15633 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.368+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d984cedf0 con 0x559d98142da0 2024-09-21T06:20:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.369+0000 7f96cd862640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d98142da0 0x559d9857c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.369+0000 7f96b17fa640 10 client.15633 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.369+0000 7f96cd862640 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d98142da0 0x559d9857c750 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71235360c7e27956 server_cookie=5aab72d3f15310e2 in_seq=0 out_seq=0 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96b17fa640 1 -- 172.21.15.38:0/1830217522 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d984cedf0 con 0x559d98142da0 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96b17fa640 10 client.15633 handle_command_reply: tid=0 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 client.15633 shutdown 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 msgr2=0x559d98570490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f96c001ee50 tx=0x7f96c0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 shutdown_connections 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d98142da0 0x559d9857c750 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96b17fa640 0 client.15633 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98570490 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.370+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d981af070 0x559d9856b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.371+0000 7f96d603a740 1 --2- 172.21.15.38:0/1830217522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.371+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 >> 172.21.15.38:0/1830217522 conn(0x559d981a3460 msgr2=0x559d985555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.371+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 shutdown_connections 2024-09-21T06:20:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.371+0000 7f96d603a740 1 -- 172.21.15.38:0/1830217522 wait complete. 2024-09-21T06:20:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.371+0000 7f96d603a740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T06:20:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.397+0000 7f96d603a740 1 Processor -- start 2024-09-21T06:20:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.397+0000 7f96d603a740 1 -- start start 2024-09-21T06:20:18.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.397+0000 7f96d603a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d98142da0 0x559d985687f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.397+0000 7f96d603a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96d603a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96d603a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81a7360 con 0x559d9816d9f0 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39560/0 (socket says 172.21.15.38:39560) 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 -- 172.21.15.38:0/184998785 learned_addr learned my addr 172.21.15.38:0/184998785 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96d603a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80732f0 con 0x559d9818e390 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8071140 con 0x559d98142da0 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd862640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d98142da0 0x559d985687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96ce063640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 -- 172.21.15.38:0/184998785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d98142da0 msgr2=0x559d985687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d98142da0 0x559d985687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 -- 172.21.15.38:0/184998785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 msgr2=0x559d9856f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 -- 172.21.15.38:0/184998785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d98566e50 con 0x559d9816d9f0 2024-09-21T06:20:18.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96ce063640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.398+0000 7f96cd061640 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96b80040c0 tx=0x7f96b8003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b2fa8587f1809b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.399+0000 7f96b37fe640 1 -- 172.21.15.38:0/184998785 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8030040 con 0x559d9816d9f0 2024-09-21T06:20:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.399+0000 7f96b37fe640 1 -- 172.21.15.38:0/184998785 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b803b070 con 0x559d9816d9f0 2024-09-21T06:20:18.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.399+0000 7f96b37fe640 1 -- 172.21.15.38:0/184998785 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8036480 con 0x559d9816d9f0 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 msgr2=0x559d98566680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96b80040c0 tx=0x7f96b8003ec0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 shutdown_connections 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d9856f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d9816d9f0 0x559d98566680 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 --2- 172.21.15.38:0/184998785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d98142da0 0x559d985687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 >> 172.21.15.38:0/184998785 conn(0x559d981a3460 msgr2=0x559d985655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 shutdown_connections 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.400+0000 7f96d603a740 1 -- 172.21.15.38:0/184998785 wait complete. 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.401+0000 7f96d603a740 1 -- start start 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.401+0000 7f96d603a740 1 Processor -- start 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.401+0000 7f96d603a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d9816d9f0 0x559d98582670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d985764e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39564/0 (socket says 172.21.15.38:39564) 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 -- 172.21.15.38:0/2173216410 learned_addr learned my addr 172.21.15.38:0/2173216410 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80717b0 con 0x559d98142da0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8072c20 con 0x559d9818e390 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8071e80 con 0x559d9816d9f0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96d603a740 10 client.0 _ll_register_callbacks cb 0x7f96c0007b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd061640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d9816d9f0 0x559d98582670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96ce063640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d985764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 -- 172.21.15.38:0/2173216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d9816d9f0 msgr2=0x559d98582670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d9816d9f0 0x559d98582670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 -- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 msgr2=0x559d985764e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:18.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d985764e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96cd862640 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d98576ba0 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.402+0000 7f96ce063640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d985764e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96cd862640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f96c4105700 tx=0x7f96c40c9cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10caea48308ae3b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40f5070 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96c41058d0 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b803b070 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96c4049040 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96d603a740 10 client.15639 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559d98563190 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.403+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b803b070 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f96c403b460 con 0x559d98142da0 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 10 client.15639 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:18.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 20 client.15639 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d981af070 0x559d985637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 4 client.15639 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d984ca8a0 con 0x559d981af070 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96cd061640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d981af070 0x559d985637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.404+0000 7f96b17fa640 10 client.15639 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96cd061640 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d981af070 0x559d985637c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=431d58feeb074081 server_cookie=a7f8d10fe0ea581d in_seq=0 out_seq=0 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96b17fa640 1 -- 172.21.15.38:0/2173216410 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d984ca8a0 con 0x559d981af070 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96b17fa640 10 client.15639 handle_command_reply: tid=0 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 client.15639 shutdown 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 msgr2=0x559d985820f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f96c4105700 tx=0x7f96c40c9cd0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 shutdown_connections 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d981af070 0x559d985637c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d9818e390 0x559d985764e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d9816d9f0 0x559d98582670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96b17fa640 0 client.15639 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 --2- 172.21.15.38:0/2173216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d98142da0 0x559d985820f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 >> 172.21.15.38:0/2173216410 conn(0x559d981a3460 msgr2=0x559d9856f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 shutdown_connections 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.405+0000 7f96d603a740 1 -- 172.21.15.38:0/2173216410 wait complete. 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.406+0000 7f96d603a740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T06:20:18.413 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:18.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.406+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 msgr2=0x7f96b40b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.406+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 0x7f96b40b8cc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007f40 tx=0x7f96c0007520 comp rx=0 tx=0).stop 2024-09-21T06:20:18.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.406+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 msgr2=0x7f96c819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:18.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.406+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f96c40314b0 tx=0x7f96c4003c10 comp rx=0 tx=0).stop 2024-09-21T06:20:18.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 shutdown_connections 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b67b0 0x7f96b40b8cc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8108d20 0x7f96c819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c81083d0 0x7f96c819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 --2- 172.21.15.38:0/975615058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8102ae0 0x7f96c819a570 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 >> 172.21.15.38:0/975615058 conn(0x7f96c8079760 msgr2=0x7f96c81013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 shutdown_connections 2024-09-21T06:20:18.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:18.407+0000 7f96cfac6640 1 -- 172.21.15.38:0/975615058 wait complete. 2024-09-21T06:20:19.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:20:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:19 smithi038 ceph-mon[31215]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T06:20:19.494 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:19.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:19 smithi174 ceph-mon[34815]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T06:20:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:19 smithi044 ceph-mon[34369]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 -- 172.21.15.38:0/3720669794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528102a60 msgr2=0x7f2528102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 --2- 172.21.15.38:0/3720669794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528102a60 0x7f2528102e70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 -- 172.21.15.38:0/3720669794 shutdown_connections 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 --2- 172.21.15.38:0/3720669794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2528108cf0 0x7f252810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 --2- 172.21.15.38:0/3720669794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25281083a0 0x7f25281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 --2- 172.21.15.38:0/3720669794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528102a60 0x7f2528102e70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.021+0000 7f2530079640 1 -- 172.21.15.38:0/3720669794 >> 172.21.15.38:0/3720669794 conn(0x7f2528079730 msgr2=0x7f2528079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.022+0000 7f2530079640 1 -- 172.21.15.38:0/3720669794 shutdown_connections 2024-09-21T06:20:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.022+0000 7f2530079640 1 -- 172.21.15.38:0/3720669794 wait complete. 2024-09-21T06:20:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 Processor -- start 2024-09-21T06:20:20.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 -- start start 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25281083a0 0x7f252819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f252819fdf0 0x7f25281a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2528112ad0 con 0x7f2528108cf0 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2528112950 con 0x7f25281083a0 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f2530079640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2528112c50 con 0x7f252819fdf0 2024-09-21T06:20:20.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f252d614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f252d614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45948/0 (socket says 172.21.15.38:45948) 2024-09-21T06:20:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.023+0000 7f252d614640 1 -- 172.21.15.38:0/2453753640 learned_addr learned my addr 172.21.15.38:0/2453753640 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252e616640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f252819fdf0 0x7f25281a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 -- 172.21.15.38:0/2453753640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f252819fdf0 msgr2=0x7f25281a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f252819fdf0 0x7f25281a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 -- 172.21.15.38:0/2453753640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25281083a0 msgr2=0x7f252819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25281083a0 0x7f252819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 -- 172.21.15.38:0/2453753640 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25281a09d0 con 0x7f2528108cf0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f252d614640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f251800d770 tx=0x7f251800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f251effd640 1 -- 172.21.15.38:0/2453753640 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518017070 con 0x7f2528108cf0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f251effd640 1 -- 172.21.15.38:0/2453753640 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2518009c30 con 0x7f2528108cf0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.024+0000 7f251effd640 1 -- 172.21.15.38:0/2453753640 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800f620 con 0x7f2528108cf0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.025+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25281a6f70 con 0x7f2528108cf0 2024-09-21T06:20:20.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.025+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25281a7310 con 0x7f2528108cf0 2024-09-21T06:20:20.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.028+0000 7f251effd640 1 -- 172.21.15.38:0/2453753640 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f251801a070 con 0x7f2528108cf0 2024-09-21T06:20:20.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.028+0000 7f25365ed740 1 Processor -- start 2024-09-21T06:20:20.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 -- start start 2024-09-21T06:20:20.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c80f8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c80f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5565c806eea0 con 0x5565c7d30390 2024-09-21T06:20:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5565c805e2d0 con 0x5565c7d281b0 2024-09-21T06:20:20.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f25365ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5565c80620e0 con 0x5565c7d51070 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f252d614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c80f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f252e616640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f252e616640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60744/0 (socket says 172.21.15.38:60744) 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.029+0000 7f252e616640 1 -- 172.21.15.38:0/2673216233 learned_addr learned my addr 172.21.15.38:0/2673216233 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f252de15640 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c80f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f252e616640 1 -- 172.21.15.38:0/2673216233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 msgr2=0x5565c80f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f252e616640 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c80f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f252e616640 1 -- 172.21.15.38:0/2673216233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 msgr2=0x5565c80f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f251effd640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 0x7f25140b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.030+0000 7f251effd640 1 -- 172.21.15.38:0/2453753640 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f25180e6fa0 con 0x7f2528108cf0 2024-09-21T06:20:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f252de15640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 0x7f25140b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f252e616640 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c80f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f252e616640 1 -- 172.21.15.38:0/2673216233 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c7dbc650 con 0x5565c7d51070 2024-09-21T06:20:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f252d614640 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c80f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f252e616640 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25200103a0 tx=0x7f2520010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88b7952ff66b07a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.031+0000 7f2513fff640 1 -- 172.21.15.38:0/2673216233 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520016070 con 0x5565c7d51070 2024-09-21T06:20:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.032+0000 7f2513fff640 1 -- 172.21.15.38:0/2673216233 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2520004d20 con 0x5565c7d51070 2024-09-21T06:20:20.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.032+0000 7f2513fff640 1 -- 172.21.15.38:0/2673216233 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25200053c0 con 0x5565c7d51070 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 -- 172.21.15.38:0/2673216233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 msgr2=0x5565c80f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25200103a0 tx=0x7f2520010860 comp rx=0 tx=0).stop 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f252de15640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 0x7f25140b8ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2524009230 tx=0x7f2524000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 -- 172.21.15.38:0/2673216233 shutdown_connections 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c80f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c80f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 --2- 172.21.15.38:0/2673216233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c80f82c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 -- 172.21.15.38:0/2673216233 >> 172.21.15.38:0/2673216233 conn(0x5565c7d45460 msgr2=0x5565c80f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 -- 172.21.15.38:0/2673216233 shutdown_connections 2024-09-21T06:20:20.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.033+0000 7f25365ed740 1 -- 172.21.15.38:0/2673216233 wait complete. 2024-09-21T06:20:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.034+0000 7f25365ed740 1 -- start start 2024-09-21T06:20:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.034+0000 7f25365ed740 1 Processor -- start 2024-09-21T06:20:20.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c8107d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c8114130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5565c7ebf700 con 0x5565c7d30390 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f252d614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5565c7ff9160 con 0x5565c7d281b0 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45962/0 (socket says 172.21.15.38:45962) 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 -- 172.21.15.38:0/1548978825 learned_addr learned my addr 172.21.15.38:0/1548978825 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.035+0000 7f25365ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5565c810add0 con 0x5565c7d51070 2024-09-21T06:20:20.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252e616640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c8114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252de15640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c8107d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f25365ed740 10 client.0 _ll_register_callbacks cb 0x5565c80129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 -- 172.21.15.38:0/1548978825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 msgr2=0x5565c8114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c8114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 -- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 msgr2=0x5565c8107d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c8107d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.036+0000 7f252d614640 1 -- 172.21.15.38:0/1548978825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c8026c90 con 0x5565c7d30390 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f252d614640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2518000c00 tx=0x7f25180ea600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc438bfd9c2c91ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25117fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518021070 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f25180d00e0 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2520004d20 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f25180acad0 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25365ed740 10 client.15651 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.037+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565c8116ba0 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f25180ac810 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2518024060 con 0x5565c7d30390 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 10 client.15651 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:20.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 20 client.15651 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7d0f9f0 0x5565c811a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 4 client.15651 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.038+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2520004d20 con 0x5565c7d0f9f0 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.039+0000 7f252de15640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7d0f9f0 0x5565c811a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.039+0000 7f25117fa640 10 client.15651 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.039+0000 7f252de15640 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7d0f9f0 0x5565c811a100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4039338fd621307 server_cookie=29e3f8d2c43a529d in_seq=0 out_seq=0 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.040+0000 7f25117fa640 1 -- 172.21.15.38:0/1548978825 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2520004d20 con 0x5565c7d0f9f0 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.040+0000 7f25117fa640 10 client.15651 handle_command_reply: tid=0 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.040+0000 7f25365ed740 1 client.15651 shutdown 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.040+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 msgr2=0x5565c81082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.040+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2518000c00 tx=0x7f25180ea600 comp rx=0 tx=0).stop 2024-09-21T06:20:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 shutdown_connections 2024-09-21T06:20:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7d0f9f0 0x5565c811a100 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d51070 0x5565c8114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d30390 0x5565c81082d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 --2- 172.21.15.38:0/1548978825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d281b0 0x5565c8107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 >> 172.21.15.38:0/1548978825 conn(0x5565c7d45460 msgr2=0x5565c80fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25117fa640 0 client.15651 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 shutdown_connections 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 1 -- 172.21.15.38:0/1548978825 wait complete. 2024-09-21T06:20:20.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.041+0000 7f25365ed740 20 client.15651 trim_cache size 0 max 16384 2024-09-21T06:20:20.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 Processor -- start 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 -- start start 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c80fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c80f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f25281b0320 con 0x5565c7d51070 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25281adbf0 con 0x5565c7d30390 2024-09-21T06:20:20.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f25365ed740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25281aba40 con 0x5565c7d281b0 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f252de15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f252de15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60762/0 (socket says 172.21.15.38:60762) 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.068+0000 7f252de15640 1 -- 172.21.15.38:0/3968918587 learned_addr learned my addr 172.21.15.38:0/3968918587 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252d614640 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c80fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 -- 172.21.15.38:0/3968918587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 msgr2=0x5565c80fbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c80fbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 -- 172.21.15.38:0/3968918587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 msgr2=0x5565c80f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c80f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 -- 172.21.15.38:0/3968918587 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c8102a00 con 0x5565c7d281b0 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.069+0000 7f252de15640 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252403b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48d1bd2a60a2cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.070+0000 7f25137fe640 1 -- 172.21.15.38:0/3968918587 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524035050 con 0x5565c7d281b0 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.070+0000 7f25137fe640 1 -- 172.21.15.38:0/3968918587 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f25240046c0 con 0x5565c7d281b0 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.070+0000 7f25137fe640 1 -- 172.21.15.38:0/3968918587 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524032920 con 0x5565c7d281b0 2024-09-21T06:20:20.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 -- 172.21.15.38:0/3968918587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 msgr2=0x5565c8106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252403b000 comp rx=0 tx=0).stop 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 -- 172.21.15.38:0/3968918587 shutdown_connections 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c80f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c80fbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 --2- 172.21.15.38:0/3968918587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c8106c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 -- 172.21.15.38:0/3968918587 >> 172.21.15.38:0/3968918587 conn(0x5565c7d45460 msgr2=0x5565c80fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 -- 172.21.15.38:0/3968918587 shutdown_connections 2024-09-21T06:20:20.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.071+0000 7f25365ed740 1 -- 172.21.15.38:0/3968918587 wait complete. 2024-09-21T06:20:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.072+0000 7f25365ed740 1 -- start start 2024-09-21T06:20:20.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.072+0000 7f25365ed740 1 Processor -- start 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f25365ed740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c810c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f25365ed740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f25365ed740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f252de15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c810c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f252de15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c810c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60774/0 (socket says 172.21.15.38:60774) 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f252d614640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f252d614640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41638/0 (socket says 172.21.15.38:41638) 2024-09-21T06:20:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.073+0000 7f252e616640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252e616640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45976/0 (socket says 172.21.15.38:45976) 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252de15640 1 -- 172.21.15.38:0/1350181272 learned_addr learned my addr 172.21.15.38:0/1350181272 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f25281ac0b0 con 0x5565c7d51070 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25281ad520 con 0x5565c7d30390 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25281ac780 con 0x5565c7d281b0 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252d614640 1 -- 172.21.15.38:0/1350181272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 msgr2=0x5565c810c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252d614640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c810c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252d614640 1 -- 172.21.15.38:0/1350181272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 msgr2=0x5565c8183ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f25365ed740 10 client.0 _ll_register_callbacks cb 0x7f251800d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252d614640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252d614640 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c810d0c0 con 0x5565c7d30390 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f252e616640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.074+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565c8103940 con 0x5565c7d30390 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f252d614640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2518009610 tx=0x7f25180ac170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4830fda9f032131 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25117fa640 10 client.25334 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25117fa640 1 -- 172.21.15.38:0/1350181272 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518021070 con 0x5565c7d30390 2024-09-21T06:20:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25117fa640 1 -- 172.21.15.38:0/1350181272 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f25180d4180 con 0x5565c7d30390 2024-09-21T06:20:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25117fa640 1 -- 172.21.15.38:0/1350181272 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f25180e92d0 con 0x5565c7d30390 2024-09-21T06:20:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25365ed740 10 client.25334 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:20.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.075+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5565c8184f00 con 0x5565c7d30390 2024-09-21T06:20:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25117fa640 1 -- 172.21.15.38:0/1350181272 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2518092ad0 con 0x5565c7d30390 2024-09-21T06:20:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 10 client.25334 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 10 client.25334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 20 client.25334 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7ce4da0 0x5565c81875b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 4 client.25334 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565c8070df0 con 0x5565c7ce4da0 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.076+0000 7f252de15640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7ce4da0 0x5565c81875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25117fa640 10 client.25334 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f252de15640 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7ce4da0 0x5565c81875b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8a835a7f42b042 server_cookie=7c439c6204932209 in_seq=0 out_seq=0 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25117fa640 1 -- 172.21.15.38:0/1350181272 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565c8070df0 con 0x5565c7ce4da0 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25117fa640 10 client.25334 handle_command_reply: tid=0 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 client.25334 shutdown 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 msgr2=0x5565c810c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2518009610 tx=0x7f25180ac170 comp rx=0 tx=0).stop 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 shutdown_connections 2024-09-21T06:20:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5565c7d51070 0x5565c8183ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5565c7d30390 0x5565c810c870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5565c7ce4da0 0x5565c81875b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 --2- 172.21.15.38:0/1350181272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5565c7d281b0 0x5565c810c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25117fa640 0 client.25334 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 >> 172.21.15.38:0/1350181272 conn(0x5565c7d45460 msgr2=0x5565c8109240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 shutdown_connections 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.077+0000 7f25365ed740 1 -- 172.21.15.38:0/1350181272 wait complete. 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f25365ed740 20 client.25334 trim_cache size 0 max 16384 2024-09-21T06:20:20.081 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 msgr2=0x7f25140b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 0x7f25140b8ca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2524009230 tx=0x7f2524000bc0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 msgr2=0x7f252819ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f251800d770 tx=0x7f251800dc30 comp rx=0 tx=0).stop 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 shutdown_connections 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f25140b6790 0x7f25140b8ca0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f252819fdf0 0x7f25281a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2528108cf0 0x7f252819ac10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 --2- 172.21.15.38:0/2453753640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25281083a0 0x7f252819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.078+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 >> 172.21.15.38:0/2453753640 conn(0x7f2528079730 msgr2=0x7f2528101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.079+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 shutdown_connections 2024-09-21T06:20:20.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:20.079+0000 7f2530079640 1 -- 172.21.15.38:0/2453753640 wait complete. 2024-09-21T06:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/1701705571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b88108300 msgr2=0x7f7b88108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/1701705571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b88108300 0x7f7b88108710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009900 tx=0x7f7b7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/1701705571 shutdown_connections 2024-09-21T06:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/1701705571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b88108c50 0x7f7b8810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/1701705571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b88108300 0x7f7b88108710 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/1701705571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b881029d0 0x7f7b88102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/1701705571 >> 172.21.15.38:0/1701705571 conn(0x7f7b880fe3f0 msgr2=0x7f7b88100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/1701705571 shutdown_connections 2024-09-21T06:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.666+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/1701705571 wait complete. 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.667+0000 7f7b8d4c5640 1 Processor -- start 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 -- start start 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 0x7f7b8819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 0x7f7b8819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 0x7f7b881a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88113b20 con 0x7f7b8819fdf0 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881139a0 con 0x7f7b88108c50 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b8d4c5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7b88113ca0 con 0x7f7b881029d0 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 0x7f7b881a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 0x7f7b8819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b86ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 0x7f7b8819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.671 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 0x7f7b8819ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41656/0 (socket says 172.21.15.38:41656) 2024-09-21T06:20:20.671 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.668+0000 7f7b867fc640 1 -- 172.21.15.38:0/4224746174 learned_addr learned my addr 172.21.15.38:0/4224746174 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 -- 172.21.15.38:0/4224746174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 msgr2=0x7f7b8819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 0x7f7b8819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 -- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 msgr2=0x7f7b881a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 0x7f7b881a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 -- 172.21.15.38:0/4224746174 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b881a09d0 con 0x7f7b881029d0 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b877fe640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 0x7f7b881a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 0x7f7b8819a680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800e9f0 tx=0x7f7b7800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b6ffff640 1 -- 172.21.15.38:0/4224746174 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ccc0 con 0x7f7b881029d0 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b881a6f70 con 0x7f7b881029d0 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b6ffff640 1 -- 172.21.15.38:0/4224746174 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b78010900 con 0x7f7b881029d0 2024-09-21T06:20:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b6ffff640 1 -- 172.21.15.38:0/4224746174 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78018920 con 0x7f7b881029d0 2024-09-21T06:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.669+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b881a7320 con 0x7f7b881029d0 2024-09-21T06:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.672+0000 7f7b6ffff640 1 -- 172.21.15.38:0/4224746174 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f7b78010ab0 con 0x7f7b881029d0 2024-09-21T06:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 Processor -- start 2024-09-21T06:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 -- start start 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc7aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc7b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5589ccbef6f0 con 0x5589cc8b44d0 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5589ccbdeb20 con 0x5589cc8ac2f0 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.673+0000 7f7b94431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5589ccbe2930 con 0x5589cc8d51b0 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b6ffff640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 0x7f7b700b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc7b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60808/0 (socket says 172.21.15.38:60808) 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 -- 172.21.15.38:0/3112477116 learned_addr learned my addr 172.21.15.38:0/3112477116 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 0x7f7b700b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 -- 172.21.15.38:0/3112477116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 msgr2=0x5589ccc7aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc7aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 -- 172.21.15.38:0/3112477116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 msgr2=0x5589ccc7b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b6ffff640 1 -- 172.21.15.38:0/4224746174 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7b780e7b20 con 0x7f7b881029d0 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc7b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 -- 172.21.15.38:0/3112477116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ccba4530 con 0x5589cc8d51b0 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b867fc640 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc7b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.674+0000 7f7b877fe640 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b80012e20 tx=0x7f7b800147e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ce3ebea3bcf7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.675+0000 7f7b6d7fa640 1 -- 172.21.15.38:0/3112477116 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80012890 con 0x5589cc8d51b0 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.675+0000 7f7b877fe640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 0x7f7b700b8c20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b8001c000 tx=0x7f7b8001f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.675+0000 7f7b6d7fa640 1 -- 172.21.15.38:0/3112477116 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b8000ed70 con 0x5589cc8d51b0 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.675+0000 7f7b6d7fa640 1 -- 172.21.15.38:0/3112477116 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8001f630 con 0x5589cc8d51b0 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 -- 172.21.15.38:0/3112477116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 msgr2=0x5589ccc7a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7b80012e20 tx=0x7f7b800147e0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 -- 172.21.15.38:0/3112477116 shutdown_connections 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc7b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc7aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 --2- 172.21.15.38:0/3112477116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc7a9b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 -- 172.21.15.38:0/3112477116 >> 172.21.15.38:0/3112477116 conn(0x5589cc8c9300 msgr2=0x5589ccc788a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 -- 172.21.15.38:0/3112477116 shutdown_connections 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.676+0000 7f7b94431740 1 -- 172.21.15.38:0/3112477116 wait complete. 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 -- start start 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 Processor -- start 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc96820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46016/0 (socket says 172.21.15.38:46016) 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b867fc640 1 -- 172.21.15.38:0/1178189348 learned_addr learned my addr 172.21.15.38:0/1178189348 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5589ccb16ab0 con 0x5589cc8b44d0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5589ccb84730 con 0x5589cc8ac2f0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5589ccc8d4f0 con 0x5589cc8d51b0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.677+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b94431740 10 client.0 _ll_register_callbacks cb 0x5589ccbd86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b877fe640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc96820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 -- 172.21.15.38:0/1178189348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 msgr2=0x5589ccc96820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc96820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 -- 172.21.15.38:0/1178189348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 msgr2=0x5589ccc8abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589cc940790 con 0x5589cc8ac2f0 2024-09-21T06:20:20.681 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b867fc640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8a610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b780e5230 tx=0x7f7b780acf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ffbe9e227b014c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b780ad700 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7b780a9490 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b8000ed70 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b780ad0a0 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.678+0000 7f7b94431740 10 client.25343 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5589cc9b9620 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b8000ed70 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b780d4050 con 0x5589cc8ac2f0 2024-09-21T06:20:20.684 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 10 client.25343 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 10 client.25343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 20 client.25343 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc893d80 0x5589ccc9c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 4 client.25343 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589ccbf1640 con 0x5589cc893d80 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.679+0000 7f7b867fc640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc893d80 0x5589ccc9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.680+0000 7f7b6aff5640 10 client.25343 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.680+0000 7f7b867fc640 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc893d80 0x5589ccc9c680 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd93654339a63ed server_cookie=9c1f9ceece7415c6 in_seq=0 out_seq=0 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b6aff5640 1 -- 172.21.15.38:0/1178189348 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589ccbf1640 con 0x5589cc893d80 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b6aff5640 10 client.25343 handle_command_reply: tid=0 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 client.25343 shutdown 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 msgr2=0x5589ccc8a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8a610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b780e5230 tx=0x7f7b780acf60 comp rx=0 tx=0).stop 2024-09-21T06:20:20.685 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 shutdown_connections 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc893d80 0x5589ccc9c680 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc8d51b0 0x5589ccc96820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8b44d0 0x5589ccc8abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b6aff5640 0 client.25343 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 --2- 172.21.15.38:0/1178189348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8a610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 >> 172.21.15.38:0/1178189348 conn(0x5589cc8c9300 msgr2=0x5589ccc76ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 shutdown_connections 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 1 -- 172.21.15.38:0/1178189348 wait complete. 2024-09-21T06:20:20.686 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.681+0000 7f7b94431740 20 client.25343 trim_cache size 0 max 16384 2024-09-21T06:20:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 Processor -- start 2024-09-21T06:20:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 -- start start 2024-09-21T06:20:20.698 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881b03b0 con 0x5589cc8ac2f0 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.696+0000 7f7b94431740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881adc80 con 0x5589cc8b44d0 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b94431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881abad0 con 0x5589cc893d80 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46030/0 (socket says 172.21.15.38:46030) 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 -- 172.21.15.38:0/743550990 learned_addr learned my addr 172.21.15.38:0/743550990 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b877fe640 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 -- 172.21.15.38:0/743550990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 msgr2=0x5589ccc775b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc775b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 -- 172.21.15.38:0/743550990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 msgr2=0x5589ccc96c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc96c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 -- 172.21.15.38:0/743550990 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ccc72bd0 con 0x5589cc8ac2f0 2024-09-21T06:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b867fc640 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c005940 tx=0x7f7b7c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a36f6c274299abc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.697+0000 7f7b6cff9640 1 -- 172.21.15.38:0/743550990 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c049030 con 0x5589cc8ac2f0 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.698+0000 7f7b6cff9640 1 -- 172.21.15.38:0/743550990 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b7c031860 con 0x5589cc8ac2f0 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.698+0000 7f7b6cff9640 1 -- 172.21.15.38:0/743550990 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c035040 con 0x5589cc8ac2f0 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.698+0000 7f7b94431740 1 -- 172.21.15.38:0/743550990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 msgr2=0x5589ccc96720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.698+0000 7f7b94431740 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c005940 tx=0x7f7b7c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- 172.21.15.38:0/743550990 shutdown_connections 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc96720 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- 172.21.15.38:0/743550990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc775b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- 172.21.15.38:0/743550990 >> 172.21.15.38:0/743550990 conn(0x5589cc8c9300 msgr2=0x5589ccc76ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- 172.21.15.38:0/743550990 shutdown_connections 2024-09-21T06:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- 172.21.15.38:0/743550990 wait complete. 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- start start 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 Processor -- start 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc92d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc8e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881ac140 con 0x5589cc8ac2f0 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881ad5b0 con 0x5589cc8b44d0 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7b881ac810 con 0x5589cc893d80 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.699+0000 7f7b94431740 10 client.0 _ll_register_callbacks cb 0x7f7b780e50c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46042/0 (socket says 172.21.15.38:46042) 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 -- 172.21.15.38:0/3841658024 learned_addr learned my addr 172.21.15.38:0/3841658024 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b877fe640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc8e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 -- 172.21.15.38:0/3841658024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 msgr2=0x5589ccc92d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc92d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc92d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 -- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 msgr2=0x5589ccc8e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc8e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 -- 172.21.15.38:0/3841658024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ccc8ec80 con 0x5589cc8ac2f0 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b877fe640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc8e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b867fc640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806767c68800e222 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.700+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c049030 con 0x5589cc8ac2f0 2024-09-21T06:20:20.705 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7b7c04e440 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7c031860 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b7c035040 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 10 client.15672 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5589ccd06c80 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b7c031860 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b7c03c820 con 0x5589cc8ac2f0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 10 client.15672 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 10 client.15672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 20 client.15672 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc8d51b0 0x5589ccd09340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 4 client.15672 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.701+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589ccbed0f0 con 0x5589cc8d51b0 2024-09-21T06:20:20.706 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.702+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc8d51b0 0x5589ccd09340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.702+0000 7f7b6aff5640 10 client.15672 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.707 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.702+0000 7f7b86ffd640 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc8d51b0 0x5589ccd09340 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eac378b3e363b01 server_cookie=6b90354762f4b3bf in_seq=0 out_seq=0 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b6aff5640 1 -- 172.21.15.38:0/3841658024 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589ccbed0f0 con 0x5589cc8d51b0 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b6aff5640 10 client.15672 handle_command_reply: tid=0 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 client.15672 shutdown 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 msgr2=0x5589ccc8e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009230 tx=0x7f7b7c0095d0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 shutdown_connections 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589cc8b44d0 0x5589ccc8e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589cc8ac2f0 0x5589ccc8e1d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5589cc8d51b0 0x5589ccd09340 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 --2- 172.21.15.38:0/3841658024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589cc893d80 0x5589ccc92d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 >> 172.21.15.38:0/3841658024 conn(0x5589cc8c9300 msgr2=0x5589ccc781a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.710+0000 7f7b6aff5640 0 client.15672 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 shutdown_connections 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b94431740 1 -- 172.21.15.38:0/3841658024 wait complete. 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b94431740 20 client.15672 trim_cache size 0 max 16384 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:20:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:20:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 msgr2=0x7f7b700b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 0x7f7b700b8c20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b8001c000 tx=0x7f7b8001f000 comp rx=0 tx=0).stop 2024-09-21T06:20:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 msgr2=0x7f7b8819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 0x7f7b8819a680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800e9f0 tx=0x7f7b7800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 shutdown_connections 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7b700b6710 0x7f7b700b8c20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b8819fdf0 0x7f7b881a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b88108c50 0x7f7b8819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 --2- 172.21.15.38:0/4224746174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b881029d0 0x7f7b8819a680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 >> 172.21.15.38:0/4224746174 conn(0x7f7b880fe3f0 msgr2=0x7f7b88100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 shutdown_connections 2024-09-21T06:20:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:20.711+0000 7f7b8d4c5640 1 -- 172.21.15.38:0/4224746174 wait complete. 2024-09-21T06:20:21.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:21 smithi174 ceph-mon[34815]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:21 smithi044 ceph-mon[34369]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:21 smithi038 ceph-mon[31215]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:21.795 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:20:21.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:20:22.198 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:22.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 -- 172.21.15.38:0/941513778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 msgr2=0x7ffbec107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/941513778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec107f40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009900 tx=0x7ffbd802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 -- 172.21.15.38:0/941513778 shutdown_connections 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/941513778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/941513778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec107f40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/941513778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 0x7ffbec102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.751+0000 7ffbf2a73640 1 -- 172.21.15.38:0/941513778 >> 172.21.15.38:0/941513778 conn(0x7ffbec077c60 msgr2=0x7ffbec0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.752+0000 7ffbf2a73640 1 -- 172.21.15.38:0/941513778 shutdown_connections 2024-09-21T06:20:22.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.752+0000 7ffbf2a73640 1 -- 172.21.15.38:0/941513778 wait complete. 2024-09-21T06:20:22.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.753+0000 7ffbf2a73640 1 Processor -- start 2024-09-21T06:20:22.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.753+0000 7ffbf2a73640 1 -- start start 2024-09-21T06:20:22.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 0x7ffbec19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec113c70 con 0x7ffbec107b30 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec113af0 con 0x7ffbec1021f0 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf2a73640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec113df0 con 0x7ffbec108480 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 0x7ffbec19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf1010640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf1010640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60846/0 (socket says 172.21.15.38:60846) 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.754+0000 7ffbf1010640 1 -- 172.21.15.38:0/2240085415 learned_addr learned my addr 172.21.15.38:0/2240085415 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:22.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbebfff640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 -- 172.21.15.38:0/2240085415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 msgr2=0x7ffbec19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 0x7ffbec19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 -- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 msgr2=0x7ffbec19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 -- 172.21.15.38:0/2240085415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec1a0590 con 0x7ffbec108480 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbebfff640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:22.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.755+0000 7ffbf1010640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009fd0 tx=0x7ffbe400def0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.756+0000 7ffbe9ffb640 1 -- 172.21.15.38:0/2240085415 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4018070 con 0x7ffbec108480 2024-09-21T06:20:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.756+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec1a0880 con 0x7ffbec108480 2024-09-21T06:20:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.756+0000 7ffbe9ffb640 1 -- 172.21.15.38:0/2240085415 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe4003e40 con 0x7ffbec108480 2024-09-21T06:20:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.756+0000 7ffbe9ffb640 1 -- 172.21.15.38:0/2240085415 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4004280 con 0x7ffbec108480 2024-09-21T06:20:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.756+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec110300 con 0x7ffbec108480 2024-09-21T06:20:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.759+0000 7ffbf8fe7740 1 Processor -- start 2024-09-21T06:20:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.760+0000 7ffbe9ffb640 1 -- 172.21.15.38:0/2240085415 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7ffbe4004420 con 0x7ffbec108480 2024-09-21T06:20:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 -- start start 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2d3670 0x56046d69beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56046d611e60 con 0x56046d2f4350 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56046d601290 con 0x56046d2cb490 2024-09-21T06:20:22.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56046d6050a0 con 0x56046d2d3670 2024-09-21T06:20:22.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.761+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41716/0 (socket says 172.21.15.38:41716) 2024-09-21T06:20:22.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 -- 172.21.15.38:0/3364320641 learned_addr learned my addr 172.21.15.38:0/3364320641 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:22.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbe9ffb640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 0x7ffbdc0b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf1010640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 0x7ffbdc0b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 -- 172.21.15.38:0/3364320641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2d3670 msgr2=0x56046d69beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2d3670 0x56046d69beb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 -- 172.21.15.38:0/3364320641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 msgr2=0x56046d69b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbe9ffb640 1 -- 172.21.15.38:0/2240085415 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffbe40eb700 con 0x7ffbec108480 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.762+0000 7ffbf080f640 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbf080f640 1 -- 172.21.15.38:0/3364320641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046d35f930 con 0x56046d2cb490 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbf1010640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 0x7ffbdc0b8ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40e8e70 tx=0x7ffbe4018000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbf080f640 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009a70 tx=0x7ffbe0009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484ee887c7cdde6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:22.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3364320641 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0017070 con 0x56046d2cb490 2024-09-21T06:20:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3364320641 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe0013470 con 0x56046d2cb490 2024-09-21T06:20:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.763+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3364320641 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0012630 con 0x56046d2cb490 2024-09-21T06:20:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.764+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3364320641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 msgr2=0x56046d69b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.764+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009a70 tx=0x7ffbe0009f30 comp rx=0 tx=0).stop 2024-09-21T06:20:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3364320641 shutdown_connections 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2d3670 0x56046d69beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d69b970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3364320641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3364320641 >> 172.21.15.38:0/3364320641 conn(0x56046d2e8740 msgr2=0x56046d699320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3364320641 shutdown_connections 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3364320641 wait complete. 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 -- start start 2024-09-21T06:20:22.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.765+0000 7ffbf8fe7740 1 Processor -- start 2024-09-21T06:20:22.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d6af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d6afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d6bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d6af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbebfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d6af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60854/0 (socket says 172.21.15.38:60854) 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.766+0000 7ffbebfff640 1 -- 172.21.15.38:0/1237220911 learned_addr learned my addr 172.21.15.38:0/1237220911 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d6afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56046d462890 con 0x56046d2f4350 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56046d59bd40 con 0x56046d2d3670 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56046d6b2340 con 0x56046d2cb490 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbebfff640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d6bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf8fe7740 10 client.0 _ll_register_callbacks cb 0x56046d5ffc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 -- 172.21.15.38:0/1237220911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 msgr2=0x56046d6af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d6af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 -- 172.21.15.38:0/1237220911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 msgr2=0x56046d6bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d6bb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.767+0000 7ffbf080f640 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046d6bbcb0 con 0x56046d2d3670 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.768+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d6afe00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0019000 tx=0x7ffbe00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698d74f765c02a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.768+0000 7ffbcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.768+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0017040 con 0x56046d2d3670 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.768+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe0013470 con 0x56046d2d3670 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.768+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffbe001c450 con 0x56046d2d3670 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffbe000ee50 con 0x56046d2d3670 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 10 client.25358 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:22.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56046d6be560 con 0x56046d2d3670 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe001cb20 con 0x56046d2d3670 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe0023070 con 0x56046d2d3670 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 10 client.25358 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 20 client.25358 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d2b2cd0 0x56046d6c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 4 client.25358 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.769+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffbe0013470 con 0x56046d2b2cd0 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.770+0000 7ffbebfff640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d2b2cd0 0x56046d6c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.770+0000 7ffbcbfff640 10 client.25358 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:22.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.770+0000 7ffbebfff640 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d2b2cd0 0x56046d6c1b70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed55e2a68dd27d36 server_cookie=fa376516acc1d072 in_seq=0 out_seq=0 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.771+0000 7ffbcbfff640 1 -- 172.21.15.38:0/1237220911 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ffbe0013470 con 0x56046d2b2cd0 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.771+0000 7ffbcbfff640 10 client.25358 handle_command_reply: tid=0 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.771+0000 7ffbf8fe7740 1 client.25358 shutdown 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 msgr2=0x56046d6afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d6afe00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0019000 tx=0x7ffbe00046c0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 shutdown_connections 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d6bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d6afe00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d2b2cd0 0x56046d6c1b70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1237220911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d6af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 >> 172.21.15.38:0/1237220911 conn(0x56046d2e8740 msgr2=0x56046d697850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbcbfff640 0 client.25358 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:22.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 shutdown_connections 2024-09-21T06:20:22.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1237220911 wait complete. 2024-09-21T06:20:22.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.772+0000 7ffbf8fe7740 20 client.25358 trim_cache size 0 max 16384 2024-09-21T06:20:22.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.808+0000 7ffbf8fe7740 1 Processor -- start 2024-09-21T06:20:22.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.808+0000 7ffbf8fe7740 1 -- start start 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d697850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2f4350 0x56046d6ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1afef0 con 0x56046d2d3670 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1ad7c0 con 0x56046d2cb490 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1ab610 con 0x56046d2f4350 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46074/0 (socket says 172.21.15.38:46074) 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.809+0000 7ffbf080f640 1 -- 172.21.15.38:0/1695219408 learned_addr learned my addr 172.21.15.38:0/1695219408 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbebfff640 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d697850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbebfff640 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2f4350 0x56046d6ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 -- 172.21.15.38:0/1695219408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2f4350 msgr2=0x56046d6ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2f4350 0x56046d6ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 -- 172.21.15.38:0/1695219408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 msgr2=0x56046d697850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d697850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 -- 172.21.15.38:0/1695219408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56046d6b0920 con 0x56046d2d3670 2024-09-21T06:20:22.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.810+0000 7ffbf080f640 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0024c60 tx=0x7ffbe00098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac0c3ee5fff1f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.811+0000 7ffbd67fc640 1 -- 172.21.15.38:0/1695219408 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0032020 con 0x56046d2d3670 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.811+0000 7ffbd67fc640 1 -- 172.21.15.38:0/1695219408 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe0024e60 con 0x56046d2d3670 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.811+0000 7ffbd67fc640 1 -- 172.21.15.38:0/1695219408 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0017040 con 0x56046d2d3670 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1695219408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 msgr2=0x56046d697d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0024c60 tx=0x7ffbe00098f0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1695219408 shutdown_connections 2024-09-21T06:20:22.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2f4350 0x56046d6ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2d3670 0x56046d697d90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/1695219408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2cb490 0x56046d697850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.812+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1695219408 >> 172.21.15.38:0/1695219408 conn(0x56046d2e8740 msgr2=0x56046d6adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.813+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1695219408 shutdown_connections 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.813+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/1695219408 wait complete. 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.813+0000 7ffbf8fe7740 1 -- start start 2024-09-21T06:20:22.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 Processor -- start 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d69b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d69b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1abc80 con 0x56046d2f4350 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1ad0f0 con 0x56046d2d3670 2024-09-21T06:20:22.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.814+0000 7ffbf8fe7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec1ac350 con 0x56046d2cb490 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbf8fe7740 10 client.0 _ll_register_callbacks cb 0x7ffbe0013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d69b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbf080f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d69b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41750/0 (socket says 172.21.15.38:41750) 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbf080f640 1 -- 172.21.15.38:0/3043113760 learned_addr learned my addr 172.21.15.38:0/3043113760 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d69b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 -- 172.21.15.38:0/3043113760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 msgr2=0x56046d69b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d69b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 -- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 msgr2=0x56046d69b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d69b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.815+0000 7ffbebfff640 1 -- 172.21.15.38:0/3043113760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046d6b6cc0 con 0x56046d2f4350 2024-09-21T06:20:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.816+0000 7ffbebfff640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69bda0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000c00 tx=0x7ffbd8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195947808365c84c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.816+0000 7ffbcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8035040 con 0x56046d2f4350 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffbd804bf90 con 0x56046d2f4350 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe0024e60 con 0x56046d2f4350 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffbd80048b0 con 0x56046d2f4350 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbf8fe7740 10 client.15690 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.817+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56046d72c7a0 con 0x56046d2f4350 2024-09-21T06:20:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe0024e60 con 0x56046d2f4350 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffbd805e070 con 0x56046d2f4350 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 10 client.15690 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 20 client.15690 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d288080 0x56046d72ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 4 client.15690 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56046d613db0 con 0x56046d288080 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.818+0000 7ffbf080f640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d288080 0x56046d72ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:22.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.819+0000 7ffbcbfff640 10 client.15690 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:22.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.819+0000 7ffbf080f640 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d288080 0x56046d72ef60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c786cb01a6f8471 server_cookie=553f414002b10e6 in_seq=0 out_seq=0 2024-09-21T06:20:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbcbfff640 1 -- 172.21.15.38:0/3043113760 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56046d613db0 con 0x56046d288080 2024-09-21T06:20:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbcbfff640 10 client.15690 handle_command_reply: tid=0 2024-09-21T06:20:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 client.15690 shutdown 2024-09-21T06:20:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 msgr2=0x56046d69bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69bda0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000c00 tx=0x7ffbd8009560 comp rx=0 tx=0).stop 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 shutdown_connections 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56046d2f4350 0x56046d69bda0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56046d2d3670 0x56046d69b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56046d288080 0x56046d72ef60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 --2- 172.21.15.38:0/3043113760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56046d2cb490 0x56046d69b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 >> 172.21.15.38:0/3043113760 conn(0x56046d2e8740 msgr2=0x56046d69c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbcbfff640 0 client.15690 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 shutdown_connections 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.821+0000 7ffbf8fe7740 1 -- 172.21.15.38:0/3043113760 wait complete. 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.822+0000 7ffbf8fe7740 20 client.15690 trim_cache size 0 max 16384 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:20:22.824 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:20:22.825 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a731b352-00be-4974-8b5a-144773b28336", 2024-09-21T06:20:22.825 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:20:22.825 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.822+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 msgr2=0x7ffbdc0b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.822+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 0x7ffbdc0b8ca0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40e8e70 tx=0x7ffbe4018000 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 msgr2=0x7ffbec19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009fd0 tx=0x7ffbe400def0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 shutdown_connections 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbdc0b6790 0x7ffbdc0b8ca0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbec108480 0x7ffbec19fe60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbec107b30 0x7ffbec19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 --2- 172.21.15.38:0/2240085415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbec1021f0 0x7ffbec19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:22.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 >> 172.21.15.38:0/2240085415 conn(0x7ffbec077c60 msgr2=0x7ffbec105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:22.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 shutdown_connections 2024-09-21T06:20:22.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:22.823+0000 7ffbf2a73640 1 -- 172.21.15.38:0/2240085415 wait complete. 2024-09-21T06:20:23.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:20:23.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T06:20:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:20:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:20:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:23 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:20:23.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T06:20:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:20:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:20:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:23 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:20:23.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-21T06:20:23.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:20:23.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:20:23.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:23.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:23 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:20:23.779 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 -- 172.21.15.38:0/3160904773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 msgr2=0x7fe77810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/3160904773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe77810f520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe770009ca0 tx=0x7fe77002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 -- 172.21.15.38:0/3160904773 shutdown_connections 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/3160904773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe77810f520 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/3160904773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 0x7fe7781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/3160904773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778102a60 0x7fe778102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 -- 172.21.15.38:0/3160904773 >> 172.21.15.38:0/3160904773 conn(0x7fe778079730 msgr2=0x7fe778079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 -- 172.21.15.38:0/3160904773 shutdown_connections 2024-09-21T06:20:24.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.322+0000 7fe77d3d8640 1 -- 172.21.15.38:0/3160904773 wait complete. 2024-09-21T06:20:24.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.324+0000 7fe77d3d8640 1 Processor -- start 2024-09-21T06:20:24.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.324+0000 7fe77d3d8640 1 -- start start 2024-09-21T06:20:24.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778102a60 0x7fe778114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 0x7fe7781133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe778112ad0 con 0x7fe778108cf0 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe778112950 con 0x7fe7781083a0 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe77d3d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe778112c50 con 0x7fe778102a60 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 0x7fe7781133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46104/0 (socket says 172.21.15.38:46104) 2024-09-21T06:20:24.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.325+0000 7fe7777fe640 1 -- 172.21.15.38:0/76983319 learned_addr learned my addr 172.21.15.38:0/76983319 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 -- 172.21.15.38:0/76983319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778102a60 msgr2=0x7fe778114dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778102a60 0x7fe778114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 -- 172.21.15.38:0/76983319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 msgr2=0x7fe7781133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 0x7fe7781133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 -- 172.21.15.38:0/76983319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe778114110 con 0x7fe778108cf0 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe7777fe640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe770005e30 tx=0x7fe770003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe774ff9640 1 -- 172.21.15.38:0/76983319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770031790 con 0x7fe778108cf0 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7781ace60 con 0x7fe778108cf0 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe774ff9640 1 -- 172.21.15.38:0/76983319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe770031930 con 0x7fe778108cf0 2024-09-21T06:20:24.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe774ff9640 1 -- 172.21.15.38:0/76983319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77002fbe0 con 0x7fe778108cf0 2024-09-21T06:20:24.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.326+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781ad3c0 con 0x7fe778108cf0 2024-09-21T06:20:24.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.331+0000 7fe78394c740 1 Processor -- start 2024-09-21T06:20:24.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.331+0000 7fe774ff9640 1 -- 172.21.15.38:0/76983319 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fe770004040 con 0x7fe778108cf0 2024-09-21T06:20:24.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.331+0000 7fe78394c740 1 -- start start 2024-09-21T06:20:24.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149baf0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149baf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56149ba66e50 con 0x56149b7201b0 2024-09-21T06:20:24.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56149ba56280 con 0x56149b728390 2024-09-21T06:20:24.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.332+0000 7fe78394c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56149ba5a090 con 0x56149b749070 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46110/0 (socket says 172.21.15.38:46110) 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 -- 172.21.15.38:0/3638051033 learned_addr learned my addr 172.21.15.38:0/3638051033 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe76ffff640 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149baf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe76ffff640 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149baf0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 -- 172.21.15.38:0/3638051033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 msgr2=0x56149baf0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149baf0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 -- 172.21.15.38:0/3638051033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 msgr2=0x56149baf0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149baf0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 -- 172.21.15.38:0/3638051033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149b7b4650 con 0x56149b7201b0 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.333+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe768009b20 tx=0x7fe76800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829c32f5af3cacfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.334+0000 7fe774ff9640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 0x7fe7640b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.334+0000 7fe76d7fa640 1 -- 172.21.15.38:0/3638051033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ed80 con 0x56149b7201b0 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.334+0000 7fe76d7fa640 1 -- 172.21.15.38:0/3638051033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7680035f0 con 0x56149b7201b0 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.334+0000 7fe76d7fa640 1 -- 172.21.15.38:0/3638051033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680186d0 con 0x56149b7201b0 2024-09-21T06:20:24.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.334+0000 7fe774ff9640 1 -- 172.21.15.38:0/76983319 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe770108b80 con 0x7fe778108cf0 2024-09-21T06:20:24.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe76ffff640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 0x7fe7640b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 -- 172.21.15.38:0/3638051033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 msgr2=0x56149baf07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe76ffff640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 0x7fe7640b8ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe778079db0 tx=0x7fe7600046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe768009b20 tx=0x7fe76800e350 comp rx=0 tx=0).stop 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 -- 172.21.15.38:0/3638051033 shutdown_connections 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149baf0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7201b0 0x56149baf07b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 --2- 172.21.15.38:0/3638051033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149baf0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.335+0000 7fe78394c740 1 -- 172.21.15.38:0/3638051033 >> 172.21.15.38:0/3638051033 conn(0x56149b73d460 msgr2=0x56149baee160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.336+0000 7fe78394c740 1 -- 172.21.15.38:0/3638051033 shutdown_connections 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.336+0000 7fe78394c740 1 -- 172.21.15.38:0/3638051033 wait complete. 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.336+0000 7fe78394c740 1 -- start start 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.336+0000 7fe78394c740 1 Processor -- start 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149bafba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 0x56149bafbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56149b8b7700 con 0x56149b749070 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56149b9f1110 con 0x56149b728390 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56149bafea50 con 0x56149b7079f0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 0x56149bafbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe78394c740 10 client.0 _ll_register_callbacks cb 0x56149ba0a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60902/0 (socket says 172.21.15.38:60902) 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 -- 172.21.15.38:0/3340322486 learned_addr learned my addr 172.21.15.38:0/3340322486 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149bafba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 -- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 msgr2=0x56149bafba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149bafba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 -- 172.21.15.38:0/3340322486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 msgr2=0x56149bafbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 0x56149bafbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe7777fe640 1 -- 172.21.15.38:0/3340322486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149ba1ec40 con 0x56149b7079f0 2024-09-21T06:20:24.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.337+0000 7fe76ffff640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 0x56149bafbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe7777fe640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe77002f540 tx=0x7fe7700ce230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360931f053373bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe75e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7700cefe0 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe770106540 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7680035f0 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe7700e9050 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe78394c740 10 client.25336 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.338+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56149bb1b870 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe770036030 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe7700f4020 con 0x56149b7079f0 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 10 client.25336 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 10 client.25336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 20 client.25336 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149b6dcda0 0x56149bb1ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 4 client.25336 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:24.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.339+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe7680035f0 con 0x56149b6dcda0 2024-09-21T06:20:24.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.340+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149b6dcda0 0x56149bb1ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.341+0000 7fe776ffd640 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149b6dcda0 0x56149bb1ed80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b5612f9f298ce8d server_cookie=9ad5c7a3a6f70bc6 in_seq=0 out_seq=0 2024-09-21T06:20:24.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.341+0000 7fe75e7fc640 10 client.25336 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.341+0000 7fe75e7fc640 1 -- 172.21.15.38:0/3340322486 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe7680035f0 con 0x56149b6dcda0 2024-09-21T06:20:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.341+0000 7fe75e7fc640 10 client.25336 handle_command_reply: tid=0 2024-09-21T06:20:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.341+0000 7fe78394c740 1 client.25336 shutdown 2024-09-21T06:20:24.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 msgr2=0x56149bb18d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe77002f540 tx=0x7fe7700ce230 comp rx=0 tx=0).stop 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 shutdown_connections 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149b6dcda0 0x56149bb1ed80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b7079f0 0x56149bb18d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b749070 0x56149bafbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 --2- 172.21.15.38:0/3340322486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b728390 0x56149bafba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 >> 172.21.15.38:0/3340322486 conn(0x56149b73d460 msgr2=0x56149baf3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.342+0000 7fe75e7fc640 0 client.25336 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.343+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 shutdown_connections 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.343+0000 7fe78394c740 1 -- 172.21.15.38:0/3340322486 wait complete. 2024-09-21T06:20:24.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.343+0000 7fe78394c740 20 client.25336 trim_cache size 0 max 16384 2024-09-21T06:20:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 Processor -- start 2024-09-21T06:20:24.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 -- start start 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 0x56149baf38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b749070 0x56149baf8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe77806f4d0 con 0x56149b7079f0 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe77806cde0 con 0x56149b749070 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe78394c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe778102e70 con 0x56149b728390 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe776ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe776ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46138/0 (socket says 172.21.15.38:46138) 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.379+0000 7fe776ffd640 1 -- 172.21.15.38:0/5429703 learned_addr learned my addr 172.21.15.38:0/5429703 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe76ffff640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 0x56149baf38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe7777fe640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b749070 0x56149baf8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 -- 172.21.15.38:0/5429703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 msgr2=0x56149baf38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 0x56149baf38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 -- 172.21.15.38:0/5429703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b749070 msgr2=0x56149baf8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b749070 0x56149baf8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 -- 172.21.15.38:0/5429703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149baf72c0 con 0x56149b7079f0 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe76ffff640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 0x56149baf38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.380+0000 7fe776ffd640 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe768009af0 tx=0x7fe768009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd512525bf7b04f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.381+0000 7fe76cff9640 1 -- 172.21.15.38:0/5429703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76800ee80 con 0x56149b7079f0 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.381+0000 7fe76cff9640 1 -- 172.21.15.38:0/5429703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe768004510 con 0x56149b7079f0 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.381+0000 7fe76cff9640 1 -- 172.21.15.38:0/5429703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768004a00 con 0x56149b7079f0 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 -- 172.21.15.38:0/5429703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 msgr2=0x56149baf3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe768009af0 tx=0x7fe768009730 comp rx=0 tx=0).stop 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 -- 172.21.15.38:0/5429703 shutdown_connections 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b749070 0x56149baf8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b728390 0x56149baf38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 --2- 172.21.15.38:0/5429703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b7079f0 0x56149baf3370 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 -- 172.21.15.38:0/5429703 >> 172.21.15.38:0/5429703 conn(0x56149b73d460 msgr2=0x56149bafa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 -- 172.21.15.38:0/5429703 shutdown_connections 2024-09-21T06:20:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.382+0000 7fe78394c740 1 -- 172.21.15.38:0/5429703 wait complete. 2024-09-21T06:20:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe78394c740 1 -- start start 2024-09-21T06:20:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe78394c740 1 Processor -- start 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe78394c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 0x56149bb153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe78394c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe78394c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149bb10dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.383+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe76ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46152/0 (socket says 172.21.15.38:46152) 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe76ffff640 1 -- 172.21.15.38:0/4189969115 learned_addr learned my addr 172.21.15.38:0/4189969115 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781a51c0 con 0x56149b728390 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781a6630 con 0x56149b7079f0 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe7781a5890 con 0x56149b749070 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe7777fe640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149bb10dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 0x56149bb153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 -- 172.21.15.38:0/4189969115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 msgr2=0x56149bb10dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149bb10dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 -- 172.21.15.38:0/4189969115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 msgr2=0x56149bb10890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe776ffd640 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149bb11410 con 0x56149b7079f0 2024-09-21T06:20:24.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.384+0000 7fe76ffff640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe776ffd640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 0x56149bb153e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7680092e0 tx=0x7fe76800e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598865e2ad91ff0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe78394c740 10 client.0 _ll_register_callbacks cb 0x7fe770106120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe75e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe768004510 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe75e7fc640 1 -- 172.21.15.38:0/4189969115 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768004040 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe75e7fc640 1 -- 172.21.15.38:0/4189969115 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe7680041e0 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe75e7fc640 1 -- 172.21.15.38:0/4189969115 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe7680035f0 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe78394c740 10 client.25382 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.385+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56149bb891d0 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe75e7fc640 1 -- 172.21.15.38:0/4189969115 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe768003790 con 0x56149b7079f0 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 10 client.25382 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 10 client.25382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 20 client.25382 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:24.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149bb896a0 0x56149bb8bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 4 client.25382 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56149ba68da0 con 0x56149bb896a0 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.386+0000 7fe76ffff640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149bb896a0 0x56149bb8bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe75e7fc640 10 client.25382 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe76ffff640 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149bb896a0 0x56149bb8bb50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3c5d548b38ff75 server_cookie=9f15cb6e2368c82b in_seq=0 out_seq=0 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe75e7fc640 1 -- 172.21.15.38:0/4189969115 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x56149ba68da0 con 0x56149bb896a0 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe75e7fc640 10 client.25382 handle_command_reply: tid=0 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 client.25382 shutdown 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 msgr2=0x56149bb153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 0x56149bb153e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7680092e0 tx=0x7fe76800e990 comp rx=0 tx=0).stop 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 shutdown_connections 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56149bb896a0 0x56149bb8bb50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56149b749070 0x56149bb10dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56149b728390 0x56149bb10890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 --2- 172.21.15.38:0/4189969115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56149b7079f0 0x56149bb153e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 >> 172.21.15.38:0/4189969115 conn(0x56149b73d460 msgr2=0x56149baf3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe75e7fc640 0 client.25382 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.387+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 shutdown_connections 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe78394c740 1 -- 172.21.15.38:0/4189969115 wait complete. 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe78394c740 20 client.25382 trim_cache size 0 max 16384 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:20:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:24.394 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 msgr2=0x7fe7640b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 0x7fe7640b8ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe778079db0 tx=0x7fe7600046c0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 msgr2=0x7fe7781138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.388+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe770005e30 tx=0x7fe770003f30 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 shutdown_connections 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe7640b6790 0x7fe7640b8ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe778108cf0 0x7fe7781138f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7781083a0 0x7fe7781133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 --2- 172.21.15.38:0/76983319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778102a60 0x7fe778114dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 >> 172.21.15.38:0/76983319 conn(0x7fe778079730 msgr2=0x7fe778101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 shutdown_connections 2024-09-21T06:20:24.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:24.389+0000 7fe77d3d8640 1 -- 172.21.15.38:0/76983319 wait complete. 2024-09-21T06:20:25.143 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:20:25.143 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:20:25.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:25 smithi038 ceph-mon[31215]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T06:20:25.550 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:25 smithi174 ceph-mon[34815]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T06:20:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:25 smithi044 ceph-mon[34369]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 -- 172.21.15.38:0/1710035457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c1083a0 msgr2=0x7fb41c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 --2- 172.21.15.38:0/1710035457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c1083a0 0x7fb41c1087b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009900 tx=0x7fb40c02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 -- 172.21.15.38:0/1710035457 shutdown_connections 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 --2- 172.21.15.38:0/1710035457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41c108cf0 0x7fb41c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 --2- 172.21.15.38:0/1710035457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c1083a0 0x7fb41c1087b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 --2- 172.21.15.38:0/1710035457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 0x7fb41c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 -- 172.21.15.38:0/1710035457 >> 172.21.15.38:0/1710035457 conn(0x7fb41c079730 msgr2=0x7fb41c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 -- 172.21.15.38:0/1710035457 shutdown_connections 2024-09-21T06:20:26.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.092+0000 7fb423c49640 1 -- 172.21.15.38:0/1710035457 wait complete. 2024-09-21T06:20:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 Processor -- start 2024-09-21T06:20:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 -- start start 2024-09-21T06:20:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 0x7fb41c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41c108cf0 0x7fb41c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:26.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111980 con 0x7fb41c19dcb0 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111800 con 0x7fb41c108cf0 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.093+0000 7fb423c49640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c111b00 con 0x7fb41c102a60 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46172/0 (socket says 172.21.15.38:46172) 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 -- 172.21.15.38:0/4070260346 learned_addr learned my addr 172.21.15.38:0/4070260346 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:26.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4219e5640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 0x7fb41c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 -- 172.21.15.38:0/4070260346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 msgr2=0x7fb41c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 0x7fb41c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 -- 172.21.15.38:0/4070260346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41c108cf0 msgr2=0x7fb41c198ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41c108cf0 0x7fb41c198ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.094+0000 7fb4221e6640 1 -- 172.21.15.38:0/4070260346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c19e890 con 0x7fb41c19dcb0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.095+0000 7fb4221e6640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb41400bfa0 tx=0x7fb41400e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.095+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41401a030 con 0x7fb41c19dcb0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.095+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb41400ec70 con 0x7fb41c19dcb0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.095+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140059d0 con 0x7fb41c19dcb0 2024-09-21T06:20:26.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.095+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c1a4e30 con 0x7fb41c19dcb0 2024-09-21T06:20:26.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.096+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c1a51d0 con 0x7fb41c19dcb0 2024-09-21T06:20:26.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.097+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c1087b0 con 0x7fb41c19dcb0 2024-09-21T06:20:26.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.099+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fb41401d070 con 0x7fb41c19dcb0 2024-09-21T06:20:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.101+0000 7fb412ffd640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 0x7fb4080b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.101+0000 7fb4219e5640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 0x7fb4080b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.101+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb4140e99c0 con 0x7fb41c19dcb0 2024-09-21T06:20:26.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.102+0000 7fb4219e5640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 0x7fb4080b8ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb418005fd0 tx=0x7fb418005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:26.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.105+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb414024070 con 0x7fb41c19dcb0 2024-09-21T06:20:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.560+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb41c02e640 con 0x7fb41c19dcb0 2024-09-21T06:20:26.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.561+0000 7fb412ffd640 1 -- 172.21.15.38:0/4070260346 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11911 (secure 0 0 0) 0x7fb414012040 con 0x7fb41c19dcb0 2024-09-21T06:20:26.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:20:26.563 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"btime":"2024-09-21T06:19:31:452263+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:19:30.723218+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:20:26.563 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.564+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 msgr2=0x7fb4080b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.564+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 0x7fb4080b8ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb418005fd0 tx=0x7fb418005850 comp rx=0 tx=0).stop 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.564+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 msgr2=0x7fb41c19e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.564+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb41400bfa0 tx=0x7fb41400e550 comp rx=0 tx=0).stop 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 shutdown_connections 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb4080b6790 0x7fb4080b8ca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb41c19dcb0 0x7fb41c19e0c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb41c108cf0 0x7fb41c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 --2- 172.21.15.38:0/4070260346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb41c102a60 0x7fb41c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 >> 172.21.15.38:0/4070260346 conn(0x7fb41c079730 msgr2=0x7fb41c104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.565+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 shutdown_connections 2024-09-21T06:20:26.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:26.569+0000 7fb423c49640 1 -- 172.21.15.38:0/4070260346 wait complete. 2024-09-21T06:20:27.243 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:20:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:27 smithi038 ceph-mon[31215]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:27.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:27 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4070260346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:27 smithi174 ceph-mon[34815]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:27.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:27 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4070260346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:27.649 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:27.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:27 smithi044 ceph-mon[34369]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:20:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:27 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4070260346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 -- 172.21.15.38:0/4018826388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 msgr2=0x7effe81125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 --2- 172.21.15.38:0/4018826388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81125a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7effe0009ca0 tx=0x7effe002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 -- 172.21.15.38:0/4018826388 shutdown_connections 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 --2- 172.21.15.38:0/4018826388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81125a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 --2- 172.21.15.38:0/4018826388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe80760a0 0x7effe810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 --2- 172.21.15.38:0/4018826388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effe8075750 0x7effe8075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 -- 172.21.15.38:0/4018826388 >> 172.21.15.38:0/4018826388 conn(0x7effe807b910 msgr2=0x7effe807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 -- 172.21.15.38:0/4018826388 shutdown_connections 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.166+0000 7effee1af640 1 -- 172.21.15.38:0/4018826388 wait complete. 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.167+0000 7effee1af640 1 Processor -- start 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.167+0000 7effee1af640 1 -- start start 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.167+0000 7effee1af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 0x7effe819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.167+0000 7effee1af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effe80760a0 0x7effe819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.167+0000 7effee1af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effee1af640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7effe8115df0 con 0x7effe8110180 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effee1af640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7effe8115c70 con 0x7effe80760a0 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effee1af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effe8115f70 con 0x7effe8075750 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46186/0 (socket says 172.21.15.38:46186) 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 -- 172.21.15.38:0/3138341974 learned_addr learned my addr 172.21.15.38:0/3138341974 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe77fe640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 0x7effe819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 -- 172.21.15.38:0/3138341974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 msgr2=0x7effe819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 0x7effe819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 -- 172.21.15.38:0/3138341974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effe80760a0 msgr2=0x7effe819cce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effe80760a0 0x7effe819cce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe7fff640 1 -- 172.21.15.38:0/3138341974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe81a26b0 con 0x7effe8110180 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.168+0000 7effe77fe640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 0x7effe819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effe7fff640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7effe0005e30 tx=0x7effe00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effe4ff9640 1 -- 172.21.15.38:0/3138341974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0031650 con 0x7effe8110180 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effe4ff9640 1 -- 172.21.15.38:0/3138341974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effe00317f0 con 0x7effe8110180 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe81a2940 con 0x7effe8110180 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe81a9100 con 0x7effe8110180 2024-09-21T06:20:28.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.169+0000 7effe4ff9640 1 -- 172.21.15.38:0/3138341974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe002fb40 con 0x7effe8110180 2024-09-21T06:20:28.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.172+0000 7efff4723740 1 Processor -- start 2024-09-21T06:20:28.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.173+0000 7effe4ff9640 1 -- 172.21.15.38:0/3138341974 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7effe002fce0 con 0x7effe8110180 2024-09-21T06:20:28.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.173+0000 7efff4723740 1 -- start start 2024-09-21T06:20:28.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dda0440ea0 con 0x55dda0102390 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dda04302d0 con 0x55dda00fa1b0 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7efff4723740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dda04340e0 con 0x55dda0123070 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7effe77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7effe77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41880/0 (socket says 172.21.15.38:41880) 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7effe77fe640 1 -- 172.21.15.38:0/2934213111 learned_addr learned my addr 172.21.15.38:0/2934213111 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7effe6ffd640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.174+0000 7effe6ffd640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 -- 172.21.15.38:0/2934213111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 msgr2=0x55dda04ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 -- 172.21.15.38:0/2934213111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 msgr2=0x55dda04cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 -- 172.21.15.38:0/2934213111 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda018e650 con 0x55dda00fa1b0 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe6ffd640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe4ff9640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 0x7effd00b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe4ff9640 1 -- 172.21.15.38:0/3138341974 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7effe01089a0 con 0x7effe8110180 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe77fe640 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effd8010580 tx=0x7effd8010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60982a61c9add002 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effe6ffd640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 0x7effd00b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.175+0000 7effcdffb640 1 -- 172.21.15.38:0/2934213111 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8011760 con 0x55dda00fa1b0 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.176+0000 7effcdffb640 1 -- 172.21.15.38:0/2934213111 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effd8011dd0 con 0x55dda00fa1b0 2024-09-21T06:20:28.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.176+0000 7effcdffb640 1 -- 172.21.15.38:0/2934213111 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd800ee50 con 0x55dda00fa1b0 2024-09-21T06:20:28.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- 172.21.15.38:0/2934213111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 msgr2=0x55dda04cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7effe6ffd640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 0x7effd00b8d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effe8111fa0 tx=0x7effdc0095a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7effd8010580 tx=0x7effd8010a40 comp rx=0 tx=0).stop 2024-09-21T06:20:28.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- 172.21.15.38:0/2934213111 shutdown_connections 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04cabe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 --2- 172.21.15.38:0/2934213111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- 172.21.15.38:0/2934213111 >> 172.21.15.38:0/2934213111 conn(0x55dda0117460 msgr2=0x55dda04c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- 172.21.15.38:0/2934213111 shutdown_connections 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- 172.21.15.38:0/2934213111 wait complete. 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 -- start start 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.177+0000 7efff4723740 1 Processor -- start 2024-09-21T06:20:28.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dda0291700 con 0x55dda0102390 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dda03cb160 con 0x55dda00fa1b0 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dda04d8e80 con 0x55dda0123070 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7effe77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7efff4723740 10 client.0 _ll_register_callbacks cb 0x55dda03e49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7effe77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41886/0 (socket says 172.21.15.38:41886) 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.178+0000 7effe77fe640 1 -- 172.21.15.38:0/85649710 learned_addr learned my addr 172.21.15.38:0/85649710 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe7fff640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe6ffd640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe77fe640 1 -- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 msgr2=0x55dda04e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe77fe640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe77fe640 1 -- 172.21.15.38:0/85649710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 msgr2=0x55dda04d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe77fe640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.179+0000 7effe77fe640 1 -- 172.21.15.38:0/85649710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda03f8c90 con 0x55dda00fa1b0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7effe77fe640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effd800ea70 tx=0x7effd800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757ea776464fcc85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7effc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8005870 con 0x55dda00fa1b0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd8011dd0 con 0x55dda00fa1b0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7effd8011560 con 0x55dda00fa1b0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7effd8011760 con 0x55dda00fa1b0 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7efff4723740 10 client.25394 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:28.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.180+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dda04e4bc0 con 0x55dda00fa1b0 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effd8011dd0 con 0x55dda00fa1b0 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7effd8024070 con 0x55dda00fa1b0 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 10 client.25394 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 10 client.25394 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 20 client.25394 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00e19f0 0x55dda04e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 4 client.25394 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:28.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dda0442df0 con 0x55dda00e19f0 2024-09-21T06:20:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.181+0000 7effe6ffd640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00e19f0 0x55dda04e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.182+0000 7effc6ffd640 10 client.25394 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.182+0000 7effe6ffd640 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00e19f0 0x55dda04e7f80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f84192e55123b7a0 server_cookie=b61b5c81a441c9eb in_seq=0 out_seq=0 2024-09-21T06:20:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7effc6ffd640 1 -- 172.21.15.38:0/85649710 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dda0442df0 con 0x55dda00e19f0 2024-09-21T06:20:28.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7effc6ffd640 10 client.25394 handle_command_reply: tid=0 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 client.25394 shutdown 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 msgr2=0x55dda04d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effd800ea70 tx=0x7effd800ee80 comp rx=0 tx=0).stop 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 shutdown_connections 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00e19f0 0x55dda04e7f80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0102390 0x55dda04d6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 --2- 172.21.15.38:0/85649710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04d5cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.183+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 >> 172.21.15.38:0/85649710 conn(0x55dda0117460 msgr2=0x55dda04cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.184+0000 7effc6ffd640 0 client.25394 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.184+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 shutdown_connections 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.184+0000 7efff4723740 1 -- 172.21.15.38:0/85649710 wait complete. 2024-09-21T06:20:28.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.184+0000 7efff4723740 20 client.25394 trim_cache size 0 max 16384 2024-09-21T06:20:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 Processor -- start 2024-09-21T06:20:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 -- start start 2024-09-21T06:20:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda00fa1b0 0x55dda04d7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda0102390 0x55dda04c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b4120 con 0x55dda00fa1b0 2024-09-21T06:20:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b19f0 con 0x55dda0102390 2024-09-21T06:20:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.197+0000 7efff4723740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effe81af840 con 0x55dda0123070 2024-09-21T06:20:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda00fa1b0 0x55dda04d7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:60974/0 (socket says 172.21.15.38:60974) 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 -- 172.21.15.38:0/4171346440 learned_addr learned my addr 172.21.15.38:0/4171346440 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe6ffd640 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda0102390 0x55dda04c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 -- 172.21.15.38:0/4171346440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda0102390 msgr2=0x55dda04c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda0102390 0x55dda04c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 -- 172.21.15.38:0/4171346440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda00fa1b0 msgr2=0x55dda04d7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda00fa1b0 0x55dda04d7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 -- 172.21.15.38:0/4171346440 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda04ee270 con 0x55dda0123070 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effe7fff640 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effe00ce690 tx=0x7effe0009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ce71ee9ffdb32c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.198+0000 7effcd7fa640 1 -- 172.21.15.38:0/4171346440 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00e9070 con 0x55dda0123070 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7effcd7fa640 1 -- 172.21.15.38:0/4171346440 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effe00f5070 con 0x55dda0123070 2024-09-21T06:20:28.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7effcd7fa640 1 -- 172.21.15.38:0/4171346440 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00d7c90 con 0x55dda0123070 2024-09-21T06:20:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7efff4723740 1 -- 172.21.15.38:0/4171346440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 msgr2=0x55dda04c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7efff4723740 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effe00ce690 tx=0x7effe0009440 comp rx=0 tx=0).stop 2024-09-21T06:20:28.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7efff4723740 1 -- 172.21.15.38:0/4171346440 shutdown_connections 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7efff4723740 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0123070 0x55dda04c8100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.199+0000 7efff4723740 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda0102390 0x55dda04c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.200+0000 7efff4723740 1 --2- 172.21.15.38:0/4171346440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda00fa1b0 0x55dda04d7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.200+0000 7efff4723740 1 -- 172.21.15.38:0/4171346440 >> 172.21.15.38:0/4171346440 conn(0x55dda0117460 msgr2=0x55dda04d7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.200+0000 7efff4723740 1 -- 172.21.15.38:0/4171346440 shutdown_connections 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.200+0000 7efff4723740 1 -- 172.21.15.38:0/4171346440 wait complete. 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.200+0000 7efff4723740 1 -- start start 2024-09-21T06:20:28.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 Processor -- start 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04e9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0102390 0x55dda04e9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7effe81afeb0 con 0x55dda0123070 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b1320 con 0x55dda00fa1b0 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7effe81b0580 con 0x55dda0102390 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7efff4723740 10 client.0 _ll_register_callbacks cb 0x7effdc009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7effe77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7effe7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7effe7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46220/0 (socket says 172.21.15.38:46220) 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.201+0000 7effe7fff640 1 -- 172.21.15.38:0/3685169928 learned_addr learned my addr 172.21.15.38:0/3685169928 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe6ffd640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0102390 0x55dda04e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 -- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0102390 msgr2=0x55dda04e9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0102390 0x55dda04e9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 -- 172.21.15.38:0/3685169928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 msgr2=0x55dda04e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04e9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 -- 172.21.15.38:0/3685169928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda0551700 con 0x55dda0123070 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe77fe640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effe7fff640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7effe0106190 tx=0x7effe0106610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4401766e69d670 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00ed020 con 0x55dda0123070 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7effe00d7ea0 con 0x55dda0123070 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.202+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe00f5070 con 0x55dda0123070 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7effe00e9040 con 0x55dda0123070 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 10 client.15732 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:28.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dda0552930 con 0x55dda0123070 2024-09-21T06:20:28.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7effe00f5070 con 0x55dda0123070 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7effe00ca050 con 0x55dda0123070 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 10 client.15732 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 10 client.15732 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 20 client.15732 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00b6da0 0x55dda0554fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 4 client.15732 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.203+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dda04c39e0 con 0x55dda00b6da0 2024-09-21T06:20:28.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.204+0000 7effe77fe640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00b6da0 0x55dda0554fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.204+0000 7effc6ffd640 10 client.15732 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7effe77fe640 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00b6da0 0x55dda0554fe0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a81fdfe868cd6c5a server_cookie=fc63758ed9ebfd5c in_seq=0 out_seq=0 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7effc6ffd640 1 -- 172.21.15.38:0/3685169928 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dda04c39e0 con 0x55dda00b6da0 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7effc6ffd640 10 client.15732 handle_command_reply: tid=0 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 client.15732 shutdown 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 msgr2=0x55dda04e9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7effe0106190 tx=0x7effe0106610 comp rx=0 tx=0).stop 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 shutdown_connections 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55dda00b6da0 0x55dda0554fe0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dda0123070 0x55dda04e9a80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dda0102390 0x55dda04e9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 --2- 172.21.15.38:0/3685169928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dda00fa1b0 0x55dda04e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 >> 172.21.15.38:0/3685169928 conn(0x55dda0117460 msgr2=0x55dda04d6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.205+0000 7effc6ffd640 0 client.15732 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:20:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 shutdown_connections 2024-09-21T06:20:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7efff4723740 1 -- 172.21.15.38:0/3685169928 wait complete. 2024-09-21T06:20:28.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7efff4723740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T06:20:28.210 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 msgr2=0x7effd00b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 0x7effd00b8d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effe8111fa0 tx=0x7effdc0095a0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 msgr2=0x7effe81a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.206+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7effe0005e30 tx=0x7effe00093d0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 shutdown_connections 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7effd00b6860 0x7effd00b8d70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7effe8110180 0x7effe81a1f80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7effe80760a0 0x7effe819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 --2- 172.21.15.38:0/3138341974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7effe8075750 0x7effe819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 >> 172.21.15.38:0/3138341974 conn(0x7effe807b910 msgr2=0x7effe8107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 shutdown_connections 2024-09-21T06:20:28.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:28.207+0000 7effee1af640 1 -- 172.21.15.38:0/3138341974 wait complete. 2024-09-21T06:20:28.933 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:20:29.205 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:29.637 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:29 smithi038 ceph-mon[31215]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-21T06:20:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:29 smithi174 ceph-mon[34815]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-21T06:20:29.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:29 smithi044 ceph-mon[34369]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 -- 172.21.15.38:0/4250772132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 msgr2=0x7f40e81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 --2- 172.21.15.38:0/4250772132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e81087b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009900 tx=0x7f40dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 -- 172.21.15.38:0/4250772132 shutdown_connections 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 --2- 172.21.15.38:0/4250772132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8108cf0 0x7f40e810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 --2- 172.21.15.38:0/4250772132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e81087b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 --2- 172.21.15.38:0/4250772132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8102a60 0x7f40e8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.732+0000 7f40ece7e640 1 -- 172.21.15.38:0/4250772132 >> 172.21.15.38:0/4250772132 conn(0x7f40e8079730 msgr2=0x7f40e8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.733+0000 7f40ece7e640 1 -- 172.21.15.38:0/4250772132 shutdown_connections 2024-09-21T06:20:29.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.733+0000 7f40ece7e640 1 -- 172.21.15.38:0/4250772132 wait complete. 2024-09-21T06:20:29.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.734+0000 7f40ece7e640 1 Processor -- start 2024-09-21T06:20:29.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.734+0000 7f40ece7e640 1 -- start start 2024-09-21T06:20:29.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.734+0000 7f40ece7e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40ece7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40ece7e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 0x7f40e819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e6d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 0x7f40e819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47922/0 (socket says 172.21.15.38:47922) 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 -- 172.21.15.38:0/2288937896 learned_addr learned my addr 172.21.15.38:0/2288937896 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58048/0 (socket says 172.21.15.38:58048) 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8112a80 con 0x7f40e81083a0 2024-09-21T06:20:29.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8112900 con 0x7f40e8102a60 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8112c00 con 0x7f40e8108cf0 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 -- 172.21.15.38:0/2288937896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 msgr2=0x7f40e819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 0x7f40e819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 -- 172.21.15.38:0/2288937896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 msgr2=0x7f40e819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e5d9b640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e81a02b0 con 0x7f40e81083a0 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e659c640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.735+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 0x7f40e819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.736+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0306c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.736+0000 7f40d77fe640 1 -- 172.21.15.38:0/2288937896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc03f070 con 0x7f40e81083a0 2024-09-21T06:20:29.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.736+0000 7f40d77fe640 1 -- 172.21.15.38:0/2288937896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40dc004460 con 0x7f40e81083a0 2024-09-21T06:20:29.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.736+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e81a0540 con 0x7f40e81083a0 2024-09-21T06:20:29.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.736+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e81a6d00 con 0x7f40e81083a0 2024-09-21T06:20:29.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.737+0000 7f40d77fe640 1 -- 172.21.15.38:0/2288937896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc035030 con 0x7f40e81083a0 2024-09-21T06:20:29.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 Processor -- start 2024-09-21T06:20:29.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 -- start start 2024-09-21T06:20:29.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40d77fe640 1 -- 172.21.15.38:0/2288937896 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f40dc042070 con 0x7f40e81083a0 2024-09-21T06:20:29.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a7070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7083670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5597a6fe9ea0 con 0x5597a6ca31b0 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597a6fd92d0 con 0x5597a6cab390 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.741+0000 7f40f33f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5597a6fdd0e0 con 0x5597a6ccc070 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47936/0 (socket says 172.21.15.38:47936) 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 -- 172.21.15.38:0/346601868 learned_addr learned my addr 172.21.15.38:0/346601868 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a7070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 -- 172.21.15.38:0/346601868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 msgr2=0x5597a7070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a7070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 -- 172.21.15.38:0/346601868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 msgr2=0x5597a7083670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:20:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7083670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40e659c640 1 -- 172.21.15.38:0/346601868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a6d37650 con 0x5597a6ca31b0 2024-09-21T06:20:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40d77fe640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 0x7f40d00b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.742+0000 7f40d77fe640 1 -- 172.21.15.38:0/2288937896 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f40dc1082a0 con 0x7f40e81083a0 2024-09-21T06:20:29.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.743+0000 7f40e659c640 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009ca0 tx=0x7f40d800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f832441bf765d4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.743+0000 7f40d4ff9640 1 -- 172.21.15.38:0/346601868 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8016070 con 0x5597a6ca31b0 2024-09-21T06:20:29.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.743+0000 7f40d4ff9640 1 -- 172.21.15.38:0/346601868 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40d80054f0 con 0x5597a6ca31b0 2024-09-21T06:20:29.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.743+0000 7f40d4ff9640 1 -- 172.21.15.38:0/346601868 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80116d0 con 0x5597a6ca31b0 2024-09-21T06:20:29.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.744+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 0x7f40d00b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.744+0000 7f40f33f2740 1 -- 172.21.15.38:0/346601868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 msgr2=0x5597a70712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.744+0000 7f40f33f2740 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009ca0 tx=0x7f40d800e6c0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.744+0000 7f40f33f2740 1 -- 172.21.15.38:0/346601868 shutdown_connections 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.744+0000 7f40f33f2740 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7083670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40f33f2740 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a70712a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40f33f2740 1 --2- 172.21.15.38:0/346601868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a7070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40f33f2740 1 -- 172.21.15.38:0/346601868 >> 172.21.15.38:0/346601868 conn(0x5597a6cc0460 msgr2=0x5597a7073240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 0x7f40d00b8d70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005fd0 tx=0x7f40e00094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40f33f2740 1 -- 172.21.15.38:0/346601868 shutdown_connections 2024-09-21T06:20:29.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.745+0000 7f40f33f2740 1 -- 172.21.15.38:0/346601868 wait complete. 2024-09-21T06:20:29.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.746+0000 7f40f33f2740 1 -- start start 2024-09-21T06:20:29.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.746+0000 7f40f33f2740 1 Processor -- start 2024-09-21T06:20:29.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.746+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47946/0 (socket says 172.21.15.38:47946) 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40e659c640 1 -- 172.21.15.38:0/833084188 learned_addr learned my addr 172.21.15.38:0/833084188 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a70880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a708d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5597a6e3a700 con 0x5597a6ca31b0 2024-09-21T06:20:29.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597a6f74160 con 0x5597a6cab390 2024-09-21T06:20:29.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a70880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.747+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5597a7084170 con 0x5597a6ccc070 2024-09-21T06:20:29.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a708d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e659c640 1 -- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 msgr2=0x5597a708d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e659c640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a708d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e659c640 1 -- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 msgr2=0x5597a70880d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e659c640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a70880d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e659c640 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a6fa1c90 con 0x5597a6ca31b0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a708d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a70880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40f33f2740 10 client.0 _ll_register_callbacks cb 0x5597a6f8d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.748+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d80054f0 con 0x5597a6ca31b0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40e659c640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f40d8004c90 tx=0x7f40d8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1021c829f331ac57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40cdffb640 10 client.15744 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40cdffb640 1 -- 172.21.15.38:0/833084188 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8028060 con 0x5597a6ca31b0 2024-09-21T06:20:29.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40cdffb640 1 -- 172.21.15.38:0/833084188 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f40d80046c0 con 0x5597a6ca31b0 2024-09-21T06:20:29.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40cdffb640 1 -- 172.21.15.38:0/833084188 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f40d8016040 con 0x5597a6ca31b0 2024-09-21T06:20:29.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40f33f2740 10 client.15744 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:29.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.749+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5597a7095e90 con 0x5597a6ca31b0 2024-09-21T06:20:29.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40cdffb640 1 -- 172.21.15.38:0/833084188 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f40d800f040 con 0x5597a6ca31b0 2024-09-21T06:20:29.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 10 client.15744 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 10 client.15744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 20 client.15744 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6c8a9f0 0x5597a70991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 4 client.15744 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.750+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a6febdf0 con 0x5597a6c8a9f0 2024-09-21T06:20:29.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.751+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6c8a9f0 0x5597a70991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.751+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6c8a9f0 0x5597a70991f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d9c86220fe26b06b server_cookie=829a4f4db731e669 in_seq=0 out_seq=0 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.751+0000 7f40cdffb640 10 client.15744 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40cdffb640 1 -- 172.21.15.38:0/833084188 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597a6febdf0 con 0x5597a6c8a9f0 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40cdffb640 10 client.15744 handle_command_reply: tid=0 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40f33f2740 1 client.15744 shutdown 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 msgr2=0x5597a7087af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f40d8004c90 tx=0x7f40d8005770 comp rx=0 tx=0).stop 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 shutdown_connections 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.752+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6c8a9f0 0x5597a70991f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ccc070 0x5597a708d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40cdffb640 0 client.15744 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a70880d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 --2- 172.21.15.38:0/833084188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7087af0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 >> 172.21.15.38:0/833084188 conn(0x5597a6cc0460 msgr2=0x5597a7070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 shutdown_connections 2024-09-21T06:20:29.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 1 -- 172.21.15.38:0/833084188 wait complete. 2024-09-21T06:20:29.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.753+0000 7f40f33f2740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T06:20:29.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 Processor -- start 2024-09-21T06:20:29.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 -- start start 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 0x5597a7085420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ca31b0 0x5597a70832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8010ed0 con 0x5597a6cab390 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40c800e7a0 con 0x5597a6c8a9f0 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.780+0000 7f40f33f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f40c800c5f0 con 0x5597a6ca31b0 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47952/0 (socket says 172.21.15.38:47952) 2024-09-21T06:20:29.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 -- 172.21.15.38:0/3818477160 learned_addr learned my addr 172.21.15.38:0/3818477160 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:29.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e659c640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 0x5597a7085420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ca31b0 0x5597a70832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 -- 172.21.15.38:0/3818477160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ca31b0 msgr2=0x5597a70832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ca31b0 0x5597a70832c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 -- 172.21.15.38:0/3818477160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 msgr2=0x5597a7085420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 0x5597a7085420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 -- 172.21.15.38:0/3818477160 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a7073b30 con 0x5597a6cab390 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e659c640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 0x5597a7085420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.781+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f40e0011790 tx=0x7f40e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e204027de272aabf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.782+0000 7f40cffff640 1 -- 172.21.15.38:0/3818477160 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0004d20 con 0x5597a6cab390 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.782+0000 7f40cffff640 1 -- 172.21.15.38:0/3818477160 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40e0023070 con 0x5597a6cab390 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.782+0000 7f40cffff640 1 -- 172.21.15.38:0/3818477160 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0005580 con 0x5597a6cab390 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 -- 172.21.15.38:0/3818477160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 msgr2=0x5597a7086190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f40e0011790 tx=0x7f40e0012000 comp rx=0 tx=0).stop 2024-09-21T06:20:29.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 -- 172.21.15.38:0/3818477160 shutdown_connections 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6cab390 0x5597a7086190 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6ca31b0 0x5597a70832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 --2- 172.21.15.38:0/3818477160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6c8a9f0 0x5597a7085420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.783+0000 7f40f33f2740 1 -- 172.21.15.38:0/3818477160 >> 172.21.15.38:0/3818477160 conn(0x5597a6cc0460 msgr2=0x5597a7082290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.784+0000 7f40f33f2740 1 -- 172.21.15.38:0/3818477160 shutdown_connections 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.784+0000 7f40f33f2740 1 -- 172.21.15.38:0/3818477160 wait complete. 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.784+0000 7f40f33f2740 1 -- start start 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.784+0000 7f40f33f2740 1 Processor -- start 2024-09-21T06:20:29.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6c8a9f0 0x5597a708fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7090570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f40c800cc60 con 0x5597a6ca31b0 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40c800e0d0 con 0x5597a6cab390 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f40c800d330 con 0x5597a6c8a9f0 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40f33f2740 10 client.0 _ll_register_callbacks cb 0x7f40d8009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47954/0 (socket says 172.21.15.38:47954) 2024-09-21T06:20:29.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40e5d9b640 1 -- 172.21.15.38:0/1093841162 learned_addr learned my addr 172.21.15.38:0/1093841162 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40e659c640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6c8a9f0 0x5597a708fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.785+0000 7f40e6d9d640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7090570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 -- 172.21.15.38:0/1093841162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6c8a9f0 msgr2=0x5597a708fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6c8a9f0 0x5597a708fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 -- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 msgr2=0x5597a7090570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7090570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 -- 172.21.15.38:0/1093841162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a7102c20 con 0x5597a6ca31b0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40e5d9b640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0cefa0 tx=0x7f40dc0cea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4942a53447ceaec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc049050 con 0x5597a6ca31b0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f40dc0ba130 con 0x5597a6ca31b0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.786+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40e0023070 con 0x5597a6ca31b0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f40dc108040 con 0x5597a6ca31b0 2024-09-21T06:20:29.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 10 client.15750 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5597a7103f00 con 0x5597a6ca31b0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40dc0ec070 con 0x5597a6ca31b0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f40dc105c20 con 0x5597a6ca31b0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 10 client.15750 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 10 client.15750 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 20 client.15750 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6ccc070 0x5597a71066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.787+0000 7f40f33f2740 4 client.15750 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597a6fe78a0 con 0x5597a6ccc070 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40e659c640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6ccc070 0x5597a71066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40e659c640 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6ccc070 0x5597a71066c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71b136380bfa110d server_cookie=57adcc1dc7b1bb35 in_seq=0 out_seq=0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40cdffb640 10 client.15750 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40cdffb640 1 -- 172.21.15.38:0/1093841162 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597a6fe78a0 con 0x5597a6ccc070 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.788+0000 7f40cdffb640 10 client.15750 handle_command_reply: tid=0 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 client.15750 shutdown 2024-09-21T06:20:29.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 msgr2=0x5597a7090010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0cefa0 tx=0x7f40dc0cea20 comp rx=0 tx=0).stop 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 shutdown_connections 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5597a6ccc070 0x5597a71066c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40cdffb640 0 client.15750 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597a6cab390 0x5597a7090570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5597a6ca31b0 0x5597a7090010 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 --2- 172.21.15.38:0/1093841162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5597a6c8a9f0 0x5597a708fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 >> 172.21.15.38:0/1093841162 conn(0x5597a6cc0460 msgr2=0x5597a7086080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 shutdown_connections 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 1 -- 172.21.15.38:0/1093841162 wait complete. 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.789+0000 7f40f33f2740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T06:20:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:29.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 msgr2=0x7f40d00b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 0x7f40d00b8d70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005fd0 tx=0x7f40e00094d0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 msgr2=0x7f40e819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:29.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0306c0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 shutdown_connections 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40d00b6860 0x7f40d00b8d70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f40e8108cf0 0x7f40e819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40e81083a0 0x7f40e819a8e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 --2- 172.21.15.38:0/2288937896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40e8102a60 0x7f40e819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 >> 172.21.15.38:0/2288937896 conn(0x7f40e8079730 msgr2=0x7f40e806b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 shutdown_connections 2024-09-21T06:20:29.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:29.790+0000 7f40ece7e640 1 -- 172.21.15.38:0/2288937896 wait complete. 2024-09-21T06:20:30.430 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:20:30.718 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 -- 172.21.15.38:0/3577536284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f41094b0 msgr2=0x7f47f41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3577536284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f41094b0 0x7f47f41098c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 -- 172.21.15.38:0/3577536284 shutdown_connections 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3577536284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f4109e00 0x7f47f4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3577536284 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f41094b0 0x7f47f41098c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3577536284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 -- 172.21.15.38:0/3577536284 >> 172.21.15.38:0/3577536284 conn(0x7f47f4077c60 msgr2=0x7f47f40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 -- 172.21.15.38:0/3577536284 shutdown_connections 2024-09-21T06:20:31.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.315+0000 7f47fbd32640 1 -- 172.21.15.38:0/3577536284 wait complete. 2024-09-21T06:20:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 Processor -- start 2024-09-21T06:20:31.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 -- start start 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f41094b0 0x7f47f419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113be0 con 0x7f47f4109e00 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113a60 con 0x7f47f4101f70 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.316+0000 7f47fbd32640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f47f4113d60 con 0x7f47f41094b0 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47972/0 (socket says 172.21.15.38:47972) 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 -- 172.21.15.38:0/3106456955 learned_addr learned my addr 172.21.15.38:0/3106456955 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47f92cd640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f41094b0 0x7f47f419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 -- 172.21.15.38:0/3106456955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f41094b0 msgr2=0x7f47f419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f41094b0 0x7f47f419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47f9ace640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 -- 172.21.15.38:0/3106456955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 msgr2=0x7f47f419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 -- 172.21.15.38:0/3106456955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f41a04e0 con 0x7f47f4109e00 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.317+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00eb10 tx=0x7f47ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47eaffd640 1 -- 172.21.15.38:0/3106456955 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec004b20 con 0x7f47f4109e00 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f41a07d0 con 0x7f47f4109e00 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47f9ace640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a6f30 con 0x7f47f4109e00 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47eaffd640 1 -- 172.21.15.38:0/3106456955 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47ec004cc0 con 0x7f47f4109e00 2024-09-21T06:20:31.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.318+0000 7f47eaffd640 1 -- 172.21.15.38:0/3106456955 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec010720 con 0x7f47f4109e00 2024-09-21T06:20:31.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.321+0000 7f47eaffd640 1 -- 172.21.15.38:0/3106456955 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f47ec0108c0 con 0x7f47f4109e00 2024-09-21T06:20:31.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.322+0000 7f48022a6740 1 Processor -- start 2024-09-21T06:20:31.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.322+0000 7f48022a6740 1 -- start start 2024-09-21T06:20:31.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.322+0000 7f47eaffd640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 0x7f47e00b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a10f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d29390 0x5586a10f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586a1067ea0 con 0x5586a0d211b0 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586a10572d0 con 0x5586a0d4a070 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f48022a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586a105b0e0 con 0x5586a0d29390 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47eaffd640 1 -- 172.21.15.38:0/3106456955 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f47ec0e7cd0 con 0x7f47f4109e00 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58132/0 (socket says 172.21.15.38:58132) 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 -- 172.21.15.38:0/200216410 learned_addr learned my addr 172.21.15.38:0/200216410 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f92cd640 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a10f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 -- 172.21.15.38:0/200216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d29390 msgr2=0x5586a10f1d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d29390 0x5586a10f1d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 -- 172.21.15.38:0/200216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 msgr2=0x5586a10f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a10f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f9ace640 1 -- 172.21.15.38:0/200216410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a0db5650 con 0x5586a0d4a070 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f92cd640 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a10f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.323+0000 7f47f92cd640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 0x7f47e00b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.324+0000 7f47f9ace640 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47f0014c70 tx=0x7f47f0009b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15d6f5514fe7749 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.324+0000 7f47dffff640 1 -- 172.21.15.38:0/200216410 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f000e8d0 con 0x5586a0d4a070 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.324+0000 7f47dffff640 1 -- 172.21.15.38:0/200216410 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47f0005020 con 0x5586a0d4a070 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.324+0000 7f47dffff640 1 -- 172.21.15.38:0/200216410 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0004b60 con 0x5586a0d4a070 2024-09-21T06:20:31.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.324+0000 7f47f92cd640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 0x7f47e00b8d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47e4005940 tx=0x7f47e40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 -- 172.21.15.38:0/200216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 msgr2=0x5586a10f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f47f0014c70 tx=0x7f47f0009b40 comp rx=0 tx=0).stop 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 -- 172.21.15.38:0/200216410 shutdown_connections 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d29390 0x5586a10f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a10f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 --2- 172.21.15.38:0/200216410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a10f12c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 -- 172.21.15.38:0/200216410 >> 172.21.15.38:0/200216410 conn(0x5586a0d3e460 msgr2=0x5586a10ef1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 -- 172.21.15.38:0/200216410 shutdown_connections 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.325+0000 7f48022a6740 1 -- 172.21.15.38:0/200216410 wait complete. 2024-09-21T06:20:31.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.326+0000 7f48022a6740 1 -- start start 2024-09-21T06:20:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.326+0000 7f48022a6740 1 Processor -- start 2024-09-21T06:20:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d211b0 0x5586a10fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a1108df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586a0eb8700 con 0x5586a0d29390 2024-09-21T06:20:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586a0ff2160 con 0x5586a0d4a070 2024-09-21T06:20:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586a10ffaa0 con 0x5586a0d211b0 2024-09-21T06:20:31.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f48022a6740 10 client.0 _ll_register_callbacks cb 0x5586a100b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47994/0 (socket says 172.21.15.38:47994) 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f47f92cd640 1 -- 172.21.15.38:0/2096901884 learned_addr learned my addr 172.21.15.38:0/2096901884 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a1108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.327+0000 7f47f9ace640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d211b0 0x5586a10fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 -- 172.21.15.38:0/2096901884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d211b0 msgr2=0x5586a10fc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d211b0 0x5586a10fc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 -- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 msgr2=0x5586a1108df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a1108df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 -- 172.21.15.38:0/2096901884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a101fc90 con 0x5586a0d29390 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a1108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47f92cd640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009230 tx=0x7f47e402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a9e84d3cfddf6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035030 con 0x5586a0d29390 2024-09-21T06:20:31.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f47e4004450 con 0x5586a0d29390 2024-09-21T06:20:31.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47f0005020 con 0x5586a0d29390 2024-09-21T06:20:31.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47e4005020 con 0x5586a0d29390 2024-09-21T06:20:31.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f48022a6740 10 client.15759 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:31.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.328+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586a1113fd0 con 0x5586a0d29390 2024-09-21T06:20:31.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47f0005020 con 0x5586a0d29390 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f47e40035f0 con 0x5586a0d29390 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 20 client.15759 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0d089f0 0x5586a1117a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 4 client.15759 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586a1069df0 con 0x5586a0d089f0 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.329+0000 7f47f9ace640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0d089f0 0x5586a1117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.330+0000 7f47dd7fa640 10 client.15759 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.330+0000 7f47f9ace640 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0d089f0 0x5586a1117a00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6dd51a77cdde93 server_cookie=6b132c60c341eb78 in_seq=0 out_seq=0 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f47dd7fa640 1 -- 172.21.15.38:0/2096901884 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586a1069df0 con 0x5586a0d089f0 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f47dd7fa640 10 client.15759 handle_command_reply: tid=0 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 client.15759 shutdown 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 msgr2=0x5586a10fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009230 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 shutdown_connections 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d4a070 0x5586a1108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d29390 0x5586a10fcf30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0d089f0 0x5586a1117a00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 --2- 172.21.15.38:0/2096901884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d211b0 0x5586a10fc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f47dd7fa640 0 client.15759 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 >> 172.21.15.38:0/2096901884 conn(0x5586a0d3e460 msgr2=0x5586a10f4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 shutdown_connections 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 1 -- 172.21.15.38:0/2096901884 wait complete. 2024-09-21T06:20:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.331+0000 7f48022a6740 20 client.15759 trim_cache size 0 max 16384 2024-09-21T06:20:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.344+0000 7f48022a6740 1 Processor -- start 2024-09-21T06:20:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.344+0000 7f48022a6740 1 -- start start 2024-09-21T06:20:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a10fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8010ed0 con 0x5586a0d211b0 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47d800e7a0 con 0x5586a0d29390 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f48022a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f47d800c5f0 con 0x5586a0d4a070 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58150/0 (socket says 172.21.15.38:58150) 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 -- 172.21.15.38:0/199109709 learned_addr learned my addr 172.21.15.38:0/199109709 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:31.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f9ace640 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a10fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 -- 172.21.15.38:0/199109709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 msgr2=0x5586a10fcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a10fcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 -- 172.21.15.38:0/199109709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 msgr2=0x5586a1108cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1108cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 -- 172.21.15.38:0/199109709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586a10ff130 con 0x5586a0d29390 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.345+0000 7f47f92cd640 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004730 tx=0x7f47e4031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6c3d2e8699de4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.346+0000 7f47df7fe640 1 -- 172.21.15.38:0/199109709 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e40037f0 con 0x5586a0d29390 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.346+0000 7f47df7fe640 1 -- 172.21.15.38:0/199109709 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47e406f070 con 0x5586a0d29390 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.346+0000 7f47df7fe640 1 -- 172.21.15.38:0/199109709 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4004a50 con 0x5586a0d29390 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- 172.21.15.38:0/199109709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 msgr2=0x5586a10fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004730 tx=0x7f47e4031850 comp rx=0 tx=0).stop 2024-09-21T06:20:31.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- 172.21.15.38:0/199109709 shutdown_connections 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a10fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a10fc7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 --2- 172.21.15.38:0/199109709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- 172.21.15.38:0/199109709 >> 172.21.15.38:0/199109709 conn(0x5586a0d3e460 msgr2=0x5586a10fb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- 172.21.15.38:0/199109709 shutdown_connections 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- 172.21.15.38:0/199109709 wait complete. 2024-09-21T06:20:31.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 -- start start 2024-09-21T06:20:31.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.347+0000 7f48022a6740 1 Processor -- start 2024-09-21T06:20:31.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a1100e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f47d800cc60 con 0x5586a0d211b0 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47d800e0d0 con 0x5586a0d29390 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f47d800d330 con 0x5586a0d4a070 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f48022a6740 10 client.0 _ll_register_callbacks cb 0x7f47ec0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58160/0 (socket says 172.21.15.38:58160) 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 -- 172.21.15.38:0/569192876 learned_addr learned my addr 172.21.15.38:0/569192876 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f9ace640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47fa2cf640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a1100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 -- 172.21.15.38:0/569192876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 msgr2=0x5586a1100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a1100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.348+0000 7f47f92cd640 1 -- 172.21.15.38:0/569192876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 msgr2=0x5586a1105420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47f92cd640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1105420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47f92cd640 1 -- 172.21.15.38:0/569192876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586a1101480 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47f9ace640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47f92cd640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004480 tx=0x7f47e4005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619a9fe456859044 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4078020 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e406f070 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f47e40055d0 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f47e4083050 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f48022a6740 10 client.25424 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.349+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586a1111d90 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47e406f070 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f47e4074980 con 0x5586a0d29390 2024-09-21T06:20:31.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 10 client.25424 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 10 client.25424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 20 client.25424 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0cddda0 0x5586a118d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:31.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 4 client.25424 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:20:31.357 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586a10658a0 con 0x5586a0cddda0 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.350+0000 7f47f9ace640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0cddda0 0x5586a118d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f47dd7fa640 10 client.25424 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f47f9ace640 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0cddda0 0x5586a118d3e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95b21890e80fb202 server_cookie=efc4e9d312965812 in_seq=0 out_seq=0 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f47dd7fa640 1 -- 172.21.15.38:0/569192876 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586a10658a0 con 0x5586a0cddda0 2024-09-21T06:20:31.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f47dd7fa640 10 client.25424 handle_command_reply: tid=0 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 client.25424 shutdown 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 msgr2=0x5586a11008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47e4004480 tx=0x7f47e4005cb0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 shutdown_connections 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586a0cddda0 0x5586a118d3e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586a0d4a070 0x5586a1100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586a0d29390 0x5586a11008d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 --2- 172.21.15.38:0/569192876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586a0d211b0 0x5586a1105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 >> 172.21.15.38:0/569192876 conn(0x5586a0d3e460 msgr2=0x5586a10fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f47dd7fa640 0 client.25424 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 shutdown_connections 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 1 -- 172.21.15.38:0/569192876 wait complete. 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.351+0000 7f48022a6740 20 client.25424 trim_cache size 0 max 16384 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 msgr2=0x7f47e00b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 0x7f47e00b8d20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f47e4005940 tx=0x7f47e40058d0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 msgr2=0x7f47f419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00eb10 tx=0x7f47ec00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 shutdown_connections 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f47e00b6810 0x7f47e00b8d20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f47f4109e00 0x7f47f419fdb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47f41094b0 0x7f47f419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 --2- 172.21.15.38:0/3106456955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47f4101f70 0x7f47f419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 >> 172.21.15.38:0/3106456955 conn(0x7f47f4077c60 msgr2=0x7f47f40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 shutdown_connections 2024-09-21T06:20:31.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:31.352+0000 7f47fbd32640 1 -- 172.21.15.38:0/3106456955 wait complete. 2024-09-21T06:20:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:31 smithi038 ceph-mon[31215]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:20:31.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:31 smithi044 ceph-mon[34369]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:20:31.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:31 smithi174 ceph-mon[34815]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:20:33.043 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:20:33.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:20:33.390 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:33.680 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:33 smithi038 ceph-mon[31215]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T06:20:33.801 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:33 smithi174 ceph-mon[34815]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T06:20:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 -- 172.21.15.38:0/1863257140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88105a20 msgr2=0x7fde8810f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 --2- 172.21.15.38:0/1863257140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88105a20 0x7fde8810f490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde80009ca0 tx=0x7fde8002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 -- 172.21.15.38:0/1863257140 shutdown_connections 2024-09-21T06:20:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 --2- 172.21.15.38:0/1863257140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88105a20 0x7fde8810f490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 --2- 172.21.15.38:0/1863257140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 0x7fde881054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 --2- 172.21.15.38:0/1863257140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88103170 0x7fde88103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.818+0000 7fde8fd69640 1 -- 172.21.15.38:0/1863257140 >> 172.21.15.38:0/1863257140 conn(0x7fde88079e90 msgr2=0x7fde8807a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.819+0000 7fde8fd69640 1 -- 172.21.15.38:0/1863257140 shutdown_connections 2024-09-21T06:20:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.819+0000 7fde8fd69640 1 -- 172.21.15.38:0/1863257140 wait complete. 2024-09-21T06:20:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.819+0000 7fde8fd69640 1 Processor -- start 2024-09-21T06:20:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.819+0000 7fde8fd69640 1 -- start start 2024-09-21T06:20:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 0x7fde8819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88105a20 0x7fde881a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fde88112a40 con 0x7fde88105a20 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde881128c0 con 0x7fde881050d0 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8fd69640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fde88112bc0 con 0x7fde88103170 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8e306640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88105a20 0x7fde881a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47472/0 (socket says 172.21.15.38:47472) 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 -- 172.21.15.38:0/442080592 learned_addr learned my addr 172.21.15.38:0/442080592 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8d304640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 0x7fde8819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 -- 172.21.15.38:0/442080592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 msgr2=0x7fde8819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 0x7fde8819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 -- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88105a20 msgr2=0x7fde881a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88105a20 0x7fde881a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.820+0000 7fde8db05640 1 -- 172.21.15.38:0/442080592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde881a2600 con 0x7fde88103170 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde8db05640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde8400ea60 tx=0x7fde8400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde7effd640 1 -- 172.21.15.38:0/442080592 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8400cde0 con 0x7fde88103170 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde7effd640 1 -- 172.21.15.38:0/442080592 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde840035f0 con 0x7fde88103170 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde881a28f0 con 0x7fde88103170 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde7effd640 1 -- 172.21.15.38:0/442080592 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84010690 con 0x7fde88103170 2024-09-21T06:20:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.821+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881a9080 con 0x7fde88103170 2024-09-21T06:20:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.824+0000 7fde96cdb740 1 Processor -- start 2024-09-21T06:20:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 -- start start 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 0x5581b370d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 0x5581b370e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5581b36826f0 con 0x5581b333f2f0 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5581b3671b20 con 0x5581b33681b0 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde96cdb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5581b3675930 con 0x5581b33474d0 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde8d304640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 0x5581b370e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde8d304640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 0x5581b370e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47482/0 (socket says 172.21.15.38:47482) 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde8d304640 1 -- 172.21.15.38:0/4032646633 learned_addr learned my addr 172.21.15.38:0/4032646633 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.825+0000 7fde8e306640 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 0x5581b370d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde7effd640 1 -- 172.21.15.38:0/442080592 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fde84004020 con 0x7fde88103170 2024-09-21T06:20:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8db05640 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 -- 172.21.15.38:0/4032646633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 msgr2=0x5581b370e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 0x5581b370e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 -- 172.21.15.38:0/4032646633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 msgr2=0x5581b370def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 -- 172.21.15.38:0/4032646633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581b3637530 con 0x5581b33681b0 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.826+0000 7fde8e306640 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 0x5581b370d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde8002ae00 tx=0x7fde80009a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9468df8896105 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde73fff640 1 -- 172.21.15.38:0/4032646633 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80031730 con 0x5581b33681b0 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde73fff640 1 -- 172.21.15.38:0/4032646633 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde80036040 con 0x5581b33681b0 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde73fff640 1 -- 172.21.15.38:0/4032646633 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80047480 con 0x5581b33681b0 2024-09-21T06:20:33.829 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde7effd640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 0x7fde740b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde7effd640 1 -- 172.21.15.38:0/442080592 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fde840e7b20 con 0x7fde88103170 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.827+0000 7fde8db05640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 0x7fde740b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 -- 172.21.15.38:0/4032646633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 msgr2=0x5581b370d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 0x5581b370d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde8002ae00 tx=0x7fde80009a10 comp rx=0 tx=0).stop 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 -- 172.21.15.38:0/4032646633 shutdown_connections 2024-09-21T06:20:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33474d0 0x5581b370e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4032646633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33681b0 0x5581b370d9b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 -- 172.21.15.38:0/4032646633 >> 172.21.15.38:0/4032646633 conn(0x5581b335c300 msgr2=0x5581b370b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 -- 172.21.15.38:0/4032646633 shutdown_connections 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde8db05640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 0x7fde740b8d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde840e5230 tx=0x7fde84003f20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.828+0000 7fde96cdb740 1 -- 172.21.15.38:0/4032646633 wait complete. 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.829+0000 7fde96cdb740 1 -- start start 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.829+0000 7fde96cdb740 1 Processor -- start 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.830+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.830+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3719630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.830+0000 7fde8e306640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.830+0000 7fde8e306640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48044/0 (socket says 172.21.15.38:48044) 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.830+0000 7fde8e306640 1 -- 172.21.15.38:0/4273376966 learned_addr learned my addr 172.21.15.38:0/4273376966 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b37253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8d304640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3719630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5581b35a9ab0 con 0x5581b333f2f0 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5581b3617730 con 0x5581b33474d0 2024-09-21T06:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5581b371c0d0 con 0x5581b33681b0 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 10 client.0 _ll_register_callbacks cb 0x5581b366b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 -- 172.21.15.38:0/4273376966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 msgr2=0x5581b37253c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b37253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 -- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 msgr2=0x5581b3719630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3719630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581b33d3790 con 0x5581b333f2f0 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde80036040 con 0x5581b333f2f0 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde8e306640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde80009620 tx=0x7fde800317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adedb5daeac861e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.831+0000 7fde717fa640 10 client.15777 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde717fa640 1 -- 172.21.15.38:0/4273376966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde800305e0 con 0x5581b333f2f0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde717fa640 1 -- 172.21.15.38:0/4273376966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fde80030780 con 0x5581b333f2f0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde717fa640 1 -- 172.21.15.38:0/4273376966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fde800309c0 con 0x5581b333f2f0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5581b344c620 con 0x5581b333f2f0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde717fa640 1 -- 172.21.15.38:0/4273376966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fde80047480 con 0x5581b333f2f0 2024-09-21T06:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 20 client.15777 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b3326d80 0x5581b372ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 4 client.15777 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.832+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581b3684640 con 0x5581b3326d80 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.833+0000 7fde8d304640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b3326d80 0x5581b372ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.833+0000 7fde8d304640 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b3326d80 0x5581b372ae70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff20ab8ef73f9c2b server_cookie=8956c0c917bced85 in_seq=0 out_seq=0 2024-09-21T06:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.833+0000 7fde717fa640 10 client.15777 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.834+0000 7fde717fa640 1 -- 172.21.15.38:0/4273376966 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5581b3684640 con 0x5581b3326d80 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.834+0000 7fde717fa640 10 client.15777 handle_command_reply: tid=0 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.834+0000 7fde96cdb740 1 client.15777 shutdown 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.834+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 msgr2=0x5581b37190f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.834+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde80009620 tx=0x7fde800317d0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 shutdown_connections 2024-09-21T06:20:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b3326d80 0x5581b372ae70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b37253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3719630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4273376966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b37190f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 >> 172.21.15.38:0/4273376966 conn(0x5581b335c300 msgr2=0x5581b370e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde717fa640 0 client.15777 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 shutdown_connections 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 1 -- 172.21.15.38:0/4273376966 wait complete. 2024-09-21T06:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.835+0000 7fde96cdb740 20 client.15777 trim_cache size 0 max 16384 2024-09-21T06:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 Processor -- start 2024-09-21T06:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 -- start start 2024-09-21T06:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3725330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b370aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde8e306640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde8e306640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48052/0 (socket says 172.21.15.38:48052) 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde8e306640 1 -- 172.21.15.38:0/4222009331 learned_addr learned my addr 172.21.15.38:0/4222009331 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fde881b3fd0 con 0x5581b333f2f0 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.865+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde881b18a0 con 0x5581b33474d0 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fde881af6f0 con 0x5581b33681b0 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b370aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8d304640 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3725330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 -- 172.21.15.38:0/4222009331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 msgr2=0x5581b370aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b370aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 -- 172.21.15.38:0/4222009331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 msgr2=0x5581b3725330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3725330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 -- 172.21.15.38:0/4222009331 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581b37107c0 con 0x5581b333f2f0 2024-09-21T06:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.866+0000 7fde8e306640 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fde8002ae00 tx=0x7fde8003e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe54c6766647e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.867+0000 7fde737fe640 1 -- 172.21.15.38:0/4222009331 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde800305e0 con 0x5581b333f2f0 2024-09-21T06:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.867+0000 7fde737fe640 1 -- 172.21.15.38:0/4222009331 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde80036040 con 0x5581b333f2f0 2024-09-21T06:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.867+0000 7fde737fe640 1 -- 172.21.15.38:0/4222009331 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80004d80 con 0x5581b333f2f0 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 msgr2=0x5581b370f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fde8002ae00 tx=0x7fde8003e050 comp rx=0 tx=0).stop 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 shutdown_connections 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b33681b0 0x5581b370aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b3725330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 --2- 172.21.15.38:0/4222009331 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b333f2f0 0x5581b370f0f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 >> 172.21.15.38:0/4222009331 conn(0x5581b335c300 msgr2=0x5581b370e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 shutdown_connections 2024-09-21T06:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.868+0000 7fde96cdb740 1 -- 172.21.15.38:0/4222009331 wait complete. 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.869+0000 7fde96cdb740 1 -- start start 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.869+0000 7fde96cdb740 1 Processor -- start 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b372bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b33681b0 0x5581b37935e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fde881afd60 con 0x5581b33681b0 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8e306640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8e306640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47526/0 (socket says 172.21.15.38:47526) 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8e306640 1 -- 172.21.15.38:0/3899506275 learned_addr learned my addr 172.21.15.38:0/3899506275 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8d304640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b372bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde881b11d0 con 0x5581b33474d0 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fde881b0430 con 0x5581b333f2f0 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8e306640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b33681b0 0x5581b37935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.870+0000 7fde8e306640 1 -- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 msgr2=0x5581b372bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8e306640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b372bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8e306640 1 -- 172.21.15.38:0/3899506275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b33681b0 msgr2=0x5581b37935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8e306640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b33681b0 0x5581b37935e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8e306640 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581b3793b20 con 0x5581b333f2f0 2024-09-21T06:20:33.873 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8d304640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b372bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde96cdb740 10 client.0 _ll_register_callbacks cb 0x7fde780097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde8e306640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5581b372edf0 tx=0x7fde800099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfad6535e2ed5989 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde80036040 con 0x5581b333f2f0 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde717fa640 10 client.25408 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde717fa640 1 -- 172.21.15.38:0/3899506275 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80004d40 con 0x5581b333f2f0 2024-09-21T06:20:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde717fa640 1 -- 172.21.15.38:0/3899506275 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fde8005b420 con 0x5581b333f2f0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde717fa640 1 -- 172.21.15.38:0/3899506275 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fde80079050 con 0x5581b333f2f0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.871+0000 7fde96cdb740 10 client.25408 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5581b3794b80 con 0x5581b333f2f0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde717fa640 1 -- 172.21.15.38:0/3899506275 <== mon.1 v2:172.21.15.174:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fde80066470 con 0x5581b333f2f0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 10 client.25408 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 10 client.25408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 20 client.25408 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b32fc1c0 0x5581b3797180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 4 client.25408 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.872+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581b36800f0 con 0x5581b32fc1c0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.873+0000 7fde8d304640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b32fc1c0 0x5581b3797180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.873+0000 7fde717fa640 10 client.25408 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.873+0000 7fde8d304640 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b32fc1c0 0x5581b3797180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cde750c4633549ff server_cookie=d598a33659a77cd7 in_seq=0 out_seq=0 2024-09-21T06:20:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde717fa640 1 -- 172.21.15.38:0/3899506275 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581b36800f0 con 0x5581b32fc1c0 2024-09-21T06:20:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde717fa640 10 client.25408 handle_command_reply: tid=0 2024-09-21T06:20:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 client.25408 shutdown 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 msgr2=0x5581b372b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5581b372edf0 tx=0x7fde800099a0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 shutdown_connections 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5581b33681b0 0x5581b37935e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5581b33474d0 0x5581b372bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5581b32fc1c0 0x5581b3797180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde717fa640 0 client.25408 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 --2- 172.21.15.38:0/3899506275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5581b333f2f0 0x5581b372b580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.879+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 >> 172.21.15.38:0/3899506275 conn(0x5581b335c300 msgr2=0x5581b371af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.880+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 shutdown_connections 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.880+0000 7fde96cdb740 1 -- 172.21.15.38:0/3899506275 wait complete. 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.880+0000 7fde96cdb740 20 client.25408 trim_cache size 0 max 16384 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:20:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 msgr2=0x7fde740b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 0x7fde740b8d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde840e5230 tx=0x7fde84003f20 comp rx=0 tx=0).stop 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 msgr2=0x7fde8819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde8400ea60 tx=0x7fde8400ef20 comp rx=0 tx=0).stop 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 shutdown_connections 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fde740b6810 0x7fde740b8d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fde88105a20 0x7fde881a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde881050d0 0x7fde8819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 --2- 172.21.15.38:0/442080592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde88103170 0x7fde8819c6d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde8400ea60 tx=0x7fde8400ef20 comp rx=0 tx=0).stop 2024-09-21T06:20:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 >> 172.21.15.38:0/442080592 conn(0x7fde88079e90 msgr2=0x7fde88101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 shutdown_connections 2024-09-21T06:20:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:33.881+0000 7fde8fd69640 1 -- 172.21.15.38:0/442080592 wait complete. 2024-09-21T06:20:33.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:33 smithi044 ceph-mon[34369]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T06:20:33.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 -- 172.21.15.38:0/950208393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1094b0 msgr2=0x7f237c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 --2- 172.21.15.38:0/950208393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1094b0 0x7f237c1098c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2370009900 tx=0x7f237002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:33.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 -- 172.21.15.38:0/950208393 shutdown_connections 2024-09-21T06:20:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 --2- 172.21.15.38:0/950208393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c109e00 0x7f237c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 --2- 172.21.15.38:0/950208393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c1094b0 0x7f237c1098c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 --2- 172.21.15.38:0/950208393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 0x7f237c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 -- 172.21.15.38:0/950208393 >> 172.21.15.38:0/950208393 conn(0x7f237c077c60 msgr2=0x7f237c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 -- 172.21.15.38:0/950208393 shutdown_connections 2024-09-21T06:20:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.950+0000 7f2381993640 1 -- 172.21.15.38:0/950208393 wait complete. 2024-09-21T06:20:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.951+0000 7f2381993640 1 Processor -- start 2024-09-21T06:20:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 -- start start 2024-09-21T06:20:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 0x7f237c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c1094b0 0x7f237c103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113be0 con 0x7f237c109e00 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113a60 con 0x7f237c1094b0 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f2381993640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113d60 con 0x7f237c101f70 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48074/0 (socket says 172.21.15.38:48074) 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f237b7fe640 1 -- 172.21.15.38:0/1408647274 learned_addr learned my addr 172.21.15.38:0/1408647274 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f237a7fc640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c1094b0 0x7f237c103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.952+0000 7f237affd640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 0x7f237c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 -- 172.21.15.38:0/1408647274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 msgr2=0x7f237c102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 0x7f237c102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 -- 172.21.15.38:0/1408647274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c1094b0 msgr2=0x7f237c103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c1094b0 0x7f237c103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 -- 172.21.15.38:0/1408647274 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c1a87f0 con 0x7f237c109e00 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f237b7fe640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f237400eb10 tx=0x7f237400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.953+0000 7f2380991640 1 -- 172.21.15.38:0/1408647274 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374004b20 con 0x7f237c109e00 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.954+0000 7f2380991640 1 -- 172.21.15.38:0/1408647274 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2374004cc0 con 0x7f237c109e00 2024-09-21T06:20:33.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.954+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c1a8ae0 con 0x7f237c109e00 2024-09-21T06:20:33.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.954+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c1a8f90 con 0x7f237c109e00 2024-09-21T06:20:33.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.955+0000 7f2380991640 1 -- 172.21.15.38:0/1408647274 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374010720 con 0x7f237c109e00 2024-09-21T06:20:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.958+0000 7f2380991640 1 -- 172.21.15.38:0/1408647274 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f23740109a0 con 0x7f237c109e00 2024-09-21T06:20:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 Processor -- start 2024-09-21T06:20:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 -- start start 2024-09-21T06:20:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e8b3350 0x55b51ec5a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec5a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b51ebd0e60 con 0x55b51e892670 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b51ebc0290 con 0x55b51e8b3350 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f2387f07740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b51ebc40a0 con 0x55b51e88a490 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.959+0000 7f237a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48086/0 (socket says 172.21.15.38:48086) 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 -- 172.21.15.38:0/1311198136 learned_addr learned my addr 172.21.15.38:0/1311198136 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e8b3350 0x55b51ec5a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237affd640 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec5a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 -- 172.21.15.38:0/1311198136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 msgr2=0x55b51ec5a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec5a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 -- 172.21.15.38:0/1311198136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e8b3350 msgr2=0x55b51ec5a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e8b3350 0x55b51ec5a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 -- 172.21.15.38:0/1311198136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51e91e930 con 0x55b51e892670 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f237a7fc640 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2370005ab0 tx=0x7f237002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533fe8f0c4ae04a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.960+0000 7f2361ffb640 1 -- 172.21.15.38:0/1311198136 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370041510 con 0x55b51e892670 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2361ffb640 1 -- 172.21.15.38:0/1311198136 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2370041b80 con 0x55b51e892670 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2361ffb640 1 -- 172.21.15.38:0/1311198136 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237003f940 con 0x55b51e892670 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2380991640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 0x7f23640b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2380991640 1 -- 172.21.15.38:0/1408647274 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f23740e8d30 con 0x7f237c109e00 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2387f07740 1 -- 172.21.15.38:0/1311198136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 msgr2=0x55b51ec5aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.961+0000 7f2387f07740 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2370005ab0 tx=0x7f237002a410 comp rx=0 tx=0).stop 2024-09-21T06:20:33.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 -- 172.21.15.38:0/1311198136 shutdown_connections 2024-09-21T06:20:33.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec5aeb0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec5a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 --2- 172.21.15.38:0/1311198136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e8b3350 0x55b51ec5a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 -- 172.21.15.38:0/1311198136 >> 172.21.15.38:0/1311198136 conn(0x55b51e8a7740 msgr2=0x55b51ec58320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 -- 172.21.15.38:0/1311198136 shutdown_connections 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f237affd640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 0x7f23640b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 -- 172.21.15.38:0/1311198136 wait complete. 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f2387f07740 1 -- start start 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.962+0000 7f237affd640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 0x7f23640b8d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55b51ec590b0 tx=0x7f236c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 Processor -- start 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec66500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e8b3350 0x55b51ec82eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f237affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b51ea21890 con 0x55b51e88a490 2024-09-21T06:20:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b51eb5ad40 con 0x55b51e892670 2024-09-21T06:20:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b51ec68bb0 con 0x55b51e8b3350 2024-09-21T06:20:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f237affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48094/0 (socket says 172.21.15.38:48094) 2024-09-21T06:20:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f237affd640 1 -- 172.21.15.38:0/2701967525 learned_addr learned my addr 172.21.15.38:0/2701967525 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f2387f07740 10 client.0 _ll_register_callbacks cb 0x55b51ebbec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f237b7fe640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e8b3350 0x55b51ec82eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.963+0000 7f237a7fc640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec66500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 -- 172.21.15.38:0/2701967525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e8b3350 msgr2=0x55b51ec82eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e8b3350 0x55b51ec82eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 -- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 msgr2=0x55b51ec66500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec66500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 -- 172.21.15.38:0/2701967525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51ec83440 con 0x55b51e88a490 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f237affd640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f236c011e60 tx=0x7f236c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c194aef18a837d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f235affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c025070 con 0x55b51e88a490 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2370041b80 con 0x55b51e88a490 2024-09-21T06:20:33.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f236c005220 con 0x55b51e88a490 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f236c030050 con 0x55b51e88a490 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f2387f07740 10 client.15795 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.964+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b51ec85e20 con 0x55b51e88a490 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2370041b80 con 0x55b51e88a490 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f236c012980 con 0x55b51e88a490 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 20 client.15795 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e871cd0 0x55b51ec892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 4 client.15795 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b51ebd2db0 con 0x55b51e871cd0 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.965+0000 7f237a7fc640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e871cd0 0x55b51ec892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.966+0000 7f235affd640 10 client.15795 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.966+0000 7f237a7fc640 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e871cd0 0x55b51ec892a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664c1e78859a2982 server_cookie=fcfbd27e7d8569b3 in_seq=0 out_seq=0 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f235affd640 1 -- 172.21.15.38:0/2701967525 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b51ebd2db0 con 0x55b51e871cd0 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f235affd640 10 client.15795 handle_command_reply: tid=0 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 client.15795 shutdown 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 msgr2=0x55b51ec65fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f236c011e60 tx=0x7f236c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 shutdown_connections 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e871cd0 0x55b51ec892a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e8b3350 0x55b51ec82eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f235affd640 0 client.15795 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec66500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 --2- 172.21.15.38:0/2701967525 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e88a490 0x55b51ec65fc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 >> 172.21.15.38:0/2701967525 conn(0x55b51e8a7740 msgr2=0x55b51ec5d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 shutdown_connections 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 1 -- 172.21.15.38:0/2701967525 wait complete. 2024-09-21T06:20:33.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.967+0000 7f2387f07740 20 client.15795 trim_cache size 0 max 16384 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.985+0000 7f2387f07740 1 Processor -- start 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.985+0000 7f2387f07740 1 -- start start 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec58390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec62fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f237c073850 con 0x55b51e871cd0 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f237c071120 con 0x55b51e892670 2024-09-21T06:20:33.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f2387f07740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f237c06ef70 con 0x55b51e88a490 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f237affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f237a7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec58390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec62fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f237affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48110/0 (socket says 172.21.15.38:48110) 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.986+0000 7f237affd640 1 -- 172.21.15.38:0/3767780606 learned_addr learned my addr 172.21.15.38:0/3767780606 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 -- 172.21.15.38:0/3767780606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 msgr2=0x55b51ec58390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec58390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 -- 172.21.15.38:0/3767780606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 msgr2=0x55b51ec62fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec62fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 -- 172.21.15.38:0/3767780606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51ec5c720 con 0x55b51e871cd0 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237b7fe640 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec62fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f237affd640 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f236c00bfd0 tx=0x7f236c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20970bbe36ac43a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f23617fa640 1 -- 172.21.15.38:0/3767780606 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c025040 con 0x55b51e871cd0 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.987+0000 7f23617fa640 1 -- 172.21.15.38:0/3767780606 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f236c039070 con 0x55b51e871cd0 2024-09-21T06:20:33.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f23617fa640 1 -- 172.21.15.38:0/3767780606 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004d90 con 0x55b51e871cd0 2024-09-21T06:20:33.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 -- 172.21.15.38:0/3767780606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 msgr2=0x55b51ec82e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f236c00bfd0 tx=0x7f236c011e90 comp rx=0 tx=0).stop 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 -- 172.21.15.38:0/3767780606 shutdown_connections 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e892670 0x55b51ec62fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e88a490 0x55b51ec58390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 --2- 172.21.15.38:0/3767780606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e871cd0 0x55b51ec82e30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.988+0000 7f2387f07740 1 -- 172.21.15.38:0/3767780606 >> 172.21.15.38:0/3767780606 conn(0x55b51e8a7740 msgr2=0x55b51ec57c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.989+0000 7f2387f07740 1 -- 172.21.15.38:0/3767780606 shutdown_connections 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.989+0000 7f2387f07740 1 -- 172.21.15.38:0/3767780606 wait complete. 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.989+0000 7f2387f07740 1 -- start start 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.989+0000 7f2387f07740 1 Processor -- start 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 0x55b51ec7f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e88a490 0x55b51ec7bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f237c06f5e0 con 0x55b51e892670 2024-09-21T06:20:33.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f237c070a50 con 0x55b51e88a490 2024-09-21T06:20:33.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f237c06fcb0 con 0x55b51e871cd0 2024-09-21T06:20:33.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f2387f07740 10 client.0 _ll_register_callbacks cb 0x7f236c016d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f237b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48126/0 (socket says 172.21.15.38:48126) 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f237b7fe640 1 -- 172.21.15.38:0/3103476799 learned_addr learned my addr 172.21.15.38:0/3103476799 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f237affd640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 0x55b51ec7f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.990+0000 7f237a7fc640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e88a490 0x55b51ec7bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 -- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e88a490 msgr2=0x55b51ec7bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e88a490 0x55b51ec7bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 -- 172.21.15.38:0/3103476799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 msgr2=0x55b51ec7c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 -- 172.21.15.38:0/3103476799 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51ec7c7b0 con 0x55b51e871cd0 2024-09-21T06:20:33.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237b7fe640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f237affd640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 0x55b51ec7f640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f236c012dd0 tx=0x7f236c016a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=479e9c905df841af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f235affd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c044060 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f236c03d450 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f236c039070 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.991+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f236c025040 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 10 client.25426 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b51ecf4bb0 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f236c01a040 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f236c049870 con 0x55b51e871cd0 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 10 client.25426 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 20 client.25426 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:33.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e8b3350 0x55b51ecf72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:33.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 4 client.25426 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:20:33.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f236c039070 con 0x55b51e8b3350 2024-09-21T06:20:33.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.992+0000 7f237a7fc640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e8b3350 0x55b51ecf72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:33.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.993+0000 7f235affd640 10 client.25426 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:33.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.994+0000 7f237a7fc640 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e8b3350 0x55b51ecf72b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb4af2a15df2c00 server_cookie=5e6a056b8b6d3caa in_seq=0 out_seq=0 2024-09-21T06:20:33.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.995+0000 7f235affd640 1 -- 172.21.15.38:0/3103476799 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f236c039070 con 0x55b51e8b3350 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.995+0000 7f235affd640 10 client.25426 handle_command_reply: tid=0 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.995+0000 7f2387f07740 1 client.25426 shutdown 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 msgr2=0x55b51ec7f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 0x55b51ec7f640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f236c012dd0 tx=0x7f236c016a40 comp rx=0 tx=0).stop 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 shutdown_connections 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b51e892670 0x55b51ec7c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b51e88a490 0x55b51ec7bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b51e8b3350 0x55b51ecf72b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 --2- 172.21.15.38:0/3103476799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b51e871cd0 0x55b51ec7f640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 >> 172.21.15.38:0/3103476799 conn(0x55b51e8a7740 msgr2=0x55b51ec67270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:33.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f235affd640 0 client.25426 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 shutdown_connections 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 1 -- 172.21.15.38:0/3103476799 wait complete. 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.996+0000 7f2387f07740 20 client.25426 trim_cache size 0 max 16384 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "deeae389-f623-4887-9b46-5fbab1e9858b", 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:20:34.000 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 msgr2=0x7f23640b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 0x7f23640b8d70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55b51ec590b0 tx=0x7f236c00b410 comp rx=0 tx=0).stop 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 msgr2=0x7f237c103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f237400eb10 tx=0x7f237400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 shutdown_connections 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f23640b6860 0x7f23640b8d70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f237c109e00 0x7f237c103990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f237c1094b0 0x7f237c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:34.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 --2- 172.21.15.38:0/1408647274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f237c101f70 0x7f237c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:34.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.997+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 >> 172.21.15.38:0/1408647274 conn(0x7f237c077c60 msgr2=0x7f237c1074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:34.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.998+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 shutdown_connections 2024-09-21T06:20:34.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:33.998+0000 7f2381993640 1 -- 172.21.15.38:0/1408647274 wait complete. 2024-09-21T06:20:34.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:34 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:20:34.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:34 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:34.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:34 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:20:34.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:34 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:34.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:20:34.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:34 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:20:34.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:34 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:34.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:34 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:20:34.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:34 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:34.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:34 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:20:34.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:34 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:34.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:34 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:20:34.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:34 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:20:35.134 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:20:35.566 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:35 smithi038 ceph-mon[31215]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T06:20:35.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.710+0000 7f17f92a8640 1 -- 172.21.15.38:0/2678167473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4102a60 msgr2=0x7f17f4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.710+0000 7f17f92a8640 1 --2- 172.21.15.38:0/2678167473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4102a60 0x7f17f4102e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009900 tx=0x7f17e402a410 comp rx=0 tx=0).stop 2024-09-21T06:20:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 -- 172.21.15.38:0/2678167473 shutdown_connections 2024-09-21T06:20:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 --2- 172.21.15.38:0/2678167473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f4108cf0 0x7f17f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 --2- 172.21.15.38:0/2678167473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f41083a0 0x7f17f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 --2- 172.21.15.38:0/2678167473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4102a60 0x7f17f4102e70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 -- 172.21.15.38:0/2678167473 >> 172.21.15.38:0/2678167473 conn(0x7f17f4079730 msgr2=0x7f17f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 -- 172.21.15.38:0/2678167473 shutdown_connections 2024-09-21T06:20:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.711+0000 7f17f92a8640 1 -- 172.21.15.38:0/2678167473 wait complete. 2024-09-21T06:20:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.712+0000 7f17f92a8640 1 Processor -- start 2024-09-21T06:20:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.712+0000 7f17f92a8640 1 -- start start 2024-09-21T06:20:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f41083a0 0x7f17f419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47604/0 (socket says 172.21.15.38:47604) 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48154/0 (socket says 172.21.15.38:48154) 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f2ffd640 1 -- 172.21.15.38:0/1829239084 learned_addr learned my addr 172.21.15.38:0/1829239084 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4113bf0 con 0x7f17f4108cf0 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4113a70 con 0x7f17f41083a0 2024-09-21T06:20:35.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4113d70 con 0x7f17f4102a60 2024-09-21T06:20:35.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.713+0000 7f17f27fc640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f41083a0 0x7f17f419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 -- 172.21.15.38:0/1829239084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f41083a0 msgr2=0x7f17f419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f41083a0 0x7f17f419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 -- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 msgr2=0x7f17f419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41a02e0 con 0x7f17f4102a60 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f37fe640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.714+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009850 tx=0x7f17e4030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.715+0000 7f17dbfff640 1 -- 172.21.15.38:0/1829239084 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e403f070 con 0x7f17f4102a60 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.715+0000 7f17dbfff640 1 -- 172.21.15.38:0/1829239084 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17e4004460 con 0x7f17f4102a60 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.715+0000 7f17dbfff640 1 -- 172.21.15.38:0/1829239084 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4035030 con 0x7f17f4102a60 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.715+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f41a0570 con 0x7f17f4102a60 2024-09-21T06:20:35.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.715+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f410fa90 con 0x7f17f4102a60 2024-09-21T06:20:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.718+0000 7f17ff81c740 1 Processor -- start 2024-09-21T06:20:35.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 -- start start 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22f41b0 0x5636b26c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5636b263ae50 con 0x5636b22fc390 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5636b262a280 con 0x5636b22f41b0 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17ff81c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5636b262e090 con 0x5636b231d070 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48158/0 (socket says 172.21.15.38:48158) 2024-09-21T06:20:35.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17f27fc640 1 -- 172.21.15.38:0/2537496749 learned_addr learned my addr 172.21.15.38:0/2537496749 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.719+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.720+0000 7f17f27fc640 1 -- 172.21.15.38:0/2537496749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 msgr2=0x5636b26c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.720+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.720+0000 7f17f27fc640 1 -- 172.21.15.38:0/2537496749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22f41b0 msgr2=0x5636b26c4780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.720+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22f41b0 0x5636b26c4780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.720+0000 7f17f27fc640 1 -- 172.21.15.38:0/2537496749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b2388650 con 0x5636b22fc390 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.721+0000 7f17dbfff640 1 -- 172.21.15.38:0/1829239084 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f17e4042070 con 0x7f17f4102a60 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.721+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b6c0 tx=0x7f17e800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68267cd1cd00fc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.721+0000 7f17d97fa640 1 -- 172.21.15.38:0/2537496749 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8003bd0 con 0x5636b22fc390 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.721+0000 7f17d97fa640 1 -- 172.21.15.38:0/2537496749 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17e801d070 con 0x5636b22fc390 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.722+0000 7f17d97fa640 1 -- 172.21.15.38:0/2537496749 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8004e10 con 0x5636b22fc390 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.722+0000 7f17dbfff640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 0x7f17dc0b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.722+0000 7f17dbfff640 1 -- 172.21.15.38:0/1829239084 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17e4107ef0 con 0x7f17f4102a60 2024-09-21T06:20:35.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.722+0000 7f17f37fe640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 0x7f17dc0b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 -- 172.21.15.38:0/2537496749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 msgr2=0x5636b26c4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b6c0 tx=0x7f17e800bb80 comp rx=0 tx=0).stop 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17f37fe640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 0x7f17dc0b8d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 -- 172.21.15.38:0/2537496749 shutdown_connections 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26c4cc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22f41b0 0x5636b26c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2537496749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 -- 172.21.15.38:0/2537496749 >> 172.21.15.38:0/2537496749 conn(0x5636b2311460 msgr2=0x5636b26c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.723+0000 7f17ff81c740 1 -- 172.21.15.38:0/2537496749 shutdown_connections 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.724+0000 7f17ff81c740 1 -- 172.21.15.38:0/2537496749 wait complete. 2024-09-21T06:20:35.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.724+0000 7f17ff81c740 1 -- start start 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.724+0000 7f17ff81c740 1 Processor -- start 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b231d070 0x5636b26dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5636b248b700 con 0x5636b22fc390 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5636b25c5110 con 0x5636b231d070 2024-09-21T06:20:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5636b26d2a20 con 0x5636b22f41b0 2024-09-21T06:20:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48170/0 (socket says 172.21.15.38:48170) 2024-09-21T06:20:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 -- 172.21.15.38:0/2856536346 learned_addr learned my addr 172.21.15.38:0/2856536346 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b231d070 0x5636b26dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 10 client.0 _ll_register_callbacks cb 0x5636b25de990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 -- 172.21.15.38:0/2856536346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 msgr2=0x5636b26cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 -- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b231d070 msgr2=0x5636b26dbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b231d070 0x5636b26dbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f27fc640 1 -- 172.21.15.38:0/2856536346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b25f2c40 con 0x5636b22fc390 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e801d070 con 0x5636b22fc390 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.725+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.726+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006010 tx=0x7f17e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58240cbdecf249ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.726+0000 7f17d6ff5640 10 client.15813 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.726+0000 7f17d6ff5640 1 -- 172.21.15.38:0/2856536346 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e802d430 con 0x5636b22fc390 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.726+0000 7f17d6ff5640 1 -- 172.21.15.38:0/2856536346 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17e802d5d0 con 0x5636b22fc390 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.726+0000 7f17d6ff5640 1 -- 172.21.15.38:0/2856536346 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f17e802d830 con 0x5636b22fc390 2024-09-21T06:20:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 10 client.15813 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5636b26de650 con 0x5636b22fc390 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17d6ff5640 1 -- 172.21.15.38:0/2856536346 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f17e802d9d0 con 0x5636b22fc390 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 10 client.15813 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 20 client.15813 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22db9f0 0x5636b26e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 4 client.15813 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.727+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636b263cda0 con 0x5636b22db9f0 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.728+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22db9f0 0x5636b26e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.728+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22db9f0 0x5636b26e19b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3d31c3782820c4 server_cookie=ac7d815e157d3d4b in_seq=0 out_seq=0 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.728+0000 7f17d6ff5640 10 client.15813 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17d6ff5640 1 -- 172.21.15.38:0/2856536346 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5636b263cda0 con 0x5636b22db9f0 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17d6ff5640 10 client.15813 handle_command_reply: tid=0 2024-09-21T06:20:35.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 client.15813 shutdown 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 msgr2=0x5636b26cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006010 tx=0x7f17e80048f0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 shutdown_connections 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b231d070 0x5636b26dbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22fc390 0x5636b26cfe30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22db9f0 0x5636b26e19b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17d6ff5640 0 client.15813 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2856536346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.729+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 >> 172.21.15.38:0/2856536346 conn(0x5636b2311460 msgr2=0x5636b26c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.730+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 shutdown_connections 2024-09-21T06:20:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.730+0000 7f17ff81c740 1 -- 172.21.15.38:0/2856536346 wait complete. 2024-09-21T06:20:35.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.730+0000 7f17ff81c740 20 client.15813 trim_cache size 0 max 16384 2024-09-21T06:20:35.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 Processor -- start 2024-09-21T06:20:35.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 -- start start 2024-09-21T06:20:35.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 0x5636b26dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41afcc0 con 0x5636b231d070 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41ad590 con 0x5636b22db9f0 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.764+0000 7f17ff81c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41ab3e0 con 0x5636b22f41b0 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58318/0 (socket says 172.21.15.38:58318) 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f2ffd640 1 -- 172.21.15.38:0/2206691179 learned_addr learned my addr 172.21.15.38:0/2206691179 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 0x5636b26dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f27fc640 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 -- 172.21.15.38:0/2206691179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 msgr2=0x5636b26c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 -- 172.21.15.38:0/2206691179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 msgr2=0x5636b26ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.765+0000 7f17f37fe640 1 -- 172.21.15.38:0/2206691179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b26d0bb0 con 0x5636b231d070 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.766+0000 7f17f37fe640 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 0x5636b26dbc10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009fd0 tx=0x7f17ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b568c43910a78d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.766+0000 7f17d8ff9640 1 -- 172.21.15.38:0/2206691179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec004b20 con 0x5636b231d070 2024-09-21T06:20:35.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.766+0000 7f17d8ff9640 1 -- 172.21.15.38:0/2206691179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17ec004cc0 con 0x5636b231d070 2024-09-21T06:20:35.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.766+0000 7f17d8ff9640 1 -- 172.21.15.38:0/2206691179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0053f0 con 0x5636b231d070 2024-09-21T06:20:35.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 -- 172.21.15.38:0/2206691179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 msgr2=0x5636b26dbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 0x5636b26dbc10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009fd0 tx=0x7f17ec015000 comp rx=0 tx=0).stop 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 -- 172.21.15.38:0/2206691179 shutdown_connections 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b231d070 0x5636b26dbc10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b22f41b0 0x5636b26c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 --2- 172.21.15.38:0/2206691179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 -- 172.21.15.38:0/2206691179 >> 172.21.15.38:0/2206691179 conn(0x5636b2311460 msgr2=0x5636b26c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 -- 172.21.15.38:0/2206691179 shutdown_connections 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.768+0000 7f17ff81c740 1 -- 172.21.15.38:0/2206691179 wait complete. 2024-09-21T06:20:35.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.769+0000 7f17ff81c740 1 -- start start 2024-09-21T06:20:35.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.769+0000 7f17ff81c740 1 Processor -- start 2024-09-21T06:20:35.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17f2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58326/0 (socket says 172.21.15.38:58326) 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48184/0 (socket says 172.21.15.38:48184) 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17f2ffd640 1 -- 172.21.15.38:0/3682415271 learned_addr learned my addr 172.21.15.38:0/3682415271 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41aba50 con 0x5636b22f41b0 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41acec0 con 0x5636b22db9f0 2024-09-21T06:20:35.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.770+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41ac120 con 0x5636b231d070 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f37fe640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f27fc640 1 -- 172.21.15.38:0/3682415271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 msgr2=0x5636b26d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f27fc640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26d4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f27fc640 1 -- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 msgr2=0x5636b26d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f27fc640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26d3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17f27fc640 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b274b200 con 0x5636b22f41b0 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17ff81c740 10 client.0 _ll_register_callbacks cb 0x7f17e80044f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:35.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.771+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17ec004cc0 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17f27fc640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f17e80045c0 tx=0x7f17e800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e643c889418659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17d6ff5640 10 client.15819 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17d6ff5640 1 -- 172.21.15.38:0/3682415271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8046020 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17d6ff5640 1 -- 172.21.15.38:0/3682415271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17e802d430 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17d6ff5640 1 -- 172.21.15.38:0/3682415271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f17e8042430 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17ff81c740 10 client.15819 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.772+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5636b274c2b0 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17d6ff5640 1 -- 172.21.15.38:0/3682415271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f17e80425d0 con 0x5636b22f41b0 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 10 client.15819 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 20 client.15819 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:35.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22b0da0 0x5636b274e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:35.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 4 client.15819 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:20:35.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636b2638850 con 0x5636b22b0da0 2024-09-21T06:20:35.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.773+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22b0da0 0x5636b274e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:35.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17d6ff5640 10 client.15819 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17f2ffd640 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22b0da0 0x5636b274e8a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5762fc8be9da04b4 server_cookie=c8b42972354caf50 in_seq=0 out_seq=0 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17d6ff5640 1 -- 172.21.15.38:0/3682415271 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x5636b2638850 con 0x5636b22b0da0 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17d6ff5640 10 client.15819 handle_command_reply: tid=0 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 client.15819 shutdown 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 msgr2=0x5636b26d41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f17e80045c0 tx=0x7f17e800b390 comp rx=0 tx=0).stop 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 shutdown_connections 2024-09-21T06:20:35.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5636b22b0da0 0x5636b274e8a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "deeae389-f623-4887-9b46-5fbab1e9858b", 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:20:35.779 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:35.780 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:20:35.781 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5636b231d070 0x5636b26d4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5636b22f41b0 0x5636b26d41e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 --2- 172.21.15.38:0/3682415271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5636b22db9f0 0x5636b26d3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 >> 172.21.15.38:0/3682415271 conn(0x5636b2311460 msgr2=0x5636b26ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17d6ff5640 0 client.15819 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 shutdown_connections 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 1 -- 172.21.15.38:0/3682415271 wait complete. 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.774+0000 7f17ff81c740 20 client.15819 trim_cache size 0 max 16384 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 msgr2=0x7f17dc0b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 0x7f17dc0b8d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005fd0 tx=0x7f17ec009600 comp rx=0 tx=0).stop 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 msgr2=0x7f17f419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009850 tx=0x7f17e4030650 comp rx=0 tx=0).stop 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 shutdown_connections 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17dc0b6810 0x7f17dc0b8d20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17f4108cf0 0x7f17f419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17f41083a0 0x7f17f419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 --2- 172.21.15.38:0/1829239084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17f4102a60 0x7f17f419a370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.775+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 >> 172.21.15.38:0/1829239084 conn(0x7f17f4079730 msgr2=0x7f17f4100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.776+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 shutdown_connections 2024-09-21T06:20:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:20:35.776+0000 7f17f92a8640 1 -- 172.21.15.38:0/1829239084 wait complete. 2024-09-21T06:20:35.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:35 smithi174 ceph-mon[34815]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T06:20:35.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:35 smithi044 ceph-mon[34369]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T06:20:36.417 INFO:tasks.cephfs.filesystem:scrub status for tag:deeae389-f623-4887-9b46-5fbab1e9858b - {'path': '/', 'tag': 'deeae389-f623-4887-9b46-5fbab1e9858b', 'options': 'recursive,force'} 2024-09-21T06:20:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:37 smithi038 ceph-mon[31215]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:20:37.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:37 smithi174 ceph-mon[34815]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:20:37.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:37 smithi044 ceph-mon[34369]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:20:38.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:38 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:20:38.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:38 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:20:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:38 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:20:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:39 smithi038 ceph-mon[31215]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:20:39.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:39 smithi174 ceph-mon[34815]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:20:39.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:39 smithi044 ceph-mon[34369]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:20:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:41 smithi044 ceph-mon[34369]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:41.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:41 smithi038 ceph-mon[31215]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:41 smithi174 ceph-mon[34815]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:43.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:43 smithi038 ceph-mon[31215]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:43.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:43 smithi174 ceph-mon[34815]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:43.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:43 smithi044 ceph-mon[34369]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:45 smithi038 ceph-mon[31215]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:45 smithi038 ceph-mon[31215]: mgrmap e27: x(active, since 9m), standbys: z, y 2024-09-21T06:20:45.769 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 92% (11742/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T06:20:45.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:45 smithi174 ceph-mon[34815]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:45.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:45 smithi174 ceph-mon[34815]: mgrmap e27: x(active, since 9m), standbys: z, y 2024-09-21T06:20:45.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:45 smithi044 ceph-mon[34369]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:20:45.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:45 smithi044 ceph-mon[34369]: mgrmap e27: x(active, since 9m), standbys: z, y 2024-09-21T06:20:46.641 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T06:20:46.641 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-21T06:20:46.642 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.643 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:20:46.643 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-21T06:20:46.643 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:20:46.647 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T06:20:46.668 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T06:20:46.670 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:20:46.670 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T06:20:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 -- 172.21.15.38:0/3442533263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 msgr2=0x7f756c108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 --2- 172.21.15.38:0/3442533263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c108720 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7558009900 tx=0x7f755802a410 comp rx=0 tx=0).stop 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 -- 172.21.15.38:0/3442533263 shutdown_connections 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 --2- 172.21.15.38:0/3442533263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c108c60 0x7f756c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 --2- 172.21.15.38:0/3442533263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c108720 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.986+0000 7f7572d20640 1 --2- 172.21.15.38:0/3442533263 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c1029e0 0x7f756c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.987+0000 7f7572d20640 1 -- 172.21.15.38:0/3442533263 >> 172.21.15.38:0/3442533263 conn(0x7f756c0fe3e0 msgr2=0x7f756c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.987+0000 7f7572d20640 1 -- 172.21.15.38:0/3442533263 shutdown_connections 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.987+0000 7f7572d20640 1 -- 172.21.15.38:0/3442533263 wait complete. 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.987+0000 7f7572d20640 1 Processor -- start 2024-09-21T06:20:46.989 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.987+0000 7f7572d20640 1 -- start start 2024-09-21T06:20:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c1029e0 0x7f756c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c108c60 0x7f756c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f756c112a80 con 0x7f756c108310 2024-09-21T06:20:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f756c112900 con 0x7f756c1029e0 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f756c112c00 con 0x7f756c108c60 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52254/0 (socket says 172.21.15.38:52254) 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7570abc640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c1029e0 0x7f756c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 -- 172.21.15.38:0/2291358187 learned_addr learned my addr 172.21.15.38:0/2291358187 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f75712bd640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c108c60 0x7f756c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 -- 172.21.15.38:0/2291358187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c108c60 msgr2=0x7f756c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c108c60 0x7f756c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 -- 172.21.15.38:0/2291358187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c1029e0 msgr2=0x7f756c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c1029e0 0x7f756c19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 -- 172.21.15.38:0/2291358187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c1a6610 con 0x7f756c108310 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f756bfff640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7558005940 tx=0x7f7558004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7569ffb640 1 -- 172.21.15.38:0/2291358187 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755803f030 con 0x7f756c108310 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7569ffb640 1 -- 172.21.15.38:0/2291358187 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7558003cd0 con 0x7f756c108310 2024-09-21T06:20:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.988+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c1a68a0 con 0x7f756c108310 2024-09-21T06:20:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.989+0000 7f7569ffb640 1 -- 172.21.15.38:0/2291358187 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558035070 con 0x7f756c108310 2024-09-21T06:20:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.989+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c1a6e10 con 0x7f756c108310 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.991+0000 7f7579c8b740 1 Processor -- start 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.991+0000 7f7579c8b740 1 -- start start 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7569ffb640 1 -- 172.21.15.38:0/2291358187 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7558042030 con 0x7f756c108310 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dc19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 0x559230dc1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559230d366f0 con 0x5592309fb4d0 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559230d25b20 con 0x559230a1c1b0 2024-09-21T06:20:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7579c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559230d29930 con 0x5592309f32f0 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7570abc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 0x559230dc1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52260/0 (socket says 172.21.15.38:52260) 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 -- 172.21.15.38:0/826413319 learned_addr learned my addr 172.21.15.38:0/826413319 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f75712bd640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dc19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 -- 172.21.15.38:0/826413319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 msgr2=0x559230dc1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 0x559230dc1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 -- 172.21.15.38:0/826413319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 msgr2=0x559230dc19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dc19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f756bfff640 1 -- 172.21.15.38:0/826413319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559230ceb530 con 0x5592309fb4d0 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7570abc640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 0x559230dc1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f75712bd640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dc19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.992+0000 7f7569ffb640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 0x7f755c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f756bfff640 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7558105880 tx=0x7f7558110540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919232b7e43b80f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f75712bd640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 0x7f755c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f7569ffb640 1 -- 172.21.15.38:0/2291358187 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7558108140 con 0x7f756c108310 2024-09-21T06:20:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f7556ffd640 1 -- 172.21.15.38:0/826413319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580ca660 con 0x5592309fb4d0 2024-09-21T06:20:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f7556ffd640 1 -- 172.21.15.38:0/826413319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7558005de0 con 0x5592309fb4d0 2024-09-21T06:20:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.993+0000 7f7556ffd640 1 -- 172.21.15.38:0/826413319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580cd780 con 0x5592309fb4d0 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- 172.21.15.38:0/826413319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 msgr2=0x559230dc2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f75712bd640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 0x7f755c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7564011550 tx=0x7f7564007680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7558105880 tx=0x7f7558110540 comp rx=0 tx=0).stop 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- 172.21.15.38:0/826413319 shutdown_connections 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309fb4d0 0x559230dc2430 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309f32f0 0x559230dc1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 --2- 172.21.15.38:0/826413319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dc19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- 172.21.15.38:0/826413319 >> 172.21.15.38:0/826413319 conn(0x559230a10300 msgr2=0x559230dbf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- 172.21.15.38:0/826413319 shutdown_connections 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- 172.21.15.38:0/826413319 wait complete. 2024-09-21T06:20:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 -- start start 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.994+0000 7f7579c8b740 1 Processor -- start 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dd9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559230c5dab0 con 0x5592309f32f0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559230ccb730 con 0x559230a1c1b0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559230dcfef0 con 0x5592309fb4d0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7579c8b740 10 client.0 _ll_register_callbacks cb 0x559230d1f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52262/0 (socket says 172.21.15.38:52262) 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 -- 172.21.15.38:0/3464338998 learned_addr learned my addr 172.21.15.38:0/3464338998 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f75712bd640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dd9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f756bfff640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 -- 172.21.15.38:0/3464338998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 msgr2=0x559230dcd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 -- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 msgr2=0x559230dd9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dd9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 -- 172.21.15.38:0/3464338998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559230a87790 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f75712bd640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dd9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f756bfff640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f7570abc640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7560011570 tx=0x7f7560009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed89ba6a2438282 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.995+0000 7f754bfff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560013670 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7560013810 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559230d38640 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7560013a10 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 10 client.15831 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559230b00620 con 0x5592309f32f0 2024-09-21T06:20:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x559230d38640 con 0x5592309f32f0 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7560027450 con 0x5592309f32f0 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 10 client.15831 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 20 client.15831 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309dad80 0x559230ddef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 4 client.15831 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.996+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559230d340f0 con 0x5592309dad80 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.997+0000 7f756bfff640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309dad80 0x559230ddef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.997+0000 7f754bfff640 10 client.15831 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.997+0000 7f756bfff640 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309dad80 0x559230ddef80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c54448dff70b0b96 server_cookie=f96ba1432ca5f9fe in_seq=0 out_seq=0 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f754bfff640 1 -- 172.21.15.38:0/3464338998 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559230d340f0 con 0x5592309dad80 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f754bfff640 10 client.15831 handle_command_reply: tid=0 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 client.15831 shutdown 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 msgr2=0x559230dcd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7560011570 tx=0x7f7560009f90 comp rx=0 tx=0).stop 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 shutdown_connections 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559230a1c1b0 0x559230dd9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309dad80 0x559230ddef80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3464338998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592309f32f0 0x559230dcd060 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f754bfff640 0 client.15831 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 >> 172.21.15.38:0/3464338998 conn(0x559230a10300 msgr2=0x559230dc29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 shutdown_connections 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 1 -- 172.21.15.38:0/3464338998 wait complete. 2024-09-21T06:20:47.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:46.998+0000 7f7579c8b740 20 client.15831 trim_cache size 0 max 16384 2024-09-21T06:20:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 Processor -- start 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 -- start start 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dc33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1b1f20 con 0x559230a1c1b0 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1af7f0 con 0x5592309f32f0 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7579c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ad660 con 0x5592309fb4d0 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f75712bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f75712bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52276/0 (socket says 172.21.15.38:52276) 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f75712bd640 1 -- 172.21.15.38:0/3670789816 learned_addr learned my addr 172.21.15.38:0/3670789816 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f7570abc640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dc33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.013+0000 7f756bfff640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 -- 172.21.15.38:0/3670789816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 msgr2=0x559230dcec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 -- 172.21.15.38:0/3670789816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 msgr2=0x559230dc33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dc33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 -- 172.21.15.38:0/3670789816 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559230dbf0f0 con 0x559230a1c1b0 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f756bfff640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f7570abc640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dc33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75712bd640 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7564007ba0 tx=0x7f7564014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcca6cf82883ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75567fc640 1 -- 172.21.15.38:0/3670789816 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564027640 con 0x559230a1c1b0 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75567fc640 1 -- 172.21.15.38:0/3670789816 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f756401d8e0 con 0x559230a1c1b0 2024-09-21T06:20:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.014+0000 7f75567fc640 1 -- 172.21.15.38:0/3670789816 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640269e0 con 0x559230a1c1b0 2024-09-21T06:20:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- 172.21.15.38:0/3670789816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 msgr2=0x559230dca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7564007ba0 tx=0x7f7564014000 comp rx=0 tx=0).stop 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- 172.21.15.38:0/3670789816 shutdown_connections 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dca230 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dcec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 --2- 172.21.15.38:0/3670789816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dc33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- 172.21.15.38:0/3670789816 >> 172.21.15.38:0/3670789816 conn(0x559230a10300 msgr2=0x559230dce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- 172.21.15.38:0/3670789816 shutdown_connections 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- 172.21.15.38:0/3670789816 wait complete. 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 -- start start 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.015+0000 7f7579c8b740 1 Processor -- start 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dd3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dd35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1adcb0 con 0x559230a1c1b0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1af120 con 0x5592309f32f0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ae380 con 0x5592309fb4d0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7579c8b740 10 client.0 _ll_register_callbacks cb 0x7f75600095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52286/0 (socket says 172.21.15.38:52286) 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 -- 172.21.15.38:0/1158012484 learned_addr learned my addr 172.21.15.38:0/1158012484 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f756bfff640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dd35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f7570abc640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dd3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 -- 172.21.15.38:0/1158012484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 msgr2=0x559230dd35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dd35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 -- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 msgr2=0x559230dd3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dd3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 -- 172.21.15.38:0/1158012484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559230e489a0 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f756bfff640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dd35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f75712bd640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f756401dcc0 tx=0x7f756401dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea13f8d96220fd9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.016+0000 7f754bfff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564004c50 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7564004df0 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f756401d8e0 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7564026720 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 10 client.15837 fetch_fsmap learned FSMap version 24 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559230e49c30 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f756401d8e0 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7564025070 con 0x559230a1c1b0 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 10 client.15837 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:20:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 20 client.15837 populate_metadata read hostname 'smithi038' 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309b01c0 0x559230e4c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 4 client.15837 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.017+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559230d31520 con 0x5592309b01c0 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.018+0000 7f7570abc640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309b01c0 0x559230e4c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.018+0000 7f754bfff640 10 client.15837 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.018+0000 7f7570abc640 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309b01c0 0x559230e4c3e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc8e7024a4b6b34 server_cookie=b49856e9288520c9 in_seq=0 out_seq=0 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f754bfff640 1 -- 172.21.15.38:0/1158012484 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559230d31520 con 0x5592309b01c0 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f754bfff640 10 client.15837 handle_command_reply: tid=0 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 client.15837 shutdown 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 msgr2=0x559230dd3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f756401dcc0 tx=0x7f756401dcf0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 shutdown_connections 2024-09-21T06:20:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559230a1c1b0 0x559230dd3ae0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592309b01c0 0x559230e4c3e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592309fb4d0 0x559230dd35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f754bfff640 0 client.15837 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 --2- 172.21.15.38:0/1158012484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592309f32f0 0x559230dd3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 >> 172.21.15.38:0/1158012484 conn(0x559230a10300 msgr2=0x559230dc3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 shutdown_connections 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.024+0000 7f7579c8b740 1 -- 172.21.15.38:0/1158012484 wait complete. 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7579c8b740 20 client.15837 trim_cache size 0 max 16384 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:20:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:20:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:20:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 msgr2=0x7f755c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 0x7f755c0b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7564011550 tx=0x7f7564007680 comp rx=0 tx=0).stop 2024-09-21T06:20:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 msgr2=0x7f756c19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:20:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7558005940 tx=0x7f7558004360 comp rx=0 tx=0).stop 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 shutdown_connections 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f755c0b6680 0x7f755c0b8b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f756c108c60 0x7f756c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f756c108310 0x7f756c19b950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 --2- 172.21.15.38:0/2291358187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f756c1029e0 0x7f756c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 >> 172.21.15.38:0/2291358187 conn(0x7f756c0fe3e0 msgr2=0x7f756c1079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 shutdown_connections 2024-09-21T06:20:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:20:47.025+0000 7f7572d20640 1 -- 172.21.15.38:0/2291358187 wait complete. 2024-09-21T06:20:47.374 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T06:20:47.444 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T06:20:47.486 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:20:47.488 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:20:47.488 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T06:20:47.528 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:20:47.531 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:20:47.531 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T06:20:47.588 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-21T06:20:47.589 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-21T06:20:47.589 DEBUG:teuthology.orchestra.run.smithi038:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-21T06:20:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:+ KERNEL=linux-4.0.5 2024-09-21T06:20:47.650 INFO:tasks.workunit.client.0.smithi038.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-21T06:20:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:47 smithi038 ceph-mon[31215]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:20:47.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:47 smithi174 ceph-mon[34815]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:20:47.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:47 smithi044 ceph-mon[34369]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:20:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:49 smithi038 ceph-mon[31215]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-21T06:20:49.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:49 smithi174 ceph-mon[34815]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-21T06:20:49.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:49 smithi044 ceph-mon[34369]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-21T06:20:50.516 INFO:tasks.workunit.client.0.smithi038.stderr:+ mkdir untar_tar 2024-09-21T06:20:50.520 INFO:tasks.workunit.client.0.smithi038.stderr:+ cd untar_tar 2024-09-21T06:20:50.520 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-21T06:20:50.561 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ 2024-09-21T06:20:50.563 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-21T06:20:50.564 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-21T06:20:50.565 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-21T06:20:50.567 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-21T06:20:50.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-21T06:20:50.569 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-21T06:20:50.570 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-21T06:20:50.572 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-21T06:20:50.573 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-21T06:20:50.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-21T06:20:50.575 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-21T06:20:50.577 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-21T06:20:50.578 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-21T06:20:50.579 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-21T06:20:50.580 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-21T06:20:50.581 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-21T06:20:50.583 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-21T06:20:50.584 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-21T06:20:50.585 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-21T06:20:50.586 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-21T06:20:50.587 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-21T06:20:50.589 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-21T06:20:50.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-21T06:20:50.591 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-21T06:20:50.592 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-21T06:20:50.593 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-21T06:20:50.594 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-21T06:20:50.596 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-21T06:20:50.597 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-21T06:20:50.598 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-21T06:20:50.599 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-21T06:20:50.600 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-21T06:20:50.601 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-21T06:20:50.602 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-21T06:20:50.603 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-21T06:20:50.604 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-21T06:20:50.605 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-21T06:20:50.606 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-21T06:20:50.607 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-21T06:20:50.608 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-21T06:20:50.609 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-21T06:20:50.611 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-21T06:20:50.612 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-21T06:20:50.613 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-21T06:20:50.614 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-21T06:20:50.615 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-21T06:20:50.616 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-21T06:20:50.618 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-21T06:20:50.619 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-21T06:20:50.620 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-21T06:20:50.621 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-21T06:20:50.622 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-21T06:20:50.623 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-21T06:20:50.624 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-21T06:20:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-21T06:20:50.626 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-21T06:20:50.627 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-21T06:20:50.628 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-21T06:20:50.629 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-21T06:20:50.630 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-21T06:20:50.631 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-21T06:20:50.632 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-21T06:20:50.633 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-21T06:20:50.634 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-21T06:20:50.635 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-21T06:20:50.636 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-21T06:20:50.637 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-21T06:20:50.638 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-21T06:20:50.639 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-21T06:20:50.640 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-21T06:20:50.641 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-21T06:20:50.642 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-21T06:20:50.643 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-21T06:20:50.645 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-21T06:20:50.646 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-21T06:20:50.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-21T06:20:50.648 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-21T06:20:50.649 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-21T06:20:50.650 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-21T06:20:50.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-21T06:20:50.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-21T06:20:50.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-21T06:20:50.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-21T06:20:50.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-21T06:20:50.657 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-21T06:20:50.658 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-21T06:20:50.659 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-21T06:20:50.660 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-21T06:20:50.661 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-21T06:20:50.662 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-21T06:20:50.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-21T06:20:50.664 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-21T06:20:50.665 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-21T06:20:50.666 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-21T06:20:50.667 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-21T06:20:50.668 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-21T06:20:50.669 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-21T06:20:50.670 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-21T06:20:50.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-21T06:20:50.672 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-21T06:20:50.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-21T06:20:50.675 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-21T06:20:50.676 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-21T06:20:50.677 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-21T06:20:50.678 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-21T06:20:50.679 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-21T06:20:50.680 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-21T06:20:50.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-21T06:20:50.682 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-21T06:20:50.683 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-21T06:20:50.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-21T06:20:50.686 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-21T06:20:50.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-21T06:20:50.688 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-21T06:20:50.689 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-21T06:20:50.690 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-21T06:20:50.691 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-21T06:20:50.692 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-21T06:20:50.693 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-21T06:20:50.694 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-21T06:20:50.695 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-21T06:20:50.696 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-21T06:20:50.697 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-21T06:20:50.699 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-21T06:20:50.700 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-21T06:20:50.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-21T06:20:50.702 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-21T06:20:50.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-21T06:20:50.704 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-21T06:20:50.705 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-21T06:20:50.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-21T06:20:50.707 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-21T06:20:50.708 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-21T06:20:50.709 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-21T06:20:50.710 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-21T06:20:50.711 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-21T06:20:50.712 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-21T06:20:50.713 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-21T06:20:50.714 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-21T06:20:50.715 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-21T06:20:50.716 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-21T06:20:50.717 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-21T06:20:50.718 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-21T06:20:50.719 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-21T06:20:50.720 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-21T06:20:50.721 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-21T06:20:50.722 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-21T06:20:50.724 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-21T06:20:50.725 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-21T06:20:50.726 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-21T06:20:50.727 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-21T06:20:50.728 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-21T06:20:50.729 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-21T06:20:50.730 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-21T06:20:50.731 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-21T06:20:50.732 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-21T06:20:50.733 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-21T06:20:50.734 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-21T06:20:50.735 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-21T06:20:50.736 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-21T06:20:50.737 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-21T06:20:50.738 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-21T06:20:50.739 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-21T06:20:50.740 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-21T06:20:50.741 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-21T06:20:50.742 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-21T06:20:50.743 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-21T06:20:50.744 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-21T06:20:50.745 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-21T06:20:50.746 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-21T06:20:50.747 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-21T06:20:50.748 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-21T06:20:50.749 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-21T06:20:50.750 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-21T06:20:50.751 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-21T06:20:50.752 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-21T06:20:50.753 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-21T06:20:50.754 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-21T06:20:50.755 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-21T06:20:50.756 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-21T06:20:50.757 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-21T06:20:50.758 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-21T06:20:50.759 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-21T06:20:50.760 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-21T06:20:50.761 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-21T06:20:50.762 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-21T06:20:50.763 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-21T06:20:50.764 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-21T06:20:50.765 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-21T06:20:50.766 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-21T06:20:50.767 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-21T06:20:50.768 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-21T06:20:50.769 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-21T06:20:50.770 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-21T06:20:50.771 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-21T06:20:50.772 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-21T06:20:50.773 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-21T06:20:50.774 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-21T06:20:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:51 smithi038 ceph-mon[31215]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:51.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:51 smithi174 ceph-mon[34815]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:51.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:51 smithi044 ceph-mon[34369]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:20:53.417 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-21T06:20:53.449 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-21T06:20:53.449 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-21T06:20:53.451 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-21T06:20:53.452 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-21T06:20:53.453 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-21T06:20:53.454 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-21T06:20:53.455 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-21T06:20:53.456 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-21T06:20:53.457 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-21T06:20:53.458 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-21T06:20:53.459 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-21T06:20:53.460 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-21T06:20:53.461 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-21T06:20:53.462 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-21T06:20:53.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-21T06:20:53.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-21T06:20:53.464 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-21T06:20:53.465 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-21T06:20:53.466 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-21T06:20:53.467 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-21T06:20:53.468 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-21T06:20:53.469 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-21T06:20:53.470 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-21T06:20:53.471 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-21T06:20:53.472 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-21T06:20:53.473 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-21T06:20:53.474 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-21T06:20:53.475 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-21T06:20:53.476 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-21T06:20:53.477 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-21T06:20:53.478 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-21T06:20:53.479 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-21T06:20:53.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-21T06:20:53.481 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-21T06:20:53.482 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-21T06:20:53.483 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-21T06:20:53.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-21T06:20:53.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-21T06:20:53.485 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-21T06:20:53.486 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-21T06:20:53.487 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-21T06:20:53.489 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-21T06:20:53.490 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-21T06:20:53.491 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-21T06:20:53.492 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-21T06:20:53.493 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-21T06:20:53.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-21T06:20:53.495 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-21T06:20:53.496 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-21T06:20:53.497 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-21T06:20:53.497 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-21T06:20:53.499 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-21T06:20:53.500 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-21T06:20:53.501 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-21T06:20:53.502 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-21T06:20:53.503 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-21T06:20:53.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-21T06:20:53.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-21T06:20:53.505 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-21T06:20:53.506 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-21T06:20:53.507 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-21T06:20:53.508 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-21T06:20:53.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/Changes 2024-09-21T06:20:53.510 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-21T06:20:53.511 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-21T06:20:53.512 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-21T06:20:53.513 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-21T06:20:53.514 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-21T06:20:53.515 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-21T06:20:53.516 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-21T06:20:53.516 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-21T06:20:53.517 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-21T06:20:53.518 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-21T06:20:53.520 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-21T06:20:53.520 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-21T06:20:53.521 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-21T06:20:53.522 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-21T06:20:53.523 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-21T06:20:53.524 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-21T06:20:53.526 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-21T06:20:53.527 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-21T06:20:53.528 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-21T06:20:53.528 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-21T06:20:53.530 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-21T06:20:53.530 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-21T06:20:53.531 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-21T06:20:53.532 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-21T06:20:53.533 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-21T06:20:53.534 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-21T06:20:53.535 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-21T06:20:53.535 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-21T06:20:53.536 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-21T06:20:53.537 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-21T06:20:53.538 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-21T06:20:53.539 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-21T06:20:53.540 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-21T06:20:53.541 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-21T06:20:53.541 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-21T06:20:53.542 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-21T06:20:53.543 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-21T06:20:53.544 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-21T06:20:53.545 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-21T06:20:53.546 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-21T06:20:53.547 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-21T06:20:53.548 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-21T06:20:53.549 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-21T06:20:53.550 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-21T06:20:53.550 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-21T06:20:53.551 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-21T06:20:53.552 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-21T06:20:53.554 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-21T06:20:53.556 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-21T06:20:53.557 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-21T06:20:53.557 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-21T06:20:53.558 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-21T06:20:53.560 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-21T06:20:53.560 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-21T06:20:53.561 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-21T06:20:53.562 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-21T06:20:53.562 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-21T06:20:53.564 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-21T06:20:53.565 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-21T06:20:53.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-21T06:20:53.569 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-21T06:20:53.570 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-21T06:20:53.571 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-21T06:20:53.572 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-21T06:20:53.573 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-21T06:20:53.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-21T06:20:53.575 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-21T06:20:53.576 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-21T06:20:53.577 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-21T06:20:53.578 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-21T06:20:53.579 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-21T06:20:53.580 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-21T06:20:53.581 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-21T06:20:53.582 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-21T06:20:53.583 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-21T06:20:53.584 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-21T06:20:53.585 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-21T06:20:53.586 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-21T06:20:53.589 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-21T06:20:53.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-21T06:20:53.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-21T06:20:53.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-21T06:20:53.591 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-21T06:20:53.592 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-21T06:20:53.593 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-21T06:20:53.594 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-21T06:20:53.596 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-21T06:20:53.597 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-21T06:20:53.598 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-21T06:20:53.599 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-21T06:20:53.600 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-21T06:20:53.601 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-21T06:20:53.602 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-21T06:20:53.603 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-21T06:20:53.604 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-21T06:20:53.605 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-21T06:20:53.606 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-21T06:20:53.607 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-21T06:20:53.608 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-21T06:20:53.609 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-21T06:20:53.610 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-21T06:20:53.611 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-21T06:20:53.612 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-21T06:20:53.613 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-21T06:20:53.613 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-21T06:20:53.615 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-21T06:20:53.616 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-21T06:20:53.617 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-21T06:20:53.618 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-21T06:20:53.619 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-21T06:20:53.620 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-21T06:20:53.621 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-21T06:20:53.622 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-21T06:20:53.623 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-21T06:20:53.624 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-21T06:20:53.625 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-21T06:20:53.625 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-21T06:20:53.626 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-21T06:20:53.627 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-21T06:20:53.628 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-21T06:20:53.629 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-21T06:20:53.630 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-21T06:20:53.631 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-21T06:20:53.632 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-21T06:20:53.633 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-21T06:20:53.634 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-21T06:20:53.635 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-21T06:20:53.636 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-21T06:20:53.637 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-21T06:20:53.638 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-21T06:20:53.639 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-21T06:20:53.639 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-21T06:20:53.641 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-21T06:20:53.642 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-21T06:20:53.643 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-21T06:20:53.643 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-21T06:20:53.645 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-21T06:20:53.645 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-21T06:20:53.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-21T06:20:53.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-21T06:20:53.648 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-21T06:20:53.650 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-21T06:20:53.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-21T06:20:53.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-21T06:20:53.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-21T06:20:53.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-21T06:20:53.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-21T06:20:53.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-21T06:20:53.657 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-21T06:20:53.657 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-21T06:20:53.658 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-21T06:20:53.659 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-21T06:20:53.660 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-21T06:20:53.661 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-21T06:20:53.662 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-21T06:20:53.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-21T06:20:53.664 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-21T06:20:53.665 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-21T06:20:53.666 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-21T06:20:53.667 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-21T06:20:53.668 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-21T06:20:53.669 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-21T06:20:53.670 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-21T06:20:53.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-21T06:20:53.672 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-21T06:20:53.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-21T06:20:53.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-21T06:20:53.675 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-21T06:20:53.675 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-21T06:20:53.676 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-21T06:20:53.677 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-21T06:20:53.678 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-21T06:20:53.680 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-21T06:20:53.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-21T06:20:53.682 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-21T06:20:53.682 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-21T06:20:53.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-21T06:20:53.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-21T06:20:53.686 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-21T06:20:53.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-21T06:20:53.688 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-21T06:20:53.688 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-21T06:20:53.690 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-21T06:20:53.691 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-21T06:20:53.692 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-21T06:20:53.693 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-21T06:20:53.694 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-21T06:20:53.695 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-21T06:20:53.696 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-21T06:20:53.697 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-21T06:20:53.698 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-21T06:20:53.699 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-21T06:20:53.700 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-21T06:20:53.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-21T06:20:53.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-21T06:20:53.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-21T06:20:53.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-21T06:20:53.704 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-21T06:20:53.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-21T06:20:53.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-21T06:20:53.707 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-21T06:20:53.708 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-21T06:20:53.709 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-21T06:20:53.710 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-21T06:20:53.711 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-21T06:20:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:53 smithi038 ceph-mon[31215]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T06:20:53.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:53 smithi174 ceph-mon[34815]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T06:20:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:53 smithi044 ceph-mon[34369]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-21T06:20:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: pgmap v356: 97 pgs: 97 active+clean; 22 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-21T06:20:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:55 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: pgmap v356: 97 pgs: 97 active+clean; 22 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:55 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: pgmap v356: 97 pgs: 97 active+clean; 22 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:55 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:56.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:56.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:20:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:20:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:20:57.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:57 smithi174 ceph-mon[34815]: pgmap v357: 97 pgs: 97 active+clean; 50 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-09-21T06:20:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:57 smithi044 ceph-mon[34369]: pgmap v357: 97 pgs: 97 active+clean; 50 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-09-21T06:20:57.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:57 smithi038 ceph-mon[31215]: pgmap v357: 97 pgs: 97 active+clean; 50 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 4.0 MiB/s wr, 17 op/s 2024-09-21T06:20:58.334 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-21T06:20:58.335 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-21T06:20:58.336 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-21T06:20:58.337 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-21T06:20:58.338 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-21T06:20:58.339 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-21T06:20:58.340 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-21T06:20:58.341 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-21T06:20:58.342 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-21T06:20:58.343 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-21T06:20:58.344 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-21T06:20:58.345 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-21T06:20:58.346 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-21T06:20:58.348 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-21T06:20:58.349 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-21T06:20:58.350 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-21T06:20:58.351 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-21T06:20:58.352 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-21T06:20:58.353 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-21T06:20:58.355 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-21T06:20:58.356 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-21T06:20:58.357 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-21T06:20:58.358 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-21T06:20:58.359 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-21T06:20:58.360 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-21T06:20:58.361 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-21T06:20:58.362 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-21T06:20:58.363 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-21T06:20:58.364 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-21T06:20:58.365 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-21T06:20:58.366 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-21T06:20:58.369 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-21T06:20:58.370 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-21T06:20:58.371 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-21T06:20:58.372 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-21T06:20:58.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-21T06:20:58.374 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-21T06:20:58.375 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-21T06:20:58.376 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-21T06:20:58.377 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-21T06:20:58.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-21T06:20:58.379 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-21T06:20:58.379 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-21T06:20:58.380 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-21T06:20:58.382 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-21T06:20:58.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-21T06:20:58.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-21T06:20:58.385 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-21T06:20:58.386 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-21T06:20:58.388 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-21T06:20:58.389 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-21T06:20:58.390 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/Makefile 2024-09-21T06:20:58.391 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-21T06:20:58.392 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-21T06:20:58.393 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-21T06:20:58.394 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-21T06:20:58.395 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-21T06:20:58.396 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-21T06:20:58.397 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-21T06:20:58.398 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-21T06:20:58.399 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-21T06:20:58.400 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-21T06:20:58.401 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-21T06:20:58.403 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-21T06:20:58.404 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-21T06:20:58.405 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-21T06:20:58.406 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-21T06:20:58.408 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-21T06:20:58.408 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-21T06:20:58.410 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-21T06:20:58.411 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-21T06:20:58.412 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-21T06:20:58.413 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-21T06:20:58.414 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-21T06:20:58.415 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-21T06:20:58.416 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-21T06:20:58.417 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-21T06:20:58.418 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-21T06:20:58.419 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-21T06:20:58.420 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-21T06:20:58.421 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-21T06:20:58.422 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-21T06:20:58.423 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-21T06:20:58.424 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-21T06:20:58.426 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-21T06:20:58.427 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-21T06:20:58.428 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-21T06:20:58.429 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-21T06:20:58.430 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-21T06:20:58.431 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-21T06:20:58.432 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-21T06:20:58.433 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-21T06:20:58.434 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-21T06:20:58.435 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-21T06:20:58.436 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-21T06:20:58.437 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-21T06:20:58.438 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-21T06:20:58.439 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-21T06:20:58.440 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-21T06:20:58.441 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-21T06:20:58.442 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-21T06:20:58.443 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-21T06:20:58.444 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-21T06:20:58.445 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-21T06:20:58.446 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-21T06:20:58.447 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-21T06:20:58.448 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-21T06:20:58.449 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-21T06:20:58.450 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-21T06:20:58.451 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-21T06:20:58.452 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-21T06:20:58.453 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-21T06:20:58.454 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-21T06:20:58.456 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-21T06:20:58.456 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-21T06:20:58.457 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-21T06:20:58.458 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-21T06:20:58.459 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/ 2024-09-21T06:20:58.460 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-21T06:20:58.461 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-21T06:20:58.462 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-21T06:20:58.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-21T06:20:58.464 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-21T06:20:58.465 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-21T06:20:58.466 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-21T06:20:58.467 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-21T06:20:58.468 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-21T06:20:58.469 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-21T06:20:58.470 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-21T06:20:58.471 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-21T06:20:58.472 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-21T06:20:58.473 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-21T06:20:58.474 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-21T06:20:58.475 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/README 2024-09-21T06:20:58.476 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-21T06:20:58.477 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-21T06:20:58.478 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-21T06:20:58.479 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-21T06:20:58.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-21T06:20:58.481 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-21T06:20:58.482 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-21T06:20:58.483 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-21T06:20:58.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-21T06:20:58.485 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-21T06:20:58.486 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-21T06:20:58.487 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-21T06:20:58.488 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-21T06:20:58.489 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-21T06:20:58.490 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-21T06:20:58.491 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-21T06:20:58.492 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-21T06:20:58.493 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-21T06:20:58.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-21T06:20:58.495 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-21T06:20:58.496 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-21T06:20:58.497 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-21T06:20:58.498 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-21T06:20:58.499 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-21T06:20:58.500 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-21T06:20:58.501 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-21T06:20:58.501 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-21T06:20:58.502 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-21T06:20:58.503 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-21T06:20:58.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-21T06:20:58.505 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-21T06:20:58.506 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-21T06:20:58.507 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-21T06:20:58.508 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-21T06:20:58.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-21T06:20:58.510 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-21T06:20:58.511 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-21T06:20:58.512 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-21T06:20:58.513 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-21T06:20:58.514 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-21T06:20:58.515 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-21T06:20:58.516 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-21T06:20:58.517 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-21T06:20:58.518 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-21T06:20:58.519 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-21T06:20:58.520 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-21T06:20:58.521 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-21T06:20:58.522 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-21T06:20:58.523 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-21T06:20:58.524 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-21T06:20:58.525 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-21T06:20:58.526 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-21T06:20:58.527 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-21T06:20:58.528 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-21T06:20:58.529 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-21T06:20:58.530 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-21T06:20:58.531 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-21T06:20:58.532 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-21T06:20:58.533 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-21T06:20:58.534 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-21T06:20:58.535 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-21T06:20:58.536 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-21T06:20:58.537 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-21T06:20:58.538 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-21T06:20:58.539 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-21T06:20:58.540 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-21T06:20:58.541 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-21T06:20:58.542 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-21T06:20:58.543 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-21T06:20:58.544 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-21T06:20:58.545 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-21T06:20:58.546 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-21T06:20:58.547 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-21T06:20:58.548 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-21T06:20:58.549 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-21T06:20:58.550 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-21T06:20:58.551 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-21T06:20:58.552 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-21T06:20:58.553 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-21T06:20:58.554 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-21T06:20:58.555 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-21T06:20:58.556 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-21T06:20:58.557 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-21T06:20:58.558 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-21T06:20:58.559 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-21T06:20:58.560 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-21T06:20:58.561 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-21T06:20:58.562 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-21T06:20:58.563 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-21T06:20:58.563 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-21T06:20:58.565 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-21T06:20:58.566 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-21T06:20:58.567 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-21T06:20:58.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-21T06:20:58.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-21T06:20:58.570 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-21T06:20:58.571 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-21T06:20:58.573 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-21T06:20:58.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-21T06:20:58.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/ 2024-09-21T06:20:58.575 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-21T06:20:58.576 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-21T06:20:58.577 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-21T06:20:58.578 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-21T06:20:58.579 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-21T06:20:58.580 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-21T06:20:58.581 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-21T06:20:58.582 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-21T06:20:58.583 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-21T06:20:58.584 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-21T06:20:58.585 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-21T06:20:58.586 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-21T06:20:58.587 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-21T06:20:58.588 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-21T06:20:58.589 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-21T06:20:58.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-21T06:20:58.591 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-21T06:20:58.592 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-21T06:20:58.593 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-21T06:20:58.594 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-21T06:20:58.595 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-21T06:20:58.596 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-21T06:20:58.597 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-21T06:20:58.598 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-21T06:20:58.599 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-21T06:20:58.600 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-21T06:20:58.601 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-21T06:20:58.602 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-21T06:20:58.603 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-21T06:20:58.604 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-21T06:20:58.605 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-21T06:20:58.606 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-21T06:20:58.607 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-21T06:20:58.608 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-21T06:20:58.609 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-21T06:20:58.611 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-21T06:20:58.612 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-21T06:20:58.613 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-21T06:20:58.614 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-21T06:20:58.615 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-21T06:20:58.616 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-21T06:20:58.617 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-21T06:20:58.619 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-21T06:20:58.619 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-21T06:20:58.621 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-21T06:20:58.622 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-21T06:20:58.623 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-21T06:20:58.624 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-21T06:20:58.625 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-21T06:20:58.626 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-21T06:20:58.627 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-21T06:20:58.628 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-21T06:20:58.629 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-21T06:20:58.630 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-21T06:20:58.631 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-21T06:20:58.632 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-21T06:20:58.633 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-21T06:20:58.634 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-21T06:20:58.635 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-21T06:20:58.636 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-21T06:20:58.637 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-21T06:20:58.638 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-21T06:20:58.639 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-21T06:20:58.640 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-21T06:20:58.640 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-21T06:20:58.642 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/ 2024-09-21T06:20:58.643 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-21T06:20:58.644 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-21T06:20:58.645 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-21T06:20:58.646 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-21T06:20:58.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-21T06:20:58.648 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/console/ 2024-09-21T06:20:58.649 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-21T06:20:58.650 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-21T06:20:58.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-21T06:20:58.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-21T06:20:58.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-21T06:20:58.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-21T06:20:58.655 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-21T06:20:58.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-21T06:20:58.657 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-21T06:20:58.658 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-21T06:20:58.659 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-21T06:20:58.660 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-21T06:20:58.661 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-21T06:20:58.662 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-21T06:20:58.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-21T06:20:58.664 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-21T06:20:58.665 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-21T06:20:58.666 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-21T06:20:58.667 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-21T06:20:58.668 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-21T06:20:58.670 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-21T06:20:58.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-21T06:20:58.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cris/ 2024-09-21T06:20:58.672 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/cris/README 2024-09-21T06:20:58.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-21T06:20:58.674 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-21T06:20:58.675 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-21T06:20:58.676 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-21T06:20:58.678 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-21T06:20:58.679 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-21T06:20:58.680 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-21T06:20:58.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-21T06:20:58.682 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-21T06:20:58.683 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-21T06:20:58.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-21T06:20:58.685 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-21T06:20:58.686 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-21T06:20:58.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-21T06:20:58.688 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-21T06:20:58.689 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-21T06:20:58.690 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-21T06:20:58.691 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-21T06:20:58.692 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-21T06:20:58.693 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-21T06:20:58.694 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-21T06:20:58.695 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-21T06:20:58.696 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-21T06:20:58.697 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-21T06:20:58.698 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-21T06:20:58.699 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-21T06:20:58.700 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-21T06:20:58.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-21T06:20:58.702 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-21T06:20:58.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-21T06:20:58.704 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-21T06:20:58.705 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-21T06:20:58.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-21T06:20:58.707 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-21T06:20:58.708 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-21T06:20:58.709 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-21T06:20:58.710 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-21T06:20:58.711 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-21T06:20:58.712 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-21T06:20:58.713 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-21T06:20:58.714 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-21T06:20:58.715 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-21T06:20:58.716 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-21T06:20:58.718 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-21T06:20:58.719 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-21T06:20:58.720 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-21T06:20:58.721 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-21T06:20:58.722 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-21T06:20:58.722 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-21T06:20:58.723 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-21T06:20:58.725 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-21T06:20:58.726 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-21T06:20:58.727 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-21T06:20:58.728 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-21T06:20:58.729 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-21T06:20:58.730 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-21T06:20:58.731 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-21T06:20:58.732 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-21T06:20:58.733 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-21T06:20:58.734 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-21T06:20:58.735 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-21T06:20:58.736 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-21T06:20:58.737 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-21T06:20:58.738 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-21T06:20:58.739 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-21T06:20:58.740 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-21T06:20:58.741 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-21T06:20:58.742 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-21T06:20:58.743 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-21T06:20:58.744 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-21T06:20:58.744 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-21T06:20:58.746 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-21T06:20:58.747 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-21T06:20:58.748 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-21T06:20:58.749 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-21T06:20:58.750 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-21T06:20:58.751 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-21T06:20:58.752 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-21T06:20:58.753 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-21T06:20:58.754 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-21T06:20:58.755 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-21T06:20:58.756 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-21T06:20:58.757 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-21T06:20:58.759 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-21T06:20:58.760 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-21T06:20:58.761 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-21T06:20:58.762 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-21T06:20:58.763 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-21T06:20:58.764 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-21T06:20:58.765 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-21T06:20:58.766 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-21T06:20:58.767 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-21T06:20:58.768 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-21T06:20:58.769 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-21T06:20:58.770 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-21T06:20:58.771 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-21T06:20:58.772 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-21T06:20:58.773 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-21T06:20:58.774 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-21T06:20:58.775 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-21T06:20:58.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-21T06:20:58.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-21T06:20:58.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-21T06:20:58.779 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-21T06:20:58.780 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-21T06:20:58.781 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-21T06:20:58.782 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-21T06:20:58.783 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-21T06:20:58.785 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-21T06:20:58.786 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-21T06:20:58.787 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-21T06:20:58.788 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-21T06:20:58.789 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-21T06:20:58.790 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-21T06:20:58.791 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-21T06:20:58.792 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-21T06:20:58.793 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-21T06:20:58.794 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-21T06:20:58.795 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-21T06:20:58.796 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-21T06:20:58.797 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-21T06:20:58.798 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-21T06:20:58.799 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-21T06:20:58.800 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-21T06:20:58.801 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-21T06:20:58.802 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-21T06:20:58.803 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-21T06:20:58.804 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-21T06:20:58.805 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-21T06:20:58.806 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-21T06:20:58.807 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-21T06:20:58.808 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-21T06:20:58.809 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-21T06:20:58.810 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-21T06:20:58.811 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-21T06:20:58.811 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-21T06:20:58.812 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-21T06:20:58.814 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-21T06:20:58.815 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-21T06:20:58.816 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-21T06:20:58.817 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-21T06:20:58.818 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-21T06:20:58.819 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-21T06:20:58.820 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-21T06:20:58.821 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-21T06:20:58.822 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-21T06:20:58.823 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-21T06:20:58.824 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-21T06:20:58.825 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-21T06:20:58.826 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-21T06:20:58.827 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-21T06:20:58.830 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-21T06:20:58.830 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-21T06:20:58.831 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-21T06:20:58.832 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-21T06:20:58.833 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-21T06:20:58.834 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-21T06:20:58.834 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-21T06:20:58.835 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-21T06:20:58.836 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-21T06:20:58.837 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-21T06:20:58.838 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-21T06:20:58.840 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-21T06:20:58.841 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-21T06:20:58.842 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-21T06:20:58.843 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-21T06:20:58.844 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-21T06:20:58.845 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-21T06:20:58.846 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-21T06:20:58.847 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-21T06:20:58.848 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-21T06:20:58.849 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-21T06:20:58.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-21T06:20:58.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-21T06:20:58.852 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-21T06:20:58.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-21T06:20:58.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-21T06:20:58.856 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-21T06:20:58.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-21T06:20:58.858 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-21T06:20:58.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-21T06:20:58.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-21T06:20:58.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-21T06:20:58.862 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-21T06:20:58.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-21T06:20:58.864 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-21T06:20:58.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-21T06:20:58.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-21T06:20:58.867 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-21T06:20:58.868 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-21T06:20:58.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-21T06:20:58.870 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-21T06:20:58.871 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-21T06:20:58.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-21T06:20:58.873 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-21T06:20:58.873 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-21T06:20:58.875 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-21T06:20:58.876 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-21T06:20:58.877 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-21T06:20:58.878 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-21T06:20:58.879 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-21T06:20:58.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-21T06:20:59.071 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-21T06:20:59.072 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-21T06:20:59.073 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-21T06:20:59.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-21T06:20:59.075 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-21T06:20:59.076 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-21T06:20:59.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-21T06:20:59.078 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-21T06:20:59.079 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-21T06:20:59.080 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-21T06:20:59.081 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-21T06:20:59.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-21T06:20:59.083 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-21T06:20:59.084 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-21T06:20:59.085 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-21T06:20:59.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-21T06:20:59.087 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-21T06:20:59.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-21T06:20:59.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-21T06:20:59.090 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-21T06:20:59.091 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-21T06:20:59.092 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-21T06:20:59.093 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-21T06:20:59.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-21T06:20:59.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-21T06:20:59.095 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-21T06:20:59.097 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-21T06:20:59.098 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-21T06:20:59.099 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-21T06:20:59.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-21T06:20:59.101 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-21T06:20:59.102 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-21T06:20:59.103 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-21T06:20:59.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-21T06:20:59.105 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-21T06:20:59.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-21T06:20:59.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-21T06:20:59.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-21T06:20:59.109 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-21T06:20:59.110 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-21T06:20:59.111 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-21T06:20:59.112 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-21T06:20:59.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-21T06:20:59.114 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-21T06:20:59.115 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-21T06:20:59.116 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-21T06:20:59.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-21T06:20:59.118 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-21T06:20:59.119 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-21T06:20:59.120 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-21T06:20:59.121 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-21T06:20:59.122 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-21T06:20:59.123 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-21T06:20:59.124 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-21T06:20:59.125 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-21T06:20:59.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-21T06:20:59.127 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-21T06:20:59.128 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-21T06:20:59.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-21T06:20:59.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-21T06:20:59.131 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-21T06:20:59.132 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-21T06:20:59.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-21T06:20:59.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-21T06:20:59.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-21T06:20:59.135 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-21T06:20:59.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-21T06:20:59.138 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-21T06:20:59.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-21T06:20:59.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-21T06:20:59.140 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-21T06:20:59.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-21T06:20:59.142 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-21T06:20:59.143 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-21T06:20:59.144 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-21T06:20:59.145 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-21T06:20:59.146 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-21T06:20:59.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-21T06:20:59.148 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-21T06:20:59.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-21T06:20:59.150 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-21T06:20:59.151 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-21T06:20:59.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-21T06:20:59.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-21T06:20:59.154 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-21T06:20:59.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-21T06:20:59.156 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-21T06:20:59.157 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-21T06:20:59.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-21T06:20:59.159 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-21T06:20:59.160 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-21T06:20:59.161 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-21T06:20:59.162 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-21T06:20:59.163 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-21T06:20:59.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-21T06:20:59.165 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-21T06:20:59.166 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-21T06:20:59.167 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-21T06:20:59.168 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-21T06:20:59.169 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-21T06:20:59.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-21T06:20:59.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-21T06:20:59.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-21T06:20:59.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-21T06:20:59.173 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-21T06:20:59.175 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-21T06:20:59.176 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-21T06:20:59.177 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-21T06:20:59.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-21T06:20:59.179 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-21T06:20:59.180 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-21T06:20:59.181 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-21T06:20:59.182 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-21T06:20:59.185 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-21T06:20:59.186 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-21T06:20:59.186 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-21T06:20:59.186 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-21T06:20:59.187 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-21T06:20:59.188 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-21T06:20:59.189 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-21T06:20:59.190 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-21T06:20:59.191 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-21T06:20:59.192 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-21T06:20:59.193 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-21T06:20:59.194 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-21T06:20:59.195 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-21T06:20:59.196 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-21T06:20:59.197 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-21T06:20:59.198 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-21T06:20:59.199 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-21T06:20:59.200 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-21T06:20:59.201 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-21T06:20:59.202 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-21T06:20:59.203 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-21T06:20:59.204 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-21T06:20:59.205 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-21T06:20:59.206 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-21T06:20:59.207 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-21T06:20:59.208 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-21T06:20:59.209 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-21T06:20:59.210 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-21T06:20:59.211 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-21T06:20:59.212 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-21T06:20:59.213 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-21T06:20:59.214 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-21T06:20:59.215 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-21T06:20:59.216 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-21T06:20:59.217 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-21T06:20:59.218 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-21T06:20:59.219 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-21T06:20:59.220 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-21T06:20:59.221 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-21T06:20:59.222 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-21T06:20:59.223 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-21T06:20:59.224 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-21T06:20:59.225 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-21T06:20:59.226 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-21T06:20:59.227 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-21T06:20:59.228 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-21T06:20:59.229 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-21T06:20:59.230 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-21T06:20:59.231 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-21T06:20:59.232 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-21T06:20:59.233 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-21T06:20:59.234 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-21T06:20:59.236 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-21T06:20:59.237 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-21T06:20:59.237 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-21T06:20:59.238 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-21T06:20:59.239 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-21T06:20:59.240 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-21T06:20:59.241 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-21T06:20:59.242 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-21T06:20:59.243 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-21T06:20:59.244 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-21T06:20:59.245 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-21T06:20:59.247 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-21T06:20:59.247 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-21T06:20:59.248 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-21T06:20:59.249 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-21T06:20:59.251 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-21T06:20:59.252 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-21T06:20:59.253 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-21T06:20:59.253 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-21T06:20:59.254 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-21T06:20:59.255 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-21T06:20:59.256 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-21T06:20:59.258 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-21T06:20:59.259 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-21T06:20:59.260 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-21T06:20:59.261 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-21T06:20:59.262 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-21T06:20:59.263 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-21T06:20:59.264 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-21T06:20:59.265 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-21T06:20:59.266 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-21T06:20:59.267 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-21T06:20:59.268 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-21T06:20:59.269 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-21T06:20:59.270 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-21T06:20:59.271 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-21T06:20:59.272 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-21T06:20:59.273 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-21T06:20:59.274 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-21T06:20:59.275 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-21T06:20:59.276 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-21T06:20:59.277 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-21T06:20:59.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-21T06:20:59.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-21T06:20:59.279 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-21T06:20:59.280 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-21T06:20:59.281 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-21T06:20:59.282 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-21T06:20:59.283 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-21T06:20:59.284 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-21T06:20:59.285 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-21T06:20:59.286 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-21T06:20:59.287 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-21T06:20:59.288 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-21T06:20:59.289 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-21T06:20:59.290 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-21T06:20:59.291 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-21T06:20:59.291 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-21T06:20:59.292 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-21T06:20:59.293 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-21T06:20:59.294 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-21T06:20:59.295 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-21T06:20:59.296 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-21T06:20:59.296 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-21T06:20:59.297 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-21T06:20:59.298 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-21T06:20:59.299 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-21T06:20:59.300 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-21T06:20:59.301 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-21T06:20:59.302 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-21T06:20:59.302 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-21T06:20:59.303 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-21T06:20:59.305 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-21T06:20:59.305 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-21T06:20:59.306 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-21T06:20:59.307 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-21T06:20:59.308 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-21T06:20:59.309 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-21T06:20:59.310 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-21T06:20:59.311 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-21T06:20:59.312 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-21T06:20:59.313 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-21T06:20:59.313 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-21T06:20:59.314 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-21T06:20:59.315 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-21T06:20:59.316 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-21T06:20:59.317 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-21T06:20:59.318 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-21T06:20:59.320 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-21T06:20:59.321 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-21T06:20:59.322 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-21T06:20:59.323 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-21T06:20:59.324 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-21T06:20:59.325 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-21T06:20:59.326 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-21T06:20:59.327 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-21T06:20:59.328 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-21T06:20:59.329 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-21T06:20:59.330 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-21T06:20:59.331 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-21T06:20:59.332 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-21T06:20:59.333 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-21T06:20:59.334 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-21T06:20:59.335 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-21T06:20:59.336 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-21T06:20:59.338 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-21T06:20:59.339 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-21T06:20:59.341 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-21T06:20:59.343 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-21T06:20:59.344 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-21T06:20:59.346 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-21T06:20:59.347 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-21T06:20:59.349 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-21T06:20:59.350 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-21T06:20:59.352 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-21T06:20:59.353 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-21T06:20:59.355 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-21T06:20:59.356 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-21T06:20:59.358 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-21T06:20:59.359 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-21T06:20:59.361 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-21T06:20:59.362 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-21T06:20:59.364 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-21T06:20:59.366 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-21T06:20:59.367 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-21T06:20:59.369 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-21T06:20:59.370 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-21T06:20:59.372 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-21T06:20:59.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-21T06:20:59.375 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-21T06:20:59.377 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-21T06:20:59.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-21T06:20:59.380 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-21T06:20:59.381 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-21T06:20:59.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-21T06:20:59.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-21T06:20:59.386 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-21T06:20:59.387 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-21T06:20:59.389 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-21T06:20:59.390 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-21T06:20:59.392 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-21T06:20:59.393 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-21T06:20:59.395 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-21T06:20:59.397 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-21T06:20:59.399 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-21T06:20:59.400 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-21T06:20:59.402 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-21T06:20:59.403 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-21T06:20:59.405 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-21T06:20:59.406 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-21T06:20:59.408 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-21T06:20:59.409 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-21T06:20:59.411 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-21T06:20:59.413 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-21T06:20:59.415 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-21T06:20:59.416 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-21T06:20:59.418 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-21T06:20:59.419 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-21T06:20:59.421 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-21T06:20:59.422 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-21T06:20:59.424 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-21T06:20:59.425 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-21T06:20:59.427 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-21T06:20:59.428 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-21T06:20:59.430 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-21T06:20:59.431 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-21T06:20:59.433 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-21T06:20:59.434 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-21T06:20:59.436 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-21T06:20:59.437 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-21T06:20:59.439 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-21T06:20:59.441 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-21T06:20:59.442 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-21T06:20:59.444 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-21T06:20:59.445 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-21T06:20:59.447 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-21T06:20:59.449 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-21T06:20:59.450 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-21T06:20:59.452 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-21T06:20:59.453 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-21T06:20:59.455 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-21T06:20:59.457 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-21T06:20:59.458 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-21T06:20:59.459 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-21T06:20:59.461 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-21T06:20:59.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-21T06:20:59.465 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-21T06:20:59.466 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-21T06:20:59.467 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-21T06:20:59.469 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-21T06:20:59.471 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-21T06:20:59.472 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-21T06:20:59.474 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-21T06:20:59.475 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-21T06:20:59.477 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-21T06:20:59.479 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-21T06:20:59.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-21T06:20:59.482 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-21T06:20:59.483 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-21T06:20:59.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-21T06:20:59.486 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-21T06:20:59.487 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-21T06:20:59.490 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-21T06:20:59.491 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-21T06:20:59.493 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-21T06:20:59.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-21T06:20:59.496 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-21T06:20:59.497 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-21T06:20:59.499 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-21T06:20:59.500 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-21T06:20:59.502 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-21T06:20:59.503 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-21T06:20:59.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-21T06:20:59.506 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-21T06:20:59.507 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-21T06:20:59.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-21T06:20:59.510 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-21T06:20:59.512 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-21T06:20:59.513 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-21T06:20:59.514 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-21T06:20:59.516 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-21T06:20:59.518 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-21T06:20:59.519 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-21T06:20:59.521 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-21T06:20:59.522 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-21T06:20:59.524 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-21T06:20:59.525 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-21T06:20:59.527 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-21T06:20:59.528 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-21T06:20:59.530 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-21T06:20:59.531 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-21T06:20:59.533 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-21T06:20:59.534 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-21T06:20:59.536 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-21T06:20:59.537 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-21T06:20:59.539 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-21T06:20:59.540 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-21T06:20:59.542 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-21T06:20:59.543 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-21T06:20:59.545 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-21T06:20:59.546 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-21T06:20:59.548 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-21T06:20:59.549 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-21T06:20:59.551 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-21T06:20:59.552 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-21T06:20:59.553 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-21T06:20:59.555 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-21T06:20:59.556 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-21T06:20:59.558 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-21T06:20:59.559 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-21T06:20:59.561 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-21T06:20:59.563 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-21T06:20:59.565 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-21T06:20:59.566 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-21T06:20:59.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-21T06:20:59.569 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-21T06:20:59.571 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-21T06:20:59.572 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-21T06:20:59.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-21T06:20:59.575 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-21T06:20:59.577 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-21T06:20:59.579 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-21T06:20:59.580 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-21T06:20:59.582 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-21T06:20:59.583 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-21T06:20:59.584 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-21T06:20:59.585 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-21T06:20:59.586 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-21T06:20:59.587 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-21T06:20:59.588 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-21T06:20:59.589 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-21T06:20:59.590 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-21T06:20:59.591 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-21T06:20:59.592 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-21T06:20:59.593 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-21T06:20:59.594 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-21T06:20:59.595 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-21T06:20:59.597 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-21T06:20:59.597 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-21T06:20:59.598 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-21T06:20:59.599 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-21T06:20:59.600 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-21T06:20:59.601 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-21T06:20:59.602 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-21T06:20:59.603 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-21T06:20:59.604 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-21T06:20:59.605 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-21T06:20:59.606 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-21T06:20:59.607 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-21T06:20:59.608 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-21T06:20:59.609 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-21T06:20:59.610 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-21T06:20:59.611 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-21T06:20:59.612 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-21T06:20:59.614 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-21T06:20:59.615 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-21T06:20:59.616 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-21T06:20:59.617 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-21T06:20:59.618 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-21T06:20:59.619 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-21T06:20:59.620 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-21T06:20:59.621 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-21T06:20:59.622 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-21T06:20:59.623 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-21T06:20:59.624 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-21T06:20:59.625 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-21T06:20:59.626 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-21T06:20:59.627 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-21T06:20:59.628 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-21T06:20:59.629 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-21T06:20:59.630 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-21T06:20:59.630 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-21T06:20:59.632 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-21T06:20:59.633 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-21T06:20:59.634 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-21T06:20:59.635 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-21T06:20:59.636 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-21T06:20:59.637 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-21T06:20:59.638 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-21T06:20:59.639 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-21T06:20:59.640 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-21T06:20:59.641 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-21T06:20:59.642 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-21T06:20:59.643 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-21T06:20:59.644 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-21T06:20:59.645 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-21T06:20:59.646 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-21T06:20:59.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-21T06:20:59.648 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-21T06:20:59.649 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-21T06:20:59.650 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-21T06:20:59.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-21T06:20:59.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-21T06:20:59.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-21T06:20:59.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-21T06:20:59.655 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-21T06:20:59.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-21T06:20:59.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-21T06:20:59.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-21T06:20:59.852 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-21T06:20:59.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-21T06:20:59.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-21T06:20:59.856 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-21T06:20:59.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-21T06:20:59.858 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-21T06:20:59.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-21T06:20:59.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-21T06:20:59.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-21T06:20:59.862 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-21T06:20:59.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-21T06:20:59.864 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-21T06:20:59.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-21T06:20:59.867 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-21T06:20:59.868 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-21T06:20:59.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-21T06:20:59.870 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-21T06:20:59.871 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-21T06:20:59.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-21T06:20:59.873 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-21T06:20:59.874 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-21T06:20:59.875 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-21T06:20:59.876 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-21T06:20:59.877 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-21T06:20:59.878 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-21T06:20:59.879 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-21T06:20:59.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-21T06:20:59.881 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-21T06:20:59.882 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-21T06:20:59.883 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-21T06:20:59.884 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-21T06:20:59.885 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-21T06:20:59.886 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-21T06:20:59.887 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-21T06:20:59.888 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-21T06:20:59.889 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-21T06:20:59.890 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-21T06:20:59.891 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-21T06:20:59.892 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-21T06:20:59.893 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-21T06:20:59.894 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-21T06:20:59.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:20:59 smithi174 ceph-mon[34815]: pgmap v358: 97 pgs: 97 active+clean; 73 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 27 op/s 2024-09-21T06:20:59.895 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-21T06:20:59.896 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-21T06:20:59.897 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-21T06:20:59.898 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-21T06:20:59.899 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-21T06:20:59.900 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-21T06:20:59.901 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-21T06:20:59.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-21T06:20:59.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-21T06:20:59.904 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-21T06:20:59.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:20:59 smithi044 ceph-mon[34369]: pgmap v358: 97 pgs: 97 active+clean; 73 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 27 op/s 2024-09-21T06:20:59.905 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-21T06:20:59.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-21T06:20:59.907 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-21T06:20:59.908 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-21T06:20:59.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-21T06:20:59.910 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-21T06:20:59.911 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-21T06:20:59.913 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-21T06:20:59.914 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-21T06:20:59.915 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-21T06:20:59.916 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-21T06:20:59.917 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-21T06:20:59.918 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-21T06:20:59.919 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-21T06:20:59.920 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-21T06:20:59.921 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-21T06:20:59.922 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-21T06:20:59.923 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-21T06:20:59.924 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-21T06:20:59.925 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-21T06:20:59.926 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-21T06:20:59.927 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-21T06:20:59.928 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-21T06:20:59.929 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-21T06:20:59.929 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-21T06:20:59.931 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-21T06:20:59.931 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-21T06:20:59.932 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-21T06:20:59.933 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-21T06:20:59.934 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-21T06:20:59.935 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-21T06:20:59.936 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-21T06:20:59.937 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-21T06:20:59.938 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-21T06:20:59.939 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-21T06:20:59.941 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-21T06:20:59.942 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-21T06:20:59.943 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-21T06:20:59.944 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-21T06:20:59.945 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-21T06:20:59.946 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-21T06:20:59.947 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-21T06:20:59.948 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-21T06:20:59.949 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-21T06:20:59.950 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-21T06:20:59.951 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-21T06:20:59.952 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-21T06:20:59.953 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-21T06:20:59.954 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-21T06:20:59.955 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-21T06:20:59.956 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-21T06:20:59.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-21T06:20:59.958 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-21T06:20:59.959 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-21T06:20:59.960 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-21T06:20:59.961 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-21T06:20:59.962 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-21T06:20:59.963 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-21T06:20:59.964 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-21T06:20:59.965 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-21T06:20:59.966 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-21T06:20:59.967 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-21T06:20:59.968 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-21T06:20:59.969 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-21T06:20:59.970 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-21T06:20:59.971 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-21T06:20:59.972 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-21T06:20:59.973 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-21T06:20:59.974 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-21T06:20:59.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-21T06:20:59.976 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-21T06:20:59.977 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-21T06:20:59.978 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-21T06:20:59.979 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-21T06:20:59.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-21T06:20:59.981 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-21T06:20:59.982 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-21T06:20:59.983 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-21T06:20:59.984 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-21T06:20:59.985 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-21T06:20:59.986 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-21T06:20:59.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:20:59 smithi038 ceph-mon[31215]: pgmap v358: 97 pgs: 97 active+clean; 73 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.0 MiB/s wr, 27 op/s 2024-09-21T06:20:59.987 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-21T06:20:59.988 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-21T06:20:59.989 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-21T06:20:59.990 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-21T06:20:59.990 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-21T06:20:59.992 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-21T06:20:59.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-21T06:20:59.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-21T06:20:59.995 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-21T06:20:59.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-21T06:20:59.997 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-21T06:20:59.998 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-21T06:20:59.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-21T06:21:00.000 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-21T06:21:00.001 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-21T06:21:00.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-21T06:21:00.003 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-21T06:21:00.004 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-21T06:21:00.005 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-21T06:21:00.006 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-21T06:21:00.007 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-21T06:21:00.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-21T06:21:00.009 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-21T06:21:00.010 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-21T06:21:00.011 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-21T06:21:00.012 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-21T06:21:00.013 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-21T06:21:00.014 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-21T06:21:00.014 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-21T06:21:00.016 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-21T06:21:00.017 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-21T06:21:00.018 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-21T06:21:00.019 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-21T06:21:00.020 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-21T06:21:00.021 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-21T06:21:00.022 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-21T06:21:00.023 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-21T06:21:00.024 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-21T06:21:00.025 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-21T06:21:00.026 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-21T06:21:00.027 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-21T06:21:00.028 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-21T06:21:00.029 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-21T06:21:00.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-21T06:21:00.031 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-21T06:21:00.032 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-21T06:21:00.033 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-21T06:21:00.034 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-21T06:21:00.035 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-21T06:21:00.036 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-21T06:21:00.037 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-21T06:21:00.038 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-21T06:21:00.039 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-21T06:21:00.041 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-21T06:21:00.042 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-21T06:21:00.043 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-21T06:21:00.044 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-21T06:21:00.046 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-21T06:21:00.047 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-21T06:21:00.048 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-21T06:21:00.049 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-21T06:21:00.051 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-21T06:21:00.052 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-21T06:21:00.053 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-21T06:21:00.054 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-21T06:21:00.055 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-21T06:21:00.056 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-21T06:21:00.057 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-21T06:21:00.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-21T06:21:00.059 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-21T06:21:00.061 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-21T06:21:00.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-21T06:21:00.063 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-21T06:21:00.065 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-21T06:21:00.067 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-21T06:21:00.069 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-21T06:21:00.070 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-21T06:21:00.072 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-21T06:21:00.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-21T06:21:00.076 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-21T06:21:00.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-21T06:21:00.079 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-21T06:21:00.081 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-21T06:21:00.083 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-21T06:21:00.084 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-21T06:21:00.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-21T06:21:00.087 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-21T06:21:00.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-21T06:21:00.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-21T06:21:00.090 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-21T06:21:00.091 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-21T06:21:00.093 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-21T06:21:00.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-21T06:21:00.095 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-21T06:21:00.096 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-21T06:21:00.097 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-21T06:21:00.098 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-21T06:21:00.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-21T06:21:00.101 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-21T06:21:00.102 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-21T06:21:00.103 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-21T06:21:00.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-21T06:21:00.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-21T06:21:00.107 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-21T06:21:00.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-21T06:21:00.109 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-21T06:21:00.111 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-21T06:21:00.112 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-21T06:21:00.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-21T06:21:00.114 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-21T06:21:00.115 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-21T06:21:00.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-21T06:21:00.118 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-21T06:21:00.119 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-21T06:21:00.120 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-21T06:21:00.121 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-21T06:21:00.122 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-21T06:21:00.124 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-21T06:21:00.125 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-21T06:21:00.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-21T06:21:00.127 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-21T06:21:00.128 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-21T06:21:00.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 -- 172.21.15.38:0/1151734859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 msgr2=0x7f10d0104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 --2- 172.21.15.38:0/1151734859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d0104da0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009900 tx=0x7f10c002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 -- 172.21.15.38:0/1151734859 shutdown_connections 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 --2- 172.21.15.38:0/1151734859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d010ddb0 0x7f10d0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 --2- 172.21.15.38:0/1151734859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d01052e0 0x7f10d010d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 --2- 172.21.15.38:0/1151734859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d0104da0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 -- 172.21.15.38:0/1151734859 >> 172.21.15.38:0/1151734859 conn(0x7f10d00fe3e0 msgr2=0x7f10d0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 -- 172.21.15.38:0/1151734859 shutdown_connections 2024-09-21T06:21:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.128+0000 7f10d592b640 1 -- 172.21.15.38:0/1151734859 wait complete. 2024-09-21T06:21:00.132 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 Processor -- start 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 -- start start 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d01052e0 0x7f10d019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d010ddb0 0x7f10d019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0113b60 con 0x7f10d0104990 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01139e0 con 0x7f10d01052e0 2024-09-21T06:21:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10d592b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10d0113ce0 con 0x7f10d010ddb0 2024-09-21T06:21:00.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.129+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44608/0 (socket says 172.21.15.38:44608) 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 -- 172.21.15.38:0/1855685327 learned_addr learned my addr 172.21.15.38:0/1855685327 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d01052e0 0x7f10d019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d010ddb0 0x7f10d019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 -- 172.21.15.38:0/1855685327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d010ddb0 msgr2=0x7f10d019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d010ddb0 0x7f10d019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 -- 172.21.15.38:0/1855685327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d01052e0 msgr2=0x7f10d019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d01052e0 0x7f10d019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 -- 172.21.15.38:0/1855685327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d01a0470 con 0x7f10d0104990 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005ab0 tx=0x7f10c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.135 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10d4929640 1 -- 172.21.15.38:0/1855685327 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c003f030 con 0x7f10d0104990 2024-09-21T06:21:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10d4929640 1 -- 172.21.15.38:0/1855685327 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10c0003cd0 con 0x7f10d0104990 2024-09-21T06:21:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d01a0700 con 0x7f10d0104990 2024-09-21T06:21:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10d4929640 1 -- 172.21.15.38:0/1855685327 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0035070 con 0x7f10d0104990 2024-09-21T06:21:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.130+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d01a6ef0 con 0x7f10d0104990 2024-09-21T06:21:00.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-21T06:21:00.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-21T06:21:00.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 Processor -- start 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 -- start start 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10d4929640 1 -- 172.21.15.38:0/1855685327 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f10c0042030 con 0x7f10d0104990 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafbaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559cdaf2f6f0 con 0x559cdabf44d0 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cdaf1eb20 con 0x559cdac151b0 2024-09-21T06:21:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10dc89a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559cdaf22930 con 0x559cdabec2f0 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10ce7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10cf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10ce7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44610/0 (socket says 172.21.15.38:44610) 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10ce7fc640 1 -- 172.21.15.38:0/248968662 learned_addr learned my addr 172.21.15.38:0/248968662 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58318/0 (socket says 172.21.15.38:58318) 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.133+0000 7f10ceffd640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafbaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 -- 172.21.15.38:0/248968662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 msgr2=0x559cdafbaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafbaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 -- 172.21.15.38:0/248968662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 msgr2=0x559cdafba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 -- 172.21.15.38:0/248968662 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdaee4530 con 0x559cdabf44d0 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10d4929640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 0x7f10b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.140 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-21T06:21:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 0x7f10b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f10c400b690 tx=0x7f10c400bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5170ee265823f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10d4929640 1 -- 172.21.15.38:0/1855685327 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f10c0107ef0 con 0x7f10d0104990 2024-09-21T06:21:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10b5ffb640 1 -- 172.21.15.38:0/248968662 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4003bd0 con 0x559cdabf44d0 2024-09-21T06:21:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10b5ffb640 1 -- 172.21.15.38:0/248968662 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10c4015070 con 0x559cdabf44d0 2024-09-21T06:21:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.134+0000 7f10b5ffb640 1 -- 172.21.15.38:0/248968662 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004e00 con 0x559cdabf44d0 2024-09-21T06:21:00.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-21T06:21:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 -- 172.21.15.38:0/248968662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 msgr2=0x559cdafbb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f10c400b690 tx=0x7f10c400bb50 comp rx=0 tx=0).stop 2024-09-21T06:21:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 0x7f10b80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f10c8005fd0 tx=0x7f10c8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 -- 172.21.15.38:0/248968662 shutdown_connections 2024-09-21T06:21:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafbb430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafbaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 --2- 172.21.15.38:0/248968662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdac151b0 0x559cdafba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 -- 172.21.15.38:0/248968662 >> 172.21.15.38:0/248968662 conn(0x559cdac09300 msgr2=0x559cdafb88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 -- 172.21.15.38:0/248968662 shutdown_connections 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.135+0000 7f10dc89a740 1 -- 172.21.15.38:0/248968662 wait complete. 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 -- start start 2024-09-21T06:21:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 Processor -- start 2024-09-21T06:21:00.143 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafc6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafc65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559cdae56ab0 con 0x559cdac151b0 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559cdaec4730 con 0x559cdabf44d0 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559cdafc9130 con 0x559cdabec2f0 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10dc89a740 10 client.0 _ll_register_callbacks cb 0x559cdaf186b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44620/0 (socket says 172.21.15.38:44620) 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10cf7fe640 1 -- 172.21.15.38:0/3244682659 learned_addr learned my addr 172.21.15.38:0/3244682659 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafc6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.136+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafc65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 -- 172.21.15.38:0/3244682659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 msgr2=0x559cdafc6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafc6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 -- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 msgr2=0x559cdafc65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafc65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 -- 172.21.15.38:0/3244682659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdac80790 con 0x559cdac151b0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f10c8010bf0 tx=0x7f10c8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97e79cf36e7e47a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c802c060 con 0x559cdac151b0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f10c8017030 con 0x559cdac151b0 2024-09-21T06:21:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c4015070 con 0x559cdac151b0 2024-09-21T06:21:00.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10c801fd40 con 0x559cdac151b0 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10dc89a740 10 client.15849 fetch_fsmap learned FSMap version 24 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.137+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559cdacf9620 con 0x559cdac151b0 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10c4015070 con 0x559cdac151b0 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10c8027530 con 0x559cdac151b0 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 10 client.15849 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 20 client.15849 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdabd3d80 0x559cdafd81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 4 client.15849 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cdaf31640 con 0x559cdabd3d80 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdabd3d80 0x559cdafd81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.138+0000 7f10aeffd640 10 client.15849 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.139+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdabd3d80 0x559cdafd81f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7b5a6938ee8e21 server_cookie=7b6951bf914866b0 in_seq=0 out_seq=0 2024-09-21T06:21:00.150 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10aeffd640 1 -- 172.21.15.38:0/3244682659 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559cdaf31640 con 0x559cdabd3d80 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10aeffd640 10 client.15849 handle_command_reply: tid=0 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 client.15849 shutdown 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 msgr2=0x559cdafd2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f10c8010bf0 tx=0x7f10c8004ab0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 shutdown_connections 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdac151b0 0x559cdafd2420 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafc65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdabd3d80 0x559cdafd81f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3244682659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdabec2f0 0x559cdafc6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10aeffd640 0 client.15849 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.141+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 >> 172.21.15.38:0/3244682659 conn(0x559cdac09300 msgr2=0x559cdafbb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.142+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 shutdown_connections 2024-09-21T06:21:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.142+0000 7f10dc89a740 1 -- 172.21.15.38:0/3244682659 wait complete. 2024-09-21T06:21:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.142+0000 7f10dc89a740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T06:21:00.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-21T06:21:00.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-21T06:21:00.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-21T06:21:00.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-21T06:21:00.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-21T06:21:00.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-21T06:21:00.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-21T06:21:00.157 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-21T06:21:00.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 Processor -- start 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 -- start start 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafd2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafc3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01b1e40 con 0x559cdabec2f0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01af710 con 0x559cdabf44d0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10dc89a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01ad560 con 0x559cdac151b0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44626/0 (socket says 172.21.15.38:44626) 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 -- 172.21.15.38:0/3142029474 learned_addr learned my addr 172.21.15.38:0/3142029474 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafd2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafc3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 -- 172.21.15.38:0/3142029474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 msgr2=0x559cdafc3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafc3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 -- 172.21.15.38:0/3142029474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 msgr2=0x559cdafd2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafd2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ceffd640 1 -- 172.21.15.38:0/3142029474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cdafc6980 con 0x559cdabec2f0 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafc3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:21:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.157+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafd2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:00.162 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.158+0000 7f10ceffd640 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cdac0 tx=0x7f10c010ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d8fd4ee858f8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.158+0000 7f10b57fa640 1 -- 172.21.15.38:0/3142029474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0049040 con 0x559cdabec2f0 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.158+0000 7f10b57fa640 1 -- 172.21.15.38:0/3142029474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10c00cd8d0 con 0x559cdabec2f0 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.158+0000 7f10b57fa640 1 -- 172.21.15.38:0/3142029474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c00d28a0 con 0x559cdabec2f0 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- 172.21.15.38:0/3142029474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 msgr2=0x559cdafc7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cdac0 tx=0x7f10c010ba40 comp rx=0 tx=0).stop 2024-09-21T06:21:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- 172.21.15.38:0/3142029474 shutdown_connections 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafc3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabf44d0 0x559cdafd2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 --2- 172.21.15.38:0/3142029474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabec2f0 0x559cdafc7c90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- 172.21.15.38:0/3142029474 >> 172.21.15.38:0/3142029474 conn(0x559cdac09300 msgr2=0x559cdafc7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- 172.21.15.38:0/3142029474 shutdown_connections 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- 172.21.15.38:0/3142029474 wait complete. 2024-09-21T06:21:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 -- start start 2024-09-21T06:21:00.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.159+0000 7f10dc89a740 1 Processor -- start 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafcbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafcc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01adbd0 con 0x559cdabf44d0 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01af040 con 0x559cdabec2f0 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10d01ae2a0 con 0x559cdac151b0 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 10 client.0 _ll_register_callbacks cb 0x7f10c8011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ce7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafcbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58342/0 (socket says 172.21.15.38:58342) 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 -- 172.21.15.38:0/1008428840 learned_addr learned my addr 172.21.15.38:0/1008428840 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10cf7fe640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafcc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 -- 172.21.15.38:0/1008428840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 msgr2=0x559cdafcc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafcc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 -- 172.21.15.38:0/1008428840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 msgr2=0x559cdafcbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafcbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 -- 172.21.15.38:0/1008428840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cdafcc8a0 con 0x559cdabec2f0 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafcbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10ceffd640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10c0004600 tx=0x7f10c002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c8f77a6cbc9887 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0049070 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f10c00ca030 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.160+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c00cd8d0 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10c00c9c60 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 10 client.25505 fetch_fsmap learned FSMap version 24 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559cdb042850 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10c00cd8d0 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10c00d7350 con 0x559cdabec2f0 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 10 client.25505 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 10 client.25505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 20 client.25505 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdaba91c0 0x559cdb044f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 4 client.25505 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:21:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559cdaf2d0f0 con 0x559cdaba91c0 2024-09-21T06:21:00.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-21T06:21:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.161+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdaba91c0 0x559cdb044f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.162+0000 7f10aeffd640 10 client.25505 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.162+0000 7f10ce7fc640 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdaba91c0 0x559cdb044f90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26a6048220804b9 server_cookie=6e22b9fa9b36ab20 in_seq=0 out_seq=0 2024-09-21T06:21:00.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-21T06:21:00.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-21T06:21:00.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-21T06:21:00.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-21T06:21:00.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-21T06:21:00.173 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-21T06:21:00.174 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-21T06:21:00.175 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-21T06:21:00.177 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-21T06:21:00.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-21T06:21:00.179 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-21T06:21:00.180 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-21T06:21:00.181 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-21T06:21:00.183 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-21T06:21:00.184 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-21T06:21:00.185 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-21T06:21:00.187 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-21T06:21:00.188 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-21T06:21:00.189 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-21T06:21:00.190 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-21T06:21:00.191 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-21T06:21:00.193 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-21T06:21:00.194 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-21T06:21:00.195 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-21T06:21:00.196 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-21T06:21:00.197 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-21T06:21:00.198 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-21T06:21:00.199 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-21T06:21:00.201 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-21T06:21:00.202 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-21T06:21:00.203 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-21T06:21:00.204 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-21T06:21:00.205 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-21T06:21:00.206 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-21T06:21:00.208 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-21T06:21:00.209 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-21T06:21:00.210 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-21T06:21:00.211 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-21T06:21:00.213 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-21T06:21:00.214 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-21T06:21:00.215 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-21T06:21:00.216 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-21T06:21:00.218 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-21T06:21:00.219 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-21T06:21:00.220 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-21T06:21:00.221 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-21T06:21:00.223 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-21T06:21:00.224 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-21T06:21:00.225 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-21T06:21:00.226 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-21T06:21:00.227 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-21T06:21:00.228 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-21T06:21:00.230 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-21T06:21:00.231 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-21T06:21:00.232 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-21T06:21:00.233 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-21T06:21:00.234 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-21T06:21:00.236 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-21T06:21:00.237 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-21T06:21:00.238 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-21T06:21:00.239 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-21T06:21:00.241 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-21T06:21:00.242 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-21T06:21:00.244 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-21T06:21:00.245 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-21T06:21:00.246 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-21T06:21:00.247 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-21T06:21:00.248 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-21T06:21:00.250 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-21T06:21:00.251 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-21T06:21:00.252 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-21T06:21:00.253 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-21T06:21:00.255 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-21T06:21:00.256 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-21T06:21:00.257 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-21T06:21:00.258 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-21T06:21:00.259 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-21T06:21:00.260 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-21T06:21:00.262 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-21T06:21:00.263 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-21T06:21:00.264 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-21T06:21:00.265 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-21T06:21:00.266 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-21T06:21:00.268 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-21T06:21:00.270 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-21T06:21:00.271 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-21T06:21:00.272 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-21T06:21:00.273 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-21T06:21:00.275 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-21T06:21:00.276 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-21T06:21:00.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-21T06:21:00.279 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-21T06:21:00.280 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-21T06:21:00.282 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-21T06:21:00.283 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-21T06:21:00.285 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-21T06:21:00.286 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-21T06:21:00.288 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-21T06:21:00.291 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-21T06:21:00.292 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-21T06:21:00.294 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-21T06:21:00.296 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-21T06:21:00.297 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-21T06:21:00.299 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-21T06:21:00.300 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-21T06:21:00.302 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-21T06:21:00.304 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-21T06:21:00.305 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-21T06:21:00.307 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-21T06:21:00.309 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-21T06:21:00.311 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-21T06:21:00.312 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-21T06:21:00.314 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-21T06:21:00.315 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-21T06:21:00.317 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-21T06:21:00.319 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-21T06:21:00.320 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-21T06:21:00.322 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-21T06:21:00.324 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-21T06:21:00.326 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-21T06:21:00.327 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-21T06:21:00.328 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-21T06:21:00.329 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-21T06:21:00.330 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-21T06:21:00.331 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-21T06:21:00.332 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-21T06:21:00.334 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-21T06:21:00.335 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-21T06:21:00.336 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-21T06:21:00.337 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-21T06:21:00.339 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-21T06:21:00.340 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-21T06:21:00.341 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-21T06:21:00.342 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-21T06:21:00.343 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-21T06:21:00.344 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-21T06:21:00.345 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-21T06:21:00.346 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-21T06:21:00.347 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-21T06:21:00.348 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-21T06:21:00.350 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-21T06:21:00.351 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-21T06:21:00.353 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-21T06:21:00.354 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-21T06:21:00.356 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-21T06:21:00.358 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-21T06:21:00.360 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-21T06:21:00.361 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-21T06:21:00.363 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-21T06:21:00.365 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-21T06:21:00.367 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-21T06:21:00.368 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-21T06:21:00.370 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-21T06:21:00.371 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-21T06:21:00.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-21T06:21:00.375 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-21T06:21:00.377 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-21T06:21:00.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-21T06:21:00.380 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-21T06:21:00.382 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-21T06:21:00.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-21T06:21:00.385 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-21T06:21:00.387 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-21T06:21:00.388 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-21T06:21:00.389 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-21T06:21:00.391 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-21T06:21:00.393 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-21T06:21:00.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-21T06:21:00.512 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10aeffd640 1 -- 172.21.15.38:0/1008428840 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559cdaf2d0f0 con 0x559cdaba91c0 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10aeffd640 10 client.25505 handle_command_reply: tid=0 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 client.25505 shutdown 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 msgr2=0x559cdafce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10c0004600 tx=0x7f10c002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 shutdown_connections 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559cdaba91c0 0x559cdb044f90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559cdac151b0 0x559cdafcc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10aeffd640 0 client.25505 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559cdabf44d0 0x559cdafcbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 --2- 172.21.15.38:0/1008428840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559cdabec2f0 0x559cdafce930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 >> 172.21.15.38:0/1008428840 conn(0x559cdac09300 msgr2=0x559cdafc7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 shutdown_connections 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 1 -- 172.21.15.38:0/1008428840 wait complete. 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.793+0000 7f10dc89a740 20 client.25505 trim_cache size 0 max 16384 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:21:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:21:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 msgr2=0x7f10b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 0x7f10b80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f10c8005fd0 tx=0x7f10c8009500 comp rx=0 tx=0).stop 2024-09-21T06:21:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 msgr2=0x7f10d019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005ab0 tx=0x7f10c00042f0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 shutdown_connections 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10b80b6680 0x7f10b80b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10d010ddb0 0x7f10d019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10d01052e0 0x7f10d019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 --2- 172.21.15.38:0/1855685327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10d0104990 0x7f10d019a540 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 >> 172.21.15.38:0/1855685327 conn(0x7f10d00fe3e0 msgr2=0x7f10d01057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 shutdown_connections 2024-09-21T06:21:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:00.794+0000 7f10d592b640 1 -- 172.21.15.38:0/1855685327 wait complete. 2024-09-21T06:21:00.799 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-21T06:21:00.845 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-21T06:21:00.846 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-21T06:21:00.846 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-21T06:21:00.847 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-21T06:21:00.848 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-21T06:21:00.849 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-21T06:21:00.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-21T06:21:00.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-21T06:21:00.852 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-21T06:21:00.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-21T06:21:00.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-21T06:21:00.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-21T06:21:00.855 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-21T06:21:00.856 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-21T06:21:00.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-21T06:21:00.858 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-21T06:21:00.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-21T06:21:00.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-21T06:21:00.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-21T06:21:00.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-21T06:21:00.862 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-21T06:21:00.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-21T06:21:00.864 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-21T06:21:00.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-21T06:21:00.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-21T06:21:00.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-21T06:21:00.867 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-21T06:21:00.868 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-21T06:21:00.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-21T06:21:00.870 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-21T06:21:00.871 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-21T06:21:00.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-21T06:21:00.873 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-21T06:21:00.874 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-21T06:21:00.875 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-21T06:21:00.875 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-21T06:21:00.877 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-21T06:21:00.878 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-21T06:21:00.879 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-21T06:21:00.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-21T06:21:00.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-21T06:21:00.882 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-21T06:21:00.883 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-21T06:21:00.884 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-21T06:21:00.885 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-21T06:21:00.886 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-21T06:21:00.887 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-21T06:21:00.888 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-21T06:21:00.889 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-21T06:21:00.890 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-21T06:21:00.891 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-21T06:21:00.892 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-21T06:21:00.893 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-21T06:21:00.894 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-21T06:21:00.895 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-21T06:21:00.896 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-21T06:21:00.897 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-21T06:21:00.898 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-21T06:21:00.899 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-21T06:21:00.900 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-21T06:21:00.900 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-21T06:21:00.901 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-21T06:21:00.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-21T06:21:00.903 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-21T06:21:00.904 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-21T06:21:00.905 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-21T06:21:00.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-21T06:21:00.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-21T06:21:00.907 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-21T06:21:00.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-21T06:21:00.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-21T06:21:00.910 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-21T06:21:00.911 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-21T06:21:00.912 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-21T06:21:00.913 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-21T06:21:00.914 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-21T06:21:00.915 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-21T06:21:00.916 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-21T06:21:00.917 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-21T06:21:00.918 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-21T06:21:00.919 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-21T06:21:00.920 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-21T06:21:00.922 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-21T06:21:00.923 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-21T06:21:00.924 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-21T06:21:00.925 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-21T06:21:00.926 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-21T06:21:00.927 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-21T06:21:00.928 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-21T06:21:00.929 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-21T06:21:00.930 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-21T06:21:00.931 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-21T06:21:00.932 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-21T06:21:00.933 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-21T06:21:00.933 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-21T06:21:00.934 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-21T06:21:00.936 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-21T06:21:00.937 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-21T06:21:00.938 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-21T06:21:00.939 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-21T06:21:00.940 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-21T06:21:00.941 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-21T06:21:00.942 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-21T06:21:00.943 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-21T06:21:00.944 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-21T06:21:00.945 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-21T06:21:00.946 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-21T06:21:00.947 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-21T06:21:00.948 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-21T06:21:00.949 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-21T06:21:00.950 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-21T06:21:00.951 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-21T06:21:00.952 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-21T06:21:00.953 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-21T06:21:00.954 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-21T06:21:00.955 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-21T06:21:00.956 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-21T06:21:00.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-21T06:21:00.958 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-21T06:21:00.959 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-21T06:21:00.960 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-21T06:21:00.961 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-21T06:21:00.962 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-21T06:21:00.963 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-21T06:21:00.964 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-21T06:21:00.965 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-21T06:21:00.965 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-21T06:21:00.966 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-21T06:21:00.968 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-21T06:21:00.969 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-21T06:21:00.970 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-21T06:21:00.971 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-21T06:21:00.972 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-21T06:21:00.973 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-21T06:21:00.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-21T06:21:00.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-21T06:21:00.976 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-21T06:21:00.977 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-21T06:21:00.978 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-21T06:21:00.979 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-21T06:21:00.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-21T06:21:00.981 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-21T06:21:00.982 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-21T06:21:00.983 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-21T06:21:00.984 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-21T06:21:00.985 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-21T06:21:00.986 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-21T06:21:00.987 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-21T06:21:00.988 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-21T06:21:00.989 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-21T06:21:00.990 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-21T06:21:00.991 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-21T06:21:00.992 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-21T06:21:00.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-21T06:21:00.994 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-21T06:21:00.995 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-21T06:21:00.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-21T06:21:00.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-21T06:21:00.998 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-21T06:21:00.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-21T06:21:00.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-21T06:21:01.001 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-21T06:21:01.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-21T06:21:01.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-21T06:21:01.003 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-21T06:21:01.005 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-21T06:21:01.005 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-21T06:21:01.007 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-21T06:21:01.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-21T06:21:01.009 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-21T06:21:01.010 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-21T06:21:01.011 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-21T06:21:01.012 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-21T06:21:01.013 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-21T06:21:01.014 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-21T06:21:01.015 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-21T06:21:01.016 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-21T06:21:01.017 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-21T06:21:01.018 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-21T06:21:01.019 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-21T06:21:01.020 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-21T06:21:01.021 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-21T06:21:01.022 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-21T06:21:01.023 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-21T06:21:01.024 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-21T06:21:01.025 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-21T06:21:01.026 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-21T06:21:01.026 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-21T06:21:01.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-21T06:21:01.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-21T06:21:01.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-21T06:21:01.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-21T06:21:01.032 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-21T06:21:01.033 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-21T06:21:01.034 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-21T06:21:01.035 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-21T06:21:01.036 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-21T06:21:01.037 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-21T06:21:01.038 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-21T06:21:01.039 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-21T06:21:01.040 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-21T06:21:01.041 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-21T06:21:01.042 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-21T06:21:01.043 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-21T06:21:01.044 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-21T06:21:01.045 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-21T06:21:01.046 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-21T06:21:01.047 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-21T06:21:01.048 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-21T06:21:01.049 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-21T06:21:01.050 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-21T06:21:01.051 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-21T06:21:01.052 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-21T06:21:01.053 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-21T06:21:01.054 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-21T06:21:01.055 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-21T06:21:01.056 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-21T06:21:01.057 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-21T06:21:01.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-21T06:21:01.059 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-21T06:21:01.060 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-21T06:21:01.061 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-21T06:21:01.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-21T06:21:01.063 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-21T06:21:01.063 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-21T06:21:01.065 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-21T06:21:01.066 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-21T06:21:01.067 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-21T06:21:01.068 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-21T06:21:01.069 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-21T06:21:01.070 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-21T06:21:01.071 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-21T06:21:01.072 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-21T06:21:01.073 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-21T06:21:01.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-21T06:21:01.075 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-21T06:21:01.076 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-21T06:21:01.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-21T06:21:01.078 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-21T06:21:01.079 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-21T06:21:01.080 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-21T06:21:01.080 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-21T06:21:01.081 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-21T06:21:01.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-21T06:21:01.083 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-21T06:21:01.084 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-21T06:21:01.085 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-21T06:21:01.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-21T06:21:01.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-21T06:21:01.087 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-21T06:21:01.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-21T06:21:01.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-21T06:21:01.090 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-21T06:21:01.091 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-21T06:21:01.092 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-21T06:21:01.093 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-21T06:21:01.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-21T06:21:01.095 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-21T06:21:01.096 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-21T06:21:01.097 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-21T06:21:01.098 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-21T06:21:01.099 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-21T06:21:01.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-21T06:21:01.101 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-21T06:21:01.102 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-21T06:21:01.103 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-21T06:21:01.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-21T06:21:01.105 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-21T06:21:01.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-21T06:21:01.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-21T06:21:01.107 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-21T06:21:01.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-21T06:21:01.109 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-21T06:21:01.110 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-21T06:21:01.112 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-21T06:21:01.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-21T06:21:01.114 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-21T06:21:01.115 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-21T06:21:01.116 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-21T06:21:01.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-21T06:21:01.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-21T06:21:01.118 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-21T06:21:01.119 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-21T06:21:01.120 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-21T06:21:01.121 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-21T06:21:01.122 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-21T06:21:01.123 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-21T06:21:01.124 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-21T06:21:01.125 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-21T06:21:01.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-21T06:21:01.127 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-21T06:21:01.128 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-21T06:21:01.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-21T06:21:01.130 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-21T06:21:01.132 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-21T06:21:01.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-21T06:21:01.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-21T06:21:01.135 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-21T06:21:01.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-21T06:21:01.137 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-21T06:21:01.138 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-21T06:21:01.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-21T06:21:01.140 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-21T06:21:01.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-21T06:21:01.142 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-21T06:21:01.143 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-21T06:21:01.144 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-21T06:21:01.145 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-21T06:21:01.146 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-21T06:21:01.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-21T06:21:01.148 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-21T06:21:01.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-21T06:21:01.150 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-21T06:21:01.151 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-21T06:21:01.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-21T06:21:01.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-21T06:21:01.154 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-21T06:21:01.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-21T06:21:01.156 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-21T06:21:01.157 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-21T06:21:01.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-21T06:21:01.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-21T06:21:01.159 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-21T06:21:01.160 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-21T06:21:01.162 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-21T06:21:01.163 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-21T06:21:01.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-21T06:21:01.165 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-21T06:21:01.165 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-21T06:21:01.166 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-21T06:21:01.167 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-21T06:21:01.168 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-21T06:21:01.169 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-21T06:21:01.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-21T06:21:01.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-21T06:21:01.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-21T06:21:01.173 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-21T06:21:01.174 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-21T06:21:01.174 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-21T06:21:01.175 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-21T06:21:01.176 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-21T06:21:01.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-21T06:21:01.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-21T06:21:01.179 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-21T06:21:01.181 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-21T06:21:01.182 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-21T06:21:01.182 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-21T06:21:01.183 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-21T06:21:01.184 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-21T06:21:01.186 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-21T06:21:01.187 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-21T06:21:01.188 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-21T06:21:01.189 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-21T06:21:01.190 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-21T06:21:01.191 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-21T06:21:01.192 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-21T06:21:01.193 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-21T06:21:01.193 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-21T06:21:01.194 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-21T06:21:01.195 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-21T06:21:01.196 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-21T06:21:01.197 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-21T06:21:01.198 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-21T06:21:01.199 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-21T06:21:01.200 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-21T06:21:01.201 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-21T06:21:01.202 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-21T06:21:01.203 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-21T06:21:01.204 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-21T06:21:01.205 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-21T06:21:01.206 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-21T06:21:01.207 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-21T06:21:01.208 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-21T06:21:01.209 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-21T06:21:01.210 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-21T06:21:01.211 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-21T06:21:01.212 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-21T06:21:01.213 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-21T06:21:01.214 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-21T06:21:01.215 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-21T06:21:01.216 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-21T06:21:01.217 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-21T06:21:01.217 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-21T06:21:01.219 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-21T06:21:01.220 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-21T06:21:01.221 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-21T06:21:01.222 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-21T06:21:01.223 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-21T06:21:01.224 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-21T06:21:01.225 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-21T06:21:01.226 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-21T06:21:01.227 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-21T06:21:01.228 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-21T06:21:01.229 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-21T06:21:01.230 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-21T06:21:01.231 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-21T06:21:01.233 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-21T06:21:01.234 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-21T06:21:01.234 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-21T06:21:01.235 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-21T06:21:01.236 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-21T06:21:01.237 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-21T06:21:01.238 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-21T06:21:01.239 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-21T06:21:01.240 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-21T06:21:01.241 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-21T06:21:01.242 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-21T06:21:01.243 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-21T06:21:01.244 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-21T06:21:01.244 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-21T06:21:01.245 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-21T06:21:01.246 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-21T06:21:01.247 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-21T06:21:01.248 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-21T06:21:01.249 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-21T06:21:01.250 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-21T06:21:01.251 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-21T06:21:01.252 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-21T06:21:01.253 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-21T06:21:01.254 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-21T06:21:01.255 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-21T06:21:01.256 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-21T06:21:01.257 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-21T06:21:01.258 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-21T06:21:01.259 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-21T06:21:01.260 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-21T06:21:01.261 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-21T06:21:01.262 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-21T06:21:01.263 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-21T06:21:01.264 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-21T06:21:01.265 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-21T06:21:01.266 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-21T06:21:01.267 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-21T06:21:01.268 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-21T06:21:01.269 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-21T06:21:01.270 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-21T06:21:01.270 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-21T06:21:01.271 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-21T06:21:01.272 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-21T06:21:01.273 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-21T06:21:01.274 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-21T06:21:01.275 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-21T06:21:01.276 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-21T06:21:01.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-21T06:21:01.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-21T06:21:01.280 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-21T06:21:01.280 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-21T06:21:01.281 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-21T06:21:01.282 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-21T06:21:01.284 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-21T06:21:01.285 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-21T06:21:01.285 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-21T06:21:01.287 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-21T06:21:01.288 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-21T06:21:01.288 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-21T06:21:01.290 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-21T06:21:01.291 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-21T06:21:01.292 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-21T06:21:01.293 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-21T06:21:01.294 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-21T06:21:01.295 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-21T06:21:01.295 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-21T06:21:01.296 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-21T06:21:01.297 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-21T06:21:01.298 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-21T06:21:01.299 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-21T06:21:01.300 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-21T06:21:01.301 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-21T06:21:01.301 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-21T06:21:01.302 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-21T06:21:01.303 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-21T06:21:01.304 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-21T06:21:01.305 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-21T06:21:01.306 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-21T06:21:01.308 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-21T06:21:01.309 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-21T06:21:01.309 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-21T06:21:01.311 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-21T06:21:01.312 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-21T06:21:01.313 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-21T06:21:01.314 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-21T06:21:01.315 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-21T06:21:01.315 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-21T06:21:01.317 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-21T06:21:01.318 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-21T06:21:01.319 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-21T06:21:01.320 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-21T06:21:01.321 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-21T06:21:01.322 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-21T06:21:01.322 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-21T06:21:01.323 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-21T06:21:01.324 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-21T06:21:01.326 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-21T06:21:01.327 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-21T06:21:01.328 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-21T06:21:01.329 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-21T06:21:01.330 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-21T06:21:01.331 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-21T06:21:01.332 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-21T06:21:01.333 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-21T06:21:01.334 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-21T06:21:01.335 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-21T06:21:01.336 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-21T06:21:01.337 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-21T06:21:01.338 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-21T06:21:01.339 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-21T06:21:01.340 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-21T06:21:01.341 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-21T06:21:01.342 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-21T06:21:01.343 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-21T06:21:01.344 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-21T06:21:01.345 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-21T06:21:01.346 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-21T06:21:01.347 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-21T06:21:01.348 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-21T06:21:01.349 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-21T06:21:01.350 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-21T06:21:01.351 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-21T06:21:01.352 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-21T06:21:01.353 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-21T06:21:01.354 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-21T06:21:01.355 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-21T06:21:01.356 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-21T06:21:01.357 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-21T06:21:01.358 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-21T06:21:01.359 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-21T06:21:01.360 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-21T06:21:01.361 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-21T06:21:01.362 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-21T06:21:01.362 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-21T06:21:01.363 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-21T06:21:01.364 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-21T06:21:01.365 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-21T06:21:01.366 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-21T06:21:01.368 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-21T06:21:01.369 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-21T06:21:01.369 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-21T06:21:01.371 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-21T06:21:01.372 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-21T06:21:01.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-21T06:21:01.374 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-21T06:21:01.375 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-21T06:21:01.376 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-21T06:21:01.377 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-21T06:21:01.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-21T06:21:01.379 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-21T06:21:01.380 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-21T06:21:01.381 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-21T06:21:01.382 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-21T06:21:01.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-21T06:21:01.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-21T06:21:01.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-21T06:21:01.385 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-21T06:21:01.646 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-21T06:21:01.647 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-21T06:21:01.649 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-21T06:21:01.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-21T06:21:01.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-21T06:21:01.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-21T06:21:01.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-21T06:21:01.658 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-21T06:21:01.659 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-21T06:21:01.661 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-21T06:21:01.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-21T06:21:01.664 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-21T06:21:01.666 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-21T06:21:01.668 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-21T06:21:01.669 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-21T06:21:01.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-21T06:21:01.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-21T06:21:01.674 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-21T06:21:01.676 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-21T06:21:01.678 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-21T06:21:01.679 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-21T06:21:01.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-21T06:21:01.683 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-21T06:21:01.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-21T06:21:01.685 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-21T06:21:01.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-21T06:21:01.688 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-21T06:21:01.690 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-21T06:21:01.691 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-21T06:21:01.693 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-21T06:21:01.694 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-21T06:21:01.696 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-21T06:21:01.697 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-21T06:21:01.699 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-21T06:21:01.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-21T06:21:01.702 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-21T06:21:01.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-21T06:21:01.705 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-21T06:21:01.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-21T06:21:01.708 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-21T06:21:01.709 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-21T06:21:01.711 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-21T06:21:01.712 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-21T06:21:01.714 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-21T06:21:01.715 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-21T06:21:01.717 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-21T06:21:01.718 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-21T06:21:01.719 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-21T06:21:01.720 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-21T06:21:01.721 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-21T06:21:01.722 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-21T06:21:01.723 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-21T06:21:01.724 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-21T06:21:01.725 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-21T06:21:01.726 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-21T06:21:01.727 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-21T06:21:01.727 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-21T06:21:01.728 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-21T06:21:01.729 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-21T06:21:01.730 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-21T06:21:01.731 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-21T06:21:01.732 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-21T06:21:01.733 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-21T06:21:01.734 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-21T06:21:01.735 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-21T06:21:01.736 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-21T06:21:01.737 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-21T06:21:01.738 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-21T06:21:01.739 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-21T06:21:01.740 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-21T06:21:01.741 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-21T06:21:01.743 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-21T06:21:01.744 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-21T06:21:01.745 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-21T06:21:01.746 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-21T06:21:01.746 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-21T06:21:01.747 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-21T06:21:01.748 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-21T06:21:01.749 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-21T06:21:01.750 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-21T06:21:01.752 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-21T06:21:01.752 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-21T06:21:01.753 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-21T06:21:01.754 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-21T06:21:01.755 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-21T06:21:01.756 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-21T06:21:01.757 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-21T06:21:01.759 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-21T06:21:01.759 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-21T06:21:01.760 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-21T06:21:01.761 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-21T06:21:01.762 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-21T06:21:01.763 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-21T06:21:01.765 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-21T06:21:01.766 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-21T06:21:01.766 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-21T06:21:01.767 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-21T06:21:01.768 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-21T06:21:01.769 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-21T06:21:01.770 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-21T06:21:01.771 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-21T06:21:01.772 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-21T06:21:01.774 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-21T06:21:01.775 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-21T06:21:01.775 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-21T06:21:01.776 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-21T06:21:01.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-21T06:21:01.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-21T06:21:01.780 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-21T06:21:01.781 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-21T06:21:01.782 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-21T06:21:01.783 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-21T06:21:01.784 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-21T06:21:01.784 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-21T06:21:01.785 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-21T06:21:01.786 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-21T06:21:01.787 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-21T06:21:01.788 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-21T06:21:01.789 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:01 smithi038 ceph-mon[31215]: pgmap v359: 97 pgs: 97 active+clean; 81 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.7 MiB/s wr, 27 op/s 2024-09-21T06:21:01.789 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/ 2024-09-21T06:21:01.790 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-21T06:21:01.791 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-21T06:21:01.792 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-21T06:21:01.793 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-21T06:21:01.794 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-21T06:21:01.795 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-21T06:21:01.796 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-21T06:21:01.797 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-21T06:21:01.798 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-21T06:21:01.799 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-21T06:21:01.800 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-21T06:21:01.801 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-21T06:21:01.802 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-21T06:21:01.803 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-21T06:21:01.804 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-21T06:21:01.805 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-21T06:21:01.806 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-21T06:21:01.807 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-21T06:21:01.808 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-21T06:21:01.808 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-21T06:21:01.809 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-21T06:21:01.810 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-21T06:21:01.811 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-21T06:21:01.812 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-21T06:21:01.813 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-21T06:21:01.814 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-21T06:21:01.814 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-21T06:21:01.815 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-21T06:21:01.816 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-21T06:21:01.817 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-21T06:21:01.818 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-21T06:21:01.819 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-21T06:21:01.820 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-21T06:21:01.821 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-21T06:21:01.822 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-21T06:21:01.823 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-21T06:21:01.824 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-21T06:21:01.824 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-21T06:21:01.825 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-21T06:21:01.826 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-21T06:21:01.827 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-21T06:21:01.828 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-21T06:21:01.829 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-21T06:21:01.830 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-21T06:21:01.831 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-21T06:21:01.832 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-21T06:21:01.832 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-21T06:21:01.834 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-21T06:21:01.835 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-21T06:21:01.836 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-21T06:21:01.837 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-21T06:21:01.838 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-21T06:21:01.839 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-21T06:21:01.840 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-21T06:21:01.841 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-21T06:21:01.842 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-21T06:21:01.843 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-21T06:21:01.844 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-21T06:21:01.844 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-21T06:21:01.845 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-21T06:21:01.846 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-21T06:21:01.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-21T06:21:01.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-21T06:21:01.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-21T06:21:01.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-21T06:21:01.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-21T06:21:01.852 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-21T06:21:01.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-21T06:21:01.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-21T06:21:01.855 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-21T06:21:01.856 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-21T06:21:01.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-21T06:21:01.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-21T06:21:01.858 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-21T06:21:01.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-21T06:21:01.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-21T06:21:01.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-21T06:21:01.862 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-21T06:21:01.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-21T06:21:01.864 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-21T06:21:01.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-21T06:21:01.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-21T06:21:01.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-21T06:21:01.868 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-21T06:21:01.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-21T06:21:01.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:01 smithi174 ceph-mon[34815]: pgmap v359: 97 pgs: 97 active+clean; 81 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.7 MiB/s wr, 27 op/s 2024-09-21T06:21:01.896 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-21T06:21:01.897 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-21T06:21:01.898 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-21T06:21:01.900 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-21T06:21:01.901 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-21T06:21:01.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-21T06:21:01.903 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-21T06:21:01.904 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-21T06:21:01.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:01 smithi044 ceph-mon[34369]: pgmap v359: 97 pgs: 97 active+clean; 81 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.7 MiB/s wr, 27 op/s 2024-09-21T06:21:01.905 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-21T06:21:01.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-21T06:21:01.907 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-21T06:21:01.908 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-21T06:21:01.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-21T06:21:01.910 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-21T06:21:01.911 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-21T06:21:01.912 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-21T06:21:01.913 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-21T06:21:01.914 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-21T06:21:01.915 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-21T06:21:01.916 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-21T06:21:01.917 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-21T06:21:01.918 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-21T06:21:01.919 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-21T06:21:01.920 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-21T06:21:01.921 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-21T06:21:01.922 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-21T06:21:01.923 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-21T06:21:01.924 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-21T06:21:01.925 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-21T06:21:01.926 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-21T06:21:01.927 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-21T06:21:01.928 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-21T06:21:01.929 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-21T06:21:01.930 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-21T06:21:01.931 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-21T06:21:01.932 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-21T06:21:01.933 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-21T06:21:01.934 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-21T06:21:01.935 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-21T06:21:01.936 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-21T06:21:01.937 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-21T06:21:01.938 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-21T06:21:01.939 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-21T06:21:01.940 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-21T06:21:01.941 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-21T06:21:01.942 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-21T06:21:01.943 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-21T06:21:01.944 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-21T06:21:01.945 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-21T06:21:01.946 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-21T06:21:01.947 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-21T06:21:01.948 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-21T06:21:01.948 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-21T06:21:01.949 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-21T06:21:01.950 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-21T06:21:01.951 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-21T06:21:01.952 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-21T06:21:01.953 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-21T06:21:01.954 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-21T06:21:01.955 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-21T06:21:01.956 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-21T06:21:01.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-21T06:21:01.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-21T06:21:01.959 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-21T06:21:01.960 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-21T06:21:01.960 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-21T06:21:01.961 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-21T06:21:01.962 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-21T06:21:01.963 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-21T06:21:01.964 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-21T06:21:01.966 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-21T06:21:01.967 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-21T06:21:01.968 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-21T06:21:01.969 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-21T06:21:01.970 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-21T06:21:01.971 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-21T06:21:01.972 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-21T06:21:01.973 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-21T06:21:01.974 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-21T06:21:01.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-21T06:21:01.976 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-21T06:21:01.977 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-21T06:21:01.978 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/ 2024-09-21T06:21:01.979 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-21T06:21:01.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-21T06:21:01.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-21T06:21:01.982 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-21T06:21:01.983 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-21T06:21:01.984 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-21T06:21:01.985 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-21T06:21:01.986 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-21T06:21:01.987 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-21T06:21:01.988 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-21T06:21:01.989 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-21T06:21:01.990 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-21T06:21:01.991 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-21T06:21:01.992 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-21T06:21:01.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-21T06:21:01.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-21T06:21:01.994 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-21T06:21:01.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-21T06:21:01.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-21T06:21:01.997 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-21T06:21:01.998 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-21T06:21:01.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/ 2024-09-21T06:21:02.000 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-21T06:21:02.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-21T06:21:02.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-21T06:21:02.003 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-21T06:21:02.004 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-21T06:21:02.005 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-21T06:21:02.006 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-21T06:21:02.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-21T06:21:02.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-21T06:21:02.010 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-21T06:21:02.011 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-21T06:21:02.012 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-21T06:21:02.013 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-21T06:21:02.014 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-21T06:21:02.015 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-21T06:21:02.015 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-21T06:21:02.017 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-21T06:21:02.017 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-21T06:21:02.019 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-21T06:21:02.019 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-21T06:21:02.020 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-21T06:21:02.021 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-21T06:21:02.022 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-21T06:21:02.023 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-21T06:21:02.024 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-21T06:21:02.025 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-21T06:21:02.026 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-21T06:21:02.027 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-21T06:21:02.028 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-21T06:21:02.029 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-21T06:21:02.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-21T06:21:02.031 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-21T06:21:02.032 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-21T06:21:02.033 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-21T06:21:02.034 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-21T06:21:02.035 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-21T06:21:02.036 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-21T06:21:02.037 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-21T06:21:02.037 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-21T06:21:02.039 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-21T06:21:02.040 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-21T06:21:02.042 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-21T06:21:02.042 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-21T06:21:02.043 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-21T06:21:02.044 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-21T06:21:02.045 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-21T06:21:02.046 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-21T06:21:02.047 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-21T06:21:02.048 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-21T06:21:02.049 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-21T06:21:02.050 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-21T06:21:02.051 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-21T06:21:02.052 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-21T06:21:02.053 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-21T06:21:02.053 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-21T06:21:02.054 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-21T06:21:02.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-21T06:21:02.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-21T06:21:02.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-21T06:21:02.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-21T06:21:02.059 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-21T06:21:02.060 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-21T06:21:02.061 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-21T06:21:02.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-21T06:21:02.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-21T06:21:02.064 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-21T06:21:02.065 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-21T06:21:02.066 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-21T06:21:02.067 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-21T06:21:02.068 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-21T06:21:02.068 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-21T06:21:02.069 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-21T06:21:02.070 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-21T06:21:02.072 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-21T06:21:02.073 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-21T06:21:02.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-21T06:21:02.075 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-21T06:21:02.076 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-21T06:21:02.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-21T06:21:02.078 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-21T06:21:02.079 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-21T06:21:02.080 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-21T06:21:02.080 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-21T06:21:02.081 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-21T06:21:02.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-21T06:21:02.083 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-21T06:21:02.084 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-21T06:21:02.085 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-21T06:21:02.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-21T06:21:02.087 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-21T06:21:02.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-21T06:21:02.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-21T06:21:02.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-21T06:21:02.090 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-21T06:21:02.091 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-21T06:21:02.092 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-21T06:21:02.093 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-21T06:21:02.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-21T06:21:02.095 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-21T06:21:02.096 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-21T06:21:02.097 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-21T06:21:02.098 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-21T06:21:02.099 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-21T06:21:02.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-21T06:21:02.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-21T06:21:02.101 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-21T06:21:02.102 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-21T06:21:02.103 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-21T06:21:02.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-21T06:21:02.105 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-21T06:21:02.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-21T06:21:02.107 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-21T06:21:02.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-21T06:21:02.109 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-21T06:21:02.110 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-21T06:21:02.111 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-21T06:21:02.112 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-21T06:21:02.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-21T06:21:02.114 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-21T06:21:02.115 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-21T06:21:02.116 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-21T06:21:02.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-21T06:21:02.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-21T06:21:02.118 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-21T06:21:02.119 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-21T06:21:02.120 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-21T06:21:02.121 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-21T06:21:02.122 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-21T06:21:02.123 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-21T06:21:02.124 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-21T06:21:02.125 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-21T06:21:02.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-21T06:21:02.127 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-21T06:21:02.128 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-21T06:21:02.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-21T06:21:02.130 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-21T06:21:02.131 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-21T06:21:02.132 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-21T06:21:02.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-21T06:21:02.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-21T06:21:02.135 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-21T06:21:02.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-21T06:21:02.137 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-21T06:21:02.138 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-21T06:21:02.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-21T06:21:02.140 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-21T06:21:02.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-21T06:21:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-21T06:21:02.142 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-21T06:21:02.143 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-21T06:21:02.144 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-21T06:21:02.145 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-21T06:21:02.146 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-21T06:21:02.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-21T06:21:02.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-21T06:21:02.148 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-21T06:21:02.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-21T06:21:02.150 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-21T06:21:02.151 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-21T06:21:02.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-21T06:21:02.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-21T06:21:02.154 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-21T06:21:02.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-21T06:21:02.156 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-21T06:21:02.156 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-21T06:21:02.157 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-21T06:21:02.159 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-21T06:21:02.160 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-21T06:21:02.161 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-21T06:21:02.161 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-21T06:21:02.162 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-21T06:21:02.163 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-21T06:21:02.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-21T06:21:02.165 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-21T06:21:02.166 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-21T06:21:02.167 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-21T06:21:02.168 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-21T06:21:02.169 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-21T06:21:02.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-21T06:21:02.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-21T06:21:02.171 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-21T06:21:02.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-21T06:21:02.173 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-21T06:21:02.174 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-21T06:21:02.175 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-21T06:21:02.176 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-21T06:21:02.177 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-21T06:21:02.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-21T06:21:02.179 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-21T06:21:02.180 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-21T06:21:02.181 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-21T06:21:02.182 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-21T06:21:02.183 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-21T06:21:02.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-21T06:21:02.374 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-21T06:21:02.376 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-21T06:21:02.377 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-21T06:21:02.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-21T06:21:02.380 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-21T06:21:02.382 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ 2024-09-21T06:21:02.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-21T06:21:02.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-21T06:21:02.386 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-21T06:21:02.387 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-21T06:21:02.388 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-21T06:21:02.390 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-21T06:21:02.392 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-21T06:21:02.393 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-21T06:21:02.395 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-21T06:21:02.396 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-21T06:21:02.398 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-21T06:21:02.399 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-21T06:21:02.400 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-21T06:21:02.402 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/init.txt 2024-09-21T06:21:02.403 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-21T06:21:02.405 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/ 2024-09-21T06:21:02.406 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-21T06:21:02.408 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-21T06:21:02.409 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-21T06:21:02.411 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-21T06:21:02.412 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-21T06:21:02.414 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-21T06:21:02.415 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-21T06:21:02.416 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-21T06:21:02.418 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-21T06:21:02.419 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-21T06:21:02.420 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-21T06:21:02.422 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-21T06:21:02.423 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-21T06:21:02.425 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-21T06:21:02.426 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-21T06:21:02.428 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-21T06:21:02.430 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-21T06:21:02.431 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-21T06:21:02.432 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-21T06:21:02.434 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-21T06:21:02.436 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-21T06:21:02.437 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-21T06:21:02.439 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-21T06:21:02.440 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-21T06:21:02.442 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-21T06:21:02.443 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-21T06:21:02.445 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-21T06:21:02.446 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-21T06:21:02.447 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-21T06:21:02.449 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-21T06:21:02.451 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-21T06:21:02.452 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-21T06:21:02.454 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-21T06:21:02.455 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-21T06:21:02.457 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-21T06:21:02.458 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-21T06:21:02.460 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-21T06:21:02.461 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-21T06:21:02.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-21T06:21:02.464 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-21T06:21:02.466 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-21T06:21:02.467 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-21T06:21:02.470 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-21T06:21:02.471 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-21T06:21:02.472 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-21T06:21:02.473 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-21T06:21:02.474 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-21T06:21:02.475 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-21T06:21:02.476 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-21T06:21:02.477 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-21T06:21:02.478 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-21T06:21:02.478 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-21T06:21:02.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-21T06:21:02.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-21T06:21:02.482 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-21T06:21:02.483 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-21T06:21:02.483 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-21T06:21:02.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-21T06:21:02.485 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-21T06:21:02.486 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-21T06:21:02.488 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-21T06:21:02.489 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-21T06:21:02.489 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-21T06:21:02.490 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-21T06:21:02.492 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-21T06:21:02.492 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-21T06:21:02.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-21T06:21:02.495 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-21T06:21:02.495 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-21T06:21:02.497 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-21T06:21:02.498 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-21T06:21:02.499 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-21T06:21:02.500 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-21T06:21:02.501 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-21T06:21:02.502 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-21T06:21:02.503 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-21T06:21:02.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/java.txt 2024-09-21T06:21:02.505 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-21T06:21:02.506 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-21T06:21:02.506 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-21T06:21:02.507 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-21T06:21:02.508 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-21T06:21:02.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-21T06:21:02.509 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-21T06:21:02.510 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-21T06:21:02.511 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-21T06:21:02.512 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-21T06:21:02.513 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-21T06:21:02.514 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-21T06:21:02.515 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-21T06:21:02.516 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-21T06:21:02.517 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-21T06:21:02.519 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-21T06:21:02.520 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-21T06:21:02.521 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-21T06:21:02.522 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-21T06:21:02.523 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-21T06:21:02.523 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-21T06:21:02.524 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-21T06:21:02.525 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-21T06:21:02.526 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-21T06:21:02.527 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-21T06:21:02.529 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-21T06:21:02.530 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-21T06:21:02.531 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-21T06:21:02.532 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-21T06:21:02.533 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-21T06:21:02.534 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-21T06:21:02.534 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-21T06:21:02.535 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-21T06:21:02.536 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-21T06:21:02.537 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-21T06:21:02.538 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-21T06:21:02.539 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-21T06:21:02.540 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-21T06:21:02.540 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-21T06:21:02.542 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/ 2024-09-21T06:21:02.543 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-21T06:21:02.544 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-21T06:21:02.545 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-21T06:21:02.546 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-21T06:21:02.546 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-21T06:21:02.548 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-21T06:21:02.549 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-21T06:21:02.550 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-21T06:21:02.551 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-21T06:21:02.552 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-21T06:21:02.552 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-21T06:21:02.553 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-21T06:21:02.554 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/ 2024-09-21T06:21:02.555 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-21T06:21:02.556 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-21T06:21:02.557 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-21T06:21:02.558 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-21T06:21:02.559 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-21T06:21:02.560 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-21T06:21:02.561 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-21T06:21:02.562 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-21T06:21:02.562 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-21T06:21:02.563 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-21T06:21:02.564 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-21T06:21:02.565 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-21T06:21:02.566 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-21T06:21:02.567 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-21T06:21:02.568 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-21T06:21:02.569 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-21T06:21:02.570 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-21T06:21:02.571 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-21T06:21:02.571 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-21T06:21:02.572 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-21T06:21:02.574 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/md.txt 2024-09-21T06:21:02.575 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-21T06:21:02.576 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-21T06:21:02.651 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-21T06:21:02.652 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-21T06:21:02.653 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-21T06:21:02.654 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/metag/ 2024-09-21T06:21:02.655 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-21T06:21:02.656 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-21T06:21:02.657 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/ 2024-09-21T06:21:02.658 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-21T06:21:02.659 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-21T06:21:02.660 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-21T06:21:02.661 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-21T06:21:02.662 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-21T06:21:02.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-21T06:21:02.663 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-21T06:21:02.664 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-21T06:21:02.665 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-21T06:21:02.667 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-21T06:21:02.667 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mips/ 2024-09-21T06:21:02.668 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-21T06:21:02.669 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-21T06:21:02.670 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-21T06:21:02.671 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-21T06:21:02.672 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-21T06:21:02.673 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-21T06:21:02.674 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-21T06:21:02.674 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-21T06:21:02.675 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-21T06:21:02.677 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-21T06:21:02.677 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-21T06:21:02.678 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-21T06:21:02.680 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-21T06:21:02.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-21T06:21:02.681 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-21T06:21:02.682 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-21T06:21:02.683 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-21T06:21:02.684 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-21T06:21:02.685 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-21T06:21:02.686 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-21T06:21:02.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-21T06:21:02.687 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-21T06:21:02.689 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-21T06:21:02.689 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-21T06:21:02.690 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-21T06:21:02.691 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-21T06:21:02.692 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-21T06:21:02.693 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-21T06:21:02.694 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-21T06:21:02.695 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-21T06:21:02.696 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-21T06:21:02.697 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-21T06:21:02.698 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-21T06:21:02.698 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-21T06:21:02.699 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-21T06:21:02.700 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-21T06:21:02.701 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-21T06:21:02.702 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-21T06:21:02.703 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-21T06:21:02.705 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-21T06:21:02.706 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-21T06:21:02.707 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-21T06:21:02.709 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-21T06:21:02.710 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-21T06:21:02.712 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-21T06:21:02.713 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ 2024-09-21T06:21:02.714 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-21T06:21:02.716 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-21T06:21:02.717 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-21T06:21:02.719 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-21T06:21:02.720 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-21T06:21:02.721 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-21T06:21:02.723 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-21T06:21:02.724 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-21T06:21:02.726 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-21T06:21:02.727 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-21T06:21:02.729 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-21T06:21:02.730 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-21T06:21:02.732 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-21T06:21:02.733 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-21T06:21:02.735 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-21T06:21:02.736 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-21T06:21:02.738 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-21T06:21:02.739 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-21T06:21:02.741 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-21T06:21:02.742 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-21T06:21:02.744 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-21T06:21:02.746 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-21T06:21:02.747 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-21T06:21:02.749 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-21T06:21:02.750 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-21T06:21:02.751 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-21T06:21:02.753 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-21T06:21:02.754 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-21T06:21:02.756 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-21T06:21:02.757 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-21T06:21:02.759 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-21T06:21:02.760 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-21T06:21:02.761 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-21T06:21:02.763 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-21T06:21:02.764 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-21T06:21:02.766 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-21T06:21:02.768 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-21T06:21:02.769 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-21T06:21:02.770 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-21T06:21:02.772 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-21T06:21:02.773 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-21T06:21:02.774 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-21T06:21:02.775 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-21T06:21:02.775 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-21T06:21:02.776 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-21T06:21:02.777 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-21T06:21:02.778 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-21T06:21:02.779 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-21T06:21:02.780 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-21T06:21:02.781 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-21T06:21:02.782 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-21T06:21:02.783 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-21T06:21:02.784 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-21T06:21:02.785 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-21T06:21:02.786 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-21T06:21:02.787 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-21T06:21:02.788 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-21T06:21:02.789 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-21T06:21:02.790 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-21T06:21:02.791 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-21T06:21:02.792 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-21T06:21:02.792 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-21T06:21:02.793 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-21T06:21:02.794 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-21T06:21:02.795 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-21T06:21:02.796 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-21T06:21:02.797 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-21T06:21:02.798 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-21T06:21:02.799 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-21T06:21:02.800 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-21T06:21:02.801 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-21T06:21:02.802 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-21T06:21:02.803 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-21T06:21:02.804 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-21T06:21:02.805 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-21T06:21:02.806 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-21T06:21:02.807 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-21T06:21:02.807 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-21T06:21:02.808 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-21T06:21:02.809 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-21T06:21:02.810 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-21T06:21:02.811 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-21T06:21:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-21T06:21:02.812 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-21T06:21:02.813 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-21T06:21:02.814 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-21T06:21:02.815 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-21T06:21:02.816 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-21T06:21:02.817 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-21T06:21:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-21T06:21:02.818 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-21T06:21:02.819 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-21T06:21:02.820 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-21T06:21:02.821 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-21T06:21:02.822 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-21T06:21:02.823 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-21T06:21:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-21T06:21:02.824 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-21T06:21:02.825 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-21T06:21:02.826 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-21T06:21:02.827 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-21T06:21:02.828 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-21T06:21:02.828 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-21T06:21:02.829 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-21T06:21:02.830 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-21T06:21:02.831 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-21T06:21:02.832 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-21T06:21:02.833 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-21T06:21:02.834 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-21T06:21:02.834 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-21T06:21:02.835 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-21T06:21:02.836 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-21T06:21:02.837 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-21T06:21:02.838 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-21T06:21:02.839 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-21T06:21:02.839 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-21T06:21:02.840 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-21T06:21:02.841 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-21T06:21:02.842 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-21T06:21:02.843 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-21T06:21:02.844 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-21T06:21:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-21T06:21:02.845 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-21T06:21:02.846 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-21T06:21:02.847 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-21T06:21:02.848 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-21T06:21:02.849 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-21T06:21:02.850 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-21T06:21:02.851 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-21T06:21:02.852 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-21T06:21:02.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-21T06:21:02.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-21T06:21:02.854 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-21T06:21:02.855 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-21T06:21:02.856 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-21T06:21:02.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-21T06:21:02.858 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-21T06:21:02.859 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-21T06:21:02.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-21T06:21:02.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-21T06:21:02.861 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-21T06:21:02.862 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-21T06:21:02.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-21T06:21:02.864 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-21T06:21:02.865 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-21T06:21:02.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-21T06:21:02.867 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-21T06:21:02.868 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-21T06:21:02.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-21T06:21:02.870 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-21T06:21:02.871 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-21T06:21:02.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-21T06:21:02.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-21T06:21:02.873 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-21T06:21:02.874 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-21T06:21:02.875 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-21T06:21:02.877 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-21T06:21:02.878 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-21T06:21:02.878 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-21T06:21:02.879 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-21T06:21:02.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/phy/ 2024-09-21T06:21:02.880 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-21T06:21:02.881 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-21T06:21:02.883 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-21T06:21:02.884 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/platform/ 2024-09-21T06:21:02.885 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-21T06:21:02.886 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-21T06:21:02.887 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/ 2024-09-21T06:21:02.888 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-21T06:21:02.889 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-21T06:21:02.890 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-21T06:21:02.891 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-21T06:21:02.892 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-21T06:21:02.893 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-21T06:21:02.894 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-21T06:21:02.895 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-21T06:21:02.896 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-21T06:21:02.897 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-21T06:21:02.898 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-21T06:21:02.899 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-21T06:21:02.900 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-21T06:21:02.901 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-21T06:21:02.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-21T06:21:02.903 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-21T06:21:02.904 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-21T06:21:02.905 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-21T06:21:02.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-21T06:21:02.907 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-21T06:21:02.908 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-21T06:21:02.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-21T06:21:02.911 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-21T06:21:02.912 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-21T06:21:02.913 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-21T06:21:02.914 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-21T06:21:02.915 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-21T06:21:02.916 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-21T06:21:02.917 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-21T06:21:02.918 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-21T06:21:02.919 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-21T06:21:02.920 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-21T06:21:02.921 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-21T06:21:02.922 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-21T06:21:02.923 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-21T06:21:02.924 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-21T06:21:02.925 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-21T06:21:02.926 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-21T06:21:02.927 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-21T06:21:02.929 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-21T06:21:02.931 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-21T06:21:02.932 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-21T06:21:02.934 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-21T06:21:02.935 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-21T06:21:02.937 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-21T06:21:02.939 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-21T06:21:02.940 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pps/ 2024-09-21T06:21:02.942 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-21T06:21:02.943 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-21T06:21:02.945 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-21T06:21:02.946 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-21T06:21:02.948 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-21T06:21:02.949 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-21T06:21:02.951 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-21T06:21:02.952 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-21T06:21:02.953 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-21T06:21:02.954 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-21T06:21:02.955 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-21T06:21:02.956 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pti/ 2024-09-21T06:21:02.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-21T06:21:02.958 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-21T06:21:02.959 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-21T06:21:02.960 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-21T06:21:02.961 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-21T06:21:02.962 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-21T06:21:02.963 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-21T06:21:02.964 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-21T06:21:02.965 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-21T06:21:02.966 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-21T06:21:02.967 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-21T06:21:02.968 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-21T06:21:02.970 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-21T06:21:02.971 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-21T06:21:02.972 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-21T06:21:02.973 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-21T06:21:02.974 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-21T06:21:02.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-21T06:21:02.976 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-21T06:21:02.977 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-21T06:21:02.979 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/ 2024-09-21T06:21:02.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-21T06:21:02.981 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-21T06:21:02.982 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-21T06:21:02.983 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-21T06:21:02.984 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-21T06:21:02.985 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-21T06:21:02.987 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-21T06:21:02.988 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-21T06:21:02.989 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-21T06:21:02.990 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-21T06:21:02.991 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-21T06:21:02.992 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-21T06:21:02.993 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-21T06:21:02.994 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-21T06:21:02.995 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-21T06:21:02.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-21T06:21:02.997 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-21T06:21:02.998 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-21T06:21:02.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-21T06:21:03.000 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-21T06:21:03.001 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-21T06:21:03.002 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-21T06:21:03.004 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-21T06:21:03.004 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-21T06:21:03.006 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-21T06:21:03.007 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-21T06:21:03.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-21T06:21:03.009 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-21T06:21:03.010 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-21T06:21:03.011 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-21T06:21:03.012 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-21T06:21:03.013 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-21T06:21:03.014 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-21T06:21:03.016 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-21T06:21:03.016 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-21T06:21:03.018 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-21T06:21:03.019 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-21T06:21:03.020 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-21T06:21:03.021 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-21T06:21:03.022 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-21T06:21:03.023 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-21T06:21:03.024 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-21T06:21:03.025 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-21T06:21:03.026 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-21T06:21:03.027 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-21T06:21:03.028 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-21T06:21:03.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-21T06:21:03.030 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-21T06:21:03.031 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-21T06:21:03.033 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-21T06:21:03.034 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-21T06:21:03.035 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-21T06:21:03.036 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-21T06:21:03.037 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-21T06:21:03.038 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-21T06:21:03.039 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-21T06:21:03.040 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-21T06:21:03.041 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-21T06:21:03.042 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-21T06:21:03.043 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-21T06:21:03.044 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-21T06:21:03.045 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-21T06:21:03.046 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-21T06:21:03.047 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-21T06:21:03.048 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-21T06:21:03.049 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-21T06:21:03.051 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-21T06:21:03.052 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-21T06:21:03.053 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-21T06:21:03.054 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-21T06:21:03.055 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-21T06:21:03.056 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-21T06:21:03.057 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-21T06:21:03.058 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-21T06:21:03.059 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-21T06:21:03.060 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-21T06:21:03.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-21T06:21:03.062 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-21T06:21:03.063 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-21T06:21:03.065 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-21T06:21:03.066 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-21T06:21:03.067 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-21T06:21:03.068 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-21T06:21:03.069 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-21T06:21:03.070 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-21T06:21:03.071 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/ 2024-09-21T06:21:03.072 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-21T06:21:03.073 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-21T06:21:03.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-21T06:21:03.075 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-21T06:21:03.076 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-21T06:21:03.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-21T06:21:03.078 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-21T06:21:03.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-21T06:21:03.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-21T06:21:03.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-21T06:21:03.082 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-21T06:21:03.084 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-21T06:21:03.085 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-21T06:21:03.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-21T06:21:03.087 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/ 2024-09-21T06:21:03.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-21T06:21:03.089 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-21T06:21:03.090 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-21T06:21:03.091 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-21T06:21:03.092 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-21T06:21:03.093 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-21T06:21:03.094 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-21T06:21:03.095 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-21T06:21:03.096 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-21T06:21:03.097 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sh/ 2024-09-21T06:21:03.099 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-21T06:21:03.100 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-21T06:21:03.101 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-21T06:21:03.102 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/ 2024-09-21T06:21:03.103 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-21T06:21:03.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-21T06:21:03.105 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-21T06:21:03.106 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-21T06:21:03.107 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-21T06:21:03.108 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-21T06:21:03.109 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-21T06:21:03.110 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-21T06:21:03.111 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-21T06:21:03.112 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-21T06:21:03.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-21T06:21:03.114 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-21T06:21:03.115 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-21T06:21:03.116 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-21T06:21:03.117 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-21T06:21:03.118 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-21T06:21:03.119 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-21T06:21:03.120 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-21T06:21:03.121 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-21T06:21:03.122 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-21T06:21:03.123 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-21T06:21:03.124 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-21T06:21:03.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-21T06:21:03.126 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-21T06:21:03.128 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-21T06:21:03.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-21T06:21:03.129 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-21T06:21:03.130 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-21T06:21:03.131 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-21T06:21:03.132 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-21T06:21:03.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-21T06:21:03.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-21T06:21:03.134 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-21T06:21:03.135 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-21T06:21:03.136 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-21T06:21:03.137 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-21T06:21:03.138 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-21T06:21:03.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-21T06:21:03.139 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-21T06:21:03.140 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-21T06:21:03.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-21T06:21:03.142 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-21T06:21:03.143 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-21T06:21:03.144 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-21T06:21:03.144 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-21T06:21:03.145 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-21T06:21:03.146 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-21T06:21:03.147 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-21T06:21:03.148 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-21T06:21:03.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-21T06:21:03.149 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-21T06:21:03.150 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-21T06:21:03.151 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-21T06:21:03.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-21T06:21:03.153 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-21T06:21:03.154 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-21T06:21:03.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-21T06:21:03.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-21T06:21:03.156 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-21T06:21:03.157 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-21T06:21:03.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-21T06:21:03.159 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-21T06:21:03.159 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-21T06:21:03.160 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/ 2024-09-21T06:21:03.161 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-21T06:21:03.162 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-21T06:21:03.163 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-21T06:21:03.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-21T06:21:03.164 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-21T06:21:03.167 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-21T06:21:03.169 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-21T06:21:03.170 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-21T06:21:03.172 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-21T06:21:03.173 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-21T06:21:03.175 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-21T06:21:03.176 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-21T06:21:03.178 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-21T06:21:03.180 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-21T06:21:03.181 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-21T06:21:03.183 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-21T06:21:03.185 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-21T06:21:03.186 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-21T06:21:03.188 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-21T06:21:03.189 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-21T06:21:03.191 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-21T06:21:03.193 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-21T06:21:03.194 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-21T06:21:03.196 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-21T06:21:03.197 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-21T06:21:03.199 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-21T06:21:03.201 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-21T06:21:03.202 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/target/ 2024-09-21T06:21:03.204 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-21T06:21:03.205 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-21T06:21:03.207 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-21T06:21:03.209 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-21T06:21:03.210 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-21T06:21:03.212 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-21T06:21:03.213 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-21T06:21:03.215 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-21T06:21:03.217 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-21T06:21:03.218 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-21T06:21:03.220 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-21T06:21:03.221 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-21T06:21:03.223 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/ 2024-09-21T06:21:03.224 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-21T06:21:03.226 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-21T06:21:03.228 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-21T06:21:03.229 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-21T06:21:03.231 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-21T06:21:03.232 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-21T06:21:03.234 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-21T06:21:03.236 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-21T06:21:03.237 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-21T06:21:03.239 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-21T06:21:03.240 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-21T06:21:03.242 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-21T06:21:03.243 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-21T06:21:03.245 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/ 2024-09-21T06:21:03.246 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-21T06:21:03.248 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-21T06:21:03.250 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-21T06:21:03.251 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-21T06:21:03.253 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-21T06:21:03.254 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-21T06:21:03.256 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-21T06:21:03.258 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-21T06:21:03.259 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-21T06:21:03.261 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-21T06:21:03.263 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-21T06:21:03.264 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-21T06:21:03.266 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-21T06:21:03.267 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-21T06:21:03.268 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-21T06:21:03.269 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-21T06:21:03.270 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-21T06:21:03.271 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-21T06:21:03.273 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-21T06:21:03.275 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-21T06:21:03.276 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/ 2024-09-21T06:21:03.278 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-21T06:21:03.280 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-21T06:21:03.281 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-21T06:21:03.283 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-21T06:21:03.284 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-21T06:21:03.286 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-21T06:21:03.288 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-21T06:21:03.289 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-21T06:21:03.291 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-21T06:21:03.292 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-21T06:21:03.294 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-21T06:21:03.295 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-21T06:21:03.297 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-21T06:21:03.297 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-21T06:21:03.298 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-21T06:21:03.300 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-21T06:21:03.301 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-21T06:21:03.302 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-21T06:21:03.303 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-21T06:21:03.304 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-21T06:21:03.305 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-21T06:21:03.306 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-21T06:21:03.307 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-21T06:21:03.308 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-21T06:21:03.309 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-21T06:21:03.310 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-21T06:21:03.311 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-21T06:21:03.312 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-21T06:21:03.313 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-21T06:21:03.314 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-21T06:21:03.315 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-21T06:21:03.316 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-21T06:21:03.317 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-21T06:21:03.318 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-21T06:21:03.319 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-21T06:21:03.320 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-21T06:21:03.322 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-21T06:21:03.323 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-21T06:21:03.324 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-21T06:21:03.325 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-21T06:21:03.326 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-21T06:21:03.327 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-21T06:21:03.329 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-21T06:21:03.331 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-21T06:21:03.332 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-21T06:21:03.333 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-21T06:21:03.334 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-21T06:21:03.335 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-21T06:21:03.336 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-21T06:21:03.337 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-21T06:21:03.338 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-21T06:21:03.339 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-21T06:21:03.341 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-21T06:21:03.342 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-21T06:21:03.343 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-21T06:21:03.344 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-21T06:21:03.345 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-21T06:21:03.346 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-21T06:21:03.347 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-21T06:21:03.348 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-21T06:21:03.350 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-21T06:21:03.351 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-21T06:21:03.353 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-21T06:21:03.355 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-21T06:21:03.356 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-21T06:21:03.358 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-21T06:21:03.359 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-21T06:21:03.361 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-21T06:21:03.362 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-21T06:21:03.364 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-21T06:21:03.365 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-21T06:21:03.367 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-21T06:21:03.368 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-21T06:21:03.370 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-21T06:21:03.372 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-21T06:21:03.373 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-21T06:21:03.375 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-21T06:21:03.376 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-21T06:21:03.378 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-21T06:21:03.379 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-21T06:21:03.381 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-21T06:21:03.382 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-21T06:21:03.383 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-21T06:21:03.384 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-21T06:21:03.385 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-21T06:21:03.386 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-21T06:21:03.387 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-21T06:21:03.388 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-21T06:21:03.389 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-21T06:21:03.390 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-21T06:21:03.391 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-21T06:21:03.392 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-21T06:21:03.393 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-21T06:21:03.394 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-21T06:21:03.395 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-21T06:21:03.396 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-21T06:21:03.398 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-21T06:21:03.399 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-21T06:21:03.401 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-21T06:21:03.403 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-21T06:21:03.404 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-21T06:21:03.406 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-21T06:21:03.407 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-21T06:21:03.409 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-21T06:21:03.410 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-21T06:21:03.412 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-21T06:21:03.414 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-21T06:21:03.415 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-21T06:21:03.417 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-21T06:21:03.419 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-21T06:21:03.420 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-21T06:21:03.421 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-21T06:21:03.423 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-21T06:21:03.425 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-21T06:21:03.426 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-21T06:21:03.428 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-21T06:21:03.429 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-21T06:21:03.431 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-21T06:21:03.433 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-21T06:21:03.434 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-21T06:21:03.436 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-21T06:21:03.437 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-21T06:21:03.439 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-21T06:21:03.440 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-21T06:21:03.442 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-21T06:21:03.444 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-21T06:21:03.445 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-21T06:21:03.447 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-21T06:21:03.448 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-21T06:21:03.450 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-21T06:21:03.452 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-21T06:21:03.453 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-21T06:21:03.455 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-21T06:21:03.457 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-21T06:21:03.458 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-21T06:21:03.460 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-21T06:21:03.461 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-21T06:21:03.463 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-21T06:21:03.464 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-21T06:21:03.466 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-21T06:21:03.468 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-21T06:21:03.469 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-21T06:21:03.471 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-21T06:21:03.472 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-21T06:21:03.474 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-21T06:21:03.476 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-21T06:21:03.477 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-21T06:21:03.479 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-21T06:21:03.480 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-21T06:21:03.482 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-21T06:21:03.484 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/ 2024-09-21T06:21:03.485 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-21T06:21:03.487 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-21T06:21:03.488 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-21T06:21:03.489 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-21T06:21:03.490 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-21T06:21:03.491 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-21T06:21:03.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-21T06:21:03.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-21T06:21:03.494 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-21T06:21:03.495 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-21T06:21:03.496 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-21T06:21:03.498 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-21T06:21:03.499 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-21T06:21:03.500 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-21T06:21:03.501 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-21T06:21:03.502 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-21T06:21:03.503 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-21T06:21:03.504 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-21T06:21:03.505 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-21T06:21:03.507 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-21T06:21:03.508 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-21T06:21:03.510 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-21T06:21:03.514 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-21T06:21:03.593 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-21T06:21:03.804 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-21T06:21:03.826 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/ 2024-09-21T06:21:03.833 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-21T06:21:03.837 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-21T06:21:03.840 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-21T06:21:03.843 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-21T06:21:03.849 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-21T06:21:03.853 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-21T06:21:03.855 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-21T06:21:03.857 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-21T06:21:03.860 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-21T06:21:03.863 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-21T06:21:03.866 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-21T06:21:03.869 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-21T06:21:03.872 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-21T06:21:03.877 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-21T06:21:03.883 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-21T06:21:03.890 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-21T06:21:03.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:03 smithi174 ceph-mon[34815]: pgmap v360: 97 pgs: 97 active+clean; 80 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 7.0 MiB/s wr, 82 op/s 2024-09-21T06:21:03.894 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-21T06:21:03.897 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-21T06:21:03.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-21T06:21:03.902 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-21T06:21:03.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:03 smithi044 ceph-mon[34369]: pgmap v360: 97 pgs: 97 active+clean; 80 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 7.0 MiB/s wr, 82 op/s 2024-09-21T06:21:03.906 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-21T06:21:03.909 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-21T06:21:03.911 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-21T06:21:03.914 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-21T06:21:03.917 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-21T06:21:03.920 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-21T06:21:03.925 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-21T06:21:03.927 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-21T06:21:03.935 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-21T06:21:03.937 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-21T06:21:03.940 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-21T06:21:03.942 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-21T06:21:03.945 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:03 smithi038 ceph-mon[31215]: pgmap v360: 97 pgs: 97 active+clean; 80 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 7.0 MiB/s wr, 82 op/s 2024-09-21T06:21:03.949 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-21T06:21:03.950 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-21T06:21:03.954 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/ 2024-09-21T06:21:03.955 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-21T06:21:03.957 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-21T06:21:03.958 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-21T06:21:03.962 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-21T06:21:03.966 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-21T06:21:03.970 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-21T06:21:03.975 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-21T06:21:03.980 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-21T06:21:03.983 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-21T06:21:03.988 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-21T06:21:03.994 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-21T06:21:03.996 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-21T06:21:03.998 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-21T06:21:03.999 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-21T06:21:04.005 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-21T06:21:04.008 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-21T06:21:04.012 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-21T06:21:04.015 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-21T06:21:04.018 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-21T06:21:04.021 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-21T06:21:04.024 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-21T06:21:04.027 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-21T06:21:04.031 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-21T06:21:04.035 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-21T06:21:04.038 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-21T06:21:04.041 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-21T06:21:04.043 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-21T06:21:04.049 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-21T06:21:04.055 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-21T06:21:04.057 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-21T06:21:04.061 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-21T06:21:04.063 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-21T06:21:04.067 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-21T06:21:04.071 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-21T06:21:04.074 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-21T06:21:04.077 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-21T06:21:04.083 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-21T06:21:04.086 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-21T06:21:04.088 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-21T06:21:04.096 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-21T06:21:04.104 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-21T06:21:04.113 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-21T06:21:04.116 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-21T06:21:04.131 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-21T06:21:04.133 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-21T06:21:04.135 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-21T06:21:04.141 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-21T06:21:04.146 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-21T06:21:04.148 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-21T06:21:04.152 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-21T06:21:04.155 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-21T06:21:04.158 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-21T06:21:04.163 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-21T06:21:04.169 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-21T06:21:04.174 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-21T06:21:04.180 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-21T06:21:04.192 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-21T06:21:04.195 INFO:tasks.workunit.client.0.smithi038.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-21T06:21:04.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:04 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:04.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:04 smithi174 ceph-mon[34815]: pgmap v361: 97 pgs: 97 active+clean; 83 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.3 MiB/s wr, 250 op/s 2024-09-21T06:21:04.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:04 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:04.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:04 smithi044 ceph-mon[34369]: pgmap v361: 97 pgs: 97 active+clean; 83 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.3 MiB/s wr, 250 op/s 2024-09-21T06:21:04.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:04 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:04.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:04 smithi038 ceph-mon[31215]: pgmap v361: 97 pgs: 97 active+clean; 83 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 7.3 MiB/s wr, 250 op/s 2024-09-21T06:21:06.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:21:06.690 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:07.116 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:06 smithi038 ceph-mon[31215]: pgmap v362: 97 pgs: 97 active+clean; 83 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T06:21:07.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:06 smithi174 ceph-mon[34815]: pgmap v362: 97 pgs: 97 active+clean; 83 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T06:21:07.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:06 smithi044 ceph-mon[34369]: pgmap v362: 97 pgs: 97 active+clean; 83 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 -- 172.21.15.38:0/1956901905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca201083e0 msgr2=0x7fca201087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 --2- 172.21.15.38:0/1956901905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca201083e0 0x7fca201087f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca1002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 -- 172.21.15.38:0/1956901905 shutdown_connections 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 --2- 172.21.15.38:0/1956901905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 0x7fca2010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 --2- 172.21.15.38:0/1956901905 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca201083e0 0x7fca201087f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 --2- 172.21.15.38:0/1956901905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20102aa0 0x7fca20102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 -- 172.21.15.38:0/1956901905 >> 172.21.15.38:0/1956901905 conn(0x7fca200797e0 msgr2=0x7fca20079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 -- 172.21.15.38:0/1956901905 shutdown_connections 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.213+0000 7fca28397640 1 -- 172.21.15.38:0/1956901905 wait complete. 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 Processor -- start 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 -- start start 2024-09-21T06:21:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca201083e0 0x7fca200ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 0x7fca201000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112ac0 con 0x7fca20102aa0 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112940 con 0x7fca20108d30 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca28397640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112c40 con 0x7fca201083e0 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca26133640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca26133640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44650/0 (socket says 172.21.15.38:44650) 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca26133640 1 -- 172.21.15.38:0/4075853902 learned_addr learned my addr 172.21.15.38:0/4075853902 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.214+0000 7fca25932640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca201083e0 0x7fca200ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26934640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 0x7fca201000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 -- 172.21.15.38:0/4075853902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca201083e0 msgr2=0x7fca200ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca201083e0 0x7fca200ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 -- 172.21.15.38:0/4075853902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 msgr2=0x7fca201000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 0x7fca201000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 -- 172.21.15.38:0/4075853902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca201a87b0 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca26133640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c920 tx=0x7fca1c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca177fe640 1 -- 172.21.15.38:0/4075853902 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c007c70 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201a8aa0 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca177fe640 1 -- 172.21.15.38:0/4075853902 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca1c007e10 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca177fe640 1 -- 172.21.15.38:0/4075853902 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0188c0 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.215+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201a9000 con 0x7fca20102aa0 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 Processor -- start 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 -- start start 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998fa070 0x561a99ca1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d11b0 0x561a99ca1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561a99c17e50 con 0x561a998d11b0 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561a99c07280 con 0x561a998fa070 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.218+0000 7fca2e90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561a99c0b090 con 0x561a998d9390 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:36684/0 (socket says 172.21.15.38:36684) 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 -- 172.21.15.38:0/709727927 learned_addr learned my addr 172.21.15.38:0/709727927 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca26934640 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998fa070 0x561a99ca1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 -- 172.21.15.38:0/709727927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998fa070 msgr2=0x561a99ca1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998fa070 0x561a99ca1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 -- 172.21.15.38:0/709727927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d11b0 msgr2=0x561a99ca1b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d11b0 0x561a99ca1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 -- 172.21.15.38:0/709727927 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a99965650 con 0x561a998d9390 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca177fe640 1 -- 172.21.15.38:0/4075853902 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fca1c018a60 con 0x7fca20102aa0 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.219+0000 7fca25932640 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca2006aaa0 tx=0x7fca10032d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6bd301042638bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca14d9a640 1 -- 172.21.15.38:0/709727927 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10035040 con 0x561a998d9390 2024-09-21T06:21:07.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca14d9a640 1 -- 172.21.15.38:0/709727927 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca10031710 con 0x561a998d9390 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca14d9a640 1 -- 172.21.15.38:0/709727927 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100047a0 con 0x561a998d9390 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca177fe640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 0x7fca0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca26934640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 0x7fca0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.220+0000 7fca177fe640 1 -- 172.21.15.38:0/4075853902 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fca1c0e7710 con 0x7fca20102aa0 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- 172.21.15.38:0/709727927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 msgr2=0x561a99ca20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca2006aaa0 tx=0x7fca10032d30 comp rx=0 tx=0).stop 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- 172.21.15.38:0/709727927 shutdown_connections 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d9390 0x561a99ca20d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d11b0 0x561a99ca1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 --2- 172.21.15.38:0/709727927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998fa070 0x561a99ca1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- 172.21.15.38:0/709727927 >> 172.21.15.38:0/709727927 conn(0x561a998ee460 msgr2=0x561a99c9f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca26934640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 0x7fca0c0b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca1800af10 tx=0x7fca1800a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- 172.21.15.38:0/709727927 shutdown_connections 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- 172.21.15.38:0/709727927 wait complete. 2024-09-21T06:21:07.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 -- start start 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.221+0000 7fca2e90b740 1 Processor -- start 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cacd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99cb90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561a99a68700 con 0x561a998d9390 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561a99ba2110 con 0x561a998d11b0 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561a99cafdd0 con 0x561a998fa070 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca2e90b740 10 client.0 _ll_register_callbacks cb 0x561a99bbb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca25932640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca25932640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44662/0 (socket says 172.21.15.38:44662) 2024-09-21T06:21:07.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca25932640 1 -- 172.21.15.38:0/3552761157 learned_addr learned my addr 172.21.15.38:0/3552761157 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cacd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26934640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99cb90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 -- 172.21.15.38:0/3552761157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 msgr2=0x561a99cb90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99cb90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 -- 172.21.15.38:0/3552761157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 msgr2=0x561a99cad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca26133640 1 -- 172.21.15.38:0/3552761157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a99bcfc40 con 0x561a998d11b0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.222+0000 7fca25932640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca26133640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cacd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0e4ee0 tx=0x7fca1c0acff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6dcadabc8c2919 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0b6240 con 0x561a998d11b0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fca1c0ac840 con 0x561a998d11b0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca10031710 con 0x561a998d11b0 2024-09-21T06:21:07.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0adce0 con 0x561a998d11b0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca2e90b740 10 client.25514 fetch_fsmap learned FSMap version 25 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a99cbbb10 con 0x561a998d11b0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.223+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca10031710 con 0x561a998d11b0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fca1c0a7ce0 con 0x561a998d11b0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 10 client.25514 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 10 client.25514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 20 client.25514 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a998b89f0 0x561a99cbf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 4 client.25514 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a99c19da0 con 0x561a998b89f0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.224+0000 7fca25932640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a998b89f0 0x561a99cbf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.225+0000 7fca25932640 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a998b89f0 0x561a99cbf060 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c03a3c3f61951a server_cookie=9778b94e0fbae176 in_seq=0 out_seq=0 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.225+0000 7fca09ffb640 10 client.25514 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:07.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.225+0000 7fca09ffb640 1 -- 172.21.15.38:0/3552761157 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a99c19da0 con 0x561a998b89f0 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.225+0000 7fca09ffb640 10 client.25514 handle_command_reply: tid=0 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.225+0000 7fca2e90b740 1 client.25514 shutdown 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 msgr2=0x561a99cacd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cacd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0e4ee0 tx=0x7fca1c0acff0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 shutdown_connections 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a998b89f0 0x561a99cbf060 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99cb90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99cad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca09ffb640 0 client.25514 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 --2- 172.21.15.38:0/3552761157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cacd10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 >> 172.21.15.38:0/3552761157 conn(0x561a998ee460 msgr2=0x561a99ca47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 shutdown_connections 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 1 -- 172.21.15.38:0/3552761157 wait complete. 2024-09-21T06:21:07.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.226+0000 7fca2e90b740 20 client.25514 trim_cache size 0 max 16384 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 Processor -- start 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 -- start start 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cabc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99ca9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b4020 con 0x561a998d9390 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b18f0 con 0x561a998d11b0 2024-09-21T06:21:07.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca2e90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca201af740 con 0x561a998fa070 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca25932640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca25932640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44666/0 (socket says 172.21.15.38:44666) 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca26133640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cabc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca25932640 1 -- 172.21.15.38:0/918579213 learned_addr learned my addr 172.21.15.38:0/918579213 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.247+0000 7fca26934640 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99ca9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 -- 172.21.15.38:0/918579213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 msgr2=0x561a99ca9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99ca9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 -- 172.21.15.38:0/918579213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 msgr2=0x561a99cabc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cabc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 -- 172.21.15.38:0/918579213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a99cadfd0 con 0x561a998d9390 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca26133640 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cabc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca25932640 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca1002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a44b681c143b15d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.248+0000 7fca0bfff640 1 -- 172.21.15.38:0/918579213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10035040 con 0x561a998d9390 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.249+0000 7fca0bfff640 1 -- 172.21.15.38:0/918579213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca10032040 con 0x561a998d9390 2024-09-21T06:21:07.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.249+0000 7fca0bfff640 1 -- 172.21.15.38:0/918579213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100526a0 con 0x561a998d9390 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- 172.21.15.38:0/918579213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 msgr2=0x561a99ca2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca1002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- 172.21.15.38:0/918579213 shutdown_connections 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998fa070 0x561a99ca9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998d9390 0x561a99ca2d90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 --2- 172.21.15.38:0/918579213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d11b0 0x561a99cabc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- 172.21.15.38:0/918579213 >> 172.21.15.38:0/918579213 conn(0x561a998ee460 msgr2=0x561a99ca2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- 172.21.15.38:0/918579213 shutdown_connections 2024-09-21T06:21:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- 172.21.15.38:0/918579213 wait complete. 2024-09-21T06:21:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.250+0000 7fca2e90b740 1 -- start start 2024-09-21T06:21:07.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 Processor -- start 2024-09-21T06:21:07.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 0x561a99cb0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998fa070 0x561a99cb1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fca201afdb0 con 0x561a998fa070 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b1220 con 0x561a998d9390 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca201b0480 con 0x561a998d11b0 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26934640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998fa070 0x561a99cb1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca2e90b740 10 client.0 _ll_register_callbacks cb 0x7fca1c00fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:36716/0 (socket says 172.21.15.38:36716) 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 -- 172.21.15.38:0/1335843384 learned_addr learned my addr 172.21.15.38:0/1335843384 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca25932640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 0x561a99cb0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 -- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 msgr2=0x561a99cb0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 0x561a99cb0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 -- 172.21.15.38:0/1335843384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998fa070 msgr2=0x561a99cb1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.251+0000 7fca26133640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998fa070 0x561a99cb1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca26133640 1 -- 172.21.15.38:0/1335843384 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a99d28a60 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca25932640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 0x561a99cb0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca26133640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00fec0 tx=0x7fca1c0a9c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85dc842d8963d281 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0ad3b0 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca10032040 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fca1c0b32f0 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0a9480 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca2e90b740 10 client.25489 fetch_fsmap learned FSMap version 25 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.252+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a99d29bf0 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca10032040 con 0x561a998d11b0 2024-09-21T06:21:07.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fca1c0a7ce0 con 0x561a998d11b0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 10 client.25489 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 10 client.25489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 20 client.25489 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a9988dda0 0x561a99d2c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 4 client.25489 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a99c15850 con 0x561a9988dda0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.253+0000 7fca25932640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a9988dda0 0x561a99d2c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca25932640 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a9988dda0 0x561a99d2c350 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc0492195018a9a2 server_cookie=3d8e3e3594f4600d in_seq=0 out_seq=0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca09ffb640 10 client.25489 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca09ffb640 1 -- 172.21.15.38:0/1335843384 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x561a99c15850 con 0x561a9988dda0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca09ffb640 10 client.25489 handle_command_reply: tid=0 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 client.25489 shutdown 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 msgr2=0x561a99cb5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00fec0 tx=0x7fca1c0a9c30 comp rx=0 tx=0).stop 2024-09-21T06:21:07.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 shutdown_connections 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561a998fa070 0x561a99cb1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561a998d9390 0x561a99cb0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561a9988dda0 0x561a99d2c350 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca2e90b740 1 --2- 172.21.15.38:0/1335843384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561a998d11b0 0x561a99cb5a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.254+0000 7fca09ffb640 0 client.25489 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.255+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 >> 172.21.15.38:0/1335843384 conn(0x561a998ee460 msgr2=0x561a99cad250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.255+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 shutdown_connections 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.255+0000 7fca2e90b740 1 -- 172.21.15.38:0/1335843384 wait complete. 2024-09-21T06:21:07.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.255+0000 7fca2e90b740 20 client.25489 trim_cache size 0 max 16384 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:07.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:07.263 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:07.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:07.264 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:07.264 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:21:07.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 msgr2=0x7fca0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 0x7fca0c0b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca1800af10 tx=0x7fca1800a4d0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 msgr2=0x7fca200ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c920 tx=0x7fca1c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 shutdown_connections 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fca0c0b6680 0x7fca0c0b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca20108d30 0x7fca201000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca201083e0 0x7fca200ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 --2- 172.21.15.38:0/4075853902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca20102aa0 0x7fca200ff670 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 >> 172.21.15.38:0/4075853902 conn(0x7fca200797e0 msgr2=0x7fca2006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 shutdown_connections 2024-09-21T06:21:07.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:07.256+0000 7fca28397640 1 -- 172.21.15.38:0/4075853902 wait complete. 2024-09-21T06:21:08.115 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:21:08.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:21:08.384 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:08.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.865+0000 7f0691cb9640 1 -- 172.21.15.38:0/2003654192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c1094b0 msgr2=0x7f068c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.865+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2003654192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c1094b0 0x7f068c1098c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0674009900 tx=0x7f067402a410 comp rx=0 tx=0).stop 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 -- 172.21.15.38:0/2003654192 shutdown_connections 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2003654192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c109e00 0x7f068c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2003654192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c1094b0 0x7f068c1098c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2003654192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c103bc0 0x7f068c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 -- 172.21.15.38:0/2003654192 >> 172.21.15.38:0/2003654192 conn(0x7f068c07b910 msgr2=0x7f068c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 -- 172.21.15.38:0/2003654192 shutdown_connections 2024-09-21T06:21:08.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 -- 172.21.15.38:0/2003654192 wait complete. 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 Processor -- start 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.866+0000 7f0691cb9640 1 -- start start 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c103bc0 0x7f068c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c1094b0 0x7f068c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f068c113be0 con 0x7f068c109e00 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f068c113a60 con 0x7f068c1094b0 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f0691cb9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f068c113d60 con 0x7f068c103bc0 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44692/0 (socket says 172.21.15.38:44692) 2024-09-21T06:21:08.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 -- 172.21.15.38:0/2187727791 learned_addr learned my addr 172.21.15.38:0/2187727791 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068b7fe640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c103bc0 0x7f068c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068affd640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c1094b0 0x7f068c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 -- 172.21.15.38:0/2187727791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c103bc0 msgr2=0x7f068c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c103bc0 0x7f068c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 -- 172.21.15.38:0/2187727791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c1094b0 msgr2=0x7f068c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c1094b0 0x7f068c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.867+0000 7f068bfff640 1 -- 172.21.15.38:0/2187727791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1a0500 con 0x7f068c109e00 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f068bfff640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f068400cce0 tx=0x7f068400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068400f450 con 0x7f068c109e00 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c1a07f0 con 0x7f068c109e00 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f068400fac0 con 0x7f068c109e00 2024-09-21T06:21:08.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684018be0 con 0x7f068c109e00 2024-09-21T06:21:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.868+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c0755f0 con 0x7f068c109e00 2024-09-21T06:21:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.869+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c104df0 con 0x7f068c109e00 2024-09-21T06:21:08.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.871+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f068400fc70 con 0x7f068c109e00 2024-09-21T06:21:08.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.872+0000 7f0688ff9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 0x7f06780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:08.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.872+0000 7f068b7fe640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 0x7f06780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:08.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.872+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f06840e7cb0 con 0x7f068c109e00 2024-09-21T06:21:08.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.873+0000 7f068b7fe640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 0x7f06780b8bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f067c00bbe0 tx=0x7f067c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:08.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:08.875+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0684014030 con 0x7f068c109e00 2024-09-21T06:21:09.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.102+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f068c10bc00 con 0x7f068c109e00 2024-09-21T06:21:09.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:08 smithi038 ceph-mon[31215]: pgmap v363: 97 pgs: 97 active+clean; 88 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 3.7 MiB/s wr, 378 op/s 2024-09-21T06:21:09.105 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:08 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:09.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.103+0000 7f0688ff9640 1 -- 172.21.15.38:0/2187727791 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11915 (secure 0 0 0) 0x7f06840ae310 con 0x7f068c109e00 2024-09-21T06:21:09.106 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:21:09.106 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":26,"btime":"2024-09-21T06:21:07:771271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:21:07.396083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:21:09.107 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 26 2024-09-21T06:21:09.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 msgr2=0x7f06780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:09.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 0x7f06780b8bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f067c00bbe0 tx=0x7f067c00b390 comp rx=0 tx=0).stop 2024-09-21T06:21:09.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 msgr2=0x7f068c19fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f068400cce0 tx=0x7f068400a620 comp rx=0 tx=0).stop 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 shutdown_connections 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f06780b66b0 0x7f06780b8bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f068c109e00 0x7f068c19fe90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f068c1094b0 0x7f068c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 --2- 172.21.15.38:0/2187727791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f068c103bc0 0x7f068c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 >> 172.21.15.38:0/2187727791 conn(0x7f068c07b910 msgr2=0x7f068c107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 shutdown_connections 2024-09-21T06:21:09.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:09.106+0000 7f0691cb9640 1 -- 172.21.15.38:0/2187727791 wait complete. 2024-09-21T06:21:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:08 smithi174 ceph-mon[34815]: pgmap v363: 97 pgs: 97 active+clean; 88 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 3.7 MiB/s wr, 378 op/s 2024-09-21T06:21:09.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:08 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:08 smithi044 ceph-mon[34369]: pgmap v363: 97 pgs: 97 active+clean; 88 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 3.7 MiB/s wr, 378 op/s 2024-09-21T06:21:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:08 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:09.194 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-21T06:21:09.993 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar xf doc.tar 2024-09-21T06:21:10.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:09 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2187727791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:10.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:09 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2187727791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:10.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:09 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2187727791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:11.045 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:10 smithi038 ceph-mon[31215]: pgmap v364: 97 pgs: 97 active+clean; 91 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 395 op/s 2024-09-21T06:21:11.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:10 smithi174 ceph-mon[34815]: pgmap v364: 97 pgs: 97 active+clean; 91 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 395 op/s 2024-09-21T06:21:11.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:10 smithi044 ceph-mon[34369]: pgmap v364: 97 pgs: 97 active+clean; 91 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 395 op/s 2024-09-21T06:21:11.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:21:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 -- 172.21.15.38:0/1092616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 msgr2=0x7fc1e0104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 --2- 172.21.15.38:0/1092616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e0104c50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009900 tx=0x7fc1d002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 -- 172.21.15.38:0/1092616684 shutdown_connections 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 --2- 172.21.15.38:0/1092616684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 0x7fc1e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 --2- 172.21.15.38:0/1092616684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 0x7fc1e010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 --2- 172.21.15.38:0/1092616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e0104c50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 -- 172.21.15.38:0/1092616684 >> 172.21.15.38:0/1092616684 conn(0x7fc1e0079730 msgr2=0x7fc1e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 -- 172.21.15.38:0/1092616684 shutdown_connections 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.075+0000 7fc1e5634640 1 -- 172.21.15.38:0/1092616684 wait complete. 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 Processor -- start 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 -- start start 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 0x7fc1e019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 0x7fc1e019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0113bb0 con 0x7fc1e0104840 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0113a30 con 0x7fc1e010ddf0 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1e5634640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0113d30 con 0x7fc1e0105270 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55530/0 (socket says 172.21.15.38:55530) 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1deffd640 1 -- 172.21.15.38:0/4232720982 learned_addr learned my addr 172.21.15.38:0/4232720982 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 0x7fc1e019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.076+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 0x7fc1e019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 -- 172.21.15.38:0/4232720982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 msgr2=0x7fc1e019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 0x7fc1e019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 -- 172.21.15.38:0/4232720982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 msgr2=0x7fc1e019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 0x7fc1e019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 -- 172.21.15.38:0/4232720982 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e01a0430 con 0x7fc1e0104840 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1deffd640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005940 tx=0x7fc1d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1dcff9640 1 -- 172.21.15.38:0/4232720982 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d003f030 con 0x7fc1e0104840 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01a06c0 con 0x7fc1e0104840 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1dcff9640 1 -- 172.21.15.38:0/4232720982 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1d0031910 con 0x7fc1e0104840 2024-09-21T06:21:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1dcff9640 1 -- 172.21.15.38:0/4232720982 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0035070 con 0x7fc1e0104840 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.077+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e01a0bf0 con 0x7fc1e0104840 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.080+0000 7fc1dcff9640 1 -- 172.21.15.38:0/4232720982 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc1d0042030 con 0x7fc1e0104840 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.080+0000 7fc1ebba8740 1 Processor -- start 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.080+0000 7fc1ebba8740 1 -- start start 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de506be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5de47cea0 con 0x55b5de1361b0 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5de46c2d0 con 0x55b5de13e390 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5de4700e0 con 0x55b5de15f070 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.081+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41876/0 (socket says 172.21.15.38:41876) 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 -- 172.21.15.38:0/3737576736 learned_addr learned my addr 172.21.15.38:0/3737576736 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1deffd640 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de506be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 -- 172.21.15.38:0/3737576736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 msgr2=0x55b5de5066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 -- 172.21.15.38:0/3737576736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 msgr2=0x55b5de506be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de506be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 -- 172.21.15.38:0/3737576736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5de1ca650 con 0x55b5de13e390 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1dcff9640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 0x7fc1cc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 0x7fc1cc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1dcff9640 1 -- 172.21.15.38:0/4232720982 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc1d0107b70 con 0x7fc1e0104840 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.082+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800ac30 tx=0x7fc1c800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad2baf976990bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.083+0000 7fc1d57fa640 1 -- 172.21.15.38:0/3737576736 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c801d070 con 0x55b5de13e390 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.083+0000 7fc1d57fa640 1 -- 172.21.15.38:0/3737576736 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1c8018b10 con 0x55b5de13e390 2024-09-21T06:21:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.083+0000 7fc1d57fa640 1 -- 172.21.15.38:0/3737576736 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8010bf0 con 0x55b5de13e390 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3737576736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 msgr2=0x55b5de507120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800ac30 tx=0x7fc1c800f790 comp rx=0 tx=0).stop 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 0x7fc1cc0b8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3737576736 shutdown_connections 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de507120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de506be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3737576736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3737576736 >> 172.21.15.38:0/3737576736 conn(0x55b5de153460 msgr2=0x55b5de504590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3737576736 shutdown_connections 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.084+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3737576736 wait complete. 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 -- start start 2024-09-21T06:21:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 Processor -- start 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 0x55b5de5122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de15f070 0x55b5de51e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5de2cd700 con 0x55b5de1361b0 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5de407160 con 0x55b5de15f070 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5de514e80 con 0x55b5de13e390 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55536/0 (socket says 172.21.15.38:55536) 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1deffd640 1 -- 172.21.15.38:0/1850069348 learned_addr learned my addr 172.21.15.38:0/1850069348 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1ebba8740 10 client.0 _ll_register_callbacks cb 0x55b5de4209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.085+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 0x55b5de5122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de15f070 0x55b5de51e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 -- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 msgr2=0x55b5de5122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 0x55b5de5122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 -- 172.21.15.38:0/1850069348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de15f070 msgr2=0x55b5de51e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de15f070 0x55b5de51e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 -- 172.21.15.38:0/1850069348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5de434c90 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 0x55b5de5122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00314b0 tx=0x7fc1d0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2d82eb2326cb98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0049050 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc1d00d6fd0 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.086+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c8018b10 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc1d00ca090 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 10 client.15888 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b5de520bf0 con 0x55b5de1361b0 2024-09-21T06:21:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1d00b6070 con 0x55b5de1361b0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc1d00d2020 con 0x55b5de1361b0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 10 client.15888 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 10 client.15888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 20 client.15888 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de11d9f0 0x55b5de5240f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 4 client.15888 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5de47edf0 con 0x55b5de11d9f0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.087+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de11d9f0 0x55b5de5240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.088+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de11d9f0 0x55b5de5240f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3dbf5f8ac769cb9 server_cookie=ab1900f4c0ba20de in_seq=0 out_seq=0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.088+0000 7fc1c67fc640 10 client.15888 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1850069348 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5de47edf0 con 0x55b5de11d9f0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1c67fc640 10 client.15888 handle_command_reply: tid=0 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 client.15888 shutdown 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 msgr2=0x55b5de511da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00314b0 tx=0x7fc1d0003f90 comp rx=0 tx=0).stop 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 shutdown_connections 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de11d9f0 0x55b5de5240f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de15f070 0x55b5de51e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de13e390 0x55b5de5122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1850069348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de511da0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1c67fc640 0 client.15888 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 >> 172.21.15.38:0/1850069348 conn(0x55b5de153460 msgr2=0x55b5de509880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 shutdown_connections 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1850069348 wait complete. 2024-09-21T06:21:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.090+0000 7fc1ebba8740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T06:21:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 Processor -- start 2024-09-21T06:21:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 -- start start 2024-09-21T06:21:12.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de503bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de504100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01afcd0 con 0x55b5de1361b0 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01ad570 con 0x55b5de13e390 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.105+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01ab3e0 con 0x55b5de15f070 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55540/0 (socket says 172.21.15.38:55540) 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de503bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 -- 172.21.15.38:0/3246735622 learned_addr learned my addr 172.21.15.38:0/3246735622 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de504100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 -- 172.21.15.38:0/3246735622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 msgr2=0x55b5de504100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de504100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 -- 172.21.15.38:0/3246735622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 msgr2=0x55b5de503bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de503bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 -- 172.21.15.38:0/3246735622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5de514380 con 0x55b5de1361b0 2024-09-21T06:21:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1deffd640 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00cacb0 tx=0x7fc1d00f11d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3767227fcc31cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1d4ff9640 1 -- 172.21.15.38:0/3246735622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0049070 con 0x55b5de1361b0 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1d4ff9640 1 -- 172.21.15.38:0/3246735622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1d00b6030 con 0x55b5de1361b0 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.106+0000 7fc1d4ff9640 1 -- 172.21.15.38:0/3246735622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00c91b0 con 0x55b5de1361b0 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3246735622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 msgr2=0x55b5de5139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00cacb0 tx=0x7fc1d00f11d0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3246735622 shutdown_connections 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de504100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de13e390 0x55b5de503bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/3246735622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de1361b0 0x55b5de5139d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.107+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3246735622 >> 172.21.15.38:0/3246735622 conn(0x55b5de153460 msgr2=0x55b5de5132c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3246735622 shutdown_connections 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 -- 172.21.15.38:0/3246735622 wait complete. 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 -- start start 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 Processor -- start 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de1361b0 0x55b5de51a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.108+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01aba30 con 0x55b5de13e390 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01acea0 con 0x55b5de1361b0 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1ebba8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01ac100 con 0x55b5de15f070 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1ebba8740 10 client.0 _ll_register_callbacks cb 0x7fc1d0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55556/0 (socket says 172.21.15.38:55556) 2024-09-21T06:21:12.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 -- 172.21.15.38:0/1652274177 learned_addr learned my addr 172.21.15.38:0/1652274177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de1361b0 0x55b5de51a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 -- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 msgr2=0x55b5de5162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 -- 172.21.15.38:0/1652274177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de1361b0 msgr2=0x55b5de51a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de1361b0 0x55b5de51a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 -- 172.21.15.38:0/1652274177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5de516990 con 0x55b5de13e390 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1df7fe640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1d7fff640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800ac30 tx=0x7fc1c800af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12675105b053909e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8032070 con 0x55b5de13e390 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc1c8018850 con 0x55b5de13e390 2024-09-21T06:21:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.109+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d00b6030 con 0x55b5de13e390 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc1c803e050 con 0x55b5de13e390 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 10 client.15894 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b5de58e950 con 0x55b5de13e390 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1d00b6030 con 0x55b5de13e390 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc1c80054d0 con 0x55b5de13e390 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 10 client.15894 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 10 client.15894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 20 client.15894 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de0f2da0 0x55b5de590da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 4 client.15894 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.110+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5de47a8a0 con 0x55b5de0f2da0 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de0f2da0 0x55b5de590da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1deffd640 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de0f2da0 0x55b5de590da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0562a24707b4c0f server_cookie=f7c48e233391110c in_seq=0 out_seq=0 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1c67fc640 10 client.15894 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1c67fc640 1 -- 172.21.15.38:0/1652274177 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5de47a8a0 con 0x55b5de0f2da0 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1c67fc640 10 client.15894 handle_command_reply: tid=0 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 client.15894 shutdown 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 msgr2=0x55b5de515d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800ac30 tx=0x7fc1c800af30 comp rx=0 tx=0).stop 2024-09-21T06:21:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 shutdown_connections 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b5de0f2da0 0x55b5de590da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5de15f070 0x55b5de5162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5de13e390 0x55b5de515d60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 --2- 172.21.15.38:0/1652274177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5de1361b0 0x55b5de51a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1c67fc640 0 client.15894 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.111+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 >> 172.21.15.38:0/1652274177 conn(0x55b5de153460 msgr2=0x55b5de5074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 shutdown_connections 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1ebba8740 1 -- 172.21.15.38:0/1652274177 wait complete. 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1ebba8740 20 client.15894 trim_cache size 0 max 16384 2024-09-21T06:21:12.118 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:12.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 msgr2=0x7fc1cc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 0x7fc1cc0b8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8009600 comp rx=0 tx=0).stop 2024-09-21T06:21:12.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 msgr2=0x7fc1e019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005940 tx=0x7fc1d00042f0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 shutdown_connections 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1cc0b66b0 0x7fc1cc0b8bc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e010ddf0 0x7fc1e019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1e0105270 0x7fc1e019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 --2- 172.21.15.38:0/4232720982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc1e0104840 0x7fc1e019a580 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.112+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 >> 172.21.15.38:0/4232720982 conn(0x7fc1e0079730 msgr2=0x7fc1e00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.113+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 shutdown_connections 2024-09-21T06:21:12.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:12.113+0000 7fc1e5634640 1 -- 172.21.15.38:0/4232720982 wait complete. 2024-09-21T06:21:12.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:21:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:13.178 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:13 smithi038 ceph-mon[31215]: pgmap v365: 97 pgs: 97 active+clean; 92 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 409 op/s 2024-09-21T06:21:13.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:13 smithi174 ceph-mon[34815]: pgmap v365: 97 pgs: 97 active+clean; 92 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 409 op/s 2024-09-21T06:21:13.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:13 smithi044 ceph-mon[34369]: pgmap v365: 97 pgs: 97 active+clean; 92 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 409 op/s 2024-09-21T06:21:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 -- 172.21.15.38:0/968876808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 msgr2=0x7f1d1c110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 --2- 172.21.15.38:0/968876808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c110660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009be0 tx=0x7f1d1402a6c0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 -- 172.21.15.38:0/968876808 shutdown_connections 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 --2- 172.21.15.38:0/968876808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c110660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 --2- 172.21.15.38:0/968876808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 --2- 172.21.15.38:0/968876808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.562+0000 7f1d2296b640 1 -- 172.21.15.38:0/968876808 >> 172.21.15.38:0/968876808 conn(0x7f1d1c0ff630 msgr2=0x7f1d1c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.563+0000 7f1d2296b640 1 -- 172.21.15.38:0/968876808 shutdown_connections 2024-09-21T06:21:13.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.563+0000 7f1d2296b640 1 -- 172.21.15.38:0/968876808 wait complete. 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.563+0000 7f1d2296b640 1 Processor -- start 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.563+0000 7f1d2296b640 1 -- start start 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113c30 con 0x7f1d1c103ba0 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113ab0 con 0x7f1d1c109e30 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d2296b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113db0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d20f08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55582/0 (socket says 172.21.15.38:55582) 2024-09-21T06:21:13.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d1bfff640 1 -- 172.21.15.38:0/2357208706 learned_addr learned my addr 172.21.15.38:0/2357208706 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 -- 172.21.15.38:0/2357208706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 msgr2=0x7f1d1c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 -- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 msgr2=0x7f1d1c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.564+0000 7f1d13fff640 1 -- 172.21.15.38:0/2357208706 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c1a04d0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c19ab00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c06aa20 tx=0x7f1d0400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d19ffb640 1 -- 172.21.15.38:0/2357208706 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400cc40 con 0x7f1d1c1094e0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c1a07c0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d19ffb640 1 -- 172.21.15.38:0/2357208706 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d0400cde0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d19ffb640 1 -- 172.21.15.38:0/2357208706 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04004a00 con 0x7f1d1c1094e0 2024-09-21T06:21:13.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.565+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c0755f0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.567+0000 7f1d28edf740 1 Processor -- start 2024-09-21T06:21:13.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 -- start start 2024-09-21T06:21:13.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d33014ea0 con 0x559d32cf7070 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d330042d0 con 0x559d32cd6390 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d28edf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d330080e0 con 0x559d32cce1b0 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d20f08640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d20f08640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55596/0 (socket says 172.21.15.38:55596) 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d20f08640 1 -- 172.21.15.38:0/1291222805 learned_addr learned my addr 172.21.15.38:0/1291222805 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:54382/0 (socket says 172.21.15.38:54382) 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d19ffb640 1 -- 172.21.15.38:0/2357208706 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1d04004ba0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.568+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1291222805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 msgr2=0x559d3309f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1291222805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 msgr2=0x559d3309e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1291222805 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d32d62650 con 0x559d32cce1b0 2024-09-21T06:21:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d20f08640 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:13.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009cc0 tx=0x7f1d0c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c77be4e8125811 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d127fc640 1 -- 172.21.15.38:0/1291222805 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c004230 con 0x559d32cce1b0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d127fc640 1 -- 172.21.15.38:0/1291222805 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d0c0043d0 con 0x559d32cce1b0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.569+0000 7f1d127fc640 1 -- 172.21.15.38:0/1291222805 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c004de0 con 0x559d32cce1b0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.570+0000 7f1d19ffb640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 0x7f1d080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.570+0000 7f1d20f08640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 0x7f1d080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.570+0000 7f1d19ffb640 1 -- 172.21.15.38:0/2357208706 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d040e75e0 con 0x7f1d1c1094e0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.570+0000 7f1d20f08640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 0x7f1d080b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d14006010 tx=0x7f1d14004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.570+0000 7f1d28edf740 1 -- 172.21.15.38:0/1291222805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 msgr2=0x559d3309ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009cc0 tx=0x7f1d0c011810 comp rx=0 tx=0).stop 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 -- 172.21.15.38:0/1291222805 shutdown_connections 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d3309ebe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 --2- 172.21.15.38:0/1291222805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d3309e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 -- 172.21.15.38:0/1291222805 >> 172.21.15.38:0/1291222805 conn(0x559d32ceb460 msgr2=0x559d3309c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 -- 172.21.15.38:0/1291222805 shutdown_connections 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 -- 172.21.15.38:0/1291222805 wait complete. 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.571+0000 7f1d28edf740 1 -- start start 2024-09-21T06:21:13.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 Processor -- start 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d330a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d32e65700 con 0x559d32cf7070 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d32f9f160 con 0x559d32cd6390 2024-09-21T06:21:13.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d28edf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d330ace80 con 0x559d32cce1b0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d13fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d13fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41934/0 (socket says 172.21.15.38:41934) 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d13fff640 1 -- 172.21.15.38:0/2761537312 learned_addr learned my addr 172.21.15.38:0/2761537312 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.572+0000 7f1d20f08640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d330a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d28edf740 10 client.0 _ll_register_callbacks cb 0x559d32fb89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 -- 172.21.15.38:0/2761537312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 msgr2=0x559d330a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d330a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 -- 172.21.15.38:0/2761537312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 msgr2=0x559d330b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 -- 172.21.15.38:0/2761537312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d32fccc90 con 0x559d32cd6390 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d0c0043d0 con 0x559d32cd6390 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d330a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d040e4e10 tx=0x7f1d040a9350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=800335f1a58a7b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1cfb7fe640 10 client.25553 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/2761537312 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0401c040 con 0x559d32cd6390 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/2761537312 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d040ac710 con 0x559d32cd6390 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/2761537312 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d040acc20 con 0x559d32cd6390 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.573+0000 7f1d28edf740 10 client.25553 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=26}) -- 0x559d330b8af0 con 0x559d32cd6390 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/2761537312 <== mon.2 v2:172.21.15.44:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1d040e70d0 con 0x559d32cd6390 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 10 client.25553 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 10 client.25553 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 20 client.25553 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32cb59f0 0x559d330bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 4 client.25553 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d33016df0 con 0x559d32cb59f0 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.574+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32cb59f0 0x559d330bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.575+0000 7f1cfb7fe640 10 client.25553 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.575+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32cb59f0 0x559d330bbf70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ca71041059dbde5 server_cookie=1b8d6fa8d7061fc4 in_seq=0 out_seq=0 2024-09-21T06:21:13.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/2761537312 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d33016df0 con 0x559d32cb59f0 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1cfb7fe640 10 client.25553 handle_command_reply: tid=0 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 client.25553 shutdown 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 msgr2=0x559d330aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d040e4e10 tx=0x7f1d040a9350 comp rx=0 tx=0).stop 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 shutdown_connections 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32cb59f0 0x559d330bbf70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d330aa260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1cfb7fe640 0 client.25553 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2761537312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cce1b0 0x559d330a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 >> 172.21.15.38:0/2761537312 conn(0x559d32ceb460 msgr2=0x559d330a1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 shutdown_connections 2024-09-21T06:21:13.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 1 -- 172.21.15.38:0/2761537312 wait complete. 2024-09-21T06:21:13.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.576+0000 7f1d28edf740 20 client.25553 trim_cache size 0 max 16384 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.590+0000 7f1d28edf740 1 Processor -- start 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.590+0000 7f1d28edf740 1 -- start start 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cf7070 0x559d3309bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b4130 con 0x559d32cce1b0 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b19d0 con 0x559d32cd6390 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d28edf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1af820 con 0x559d32cf7070 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d13fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55616/0 (socket says 172.21.15.38:55616) 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 -- 172.21.15.38:0/2883047095 learned_addr learned my addr 172.21.15.38:0/2883047095 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d20f08640 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cf7070 0x559d3309bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 -- 172.21.15.38:0/2883047095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cf7070 msgr2=0x559d3309bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cf7070 0x559d3309bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 -- 172.21.15.38:0/2883047095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 msgr2=0x559d3309fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 -- 172.21.15.38:0/2883047095 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d330a8220 con 0x559d32cce1b0 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d13fff640 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.591+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c019410 tx=0x7f1d0c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e682e735a2ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.592+0000 7f1d11ffb640 1 -- 172.21.15.38:0/2883047095 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c032070 con 0x559d32cce1b0 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.592+0000 7f1d11ffb640 1 -- 172.21.15.38:0/2883047095 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d0c01f040 con 0x559d32cce1b0 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.592+0000 7f1d11ffb640 1 -- 172.21.15.38:0/2883047095 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c027670 con 0x559d32cce1b0 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- 172.21.15.38:0/2883047095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 msgr2=0x559d330abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c019410 tx=0x7f1d0c005e10 comp rx=0 tx=0).stop 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- 172.21.15.38:0/2883047095 shutdown_connections 2024-09-21T06:21:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cf7070 0x559d3309bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cd6390 0x559d3309fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 --2- 172.21.15.38:0/2883047095 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cce1b0 0x559d330abc00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- 172.21.15.38:0/2883047095 >> 172.21.15.38:0/2883047095 conn(0x559d32ceb460 msgr2=0x559d3309f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- 172.21.15.38:0/2883047095 shutdown_connections 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- 172.21.15.38:0/2883047095 wait complete. 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 -- start start 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.593+0000 7f1d28edf740 1 Processor -- start 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cd6390 0x559d330ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1afe90 con 0x559d32cf7070 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b1300 con 0x559d32cce1b0 2024-09-21T06:21:13.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b0560 con 0x559d32cd6390 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d28edf740 10 client.0 _ll_register_callbacks cb 0x7f1d040046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41954/0 (socket says 172.21.15.38:41954) 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 -- 172.21.15.38:0/211544923 learned_addr learned my addr 172.21.15.38:0/211544923 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d13fff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cd6390 0x559d330ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d20f08640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 -- 172.21.15.38:0/211544923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cd6390 msgr2=0x559d330ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cd6390 0x559d330ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 -- 172.21.15.38:0/211544923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 msgr2=0x559d330aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d1bfff640 1 -- 172.21.15.38:0/211544923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d33125930 con 0x559d32cce1b0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.594+0000 7f1d20f08640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009cc0 tx=0x7f1d0c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e52f55a978883cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1cfb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:13.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c032070 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d0c01f040 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d0c019a50 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d0c019c50 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1d28edf740 10 client.25559 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559d33126bb0 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.595+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d0c01f040 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f1d0c024040 con 0x559d32cce1b0 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 10 client.25559 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 10 client.25559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 20 client.25559 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32c8ada0 0x559d33129100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 4 client.25559 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:13.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d330128a0 con 0x559d32c8ada0 2024-09-21T06:21:13.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d13fff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32c8ada0 0x559d33129100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1cfb7fe640 10 client.25559 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.596+0000 7f1d13fff640 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32c8ada0 0x559d33129100 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71ed7989f3d87cff server_cookie=d8e5a5d0363f0ebe in_seq=0 out_seq=0 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/211544923 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d330128a0 con 0x559d32c8ada0 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1cfb7fe640 10 client.25559 handle_command_reply: tid=0 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 client.25559 shutdown 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 msgr2=0x559d330ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009cc0 tx=0x7f1d0c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 shutdown_connections 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d32c8ada0 0x559d33129100 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d32cf7070 0x559d330aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d32cd6390 0x559d330ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 --2- 172.21.15.38:0/211544923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d32cce1b0 0x559d330ae0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1cfb7fe640 0 client.25559 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.598+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 >> 172.21.15.38:0/211544923 conn(0x559d32ceb460 msgr2=0x559d3309ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 shutdown_connections 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d28edf740 1 -- 172.21.15.38:0/211544923 wait complete. 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d28edf740 20 client.25559 trim_cache size 0 max 16384 2024-09-21T06:21:13.603 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 msgr2=0x7f1d080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 0x7f1d080b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d14006010 tx=0x7f1d14004a40 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 msgr2=0x7f1d1c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c19ab00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c06aa20 tx=0x7f1d0400ee50 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 shutdown_connections 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d080b6680 0x7f1d080b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109e30 0x7f1d1c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c1094e0 0x7f1d1c19ab00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 --2- 172.21.15.38:0/2357208706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103ba0 0x7f1d1c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 >> 172.21.15.38:0/2357208706 conn(0x7f1d1c0ff630 msgr2=0x7f1d1c108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 shutdown_connections 2024-09-21T06:21:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:13.599+0000 7f1d2296b640 1 -- 172.21.15.38:0/2357208706 wait complete. 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 -- 172.21.15.38:0/3457247381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0102060 msgr2=0x7fead0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 --2- 172.21.15.38:0/3457247381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0102060 0x7fead0102470 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7feac0009900 tx=0x7feac002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 -- 172.21.15.38:0/3457247381 shutdown_connections 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 --2- 172.21.15.38:0/3457247381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead01105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 --2- 172.21.15.38:0/3457247381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0109430 0x7fead0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 --2- 172.21.15.38:0/3457247381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0102060 0x7fead0102470 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 -- 172.21.15.38:0/3457247381 >> 172.21.15.38:0/3457247381 conn(0x7fead0079e90 msgr2=0x7fead007a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 -- 172.21.15.38:0/3457247381 shutdown_connections 2024-09-21T06:21:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 -- 172.21.15.38:0/3457247381 wait complete. 2024-09-21T06:21:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.898+0000 7fead5625640 1 Processor -- start 2024-09-21T06:21:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 -- start start 2024-09-21T06:21:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0102060 0x7fead019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fead0113b80 con 0x7fead0109430 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fead0113a00 con 0x7fead0109d80 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7fead5625640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fead0113d00 con 0x7fead0102060 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55628/0 (socket says 172.21.15.38:55628) 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 -- 172.21.15.38:0/1968772748 learned_addr learned my addr 172.21.15.38:0/1968772748 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feaceffd640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0102060 0x7fead019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 -- 172.21.15.38:0/1968772748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0102060 msgr2=0x7fead019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0102060 0x7fead019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 -- 172.21.15.38:0/1968772748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 msgr2=0x7fead019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead019fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feace7fc640 1 -- 172.21.15.38:0/1968772748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead01a0530 con 0x7fead0109430 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.899+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7feace7fc640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feac400d750 tx=0x7feac400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7feab7fff640 1 -- 172.21.15.38:0/1968772748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4017070 con 0x7fead0109430 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead01a0820 con 0x7fead0109430 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7feab7fff640 1 -- 172.21.15.38:0/1968772748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feac40054f0 con 0x7fead0109430 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7feab7fff640 1 -- 172.21.15.38:0/1968772748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4004d90 con 0x7fead0109430 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.900+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead01a6fb0 con 0x7fead0109430 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 Processor -- start 2024-09-21T06:21:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 -- start start 2024-09-21T06:21:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820ecbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820ecc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feab7fff640 1 -- 172.21.15.38:0/1968772748 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7feac4005020 con 0x7fead0109430 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e820e406f0 con 0x55e820b054d0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e820e2fb20 con 0x55e820b261b0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.903+0000 7feadc673740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e820e33930 con 0x55e820afd2f0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820ecc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41982/0 (socket says 172.21.15.38:41982) 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 -- 172.21.15.38:0/1639067491 learned_addr learned my addr 172.21.15.38:0/1639067491 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feaceffd640 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820ecbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 -- 172.21.15.38:0/1639067491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 msgr2=0x55e820ecbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820ecbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 -- 172.21.15.38:0/1639067491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 msgr2=0x55e820ecc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820ecc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 -- 172.21.15.38:0/1639067491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e820df5530 con 0x55e820b261b0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feac80117c0 tx=0x7feac8011c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99628e20453a1fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feab7fff640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 0x7feab80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feab57fa640 1 -- 172.21.15.38:0/1639067491 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8003c30 con 0x55e820b261b0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feab57fa640 1 -- 172.21.15.38:0/1639067491 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feac800fe70 con 0x55e820b261b0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feab57fa640 1 -- 172.21.15.38:0/1639067491 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac80193e0 con 0x55e820b261b0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.904+0000 7feaceffd640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 0x7feab80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.905+0000 7feab7fff640 1 -- 172.21.15.38:0/1968772748 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feac40e7000 con 0x7fead0109430 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.905+0000 7feadc673740 1 -- 172.21.15.38:0/1639067491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 msgr2=0x55e820ecb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.905+0000 7feaceffd640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 0x7feab80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feac0009230 tx=0x7feac00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.905+0000 7feadc673740 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feac80117c0 tx=0x7feac8011c80 comp rx=0 tx=0).stop 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 -- 172.21.15.38:0/1639067491 shutdown_connections 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820ecc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820ecbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 --2- 172.21.15.38:0/1639067491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820ecb9b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 -- 172.21.15.38:0/1639067491 >> 172.21.15.38:0/1639067491 conn(0x55e820b1a300 msgr2=0x55e820ec98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 -- 172.21.15.38:0/1639067491 shutdown_connections 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 -- 172.21.15.38:0/1639067491 wait complete. 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 -- start start 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.906+0000 7feadc673740 1 Processor -- start 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b054d0 0x55e820ed7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b261b0 0x55e820ee3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e820d67ab0 con 0x55e820afd2f0 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e820dd5730 con 0x55e820b054d0 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e820eda130 con 0x55e820b261b0 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 10 client.0 _ll_register_callbacks cb 0x55e820e296b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55652/0 (socket says 172.21.15.38:55652) 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 -- 172.21.15.38:0/1795321732 learned_addr learned my addr 172.21.15.38:0/1795321732 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feace7fc640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b054d0 0x55e820ed7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feacf7fe640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b261b0 0x55e820ee3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 -- 172.21.15.38:0/1795321732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b261b0 msgr2=0x55e820ee3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b261b0 0x55e820ee3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 -- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b054d0 msgr2=0x55e820ed7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b054d0 0x55e820ed7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 -- 172.21.15.38:0/1795321732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e820b91790 con 0x55e820afd2f0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feaceffd640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feac0033000 tx=0x7feac0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53978602b39a903 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feab2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac004c030 con 0x55e820afd2f0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feac0004250 con 0x55e820afd2f0 2024-09-21T06:21:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.907+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac800fe70 con 0x55e820afd2f0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feac0035040 con 0x55e820afd2f0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 10 client.15924 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e820c0a620 con 0x55e820afd2f0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feac800fe70 con 0x55e820afd2f0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7feac0048560 con 0x55e820afd2f0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 10 client.15924 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 20 client.15924 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820ae4d80 0x55e820ee9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 4 client.15924 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e820e42640 con 0x55e820ae4d80 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.908+0000 7feace7fc640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820ae4d80 0x55e820ee9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.909+0000 7feace7fc640 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820ae4d80 0x55e820ee9270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e82a8db6e2de55e server_cookie=c733b3be89efcd63 in_seq=0 out_seq=0 2024-09-21T06:21:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.909+0000 7feab2ff5640 10 client.15924 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.909+0000 7feab2ff5640 1 -- 172.21.15.38:0/1795321732 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e820e42640 con 0x55e820ae4d80 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.909+0000 7feab2ff5640 10 client.15924 handle_command_reply: tid=0 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.909+0000 7feadc673740 1 client.15924 shutdown 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 msgr2=0x55e820ed7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feac0033000 tx=0x7feac0009260 comp rx=0 tx=0).stop 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 shutdown_connections 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820ae4d80 0x55e820ee9270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b261b0 0x55e820ee3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b054d0 0x55e820ed7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feab2ff5640 0 client.15924 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 --2- 172.21.15.38:0/1795321732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820afd2f0 0x55e820ed7140 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 >> 172.21.15.38:0/1795321732 conn(0x55e820b1a300 msgr2=0x55e820ecc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 shutdown_connections 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 1 -- 172.21.15.38:0/1795321732 wait complete. 2024-09-21T06:21:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.910+0000 7feadc673740 20 client.15924 trim_cache size 0 max 16384 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.924+0000 7feadc673740 1 Processor -- start 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.924+0000 7feadc673740 1 -- start start 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820afd2f0 0x55e820ed7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b054d0 0x55e820ecd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fead01b2070 con 0x55e820b261b0 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fead01af910 con 0x55e820afd2f0 2024-09-21T06:21:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feadc673740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fead01ad760 con 0x55e820b054d0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55668/0 (socket says 172.21.15.38:55668) 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 -- 172.21.15.38:0/206155144 learned_addr learned my addr 172.21.15.38:0/206155144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feace7fc640 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b054d0 0x55e820ecd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feaceffd640 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820afd2f0 0x55e820ed7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 -- 172.21.15.38:0/206155144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b054d0 msgr2=0x55e820ecd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b054d0 0x55e820ecd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 -- 172.21.15.38:0/206155144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820afd2f0 msgr2=0x55e820ed7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820afd2f0 0x55e820ed7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 -- 172.21.15.38:0/206155144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e820ece7c0 con 0x55e820b261b0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.925+0000 7feacf7fe640 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feac8011730 tx=0x7feac8011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87779fb55f87424 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feab4ff9640 1 -- 172.21.15.38:0/206155144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8003ab0 con 0x55e820b261b0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feab4ff9640 1 -- 172.21.15.38:0/206155144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feac802a070 con 0x55e820b261b0 2024-09-21T06:21:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feab4ff9640 1 -- 172.21.15.38:0/206155144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8025480 con 0x55e820b261b0 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 -- 172.21.15.38:0/206155144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 msgr2=0x55e820ed8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feac8011730 tx=0x7feac8011440 comp rx=0 tx=0).stop 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 -- 172.21.15.38:0/206155144 shutdown_connections 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b261b0 0x55e820ed8d70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820b054d0 0x55e820ecd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 --2- 172.21.15.38:0/206155144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820afd2f0 0x55e820ed7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.926+0000 7feadc673740 1 -- 172.21.15.38:0/206155144 >> 172.21.15.38:0/206155144 conn(0x55e820b1a300 msgr2=0x55e820ed8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- 172.21.15.38:0/206155144 shutdown_connections 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- 172.21.15.38:0/206155144 wait complete. 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- start start 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 Processor -- start 2024-09-21T06:21:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820edf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820edb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fead01addd0 con 0x55e820b054d0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fead01af240 con 0x55e820b261b0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fead01ae4a0 con 0x55e820afd2f0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feadc673740 10 client.0 _ll_register_callbacks cb 0x7feac0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feace7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55684/0 (socket says 172.21.15.38:55684) 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feaceffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820edf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feace7fc640 1 -- 172.21.15.38:0/3181826575 learned_addr learned my addr 172.21.15.38:0/3181826575 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.927+0000 7feacf7fe640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820edb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 -- 172.21.15.38:0/3181826575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 msgr2=0x55e820edf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820edf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 -- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 msgr2=0x55e820edb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820edb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 -- 172.21.15.38:0/3181826575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e820edb7c0 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feace7fc640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feac40e4880 tx=0x7feac40d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff6b9c47e64b685 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feab2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4020040 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feac40a91f0 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feac802a070 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feac40ac8d0 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feadc673740 10 client.15930 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e820f53900 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.928+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feac802a070 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7feac40980d0 con 0x55e820b054d0 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 20 client.15930 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820aba1c0 0x55e820f56050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 4 client.15930 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e820e3e0f0 con 0x55e820aba1c0 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feaceffd640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820aba1c0 0x55e820f56050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feab2ff5640 10 client.15930 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:13.929+0000 7feaceffd640 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820aba1c0 0x55e820f56050 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=283ebf2ebdf8bb85 server_cookie=7edfda71b97f4557 in_seq=0 out_seq=0 2024-09-21T06:21:14.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:21:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.898+0000 7feab2ff5640 1 -- 172.21.15.38:0/3181826575 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e820e3e0f0 con 0x55e820aba1c0 2024-09-21T06:21:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.898+0000 7feab2ff5640 10 client.15930 handle_command_reply: tid=0 2024-09-21T06:21:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.898+0000 7feadc673740 1 client.15930 shutdown 2024-09-21T06:21:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 msgr2=0x55e820edad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feac40e4880 tx=0x7feac40d0040 comp rx=0 tx=0).stop 2024-09-21T06:21:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 shutdown_connections 2024-09-21T06:21:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e820b261b0 0x55e820edb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e820b054d0 0x55e820edad40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e820aba1c0 0x55e820f56050 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 --2- 172.21.15.38:0/3181826575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e820afd2f0 0x55e820edf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feab2ff5640 0 client.15930 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 >> 172.21.15.38:0/3181826575 conn(0x55e820b1a300 msgr2=0x55e820ecd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 shutdown_connections 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.899+0000 7feadc673740 1 -- 172.21.15.38:0/3181826575 wait complete. 2024-09-21T06:21:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.900+0000 7feadc673740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 msgr2=0x7feab80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 0x7feab80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feac0009230 tx=0x7feac00058d0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 msgr2=0x7fead019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:14.903 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feac400d750 tx=0x7feac400dc10 comp rx=0 tx=0).stop 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 shutdown_connections 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feab80b6680 0x7feab80b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fead0109d80 0x7fead019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fead0109430 0x7fead019aba0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 --2- 172.21.15.38:0/1968772748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fead0102060 0x7fead019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 >> 172.21.15.38:0/1968772748 conn(0x7fead0079e90 msgr2=0x7fead01074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 shutdown_connections 2024-09-21T06:21:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:14.901+0000 7fead5625640 1 -- 172.21.15.38:0/1968772748 wait complete. 2024-09-21T06:21:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:15.264 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:15 smithi038 ceph-mon[31215]: pgmap v366: 97 pgs: 97 active+clean; 94 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 362 op/s 2024-09-21T06:21:15.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:15 smithi174 ceph-mon[34815]: pgmap v366: 97 pgs: 97 active+clean; 94 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 362 op/s 2024-09-21T06:21:15.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:15 smithi044 ceph-mon[34369]: pgmap v366: 97 pgs: 97 active+clean; 94 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 362 op/s 2024-09-21T06:21:15.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 -- 172.21.15.38:0/2305537822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 msgr2=0x7f93bc10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 --2- 172.21.15.38:0/2305537822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc10f340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009ca0 tx=0x7f93b402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 -- 172.21.15.38:0/2305537822 shutdown_connections 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 --2- 172.21.15.38:0/2305537822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc10f340 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 --2- 172.21.15.38:0/2305537822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 0x7f93bc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 --2- 172.21.15.38:0/2305537822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 -- 172.21.15.38:0/2305537822 >> 172.21.15.38:0/2305537822 conn(0x7f93bc0fe2d0 msgr2=0x7f93bc100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 -- 172.21.15.38:0/2305537822 shutdown_connections 2024-09-21T06:21:15.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.501+0000 7f93c239d640 1 -- 172.21.15.38:0/2305537822 wait complete. 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.502+0000 7f93c239d640 1 Processor -- start 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.502+0000 7f93c239d640 1 -- start start 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.502+0000 7f93c239d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.502+0000 7f93c239d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 0x7f93bc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.502+0000 7f93c239d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc19ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c239d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc112900 con 0x7f93bc108b10 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c239d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc112780 con 0x7f93bc102880 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c239d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc112a80 con 0x7f93bc1081c0 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42020/0 (socket says 172.21.15.38:42020) 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c139b640 1 -- 172.21.15.38:0/3969703339 learned_addr learned my addr 172.21.15.38:0/3969703339 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc19ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 0x7f93bc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 -- 172.21.15.38:0/3969703339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 msgr2=0x7f93bc1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 0x7f93bc1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 -- 172.21.15.38:0/3969703339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 msgr2=0x7f93bc199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c1b9c640 1 -- 172.21.15.38:0/3969703339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc19f1c0 con 0x7f93bc108b10 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.503+0000 7f93c139b640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc19ea90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f93b402ade0 tx=0x7f93b4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93b27fc640 1 -- 172.21.15.38:0/3969703339 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4031650 con 0x7f93bc108b10 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93b27fc640 1 -- 172.21.15.38:0/3969703339 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f93b40317f0 con 0x7f93bc108b10 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93b27fc640 1 -- 172.21.15.38:0/3969703339 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b402fa20 con 0x7f93bc108b10 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc19f450 con 0x7f93bc108b10 2024-09-21T06:21:15.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.504+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc06b900 con 0x7f93bc108b10 2024-09-21T06:21:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 Processor -- start 2024-09-21T06:21:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93b27fc640 1 -- 172.21.15.38:0/3969703339 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f93b402fbe0 con 0x7f93bc108b10 2024-09-21T06:21:15.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 -- start start 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5649c7024ea0 con 0x5649c6ce6390 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649c70142d0 con 0x5649c6cde1b0 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c9b73740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5649c70180e0 con 0x5649c6d07070 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42030/0 (socket says 172.21.15.38:42030) 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c139b640 1 -- 172.21.15.38:0/713882547 learned_addr learned my addr 172.21.15.38:0/713882547 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.507+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 -- 172.21.15.38:0/713882547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 msgr2=0x5649c70ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93b27fc640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 0x7f93a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 -- 172.21.15.38:0/713882547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 msgr2=0x5649c70af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 -- 172.21.15.38:0/713882547 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c6d72650 con 0x5649c6cde1b0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 0x7f93a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93c139b640 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f93b8011650 tx=0x7f93b8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beb0e10ba24d025 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93b27fc640 1 -- 172.21.15.38:0/3969703339 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f93b4108720 con 0x7f93bc108b10 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93a77fe640 1 -- 172.21.15.38:0/713882547 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b801e070 con 0x5649c6cde1b0 2024-09-21T06:21:15.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93a77fe640 1 -- 172.21.15.38:0/713882547 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f93b800fb10 con 0x5649c6cde1b0 2024-09-21T06:21:15.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.508+0000 7f93a77fe640 1 -- 172.21.15.38:0/713882547 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8019c30 con 0x5649c6cde1b0 2024-09-21T06:21:15.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 -- 172.21.15.38:0/713882547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 msgr2=0x5649c70aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c1b9c640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 0x7f93a80b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93b4105fa0 tx=0x7f93b4092c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f93b8011650 tx=0x7f93b8009f90 comp rx=0 tx=0).stop 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 -- 172.21.15.38:0/713882547 shutdown_connections 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70aeda0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 --2- 172.21.15.38:0/713882547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 -- 172.21.15.38:0/713882547 >> 172.21.15.38:0/713882547 conn(0x5649c6cfb460 msgr2=0x5649c70ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 -- 172.21.15.38:0/713882547 shutdown_connections 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.509+0000 7f93c9b73740 1 -- 172.21.15.38:0/713882547 wait complete. 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 -- start start 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 Processor -- start 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5649c6e75700 con 0x5649c6ce6390 2024-09-21T06:21:15.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649c6faf160 con 0x5649c6cde1b0 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.510+0000 7f93c9b73740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5649c70bd040 con 0x5649c6d07070 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c9b73740 10 client.0 _ll_register_callbacks cb 0x5649c6fc89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55722/0 (socket says 172.21.15.38:55722) 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 -- 172.21.15.38:0/766375587 learned_addr learned my addr 172.21.15.38:0/766375587 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 -- 172.21.15.38:0/766375587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 msgr2=0x5649c70c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 -- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 msgr2=0x5649c70b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 -- 172.21.15.38:0/766375587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c6fdcc90 con 0x5649c6ce6390 2024-09-21T06:21:15.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c139b640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f93b80197b0 tx=0x7f93b800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9f85bc078d9402 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b801e040 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f93b800f640 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.511+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b800fb10 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f93b800fe30 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5649c70c8d20 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f93b800fb10 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f93b8021070 con 0x5649c6ce6390 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 20 client.15942 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6cc59f0 0x5649c70cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 4 client.15942 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:15.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649c7026df0 con 0x5649c6cc59f0 2024-09-21T06:21:15.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.512+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6cc59f0 0x5649c70cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.513+0000 7f93a4ff9640 10 client.15942 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:15.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.513+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6cc59f0 0x5649c70cc080 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c0ffd442b656c server_cookie=ababe5f1965dc997 in_seq=0 out_seq=0 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.515+0000 7f93a4ff9640 1 -- 172.21.15.38:0/766375587 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5649c7026df0 con 0x5649c6cc59f0 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.515+0000 7f93a4ff9640 10 client.15942 handle_command_reply: tid=0 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.515+0000 7f93c9b73740 1 client.15942 shutdown 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 msgr2=0x5649c70ba3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f93b80197b0 tx=0x7f93b800fcc0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 shutdown_connections 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6cc59f0 0x5649c70cc080 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6d07070 0x5649c70c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6ce6390 0x5649c70ba3f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 --2- 172.21.15.38:0/766375587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 >> 172.21.15.38:0/766375587 conn(0x5649c6cfb460 msgr2=0x5649c70b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93a4ff9640 0 client.15942 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:15.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 shutdown_connections 2024-09-21T06:21:15.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 1 -- 172.21.15.38:0/766375587 wait complete. 2024-09-21T06:21:15.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.516+0000 7f93c9b73740 20 client.15942 trim_cache size 0 max 16384 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 Processor -- start 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 -- start start 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6ce6390 0x5649c70bbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1afb70 con 0x5649c6d07070 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1ad410 con 0x5649c6cde1b0 2024-09-21T06:21:15.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c9b73740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1ab260 con 0x5649c6ce6390 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42054/0 (socket says 172.21.15.38:42054) 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.531+0000 7f93c0b9a640 1 -- 172.21.15.38:0/3526776662 learned_addr learned my addr 172.21.15.38:0/3526776662 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c139b640 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6ce6390 0x5649c70bbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 -- 172.21.15.38:0/3526776662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6ce6390 msgr2=0x5649c70bbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6ce6390 0x5649c70bbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 -- 172.21.15.38:0/3526776662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 msgr2=0x5649c70c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 -- 172.21.15.38:0/3526776662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c6cc5c10 con 0x5649c6cde1b0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009c10 tx=0x7f93ac009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790a798c593bcc84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93a6ffd640 1 -- 172.21.15.38:0/3526776662 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac004020 con 0x5649c6cde1b0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93a6ffd640 1 -- 172.21.15.38:0/3526776662 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f93ac0041c0 con 0x5649c6cde1b0 2024-09-21T06:21:15.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.532+0000 7f93a6ffd640 1 -- 172.21.15.38:0/3526776662 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac02c710 con 0x5649c6cde1b0 2024-09-21T06:21:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- 172.21.15.38:0/3526776662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 msgr2=0x5649c70b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009c10 tx=0x7f93ac009500 comp rx=0 tx=0).stop 2024-09-21T06:21:15.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- 172.21.15.38:0/3526776662 shutdown_connections 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6ce6390 0x5649c70bbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3526776662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6cde1b0 0x5649c70b0250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- 172.21.15.38:0/3526776662 >> 172.21.15.38:0/3526776662 conn(0x5649c6cfb460 msgr2=0x5649c70bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- 172.21.15.38:0/3526776662 shutdown_connections 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- 172.21.15.38:0/3526776662 wait complete. 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.533+0000 7f93c9b73740 1 -- start start 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 Processor -- start 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6cde1b0 0x5649c70be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1ab8d0 con 0x5649c6d07070 2024-09-21T06:21:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1acd40 con 0x5649c6ce6390 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc1abfa0 con 0x5649c6cde1b0 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c9b73740 10 client.0 _ll_register_callbacks cb 0x7f93b801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c0b9a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55742/0 (socket says 172.21.15.38:55742) 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c139b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42062/0 (socket says 172.21.15.38:42062) 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c0b9a640 1 -- 172.21.15.38:0/3198082379 learned_addr learned my addr 172.21.15.38:0/3198082379 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.534+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6cde1b0 0x5649c70be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 -- 172.21.15.38:0/3198082379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6cde1b0 msgr2=0x5649c70be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6cde1b0 0x5649c70be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 -- 172.21.15.38:0/3198082379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 msgr2=0x5649c70bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 -- 172.21.15.38:0/3198082379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c7135a40 con 0x5649c6ce6390 2024-09-21T06:21:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c139b640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93b802e040 tx=0x7f93b80052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73eb0727c69b48b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b801e040 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f93b800f840 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ac0041c0 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.535+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f93b800fa40 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 10 client.25595 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5649c7136cc0 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f93ac0041c0 con 0x5649c6ce6390 2024-09-21T06:21:15.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f93b8021040 con 0x5649c6ce6390 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 10 client.25595 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 20 client.25595 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6c9ada0 0x5649c7139450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 4 client.25595 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649c70b5a60 con 0x5649c6c9ada0 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.536+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6c9ada0 0x5649c7139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.537+0000 7f93a4ff9640 10 client.25595 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.537+0000 7f93c0b9a640 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6c9ada0 0x5649c7139450 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=961a75856dcbae9a server_cookie=b97737311db7143e in_seq=0 out_seq=0 2024-09-21T06:21:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93a4ff9640 1 -- 172.21.15.38:0/3198082379 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649c70b5a60 con 0x5649c6c9ada0 2024-09-21T06:21:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93a4ff9640 10 client.25595 handle_command_reply: tid=0 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 client.25595 shutdown 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 msgr2=0x5649c70be830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93b802e040 tx=0x7f93b80052e0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 shutdown_connections 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5649c6d07070 0x5649c70bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649c6ce6390 0x5649c70be830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5649c6c9ada0 0x5649c7139450 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 --2- 172.21.15.38:0/3198082379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5649c6cde1b0 0x5649c70be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 >> 172.21.15.38:0/3198082379 conn(0x5649c6cfb460 msgr2=0x5649c70bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93a4ff9640 0 client.25595 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 shutdown_connections 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.539+0000 7f93c9b73740 1 -- 172.21.15.38:0/3198082379 wait complete. 2024-09-21T06:21:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c9b73740 20 client.25595 trim_cache size 0 max 16384 2024-09-21T06:21:15.545 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 msgr2=0x7f93a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 0x7f93a80b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93b4105fa0 tx=0x7f93b4092c90 comp rx=0 tx=0).stop 2024-09-21T06:21:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 msgr2=0x7f93bc19ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc19ea90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f93b402ade0 tx=0x7f93b4003ce0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 shutdown_connections 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93a80b6680 0x7f93a80b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93bc108b10 0x7f93bc19ea90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93bc1081c0 0x7f93bc1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 --2- 172.21.15.38:0/3969703339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93bc102880 0x7f93bc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 >> 172.21.15.38:0/3969703339 conn(0x7f93bc0fe2d0 msgr2=0x7f93bc1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 shutdown_connections 2024-09-21T06:21:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:15.540+0000 7f93c239d640 1 -- 172.21.15.38:0/3969703339 wait complete. 2024-09-21T06:21:17.210 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:21:17.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:21:17.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:17 smithi174 ceph-mon[34815]: pgmap v367: 97 pgs: 97 active+clean; 101 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 310 op/s 2024-09-21T06:21:17.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:17 smithi044 ceph-mon[34369]: pgmap v367: 97 pgs: 97 active+clean; 101 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 310 op/s 2024-09-21T06:21:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:17 smithi038 ceph-mon[31215]: pgmap v367: 97 pgs: 97 active+clean; 101 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 310 op/s 2024-09-21T06:21:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 -- 172.21.15.38:0/1966031546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa01083a0 msgr2=0x7f5aa01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 --2- 172.21.15.38:0/1966031546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa01083a0 0x7f5aa01087b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009900 tx=0x7f5a8802a410 comp rx=0 tx=0).stop 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 -- 172.21.15.38:0/1966031546 shutdown_connections 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 --2- 172.21.15.38:0/1966031546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa0108cf0 0x7f5aa010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 --2- 172.21.15.38:0/1966031546 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa01083a0 0x7f5aa01087b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 --2- 172.21.15.38:0/1966031546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0102a60 0x7f5aa0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 -- 172.21.15.38:0/1966031546 >> 172.21.15.38:0/1966031546 conn(0x7f5aa0079730 msgr2=0x7f5aa0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 -- 172.21.15.38:0/1966031546 shutdown_connections 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.000+0000 7f5aa582e640 1 -- 172.21.15.38:0/1966031546 wait complete. 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 Processor -- start 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 -- start start 2024-09-21T06:21:18.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 0x7f5aa019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0108cf0 0x7f5aa01a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa0112a80 con 0x7f5aa0102a60 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa0112900 con 0x7f5aa01083a0 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5aa582e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa0112c00 con 0x7f5aa0108cf0 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55770/0 (socket says 172.21.15.38:55770) 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 -- 172.21.15.38:0/488117364 learned_addr learned my addr 172.21.15.38:0/488117364 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a97fff640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 0x7f5aa019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0108cf0 0x7f5aa01a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 -- 172.21.15.38:0/488117364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0108cf0 msgr2=0x7f5aa01a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0108cf0 0x7f5aa01a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 -- 172.21.15.38:0/488117364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 msgr2=0x7f5aa019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 0x7f5aa019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a9effd640 1 -- 172.21.15.38:0/488117364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa01a2840 con 0x7f5aa0102a60 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.001+0000 7f5a97fff640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 0x7f5aa019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5a9effd640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000d950 tx=0x7f5a9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5aa482c640 1 -- 172.21.15.38:0/488117364 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a90017070 con 0x7f5aa0102a60 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa01a2b30 con 0x7f5aa0102a60 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5aa482c640 1 -- 172.21.15.38:0/488117364 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a90009c30 con 0x7f5aa0102a60 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa01a9290 con 0x7f5aa0102a60 2024-09-21T06:21:18.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.002+0000 7f5aa482c640 1 -- 172.21.15.38:0/488117364 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000f6b0 con 0x7f5aa0102a60 2024-09-21T06:21:18.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.004+0000 7f5aabda2740 1 Processor -- start 2024-09-21T06:21:18.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 -- start start 2024-09-21T06:21:18.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f92430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f92970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5578f3f08e60 con 0x5578f3beb350 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578f3ef8290 con 0x5578f3bc2490 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aabda2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5578f3efc0a0 con 0x5578f3bca670 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5aa482c640 1 -- 172.21.15.38:0/488117364 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5a900109c0 con 0x7f5aa0102a60 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f92970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:54532/0 (socket says 172.21.15.38:54532) 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5a97fff640 1 -- 172.21.15.38:0/1901673167 learned_addr learned my addr 172.21.15.38:0/1901673167 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.005+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 -- 172.21.15.38:0/1901673167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 msgr2=0x5578f3f92eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 -- 172.21.15.38:0/1901673167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 msgr2=0x5578f3f92430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f92430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 -- 172.21.15.38:0/1901673167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f3c56930 con 0x5578f3bc2490 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f92970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a900e4a20 tx=0x7f5a900ef880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c220bdecdfbb60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1901673167 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900e9520 con 0x5578f3bc2490 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1901673167 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a900e9d10 con 0x5578f3bc2490 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.006+0000 7f5a95ffb640 1 -- 172.21.15.38:0/1901673167 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900e7940 con 0x5578f3bc2490 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aa482c640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 0x7f5a8c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 0x7f5a8c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aa482c640 1 -- 172.21.15.38:0/488117364 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5a900e72b0 con 0x7f5aa0102a60 2024-09-21T06:21:18.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 -- 172.21.15.38:0/1901673167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 msgr2=0x5578f3f92970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f92970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a900e4a20 tx=0x7f5a900ef880 comp rx=0 tx=0).stop 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 0x7f5a8c0b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5a98005fd0 tx=0x7f5a98009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 -- 172.21.15.38:0/1901673167 shutdown_connections 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f92eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f92970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1901673167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f92430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 -- 172.21.15.38:0/1901673167 >> 172.21.15.38:0/1901673167 conn(0x5578f3bdf740 msgr2=0x5578f3f90320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 -- 172.21.15.38:0/1901673167 shutdown_connections 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.007+0000 7f5aabda2740 1 -- 172.21.15.38:0/1901673167 wait complete. 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.008+0000 7f5aabda2740 1 -- start start 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.008+0000 7f5aabda2740 1 Processor -- start 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f9e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3fa9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5578f3d59890 con 0x5578f3beb350 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5578f3e92d40 con 0x5578f3bc2490 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5578f3fa0c10 con 0x5578f3bca670 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5aabda2740 10 client.0 _ll_register_callbacks cb 0x5578f3ef6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42094/0 (socket says 172.21.15.38:42094) 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 -- 172.21.15.38:0/1560371060 learned_addr learned my addr 172.21.15.38:0/1560371060 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3fa9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f9e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 -- 172.21.15.38:0/1560371060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 msgr2=0x5578f3f9e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f9e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 -- 172.21.15.38:0/1560371060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 msgr2=0x5578f3fa9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3fa9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 -- 172.21.15.38:0/1560371060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f3faa540 con 0x5578f3bc2490 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a9effd640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a900a97a0 tx=0x7f5a900e4ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e159e7542575592 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.009+0000 7f5a7effd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.010+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900e6020 con 0x5578f3bc2490 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.010+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5a900b68b0 con 0x5578f3bc2490 2024-09-21T06:21:18.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.010+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a900e9d10 con 0x5578f3bc2490 2024-09-21T06:21:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.013+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5a90020030 con 0x5578f3bc2490 2024-09-21T06:21:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.013+0000 7f5aabda2740 10 client.25607 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.013+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5578f3face70 con 0x5578f3bc2490 2024-09-21T06:21:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.013+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a900e9d10 con 0x5578f3bc2490 2024-09-21T06:21:18.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.013+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f5a900a8b20 con 0x5578f3bc2490 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 10 client.25607 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 10 client.25607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 20 client.25607 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3ba9cd0 0x5578f3fb01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 4 client.25607 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578f3f0adb0 con 0x5578f3ba9cd0 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3ba9cd0 0x5578f3fb01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5a7effd640 10 client.25607 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:18.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.014+0000 7f5a97fff640 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3ba9cd0 0x5578f3fb01d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1209ae582e8a2b server_cookie=e287ca9ef7f3a976 in_seq=0 out_seq=0 2024-09-21T06:21:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.015+0000 7f5a7effd640 1 -- 172.21.15.38:0/1560371060 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578f3f0adb0 con 0x5578f3ba9cd0 2024-09-21T06:21:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.015+0000 7f5a7effd640 10 client.25607 handle_command_reply: tid=0 2024-09-21T06:21:18.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.015+0000 7f5aabda2740 1 client.25607 shutdown 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 msgr2=0x5578f3f9e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a900a97a0 tx=0x7f5a900e4ed0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 shutdown_connections 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3fa9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3ba9cd0 0x5578f3fb01d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bca670 0x5578f3f9e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 --2- 172.21.15.38:0/1560371060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3f9e0b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 >> 172.21.15.38:0/1560371060 conn(0x5578f3bdf740 msgr2=0x5578f3f95610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5a7effd640 0 client.25607 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 shutdown_connections 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 1 -- 172.21.15.38:0/1560371060 wait complete. 2024-09-21T06:21:18.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.016+0000 7f5aabda2740 20 client.25607 trim_cache size 0 max 16384 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.035+0000 7f5aabda2740 1 Processor -- start 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.035+0000 7f5aabda2740 1 -- start start 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bc2490 0x5578f3fa9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 0x5578f3f97540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01b4200 con 0x5578f3beb350 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01b1aa0 con 0x5578f3bca670 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5aabda2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01af8f0 con 0x5578f3bc2490 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55792/0 (socket says 172.21.15.38:55792) 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 -- 172.21.15.38:0/51313875 learned_addr learned my addr 172.21.15.38:0/51313875 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a97fff640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 0x5578f3f97540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9effd640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bc2490 0x5578f3fa9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 -- 172.21.15.38:0/51313875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bc2490 msgr2=0x5578f3fa9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bc2490 0x5578f3fa9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 -- 172.21.15.38:0/51313875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 msgr2=0x5578f3f97540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 0x5578f3f97540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 -- 172.21.15.38:0/51313875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f3fa05f0 con 0x5578f3beb350 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a97fff640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 0x5578f3f97540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:18.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.036+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a98003f90 tx=0x7f5a9801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dfb1872283c732 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.037+0000 7f5a957fa640 1 -- 172.21.15.38:0/51313875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a98004b20 con 0x5578f3beb350 2024-09-21T06:21:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.037+0000 7f5a957fa640 1 -- 172.21.15.38:0/51313875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a98004cc0 con 0x5578f3beb350 2024-09-21T06:21:18.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.037+0000 7f5a957fa640 1 -- 172.21.15.38:0/51313875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a98005440 con 0x5578f3beb350 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- 172.21.15.38:0/51313875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 msgr2=0x5578f3f97a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a98003f90 tx=0x7f5a9801a000 comp rx=0 tx=0).stop 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- 172.21.15.38:0/51313875 shutdown_connections 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3beb350 0x5578f3f97a80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bca670 0x5578f3f97540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 --2- 172.21.15.38:0/51313875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3bc2490 0x5578f3fa9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- 172.21.15.38:0/51313875 >> 172.21.15.38:0/51313875 conn(0x5578f3bdf740 msgr2=0x5578f3f9c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- 172.21.15.38:0/51313875 shutdown_connections 2024-09-21T06:21:18.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- 172.21.15.38:0/51313875 wait complete. 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 -- start start 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.038+0000 7f5aabda2740 1 Processor -- start 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55798/0 (socket says 172.21.15.38:55798) 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3beb350 0x5578f3fb23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a9effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42126/0 (socket says 172.21.15.38:42126) 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 -- 172.21.15.38:0/2640506116 learned_addr learned my addr 172.21.15.38:0/2640506116 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01aff60 con 0x5578f3bca670 2024-09-21T06:21:18.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01b13d0 con 0x5578f3bc2490 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01b0630 con 0x5578f3beb350 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a9f7fe640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3beb350 0x5578f3fb23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 -- 172.21.15.38:0/2640506116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3beb350 msgr2=0x5578f3fb23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3beb350 0x5578f3fb23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 -- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 msgr2=0x5578f3fb3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a97fff640 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f3f8fa70 con 0x5578f3bca670 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.039+0000 7f5a9effd640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5a7effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5aabda2740 10 client.0 _ll_register_callbacks cb 0x7f5a98009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5a97fff640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5a88005940 tx=0x7f5a880042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cb17b8d9dc02ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a98004cc0 con 0x5578f3bca670 2024-09-21T06:21:18.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5a7effd640 1 -- 172.21.15.38:0/2640506116 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8804c070 con 0x5578f3bca670 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5a7effd640 1 -- 172.21.15.38:0/2640506116 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5a88031ae0 con 0x5578f3bca670 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5a7effd640 1 -- 172.21.15.38:0/2640506116 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5a88035040 con 0x5578f3bca670 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5aabda2740 10 client.15966 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.040+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5578f401b570 con 0x5578f3bca670 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5a7effd640 1 -- 172.21.15.38:0/2640506116 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f5a88031ce0 con 0x5578f3bca670 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 10 client.15966 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 20 client.15966 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3b7f080 0x5578f401dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 4 client.15966 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f5a98004cc0 con 0x5578f3b7f080 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5a9effd640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3b7f080 0x5578f401dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5a7effd640 10 client.15966 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:18.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.041+0000 7f5a9effd640 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3b7f080 0x5578f401dca0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf9301af9a91a85 server_cookie=7803b37415e7fee1 in_seq=0 out_seq=0 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5a7effd640 1 -- 172.21.15.38:0/2640506116 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f5a98004cc0 con 0x5578f3b7f080 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5a7effd640 10 client.15966 handle_command_reply: tid=0 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 client.15966 shutdown 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 msgr2=0x5578f3fb1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5a88005940 tx=0x7f5a880042a0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 shutdown_connections 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5578f3b7f080 0x5578f401dca0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5578f3beb350 0x5578f3fb23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5a7effd640 0 client.15966 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5578f3bca670 0x5578f3fb1e80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 --2- 172.21.15.38:0/2640506116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5578f3bc2490 0x5578f3fb3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 >> 172.21.15.38:0/2640506116 conn(0x5578f3bdf740 msgr2=0x5578f3f97540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 shutdown_connections 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.042+0000 7f5aabda2740 1 -- 172.21.15.38:0/2640506116 wait complete. 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aabda2740 20 client.15966 trim_cache size 0 max 16384 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:21:18.049 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:21:18.050 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "35bee73d-349c-4edf-b605-479b745044b2", 2024-09-21T06:21:18.050 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:21:18.050 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:21:18.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 msgr2=0x7f5a8c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 0x7f5a8c0b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5a98005fd0 tx=0x7f5a98009500 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 msgr2=0x7f5aa019c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000d950 tx=0x7f5a9000de10 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 shutdown_connections 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5a8c0b6700 0x7f5a8c0b8c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5aa0108cf0 0x7f5aa01a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5aa01083a0 0x7f5aa019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 --2- 172.21.15.38:0/488117364 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5aa0102a60 0x7f5aa019c8d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 >> 172.21.15.38:0/488117364 conn(0x7f5aa0079730 msgr2=0x7f5aa006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 shutdown_connections 2024-09-21T06:21:18.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:18.043+0000 7f5aa582e640 1 -- 172.21.15.38:0/488117364 wait complete. 2024-09-21T06:21:18.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:21:19.021 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: pgmap v368: 97 pgs: 97 active+clean; 115 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 457 op/s 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.286 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.287 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.287 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.287 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: pgmap v368: 97 pgs: 97 active+clean; 115 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 457 op/s 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: pgmap v368: 97 pgs: 97 active+clean; 115 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 457 op/s 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:19.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/2333280579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 msgr2=0x7f8bb8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/2333280579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb8110630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009ca0 tx=0x7f8bb002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/2333280579 shutdown_connections 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/2333280579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb8110630 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/2333280579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb81094b0 0x7f8bb81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/2333280579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb8103bc0 0x7f8bb8103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/2333280579 >> 172.21.15.38:0/2333280579 conn(0x7f8bb807b910 msgr2=0x7f8bb807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/2333280579 shutdown_connections 2024-09-21T06:21:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.550+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/2333280579 wait complete. 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 Processor -- start 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 -- start start 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb8103bc0 0x7f8bb819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 0x7f8bb819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8113c00 con 0x7f8bb8109e00 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8113a80 con 0x7f8bb8103bc0 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bbdbc7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8113d80 con 0x7f8bb81094b0 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb8103bc0 0x7f8bb819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 0x7f8bb819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38120/0 (socket says 172.21.15.38:38120) 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.551+0000 7f8bb7fff640 1 -- 172.21.15.38:0/3386632232 learned_addr learned my addr 172.21.15.38:0/3386632232 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/3386632232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb8103bc0 msgr2=0x7f8bb819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb8103bc0 0x7f8bb819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 msgr2=0x7f8bb819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/3386632232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb81a0500 con 0x7f8bb81094b0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 0x7f8bb819ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005fd0 tx=0x7f8bac00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb4ff9640 1 -- 172.21.15.38:0/3386632232 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac009c00 con 0x7f8bb81094b0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb4ff9640 1 -- 172.21.15.38:0/3386632232 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bac009da0 con 0x7f8bb81094b0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb81a07f0 con 0x7f8bb81094b0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bb4ff9640 1 -- 172.21.15.38:0/3386632232 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac010460 con 0x7f8bb81094b0 2024-09-21T06:21:19.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.552+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb81a6f50 con 0x7f8bb81094b0 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 Processor -- start 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 -- start start 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bb4ff9640 1 -- 172.21.15.38:0/3386632232 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8bac0035f0 con 0x7f8bb81094b0 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e8f1b0 0x55976125fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x5597612600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5597611d5e50 con 0x559760e97390 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597611c5280 con 0x559760e8f1b0 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.555+0000 7f8bc413b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5597611c9090 con 0x559760eb8070 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x5597612600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:55594/0 (socket says 172.21.15.38:55594) 2024-09-21T06:21:19.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 -- 172.21.15.38:0/2625966530 learned_addr learned my addr 172.21.15.38:0/2625966530 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x5597612600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38136/0 (socket says 172.21.15.38:38136) 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e8f1b0 0x55976125fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 -- 172.21.15.38:0/2625966530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e8f1b0 msgr2=0x55976125fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e8f1b0 0x55976125fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 -- 172.21.15.38:0/2625966530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 msgr2=0x5597612600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x5597612600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 -- 172.21.15.38:0/2625966530 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559760f23650 con 0x559760eb8070 2024-09-21T06:21:19.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.556+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8bb002f500 tx=0x7f8bb0009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4354fa8ff2cc7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8bb4ff9640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 0x7f8ba00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8b9dffb640 1 -- 172.21.15.38:0/2625966530 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0031e00 con 0x559760eb8070 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 0x7f8ba00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8b9dffb640 1 -- 172.21.15.38:0/2625966530 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb0036030 con 0x559760eb8070 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8bb4ff9640 1 -- 172.21.15.38:0/3386632232 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8bac0e6fc0 con 0x7f8bb81094b0 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.557+0000 7f8b9dffb640 1 -- 172.21.15.38:0/2625966530 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0004370 con 0x559760eb8070 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 0x7f8ba00b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55976125e2d0 tx=0x7f8ba8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 -- 172.21.15.38:0/2625966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 msgr2=0x55976125f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8bb002f500 tx=0x7f8bb0009820 comp rx=0 tx=0).stop 2024-09-21T06:21:19.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 -- 172.21.15.38:0/2625966530 shutdown_connections 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x5597612600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e8f1b0 0x55976125fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 --2- 172.21.15.38:0/2625966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760eb8070 0x55976125f650 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 -- 172.21.15.38:0/2625966530 >> 172.21.15.38:0/2625966530 conn(0x559760eac460 msgr2=0x55976125d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 -- 172.21.15.38:0/2625966530 shutdown_connections 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.558+0000 7f8bc413b740 1 -- 172.21.15.38:0/2625966530 wait complete. 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 -- start start 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 Processor -- start 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976126f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976127b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559761026700 con 0x559760eb8070 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559761160110 con 0x559760e97390 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bc413b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559761271fb0 con 0x559760e8f1b0 2024-09-21T06:21:19.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976126f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.559+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:55602/0 (socket says 172.21.15.38:55602) 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bc413b740 10 client.0 _ll_register_callbacks cb 0x559761179990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb77fe640 1 -- 172.21.15.38:0/945733454 learned_addr learned my addr 172.21.15.38:0/945733454 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976127b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/945733454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 msgr2=0x55976126f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/945733454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 msgr2=0x55976127b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976127b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/945733454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976118dc40 con 0x559760e97390 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976127b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976126f660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0e4790 tx=0x7f8bac0ea700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fead91a66fbb38d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac020030 con 0x559760e97390 2024-09-21T06:21:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8bac0e9280 con 0x559760e97390 2024-09-21T06:21:19.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.560+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb0036030 con 0x559760e97390 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8bac0a8de0 con 0x559760e97390 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 10 client.25625 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55976127dd30 con 0x559760e97390 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb0036030 con 0x559760e97390 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8bac094230 con 0x559760e97390 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 10 client.25625 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 10 client.25625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 20 client.25625 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.561+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e769f0 0x559761281220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.562+0000 7f8bc413b740 4 client.25625 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.562+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597611d7da0 con 0x559760e769f0 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.562+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e769f0 0x559761281220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.562+0000 7f8b96ffd640 10 client.25625 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:19.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.562+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e769f0 0x559761281220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a677ff3f86524db server_cookie=4c1b3b646f44ed37 in_seq=0 out_seq=0 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8b96ffd640 1 -- 172.21.15.38:0/945733454 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597611d7da0 con 0x559760e769f0 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8b96ffd640 10 client.25625 handle_command_reply: tid=0 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 client.25625 shutdown 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 msgr2=0x55976126f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976126f660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0e4790 tx=0x7f8bac0ea700 comp rx=0 tx=0).stop 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 shutdown_connections 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976127b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976126f660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e769f0 0x559761281220 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 --2- 172.21.15.38:0/945733454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 >> 172.21.15.38:0/945733454 conn(0x559760eac460 msgr2=0x559761261040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8b96ffd640 0 client.25625 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:19.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 shutdown_connections 2024-09-21T06:21:19.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 1 -- 172.21.15.38:0/945733454 wait complete. 2024-09-21T06:21:19.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.566+0000 7f8bc413b740 20 client.25625 trim_cache size 0 max 16384 2024-09-21T06:21:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 Processor -- start 2024-09-21T06:21:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 -- start start 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976127b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81afcc0 con 0x559760eb8070 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ad560 con 0x559760e97390 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.584+0000 7f8bc413b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ab3b0 con 0x559760e8f1b0 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976127b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38154/0 (socket says 172.21.15.38:38154) 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 -- 172.21.15.38:0/901607559 learned_addr learned my addr 172.21.15.38:0/901607559 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 -- 172.21.15.38:0/901607559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 msgr2=0x55976126f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 -- 172.21.15.38:0/901607559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 msgr2=0x55976127b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976127b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 -- 172.21.15.38:0/901607559 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559761260440 con 0x559760eb8070 2024-09-21T06:21:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00319a0 tx=0x7f8bb00319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a2174994c922c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.585+0000 7f8b9d7fa640 1 -- 172.21.15.38:0/901607559 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb004a040 con 0x559760eb8070 2024-09-21T06:21:19.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8b9d7fa640 1 -- 172.21.15.38:0/901607559 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb0055070 con 0x559760eb8070 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8b9d7fa640 1 -- 172.21.15.38:0/901607559 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb002f660 con 0x559760eb8070 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 -- 172.21.15.38:0/901607559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 msgr2=0x55976125ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00319a0 tx=0x7f8bb00319d0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 -- 172.21.15.38:0/901607559 shutdown_connections 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760eb8070 0x55976125ce60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760e97390 0x55976127b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 --2- 172.21.15.38:0/901607559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x55976126f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.586+0000 7f8bc413b740 1 -- 172.21.15.38:0/901607559 >> 172.21.15.38:0/901607559 conn(0x559760eac460 msgr2=0x55976126eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.587+0000 7f8bc413b740 1 -- 172.21.15.38:0/901607559 shutdown_connections 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.587+0000 7f8bc413b740 1 -- 172.21.15.38:0/901607559 wait complete. 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.587+0000 7f8bc413b740 1 -- start start 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.587+0000 7f8bc413b740 1 Processor -- start 2024-09-21T06:21:19.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x5597612732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760eb8070 0x559761273d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81aba20 con 0x559760e97390 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ace90 con 0x559760eb8070 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb81ac0f0 con 0x559760e8f1b0 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bc413b740 10 client.0 _ll_register_callbacks cb 0x7f8bac009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x5597612732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38166/0 (socket says 172.21.15.38:38166) 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb6ffd640 1 -- 172.21.15.38:0/3436965519 learned_addr learned my addr 172.21.15.38:0/3436965519 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb7fff640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760eb8070 0x559761273d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 -- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760eb8070 msgr2=0x559761273d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760eb8070 0x559761273d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 -- 172.21.15.38:0/3436965519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 msgr2=0x559761273830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:19.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 -- 172.21.15.38:0/3436965519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597612eacb0 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8bb77fe640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x5597612732f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55976127f1e0 tx=0x7f8ba8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0ed9a51baaa1953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.588+0000 7f8b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004410 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb0055070 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8ba8018030 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ba8005020 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 10 client.25597 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5597612ebfa0 con 0x559760e8f1b0 2024-09-21T06:21:19.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb0055070 con 0x559760e8f1b0 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8ba80035f0 con 0x559760e8f1b0 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 10 client.25597 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 10 client.25597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 20 client.25597 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e4bda0 0x5597612ee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 4 client.25597 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.589+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597611d3850 con 0x559760e4bda0 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.590+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e4bda0 0x5597612ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.590+0000 7f8b96ffd640 10 client.25597 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.590+0000 7f8bb6ffd640 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e4bda0 0x5597612ee810 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34a2348eb7c917a0 server_cookie=eec55a1d022caa70 in_seq=0 out_seq=0 2024-09-21T06:21:19.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8b96ffd640 1 -- 172.21.15.38:0/3436965519 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1430 (crc 0 0 0) 0x5597611d3850 con 0x559760e4bda0 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8b96ffd640 10 client.25597 handle_command_reply: tid=0 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 client.25597 shutdown 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 msgr2=0x5597612732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x5597612732f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55976127f1e0 tx=0x7f8ba8004730 comp rx=0 tx=0).stop 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 shutdown_connections 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559760eb8070 0x559761273d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559760e97390 0x559761273830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559760e4bda0 0x5597612ee810 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 --2- 172.21.15.38:0/3436965519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559760e8f1b0 0x5597612732f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8b96ffd640 0 client.25597 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 >> 172.21.15.38:0/3436965519 conn(0x559760eac460 msgr2=0x55976125ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 shutdown_connections 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 1 -- 172.21.15.38:0/3436965519 wait complete. 2024-09-21T06:21:19.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.593+0000 7f8bc413b740 20 client.25597 trim_cache size 0 max 16384 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "scrub active (558 inodes in the stack)", 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "35bee73d-349c-4edf-b605-479b745044b2", 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:21:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:21:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:21:19.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 msgr2=0x7f8ba00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 0x7f8ba00b8c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55976125e2d0 tx=0x7f8ba8005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 msgr2=0x7f8bb819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 0x7f8bb819ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bac005fd0 tx=0x7f8bac00dde0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 shutdown_connections 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ba00b6700 0x7f8ba00b8c10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bb8109e00 0x7f8bb819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bb81094b0 0x7f8bb819ab30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 --2- 172.21.15.38:0/3386632232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bb8103bc0 0x7f8bb819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 >> 172.21.15.38:0/3386632232 conn(0x7f8bb807b910 msgr2=0x7f8bb8105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 shutdown_connections 2024-09-21T06:21:19.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:19.594+0000 7f8bbdbc7640 1 -- 172.21.15.38:0/3386632232 wait complete. 2024-09-21T06:21:20.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:20.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:20.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:20 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.303 INFO:tasks.cephfs.filesystem:scrub status for tag:35bee73d-349c-4edf-b605-479b745044b2 - {'path': '/', 'tag': '35bee73d-349c-4edf-b605-479b745044b2', 'options': 'recursive,force'} 2024-09-21T06:21:20.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:20.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:20.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:20.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:20 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:20.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:20 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:21 smithi174 ceph-mon[34815]: pgmap v369: 97 pgs: 97 active+clean; 126 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 710 op/s 2024-09-21T06:21:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:21 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:21.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:21 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:21 smithi044 ceph-mon[34369]: pgmap v369: 97 pgs: 97 active+clean; 126 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 710 op/s 2024-09-21T06:21:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:21 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:21 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:21 smithi038 ceph-mon[31215]: pgmap v369: 97 pgs: 97 active+clean; 126 MiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 710 op/s 2024-09-21T06:21:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:21 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:21.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:21 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:22.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:22 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:22 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:22.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:22 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:23 smithi174 ceph-mon[34815]: pgmap v370: 97 pgs: 97 active+clean; 138 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 809 op/s 2024-09-21T06:21:23.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:23 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:21:23.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:23 smithi044 ceph-mon[34369]: pgmap v370: 97 pgs: 97 active+clean; 138 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 809 op/s 2024-09-21T06:21:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:23 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:21:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:23 smithi038 ceph-mon[31215]: pgmap v370: 97 pgs: 97 active+clean; 138 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.9 MiB/s wr, 809 op/s 2024-09-21T06:21:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:23 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:21:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:21:25.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:25 smithi174 ceph-mon[34815]: pgmap v371: 97 pgs: 97 active+clean; 158 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.06k op/s 2024-09-21T06:21:25.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:25 smithi044 ceph-mon[34369]: pgmap v371: 97 pgs: 97 active+clean; 158 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.06k op/s 2024-09-21T06:21:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:25 smithi038 ceph-mon[31215]: pgmap v371: 97 pgs: 97 active+clean; 158 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.7 MiB/s wr, 1.06k op/s 2024-09-21T06:21:27.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:27 smithi174 ceph-mon[34815]: pgmap v372: 97 pgs: 97 active+clean; 158 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 1.11k op/s 2024-09-21T06:21:27.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:27 smithi044 ceph-mon[34369]: pgmap v372: 97 pgs: 97 active+clean; 158 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 1.11k op/s 2024-09-21T06:21:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:27 smithi038 ceph-mon[31215]: pgmap v372: 97 pgs: 97 active+clean; 158 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.5 MiB/s wr, 1.11k op/s 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 -- 172.21.15.38:0/501098126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea4108c30 msgr2=0x7feea410f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 --2- 172.21.15.38:0/501098126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea4108c30 0x7feea410f460 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009ca0 tx=0x7fee9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 -- 172.21.15.38:0/501098126 shutdown_connections 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 --2- 172.21.15.38:0/501098126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea4108c30 0x7feea410f460 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 --2- 172.21.15.38:0/501098126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 0x7feea41086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 --2- 172.21.15.38:0/501098126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea41029b0 0x7feea4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 -- 172.21.15.38:0/501098126 >> 172.21.15.38:0/501098126 conn(0x7feea407a740 msgr2=0x7feea407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 -- 172.21.15.38:0/501098126 shutdown_connections 2024-09-21T06:21:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.007+0000 7feea88f2640 1 -- 172.21.15.38:0/501098126 wait complete. 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 Processor -- start 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 -- start start 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 0x7feea419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea4108c30 0x7feea419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feea4112a30 con 0x7feea41029b0 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feea41128b0 con 0x7feea41082e0 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea88f2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feea4112bb0 con 0x7feea4108c30 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38186/0 (socket says 172.21.15.38:38186) 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea259c640 1 -- 172.21.15.38:0/267765807 learned_addr learned my addr 172.21.15.38:0/267765807 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea1d9b640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 0x7feea419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.008+0000 7feea2d9d640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea4108c30 0x7feea419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 -- 172.21.15.38:0/267765807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea4108c30 msgr2=0x7feea419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea4108c30 0x7feea419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 -- 172.21.15.38:0/267765807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 msgr2=0x7feea419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 0x7feea419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 -- 172.21.15.38:0/267765807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea41a0470 con 0x7feea41029b0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea259c640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fee9400d770 tx=0x7fee9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7fee937fe640 1 -- 172.21.15.38:0/267765807 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94017070 con 0x7feea41029b0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a0760 con 0x7feea41029b0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7fee937fe640 1 -- 172.21.15.38:0/267765807 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee940054f0 con 0x7feea41029b0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7fee937fe640 1 -- 172.21.15.38:0/267765807 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94004de0 con 0x7feea41029b0 2024-09-21T06:21:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.009+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41a6ef0 con 0x7feea41029b0 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 Processor -- start 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 -- start start 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7fee937fe640 1 -- 172.21.15.38:0/267765807 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fee94004f80 con 0x7feea41029b0 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a34672e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34672f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a3466a36f0 con 0x55a3463602f0 2024-09-21T06:21:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a346692b20 con 0x55a3463891b0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feeaf861740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a346696930 con 0x55a3463684d0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feea2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a34672e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38196/0 (socket says 172.21.15.38:38196) 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feea259c640 1 -- 172.21.15.38:0/832166006 learned_addr learned my addr 172.21.15.38:0/832166006 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.012+0000 7feea1d9b640 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34672f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 -- 172.21.15.38:0/832166006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 msgr2=0x55a34672f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34672f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 -- 172.21.15.38:0/832166006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 msgr2=0x55a34672e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a34672e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 -- 172.21.15.38:0/832166006 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a346658530 con 0x55a3463602f0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea2d9d640 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a34672e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7feea259c640 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee940e4860 tx=0x7fee940ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787133e13e472779 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7fee90ff9640 1 -- 172.21.15.38:0/832166006 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940fa070 con 0x55a3463602f0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7fee90ff9640 1 -- 172.21.15.38:0/832166006 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee940e7a70 con 0x55a3463602f0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7fee90ff9640 1 -- 172.21.15.38:0/832166006 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940f5bf0 con 0x55a3463602f0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.013+0000 7fee937fe640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 0x7fee8c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feea2d9d640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 0x7fee8c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7fee937fe640 1 -- 172.21.15.38:0/267765807 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee940e7080 con 0x7feea41029b0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 -- 172.21.15.38:0/832166006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 msgr2=0x55a34672eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee940e4860 tx=0x7fee940ef910 comp rx=0 tx=0).stop 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feea2d9d640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 0x7fee8c0b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fee9c02f500 tx=0x7fee9c02f490 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 -- 172.21.15.38:0/832166006 shutdown_connections 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34672f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a34672eef0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 --2- 172.21.15.38:0/832166006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a34672e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 -- 172.21.15.38:0/832166006 >> 172.21.15.38:0/832166006 conn(0x55a34637d300 msgr2=0x55a34672c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.014+0000 7feeaf861740 1 -- 172.21.15.38:0/832166006 shutdown_connections 2024-09-21T06:21:28.019 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 -- 172.21.15.38:0/832166006 wait complete. 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 -- start start 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 Processor -- start 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 0x55a34673a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463891b0 0x55a346746450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a3465caab0 con 0x55a3463684d0 2024-09-21T06:21:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a346638730 con 0x55a3463602f0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a34673d130 con 0x55a3463891b0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feeaf861740 10 client.0 _ll_register_callbacks cb 0x55a34668c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.015+0000 7feea1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38210/0 (socket says 172.21.15.38:38210) 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 0x55a34673a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 -- 172.21.15.38:0/559451199 learned_addr learned my addr 172.21.15.38:0/559451199 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea2d9d640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463891b0 0x55a346746450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 -- 172.21.15.38:0/559451199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463891b0 msgr2=0x55a346746450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463891b0 0x55a346746450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 -- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 msgr2=0x55a34673a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 0x55a34673a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 -- 172.21.15.38:0/559451199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3463f4790 con 0x55a3463684d0 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea259c640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 0x55a34673a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:28.023 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feea1d9b640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee98012700 tx=0x7fee98012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe69ea93beefc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7fee89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98004030 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee980041d0 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee940e7a70 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee980043d0 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feeaf861740 10 client.15996 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.016+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a34646d620 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee940e7a70 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fee98003c60 con 0x55a3463684d0 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 20 client.15996 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a346347d80 0x55a34674c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 4 client.15996 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3466a5640 con 0x55a346347d80 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feea259c640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a346347d80 0x55a34674c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7feea259c640 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a346347d80 0x55a34674c2e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc1303335859c9 server_cookie=90ecb96a075136d7 in_seq=0 out_seq=0 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.017+0000 7fee89ffb640 10 client.15996 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7fee89ffb640 1 -- 172.21.15.38:0/559451199 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3466a5640 con 0x55a346347d80 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7fee89ffb640 10 client.15996 handle_command_reply: tid=0 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 client.15996 shutdown 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 msgr2=0x55a34673a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee98012700 tx=0x7fee98012bc0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 shutdown_connections 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a346347d80 0x55a34674c2e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463891b0 0x55a346746450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463684d0 0x55a34673a5e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 --2- 172.21.15.38:0/559451199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463602f0 0x55a34673a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7fee89ffb640 0 client.15996 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 >> 172.21.15.38:0/559451199 conn(0x55a34637d300 msgr2=0x55a34672f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 shutdown_connections 2024-09-21T06:21:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.019+0000 7feeaf861740 1 -- 172.21.15.38:0/559451199 wait complete. 2024-09-21T06:21:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.020+0000 7feeaf861740 20 client.15996 trim_cache size 0 max 16384 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 Processor -- start 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 -- start start 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34673bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a346737270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feea41b1f90 con 0x55a3463602f0 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feea41af830 con 0x55a3463891b0 2024-09-21T06:21:28.037 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feeaf861740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feea41ad680 con 0x55a3463684d0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feea259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38218/0 (socket says 172.21.15.38:38218) 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feea259c640 1 -- 172.21.15.38:0/1540148074 learned_addr learned my addr 172.21.15.38:0/1540148074 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.034+0000 7feea2d9d640 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a346737270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 -- 172.21.15.38:0/1540148074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 msgr2=0x55a34673bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea1d9b640 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34673bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34673bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 -- 172.21.15.38:0/1540148074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 msgr2=0x55a346737270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a346737270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 -- 172.21.15.38:0/1540148074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a346748d90 con 0x55a3463602f0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7feea259c640 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee940f5720 tx=0x7fee940f56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ebbaaed8af4ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7fee8bfff640 1 -- 172.21.15.38:0/1540148074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94020070 con 0x55a3463602f0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7fee8bfff640 1 -- 172.21.15.38:0/1540148074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee940b4e50 con 0x55a3463602f0 2024-09-21T06:21:28.038 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.035+0000 7fee8bfff640 1 -- 172.21.15.38:0/1540148074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940ac9f0 con 0x55a3463602f0 2024-09-21T06:21:28.040 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- 172.21.15.38:0/1540148074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 msgr2=0x55a3467303a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee940f5720 tx=0x7fee940f56b0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- 172.21.15.38:0/1540148074 shutdown_connections 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463891b0 0x55a346737270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463684d0 0x55a34673bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 --2- 172.21.15.38:0/1540148074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463602f0 0x55a3467303a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- 172.21.15.38:0/1540148074 >> 172.21.15.38:0/1540148074 conn(0x55a34637d300 msgr2=0x55a34673b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- 172.21.15.38:0/1540148074 shutdown_connections 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- 172.21.15.38:0/1540148074 wait complete. 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 -- start start 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.036+0000 7feeaf861740 1 Processor -- start 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 0x55a346740ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.041 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463891b0 0x55a346740ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feea41adcf0 con 0x55a3463891b0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feea41af160 con 0x55a3463684d0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feea41ae3c0 con 0x55a3463602f0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feeaf861740 10 client.0 _ll_register_callbacks cb 0x7fee98009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463891b0 0x55a346740ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 0x55a346740ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea259c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:55672/0 (socket says 172.21.15.38:55672) 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea259c640 1 -- 172.21.15.38:0/2371585093 learned_addr learned my addr 172.21.15.38:0/2371585093 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 -- 172.21.15.38:0/2371585093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 msgr2=0x55a346740570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 -- 172.21.15.38:0/2371585093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463891b0 msgr2=0x55a346740ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463891b0 0x55a346740ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:28.042 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 -- 172.21.15.38:0/2371585093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3467b5eb0 con 0x55a3463684d0 2024-09-21T06:21:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea259c640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.037+0000 7feea1d9b640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 0x55a346740ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee9801c5f0 tx=0x7fee98005580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb4c34ee03556c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:28.043 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.038+0000 7fee89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98004000 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee980041a0 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee940b4e50 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee9800f920 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7feeaf861740 10 client.25649 fetch_fsmap learned FSMap version 26 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a3467b7120 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee940b4e50 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.042+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fee98003710 con 0x55a3463684d0 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 10 client.25649 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 20 client.25649 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a34631d1c0 0x55a3467b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 4 client.25649 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:21:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3466a10f0 con 0x55a34631d1c0 2024-09-21T06:21:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feea259c640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a34631d1c0 0x55a3467b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7feea259c640 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a34631d1c0 0x55a3467b9940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5893251ae686ec42 server_cookie=31eefd00ba8d5bcf in_seq=0 out_seq=0 2024-09-21T06:21:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:28.043+0000 7fee89ffb640 10 client.25649 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:29.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:29 smithi174 ceph-mon[34815]: pgmap v373: 97 pgs: 97 active+clean; 161 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 1.04k op/s 2024-09-21T06:21:29.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:29 smithi044 ceph-mon[34369]: pgmap v373: 97 pgs: 97 active+clean; 161 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 1.04k op/s 2024-09-21T06:21:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:29 smithi038 ceph-mon[31215]: pgmap v373: 97 pgs: 97 active+clean; 161 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.3 MiB/s wr, 1.04k op/s 2024-09-21T06:21:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7fee89ffb640 1 -- 172.21.15.38:0/2371585093 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3466a10f0 con 0x55a34631d1c0 2024-09-21T06:21:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7fee89ffb640 10 client.25649 handle_command_reply: tid=0 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 client.25649 shutdown 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 msgr2=0x55a346740ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 0x55a346740ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fee9801c5f0 tx=0x7fee98005580 comp rx=0 tx=0).stop 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 shutdown_connections 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a3463891b0 0x55a346740ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3463684d0 0x55a346740ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.885 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a34631d1c0 0x55a3467b9940 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7fee89ffb640 0 client.25649 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 --2- 172.21.15.38:0/2371585093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a3463602f0 0x55a346740570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.882+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 >> 172.21.15.38:0/2371585093 conn(0x55a34637d300 msgr2=0x55a346730170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.883+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 shutdown_connections 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.883+0000 7feeaf861740 1 -- 172.21.15.38:0/2371585093 wait complete. 2024-09-21T06:21:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.883+0000 7feeaf861740 20 client.25649 trim_cache size 0 max 16384 2024-09-21T06:21:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:21:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:21:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:21:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:21:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 msgr2=0x7fee8c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 0x7fee8c0b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fee9c02f500 tx=0x7fee9c02f490 comp rx=0 tx=0).stop 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 msgr2=0x7feea419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fee9400d770 tx=0x7fee9400dc30 comp rx=0 tx=0).stop 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 shutdown_connections 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fee8c0b6680 0x7fee8c0b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feea4108c30 0x7feea419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feea41082e0 0x7feea419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 --2- 172.21.15.38:0/267765807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feea41029b0 0x7feea419a540 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.884+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 >> 172.21.15.38:0/267765807 conn(0x7feea407a740 msgr2=0x7feea4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.885+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 shutdown_connections 2024-09-21T06:21:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:30.885+0000 7feea88f2640 1 -- 172.21.15.38:0/267765807 wait complete. 2024-09-21T06:21:31.334 INFO:tasks.workunit.client.0.smithi038.stderr:+ sync 2024-09-21T06:21:31.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:31 smithi174 ceph-mon[34815]: pgmap v374: 97 pgs: 97 active+clean; 166 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 840 op/s 2024-09-21T06:21:31.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:31 smithi044 ceph-mon[34369]: pgmap v374: 97 pgs: 97 active+clean; 166 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 840 op/s 2024-09-21T06:21:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:31 smithi038 ceph-mon[31215]: pgmap v374: 97 pgs: 97 active+clean; 166 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 840 op/s 2024-09-21T06:21:33.260 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar c linux-4.0.5 2024-09-21T06:21:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:33 smithi174 ceph-mon[34815]: pgmap v375: 97 pgs: 97 active+clean; 160 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 694 op/s 2024-09-21T06:21:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:33 smithi044 ceph-mon[34369]: pgmap v375: 97 pgs: 97 active+clean; 160 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 694 op/s 2024-09-21T06:21:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:33 smithi038 ceph-mon[31215]: pgmap v375: 97 pgs: 97 active+clean; 160 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 694 op/s 2024-09-21T06:21:33.667 INFO:tasks.workunit.client.0.smithi038.stderr:+ rm -rf linux-4.0.5 2024-09-21T06:21:34.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:34 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:21:34.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:34 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:21:34.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:34 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:21:34.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:34 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:21:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:34 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:21:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:34 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:21:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:34 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:21:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:34 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:21:34.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:34 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:21:35.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:35 smithi174 ceph-mon[34815]: pgmap v376: 97 pgs: 97 active+clean; 167 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 867 op/s 2024-09-21T06:21:35.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:35 smithi044 ceph-mon[34369]: pgmap v376: 97 pgs: 97 active+clean; 167 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 867 op/s 2024-09-21T06:21:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:35 smithi038 ceph-mon[31215]: pgmap v376: 97 pgs: 97 active+clean; 167 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 867 op/s 2024-09-21T06:21:36.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:36 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:36.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:36 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:36.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:36 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:37 smithi174 ceph-mon[34815]: pgmap v377: 97 pgs: 97 active+clean; 168 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 735 op/s 2024-09-21T06:21:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:37 smithi044 ceph-mon[34369]: pgmap v377: 97 pgs: 97 active+clean; 168 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 735 op/s 2024-09-21T06:21:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:37 smithi038 ceph-mon[31215]: pgmap v377: 97 pgs: 97 active+clean; 168 MiB data, 1007 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 735 op/s 2024-09-21T06:21:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:39 smithi174 ceph-mon[34815]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 777 op/s 2024-09-21T06:21:39.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:39 smithi044 ceph-mon[34369]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 777 op/s 2024-09-21T06:21:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:39 smithi038 ceph-mon[31215]: pgmap v378: 97 pgs: 97 active+clean; 181 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 777 op/s 2024-09-21T06:21:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:41 smithi174 ceph-mon[34815]: pgmap v379: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 784 op/s 2024-09-21T06:21:41.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:41 smithi044 ceph-mon[34369]: pgmap v379: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 784 op/s 2024-09-21T06:21:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:41 smithi038 ceph-mon[31215]: pgmap v379: 97 pgs: 97 active+clean; 181 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 784 op/s 2024-09-21T06:21:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:43 smithi174 ceph-mon[34815]: pgmap v380: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 759 op/s 2024-09-21T06:21:43.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:43 smithi044 ceph-mon[34369]: pgmap v380: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 759 op/s 2024-09-21T06:21:43.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:43 smithi038 ceph-mon[31215]: pgmap v380: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 759 op/s 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 -- 172.21.15.38:0/2283102089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 msgr2=0x7f7de0102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/2283102089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de0102dc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009900 tx=0x7f7dd002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 -- 172.21.15.38:0/2283102089 shutdown_connections 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/2283102089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de0108c30 0x7f7de010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/2283102089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de01082e0 0x7f7de01086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/2283102089 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de0102dc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 -- 172.21.15.38:0/2283102089 >> 172.21.15.38:0/2283102089 conn(0x7f7de007a740 msgr2=0x7f7de007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 -- 172.21.15.38:0/2283102089 shutdown_connections 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.987+0000 7f7de4fe6640 1 -- 172.21.15.38:0/2283102089 wait complete. 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.988+0000 7f7de4fe6640 1 Processor -- start 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.988+0000 7f7de4fe6640 1 -- start start 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.988+0000 7f7de4fe6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7de4fe6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 0x7f7de00ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7de4fe6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de0108c30 0x7f7de00fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7de4fe6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7de0112a30 con 0x7f7de01029b0 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7de4fe6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01128b0 con 0x7f7de0108c30 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7de4fe6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7de0112bb0 con 0x7f7de01082e0 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39704/0 (socket says 172.21.15.38:39704) 2024-09-21T06:21:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 -- 172.21.15.38:0/189366804 learned_addr learned my addr 172.21.15.38:0/189366804 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dded9d640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de0108c30 0x7f7de00fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 0x7f7de00ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 -- 172.21.15.38:0/189366804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 msgr2=0x7f7de00ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 0x7f7de00ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 -- 172.21.15.38:0/189366804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de0108c30 msgr2=0x7f7de00fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de0108c30 0x7f7de00fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 -- 172.21.15.38:0/189366804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de01a8850 con 0x7f7de01029b0 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 0x7f7de00ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dde59c640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005ab0 tx=0x7f7dd00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.989+0000 7f7dd7fff640 1 -- 172.21.15.38:0/189366804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd003f030 con 0x7f7de01029b0 2024-09-21T06:21:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.990+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de01a8ae0 con 0x7f7de01029b0 2024-09-21T06:21:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.990+0000 7f7dd7fff640 1 -- 172.21.15.38:0/189366804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dd0003ac0 con 0x7f7de01029b0 2024-09-21T06:21:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.990+0000 7f7dd7fff640 1 -- 172.21.15.38:0/189366804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0035070 con 0x7f7de01029b0 2024-09-21T06:21:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.990+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de01a9020 con 0x7f7de01029b0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.992+0000 7f7dec02b740 1 Processor -- start 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.992+0000 7f7dd7fff640 1 -- 172.21.15.38:0/189366804 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7dd0042030 con 0x7f7de01029b0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.992+0000 7f7dec02b740 1 -- start start 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe97aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 0x5640fe97b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5640fe8ef6f0 con 0x5640fe5b44d0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5640fe8deb20 con 0x5640fe5ac2f0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dec02b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5640fe8e2930 con 0x5640fe5d51b0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dd5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 0x5640fe97b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dde59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe97aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:38662/0 (socket says 172.21.15.38:38662) 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dd5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 0x5640fe97b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39706/0 (socket says 172.21.15.38:39706) 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dde59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe97aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:60996/0 (socket says 172.21.15.38:60996) 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 -- 172.21.15.38:0/1137174688 learned_addr learned my addr 172.21.15.38:0/1137174688 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 -- 172.21.15.38:0/1137174688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 msgr2=0x5640fe97aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe97aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 -- 172.21.15.38:0/1137174688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 msgr2=0x5640fe97b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 0x5640fe97b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 -- 172.21.15.38:0/1137174688 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fe8a4530 con 0x5640fe5d51b0 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dd7fff640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 0x7f7dcc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dde59c640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 0x7f7dcc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009f80 tx=0x7f7dd80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56759388a87d1fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.993+0000 7f7dd7fff640 1 -- 172.21.15.38:0/189366804 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7dd0107a60 con 0x7f7de01029b0 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.994+0000 7f7dd4d99640 1 -- 172.21.15.38:0/1137174688 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8004d20 con 0x5640fe5d51b0 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.994+0000 7f7dd4d99640 1 -- 172.21.15.38:0/1137174688 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dd8004050 con 0x5640fe5d51b0 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.994+0000 7f7dd4d99640 1 -- 172.21.15.38:0/1137174688 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8005220 con 0x5640fe5d51b0 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- 172.21.15.38:0/1137174688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 msgr2=0x5640fe97a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dde59c640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 0x7f7dcc0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dd01052e0 tx=0x7f7dd010b5b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009f80 tx=0x7f7dd80118d0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- 172.21.15.38:0/1137174688 shutdown_connections 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5b44d0 0x5640fe97b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe97aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1137174688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5d51b0 0x5640fe97a9b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- 172.21.15.38:0/1137174688 >> 172.21.15.38:0/1137174688 conn(0x5640fe5c9300 msgr2=0x5640fe9788a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- 172.21.15.38:0/1137174688 shutdown_connections 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- 172.21.15.38:0/1137174688 wait complete. 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- start start 2024-09-21T06:21:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 Processor -- start 2024-09-21T06:21:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe986590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5d51b0 0x5640fe992420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5640fe816ab0 con 0x5640fe5ac2f0 2024-09-21T06:21:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5640fe884730 con 0x5640fe5d51b0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.995+0000 7f7dec02b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5640fe989130 con 0x5640fe5b44d0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dec02b740 10 client.0 _ll_register_callbacks cb 0x5640fe8d86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39710/0 (socket says 172.21.15.38:39710) 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dded9d640 1 -- 172.21.15.38:0/1402592629 learned_addr learned my addr 172.21.15.38:0/1402592629 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe986590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5d51b0 0x5640fe992420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5d51b0 msgr2=0x5640fe992420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5d51b0 0x5640fe992420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/1402592629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 msgr2=0x5640fe986050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/1402592629 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fe640790 con 0x5640fe5b44d0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe986590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7de006c730 tx=0x7f7dc8012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dbdc9b43715126e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8004300 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd8004050 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.996+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7dc8011970 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dc80044a0 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 10 client.25624 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640fe6b9620 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dd8004050 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7dc800f460 con 0x5640fe5b44d0 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 10 client.25624 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 20 client.25624 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe593d80 0x5640fe9982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 4 client.25624 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640fe8f1640 con 0x5640fe593d80 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.997+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe593d80 0x5640fe9982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.998+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe593d80 0x5640fe9982a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708864a1d2edb881 server_cookie=67bab38c05da3d1d in_seq=0 out_seq=0 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:43.998+0000 7f7dc5ffb640 10 client.25624 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1402592629 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640fe8f1640 con 0x5640fe593d80 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dc5ffb640 10 client.25624 handle_command_reply: tid=0 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 client.25624 shutdown 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 msgr2=0x5640fe986590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe986590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7de006c730 tx=0x7f7dc8012b60 comp rx=0 tx=0).stop 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 shutdown_connections 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5d51b0 0x5640fe992420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe593d80 0x5640fe9982a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe986590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dc5ffb640 0 client.25624 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1402592629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5ac2f0 0x5640fe986050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 >> 172.21.15.38:0/1402592629 conn(0x5640fe5c9300 msgr2=0x5640fe97b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 shutdown_connections 2024-09-21T06:21:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 1 -- 172.21.15.38:0/1402592629 wait complete. 2024-09-21T06:21:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.000+0000 7f7dec02b740 20 client.25624 trim_cache size 0 max 16384 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 Processor -- start 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 -- start start 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5ac2f0 0x5640fe97c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01b4210 con 0x5640fe5d51b0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01b1a20 con 0x5640fe5b44d0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dec02b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01af870 con 0x5640fe5ac2f0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:32784/0 (socket says 172.21.15.38:32784) 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39726/0 (socket says 172.21.15.38:39726) 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/3887571987 learned_addr learned my addr 172.21.15.38:0/3887571987 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dded9d640 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5ac2f0 0x5640fe97c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/3887571987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5ac2f0 msgr2=0x5640fe97c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5ac2f0 0x5640fe97c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/3887571987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 msgr2=0x5640fe99da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dd5d9b640 1 -- 172.21.15.38:0/3887571987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640fe984530 con 0x5640fe5b44d0 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.015+0000 7f7dded9d640 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.016+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001eb0 tx=0x7f7dc8009dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed888d0389ba5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.016+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3887571987 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc802b070 con 0x5640fe5b44d0 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.016+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3887571987 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dc8011e40 con 0x5640fe5b44d0 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.016+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3887571987 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80052e0 con 0x5640fe5b44d0 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- 172.21.15.38:0/3887571987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 msgr2=0x5640fe987c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001eb0 tx=0x7f7dc8009dd0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- 172.21.15.38:0/3887571987 shutdown_connections 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe99da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5b44d0 0x5640fe987c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- 172.21.15.38:0/3887571987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5ac2f0 0x5640fe97c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- 172.21.15.38:0/3887571987 >> 172.21.15.38:0/3887571987 conn(0x5640fe5c9300 msgr2=0x5640fe987570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- 172.21.15.38:0/3887571987 shutdown_connections 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- 172.21.15.38:0/3887571987 wait complete. 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- start start 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 Processor -- start 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe98e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe98bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe98c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01afee0 con 0x5640fe5d51b0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01b1350 con 0x5640fe5ac2f0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7de01b05b0 con 0x5640fe5b44d0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.017+0000 7f7dec02b740 10 client.0 _ll_register_callbacks cb 0x7f7dc8009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe98e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe98e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:32794/0 (socket says 172.21.15.38:32794) 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 -- 172.21.15.38:0/1034790734 learned_addr learned my addr 172.21.15.38:0/1034790734 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe98c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe98bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 -- 172.21.15.38:0/1034790734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 msgr2=0x5640fe98bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe98bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 -- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 msgr2=0x5640fe98e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe98e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 -- 172.21.15.38:0/1034790734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640fe98c810 con 0x5640fe5d51b0 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dded9d640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe98c2d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8003fd0 tx=0x7f7dd8009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e23dd3210a2a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.018+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800f4e0 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dc8011e40 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7dd800f680 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dd800f880 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 10 client.16020 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640fea02980 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dc8011e40 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7dd8025040 con 0x5640fe5d51b0 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 10 client.16020 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 20 client.16020 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe5691c0 0x5640fea04fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 4 client.16020 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:21:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640fe8ed0f0 con 0x5640fe5691c0 2024-09-21T06:21:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.019+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe5691c0 0x5640fea04fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.020+0000 7f7dd5d9b640 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe5691c0 0x5640fea04fc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6197a4cecf9413 server_cookie=37245174062ea364 in_seq=0 out_seq=0 2024-09-21T06:21:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.020+0000 7f7dc5ffb640 10 client.16020 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/1034790734 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640fe8ed0f0 con 0x5640fe5691c0 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dc5ffb640 10 client.16020 handle_command_reply: tid=0 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 client.16020 shutdown 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 msgr2=0x5640fe98c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe98c2d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8003fd0 tx=0x7f7dd8009d00 comp rx=0 tx=0).stop 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 shutdown_connections 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640fe5d51b0 0x5640fe98c2d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5640fe5691c0 0x5640fea04fc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640fe5b44d0 0x5640fe98bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 --2- 172.21.15.38:0/1034790734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640fe5ac2f0 0x5640fe98e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dc5ffb640 0 client.16020 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 >> 172.21.15.38:0/1034790734 conn(0x5640fe5c9300 msgr2=0x5640fe977630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 shutdown_connections 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 1 -- 172.21.15.38:0/1034790734 wait complete. 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.262+0000 7f7dec02b740 20 client.16020 trim_cache size 0 max 16384 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:21:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:21:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:21:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 msgr2=0x7f7dcc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 0x7f7dcc0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dd01052e0 tx=0x7f7dd010b5b0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 msgr2=0x7f7de00ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005ab0 tx=0x7f7dd00040c0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 shutdown_connections 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7dcc0b66b0 0x7f7dcc0b8bc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7de0108c30 0x7f7de00fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7de01082e0 0x7f7de00ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 --2- 172.21.15.38:0/189366804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7de01029b0 0x7f7de00ff550 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 >> 172.21.15.38:0/189366804 conn(0x7f7de007a740 msgr2=0x7f7de0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 shutdown_connections 2024-09-21T06:21:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:44.263+0000 7f7de4fe6640 1 -- 172.21.15.38:0/189366804 wait complete. 2024-09-21T06:21:44.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:44 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:44.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:44 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:44 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:21:44.968 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar xf doc.tar 2024-09-21T06:21:45.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:45 smithi174 ceph-mon[34815]: pgmap v381: 97 pgs: 97 active+clean; 183 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 732 op/s 2024-09-21T06:21:45.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:45 smithi044 ceph-mon[34369]: pgmap v381: 97 pgs: 97 active+clean; 183 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 732 op/s 2024-09-21T06:21:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:45 smithi038 ceph-mon[31215]: pgmap v381: 97 pgs: 97 active+clean; 183 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 732 op/s 2024-09-21T06:21:47.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:47 smithi174 ceph-mon[34815]: pgmap v382: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 519 op/s 2024-09-21T06:21:47.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:47 smithi044 ceph-mon[34369]: pgmap v382: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 519 op/s 2024-09-21T06:21:47.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:47 smithi038 ceph-mon[31215]: pgmap v382: 97 pgs: 97 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 519 op/s 2024-09-21T06:21:49.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:49 smithi174 ceph-mon[34815]: pgmap v383: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 514 op/s 2024-09-21T06:21:49.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:49 smithi044 ceph-mon[34369]: pgmap v383: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 514 op/s 2024-09-21T06:21:49.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:49 smithi038 ceph-mon[31215]: pgmap v383: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 514 op/s 2024-09-21T06:21:50.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:21:50.570 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:51.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 -- 172.21.15.38:0/3689665746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad01083a0 msgr2=0x7f4ad01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 --2- 172.21.15.38:0/3689665746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad01083a0 0x7f4ad01087b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009900 tx=0x7f4ac002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:51.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 -- 172.21.15.38:0/3689665746 shutdown_connections 2024-09-21T06:21:51.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 --2- 172.21.15.38:0/3689665746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad0108cf0 0x7f4ad010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 --2- 172.21.15.38:0/3689665746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad01083a0 0x7f4ad01087b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 --2- 172.21.15.38:0/3689665746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 -- 172.21.15.38:0/3689665746 >> 172.21.15.38:0/3689665746 conn(0x7f4ad0079730 msgr2=0x7f4ad0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 -- 172.21.15.38:0/3689665746 shutdown_connections 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 -- 172.21.15.38:0/3689665746 wait complete. 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.039+0000 7f4ad845a640 1 Processor -- start 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 -- start start 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 0x7f4ad019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0112a80 con 0x7f4ad0108cf0 2024-09-21T06:21:51.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0112900 con 0x7f4ad01083a0 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad845a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0112c00 con 0x7f4ad0102a60 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39312/0 (socket says 172.21.15.38:39312) 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 -- 172.21.15.38:0/1618053893 learned_addr learned my addr 172.21.15.38:0/1618053893 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 0x7f4ad019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 -- 172.21.15.38:0/1618053893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 msgr2=0x7f4ad019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 -- 172.21.15.38:0/1618053893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 msgr2=0x7f4ad019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 0x7f4ad019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad69f7640 1 -- 172.21.15.38:0/1618053893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad01a04f0 con 0x7f4ad0108cf0 2024-09-21T06:21:51.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.040+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 0x7f4ad019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ad69f7640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eb10 tx=0x7f4ac800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ac77fe640 1 -- 172.21.15.38:0/1618053893 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8004b20 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad01a07e0 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ac77fe640 1 -- 172.21.15.38:0/1618053893 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ac8004cc0 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ac77fe640 1 -- 172.21.15.38:0/1618053893 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8010720 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.041+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad01a6f40 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.044+0000 7f4ac77fe640 1 -- 172.21.15.38:0/1618053893 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4ac8005020 con 0x7f4ad0108cf0 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.044+0000 7f4ade9ce740 1 Processor -- start 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.044+0000 7f4ade9ce740 1 -- start start 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558552514e50 con 0x5585521d6390 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558552504280 con 0x5585521ce1b0 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558552508090 con 0x5585521f7070 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39318/0 (socket says 172.21.15.38:39318) 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad59f5640 1 -- 172.21.15.38:0/2949461586 learned_addr learned my addr 172.21.15.38:0/2949461586 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:39984/0 (socket says 172.21.15.38:39984) 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ac77fe640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 0x7f4abc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad69f7640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 0x7f4abc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ac77fe640 1 -- 172.21.15.38:0/1618053893 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ac80e7ce0 con 0x7f4ad0108cf0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 -- 172.21.15.38:0/2949461586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 msgr2=0x55855259e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 -- 172.21.15.38:0/2949461586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 msgr2=0x55855259f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad61f6640 1 -- 172.21.15.38:0/2949461586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558552262650 con 0x5585521ce1b0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.045+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.046+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00bc80 tx=0x7f4acc00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf008d8efe9be972 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.046+0000 7f4ad69f7640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 0x7f4abc0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80e5560 tx=0x7f4ac800efd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.046+0000 7f4ac4d9a640 1 -- 172.21.15.38:0/2949461586 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc015070 con 0x5585521ce1b0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.046+0000 7f4ac4d9a640 1 -- 172.21.15.38:0/2949461586 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4acc01a930 con 0x5585521ce1b0 2024-09-21T06:21:51.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.046+0000 7f4ac4d9a640 1 -- 172.21.15.38:0/2949461586 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0119a0 con 0x5585521ce1b0 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- 172.21.15.38:0/2949461586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 msgr2=0x55855259eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00bc80 tx=0x7f4acc00f730 comp rx=0 tx=0).stop 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- 172.21.15.38:0/2949461586 shutdown_connections 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x55855259f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521ce1b0 0x55855259eb90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/2949461586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- 172.21.15.38:0/2949461586 >> 172.21.15.38:0/2949461586 conn(0x5585521eb460 msgr2=0x55855259c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- 172.21.15.38:0/2949461586 shutdown_connections 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- 172.21.15.38:0/2949461586 wait complete. 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 -- start start 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.047+0000 7f4ade9ce740 1 Processor -- start 2024-09-21T06:21:51.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x5585525ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x5585525ae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x5585525ba490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558552365700 con 0x5585521ce1b0 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55855249f110 con 0x5585521d6390 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585525b1160 con 0x5585521f7070 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ade9ce740 10 client.0 _ll_register_callbacks cb 0x5585524b8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x5585525ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x5585525ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39334/0 (socket says 172.21.15.38:39334) 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x5585525ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad59f5640 1 -- 172.21.15.38:0/983057396 learned_addr learned my addr 172.21.15.38:0/983057396 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x5585525ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 -- 172.21.15.38:0/983057396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 msgr2=0x5585525ba490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x5585525ba490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 -- 172.21.15.38:0/983057396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 msgr2=0x5585525ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x5585525ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 -- 172.21.15.38:0/983057396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585524ccc40 con 0x5585521d6390 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x5585525ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x5585525ae650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc00bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04222486aac1682 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.048+0000 7f4ab9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc028060 con 0x5585521d6390 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4acc01aae0 con 0x5585521d6390 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4acc01a930 con 0x5585521d6390 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4acc015070 con 0x5585521d6390 2024-09-21T06:21:51.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 10 client.25679 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5585525bceb0 con 0x5585521d6390 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4acc01a930 con 0x5585521d6390 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4acc0118b0 con 0x5585521d6390 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 10 client.25679 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 20 client.25679 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5585521b59f0 0x5585525c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 4 client.25679 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.049+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558552516da0 con 0x5585521b59f0 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.050+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5585521b59f0 0x5585525c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.050+0000 7f4ab9ffb640 10 client.25679 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:51.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.050+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5585521b59f0 0x5585525c02c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e517eca1771bdcb server_cookie=68d105a4c25082cf in_seq=0 out_seq=0 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/983057396 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558552516da0 con 0x5585521b59f0 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ab9ffb640 10 client.25679 handle_command_reply: tid=0 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 client.25679 shutdown 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 msgr2=0x5585525ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x5585525ae650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006010 tx=0x7f4acc00bfa0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 shutdown_connections 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5585521b59f0 0x5585525c02c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x5585525ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x5585525ae650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/983057396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x5585525ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ab9ffb640 0 client.25679 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:51.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 >> 172.21.15.38:0/983057396 conn(0x5585521eb460 msgr2=0x5585525a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 shutdown_connections 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 1 -- 172.21.15.38:0/983057396 wait complete. 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.051+0000 7f4ade9ce740 20 client.25679 trim_cache size 0 max 16384 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 Processor -- start 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 -- start start 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x55855259bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01afe30 con 0x5585521ce1b0 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01ad640 con 0x5585521d6390 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01ab4b0 con 0x5585521f7070 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39340/0 (socket says 172.21.15.38:39340) 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 -- 172.21.15.38:0/3570757980 learned_addr learned my addr 172.21.15.38:0/3570757980 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x55855259bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 -- 172.21.15.38:0/3570757980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 msgr2=0x55855259c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 -- 172.21.15.38:0/3570757980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 msgr2=0x55855259bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x55855259bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.069+0000 7f4ad59f5640 1 -- 172.21.15.38:0/3570757980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585525bab70 con 0x5585521ce1b0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.070+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0000c00 tx=0x7f4ac002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4497f0df942f4c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.070+0000 7f4abbfff640 1 -- 172.21.15.38:0/3570757980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0035070 con 0x5585521ce1b0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.070+0000 7f4abbfff640 1 -- 172.21.15.38:0/3570757980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ac00318f0 con 0x5585521ce1b0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.070+0000 7f4abbfff640 1 -- 172.21.15.38:0/3570757980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00052e0 con 0x5585521ce1b0 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3570757980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 msgr2=0x55855259fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0000c00 tx=0x7f4ac002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3570757980 shutdown_connections 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521f7070 0x55855259c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521d6390 0x55855259bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3570757980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521ce1b0 0x55855259fd90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3570757980 >> 172.21.15.38:0/3570757980 conn(0x5585521eb460 msgr2=0x55855259f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3570757980 shutdown_connections 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3570757980 wait complete. 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- start start 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 Processor -- start 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 0x5585525c1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521f7070 0x5585525c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01abb00 con 0x5585521d6390 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01acf70 con 0x5585521f7070 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad01ac1d0 con 0x5585521ce1b0 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.071+0000 7f4ade9ce740 10 client.0 _ll_register_callbacks cb 0x7f4ac0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39356/0 (socket says 172.21.15.38:39356) 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 -- 172.21.15.38:0/3585920796 learned_addr learned my addr 172.21.15.38:0/3585920796 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521f7070 0x5585525c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 0x5585525c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 -- 172.21.15.38:0/3585920796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 msgr2=0x5585525c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 0x5585525c1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 -- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521f7070 msgr2=0x5585525c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521f7070 0x5585525c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 -- 172.21.15.38:0/3585920796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558552629b40 con 0x5585521d6390 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 0x5585525c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ad61f6640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00b800 tx=0x7f4acc0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54bd0b893bb7593 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ab9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc03a060 con 0x5585521d6390 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4acc0115f0 con 0x5585521d6390 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.072+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ac00318f0 con 0x5585521d6390 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4acc028070 con 0x5585521d6390 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:51.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55855262add0 con 0x5585521d6390 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ac00318f0 con 0x5585521d6390 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4acc0244e0 con 0x5585521d6390 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 20 client.16038 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55855218ada0 0x55855262d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 4 client.16038 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558552512850 con 0x55855218ada0 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.073+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55855218ada0 0x55855262d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ab9ffb640 10 client.16038 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ad59f5640 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55855218ada0 0x55855262d530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf81403e1f3fb142 server_cookie=dfe011805fbe8f1 in_seq=0 out_seq=0 2024-09-21T06:21:51.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ab9ffb640 1 -- 172.21.15.38:0/3585920796 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x558552512850 con 0x55855218ada0 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ab9ffb640 10 client.16038 handle_command_reply: tid=0 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 client.16038 shutdown 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 msgr2=0x5585525c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00b800 tx=0x7f4acc0114b0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 shutdown_connections 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585521f7070 0x5585525c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585521d6390 0x5585525c1980 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55855218ada0 0x55855262d530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 --2- 172.21.15.38:0/3585920796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585521ce1b0 0x5585525c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ab9ffb640 0 client.16038 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:51.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.074+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 >> 172.21.15.38:0/3585920796 conn(0x5585521eb460 msgr2=0x5585525a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 shutdown_connections 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ade9ce740 1 -- 172.21.15.38:0/3585920796 wait complete. 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ade9ce740 20 client.16038 trim_cache size 0 max 16384 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:21:51.095 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:51.096 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:21:51.097 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:21:51.098 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 msgr2=0x7f4abc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 0x7f4abc0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80e5560 tx=0x7f4ac800efd0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 msgr2=0x7f4ad019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eb10 tx=0x7f4ac800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 shutdown_connections 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4abc0b6680 0x7f4abc0b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ad0108cf0 0x7f4ad019fdc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad01083a0 0x7f4ad019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 --2- 172.21.15.38:0/1618053893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad0102a60 0x7f4ad019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:51.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.075+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 >> 172.21.15.38:0/1618053893 conn(0x7f4ad0079730 msgr2=0x7f4ad0101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:51.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.076+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 shutdown_connections 2024-09-21T06:21:51.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:51.076+0000 7f4ad845a640 1 -- 172.21.15.38:0/1618053893 wait complete. 2024-09-21T06:21:51.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:51 smithi038 ceph-mon[31215]: pgmap v384: 97 pgs: 97 active+clean; 156 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 483 op/s 2024-09-21T06:21:51.256 INFO:tasks.workunit.client.0.smithi038.stderr:+ sync 2024-09-21T06:21:51.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:51 smithi174 ceph-mon[34815]: pgmap v384: 97 pgs: 97 active+clean; 156 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 483 op/s 2024-09-21T06:21:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:51 smithi044 ceph-mon[34369]: pgmap v384: 97 pgs: 97 active+clean; 156 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 483 op/s 2024-09-21T06:21:52.936 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:21:52.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:21:53.211 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:53.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:53 smithi038 ceph-mon[31215]: pgmap v385: 97 pgs: 97 active+clean; 160 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 442 op/s 2024-09-21T06:21:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:53 smithi174 ceph-mon[34815]: pgmap v385: 97 pgs: 97 active+clean; 160 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 442 op/s 2024-09-21T06:21:53.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:53 smithi044 ceph-mon[34369]: pgmap v385: 97 pgs: 97 active+clean; 160 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 442 op/s 2024-09-21T06:21:53.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 -- 172.21.15.38:0/2877386052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68381047c0 msgr2=0x7f6838104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:53.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 --2- 172.21.15.38:0/2877386052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68381047c0 0x7f6838104bd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6828009ca0 tx=0x7f682802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 -- 172.21.15.38:0/2877386052 shutdown_connections 2024-09-21T06:21:53.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 --2- 172.21.15.38:0/2877386052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f683810dc20 0x7f6838110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 --2- 172.21.15.38:0/2877386052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 --2- 172.21.15.38:0/2877386052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68381047c0 0x7f6838104bd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 -- 172.21.15.38:0/2877386052 >> 172.21.15.38:0/2877386052 conn(0x7f68380fe2c0 msgr2=0x7f6838100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:53.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 -- 172.21.15.38:0/2877386052 shutdown_connections 2024-09-21T06:21:53.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.701+0000 7f683759e640 1 -- 172.21.15.38:0/2877386052 wait complete. 2024-09-21T06:21:53.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.702+0000 7f683759e640 1 Processor -- start 2024-09-21T06:21:53.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.702+0000 7f683759e640 1 -- start start 2024-09-21T06:21:53.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68381047c0 0x7f683819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f68381139e0 con 0x7f683810dc20 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6838113860 con 0x7f6838105110 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683759e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6838113b60 con 0x7f68381047c0 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39370/0 (socket says 172.21.15.38:39370) 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 -- 172.21.15.38:0/68523367 learned_addr learned my addr 172.21.15.38:0/68523367 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6835d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f683659c640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68381047c0 0x7f683819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:53.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 -- 172.21.15.38:0/68523367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68381047c0 msgr2=0x7f683819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68381047c0 0x7f683819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 -- 172.21.15.38:0/68523367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 msgr2=0x7f683819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 -- 172.21.15.38:0/68523367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68381a0300 con 0x7f683810dc20 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6835d9b640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.703+0000 7f6836d9d640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f683000d750 tx=0x7f683000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.704+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830017070 con 0x7f683810dc20 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.704+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68300054f0 con 0x7f683810dc20 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.704+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830004cd0 con 0x7f683810dc20 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.704+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68381a05f0 con 0x7f683810dc20 2024-09-21T06:21:53.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.704+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68381a6d50 con 0x7f683810dc20 2024-09-21T06:21:53.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.705+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838104bd0 con 0x7f683810dc20 2024-09-21T06:21:53.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.707+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6830009bd0 con 0x7f683810dc20 2024-09-21T06:21:53.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.707+0000 7f682f7fe640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 0x7f68240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:53.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.707+0000 7f683659c640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 0x7f68240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:53.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.707+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f68300e74e0 con 0x7f683810dc20 2024-09-21T06:21:53.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.708+0000 7f683659c640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 0x7f68240b8c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6828005e30 tx=0x7f6828009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:53.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.711+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68300b1eb0 con 0x7f683810dc20 2024-09-21T06:21:53.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.938+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f683819b4c0 con 0x7f683810dc20 2024-09-21T06:21:53.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.939+0000 7f682f7fe640 1 -- 172.21.15.38:0/68523367 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11920 (secure 0 0 0) 0x7f68300b6df0 con 0x7f683810dc20 2024-09-21T06:21:53.943 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:21:53.943 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"btime":"2024-09-21T06:21:43:078980+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:21:42.404223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:21:53.943 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 28 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 msgr2=0x7f68240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 0x7f68240b8c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6828005e30 tx=0x7f6828009360 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 msgr2=0x7f683819fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f683000d750 tx=0x7f683000dc10 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 shutdown_connections 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f68240b6700 0x7f68240b8c10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f683810dc20 0x7f683819fbd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6838105110 0x7f683819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 --2- 172.21.15.38:0/68523367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68381047c0 0x7f683819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 >> 172.21.15.38:0/68523367 conn(0x7f68380fe2c0 msgr2=0x7f6838107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 shutdown_connections 2024-09-21T06:21:53.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:53.942+0000 7f683759e640 1 -- 172.21.15.38:0/68523367 wait complete. 2024-09-21T06:21:54.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar c linux-4.0.5 2024-09-21T06:21:54.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:54 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/68523367' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:54.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:54 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/68523367' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:54.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:54 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/68523367' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:21:54.530 INFO:tasks.workunit.client.0.smithi038.stdout:Ok 2024-09-21T06:21:54.531 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo Ok 2024-09-21T06:21:54.531 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:21:54.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:21:54.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:21:54.909 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:55.352 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:55 smithi038 ceph-mon[31215]: pgmap v386: 97 pgs: 97 active+clean; 173 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 552 op/s 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 -- 172.21.15.38:0/2141590929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae8108d10 msgr2=0x7f4ae810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/2141590929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae8108d10 0x7f4ae810f540 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009900 tx=0x7f4ae002a410 comp rx=0 tx=0).stop 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 -- 172.21.15.38:0/2141590929 shutdown_connections 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/2141590929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae8108d10 0x7f4ae810f540 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/2141590929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae81083c0 0x7f4ae81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/2141590929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 -- 172.21.15.38:0/2141590929 >> 172.21.15.38:0/2141590929 conn(0x7f4ae80796d0 msgr2=0x7f4ae8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 -- 172.21.15.38:0/2141590929 shutdown_connections 2024-09-21T06:21:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.363+0000 7f4aed1b1640 1 -- 172.21.15.38:0/2141590929 wait complete. 2024-09-21T06:21:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 Processor -- start 2024-09-21T06:21:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 -- start start 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 0x7f4ae819bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8112b70 con 0x7f4ae81083c0 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81129f0 con 0x7f4ae8108d10 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4aed1b1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8112cf0 con 0x7f4ae8102ad0 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39384/0 (socket says 172.21.15.38:39384) 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4ae659c640 1 -- 172.21.15.38:0/3018921538 learned_addr learned my addr 172.21.15.38:0/3018921538 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.364+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 0x7f4ae819bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 -- 172.21.15.38:0/3018921538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 msgr2=0x7f4ae819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 -- 172.21.15.38:0/3018921538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 msgr2=0x7f4ae819bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 0x7f4ae819bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 -- 172.21.15.38:0/3018921538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae81a66d0 con 0x7f4ae81083c0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 0x7f4ae819bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e9f0 tx=0x7f4ad000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4adffff640 1 -- 172.21.15.38:0/3018921538 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ccc0 con 0x7f4ae81083c0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4adffff640 1 -- 172.21.15.38:0/3018921538 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ad0010900 con 0x7f4ae81083c0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4adffff640 1 -- 172.21.15.38:0/3018921538 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0018900 con 0x7f4ae81083c0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae81a69c0 con 0x7f4ae81083c0 2024-09-21T06:21:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.365+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae81a6eb0 con 0x7f4ae81083c0 2024-09-21T06:21:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 Processor -- start 2024-09-21T06:21:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 -- start start 2024-09-21T06:21:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4adffff640 1 -- 172.21.15.38:0/3018921538 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4ad0010ab0 con 0x7f4ae81083c0 2024-09-21T06:21:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067a982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067a98d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562067a0eea0 con 0x5620676c81b0 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5620679fe2d0 con 0x5620676f1070 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.368+0000 7f4af3725740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562067a020e0 con 0x5620676d0390 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067a982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39400/0 (socket says 172.21.15.38:39400) 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/2349188073 learned_addr learned my addr 172.21.15.38:0/2349188073 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae659c640 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067a98d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/2349188073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 msgr2=0x562067a98d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067a98d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/2349188073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 msgr2=0x562067a982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067a982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/2349188073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56206775c650 con 0x5620676c81b0 2024-09-21T06:21:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c450 tx=0x7f4ad800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3cbba19b938b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4adffff640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 0x7f4ad40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.369+0000 7f4add7fa640 1 -- 172.21.15.38:0/2349188073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad801a070 con 0x5620676c81b0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.370+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 0x7f4ad40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.370+0000 7f4add7fa640 1 -- 172.21.15.38:0/2349188073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ad8007900 con 0x5620676c81b0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.370+0000 7f4add7fa640 1 -- 172.21.15.38:0/2349188073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8015800 con 0x5620676c81b0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.370+0000 7f4adffff640 1 -- 172.21.15.38:0/3018921538 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ad00e7a00 con 0x7f4ae81083c0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- 172.21.15.38:0/2349188073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 msgr2=0x562067a98800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 0x7f4ad40b8bc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0006010 tx=0x7f4ae0005df0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c450 tx=0x7f4ad800c910 comp rx=0 tx=0).stop 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- 172.21.15.38:0/2349188073 shutdown_connections 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067a98d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067a98800 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 --2- 172.21.15.38:0/2349188073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067a982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- 172.21.15.38:0/2349188073 >> 172.21.15.38:0/2349188073 conn(0x5620676e5460 msgr2=0x562067a961b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- 172.21.15.38:0/2349188073 shutdown_connections 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- 172.21.15.38:0/2349188073 wait complete. 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 -- start start 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.371+0000 7f4af3725740 1 Processor -- start 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067aa3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067aafd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56206785f700 con 0x5620676c81b0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562067999160 con 0x5620676f1070 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562067aa6aa0 con 0x5620676d0390 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4af3725740 10 client.0 _ll_register_callbacks cb 0x5620679b29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067aa3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39416/0 (socket says 172.21.15.38:39416) 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/3754430298 learned_addr learned my addr 172.21.15.38:0/3754430298 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067aafd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 msgr2=0x562067aa3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067aa3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/3754430298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 msgr2=0x562067aafd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067aafd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.372+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/3754430298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620679c6c90 con 0x5620676c81b0 2024-09-21T06:21:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8004a80 tx=0x7f4ad8007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533628dec493496a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8024060 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ad8015790 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad8007900 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ad801a070 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4af3725740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562067ab2750 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ad8007900 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.373+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4ad80297a0 con 0x5620676c81b0 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 10 client.16056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 20 client.16056 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5620676af9f0 0x562067ab5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 4 client.16056 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562067a10df0 con 0x5620676af9f0 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5620676af9f0 0x562067ab5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5620676af9f0 0x562067ab5b10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f14f45c351a0feac server_cookie=fc6a8d97fd458afd in_seq=0 out_seq=0 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.374+0000 7f4ace7fc640 10 client.16056 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3754430298 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562067a10df0 con 0x5620676af9f0 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4ace7fc640 10 client.16056 handle_command_reply: tid=0 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 client.16056 shutdown 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 msgr2=0x562067aa3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8004a80 tx=0x7f4ad8007ce0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 shutdown_connections 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5620676af9f0 0x562067ab5b10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676f1070 0x562067aafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676d0390 0x562067aa3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 --2- 172.21.15.38:0/3754430298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aa3970 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4ace7fc640 0 client.16056 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 >> 172.21.15.38:0/3754430298 conn(0x5620676e5460 msgr2=0x562067a9b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 shutdown_connections 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 1 -- 172.21.15.38:0/3754430298 wait complete. 2024-09-21T06:21:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.375+0000 7f4af3725740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 Processor -- start 2024-09-21T06:21:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 -- start start 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676c81b0 0x562067aa3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 0x562067a9b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81b2180 con 0x5620676f1070 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81af990 con 0x5620676d0390 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4af3725740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ad7e0 con 0x5620676c81b0 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4ae759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 0x562067a9b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4ae759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 0x562067a9b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39422/0 (socket says 172.21.15.38:39422) 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.389+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40074/0 (socket says 172.21.15.38:40074) 2024-09-21T06:21:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae759e640 1 -- 172.21.15.38:0/1481435927 learned_addr learned my addr 172.21.15.38:0/1481435927 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676c81b0 0x562067aa3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 -- 172.21.15.38:0/1481435927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676c81b0 msgr2=0x562067aa3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676c81b0 0x562067aa3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 -- 172.21.15.38:0/1481435927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 msgr2=0x562067a9b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 0x562067a9b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 -- 172.21.15.38:0/1481435927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562067aa4c30 con 0x5620676d0390 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4ae659c640 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00e51d0 tx=0x7f4ad00a9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb95bf507a6564e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4adcff9640 1 -- 172.21.15.38:0/1481435927 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00ad040 con 0x5620676d0390 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4adcff9640 1 -- 172.21.15.38:0/1481435927 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ad0010e20 con 0x5620676d0390 2024-09-21T06:21:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.390+0000 7f4adcff9640 1 -- 172.21.15.38:0/1481435927 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ce60 con 0x5620676d0390 2024-09-21T06:21:55.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:55 smithi174 ceph-mon[34815]: pgmap v386: 97 pgs: 97 active+clean; 173 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 552 op/s 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 -- 172.21.15.38:0/1481435927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 msgr2=0x562067a9b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00e51d0 tx=0x7f4ad00a9040 comp rx=0 tx=0).stop 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 -- 172.21.15.38:0/1481435927 shutdown_connections 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676f1070 0x562067a9b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067a9b3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 --2- 172.21.15.38:0/1481435927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676c81b0 0x562067aa3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 -- 172.21.15.38:0/1481435927 >> 172.21.15.38:0/1481435927 conn(0x5620676e5460 msgr2=0x562067aa3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 -- 172.21.15.38:0/1481435927 shutdown_connections 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.391+0000 7f4af3725740 1 -- 172.21.15.38:0/1481435927 wait complete. 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 -- start start 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 Processor -- start 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067aa7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 0x562067aa8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ade50 con 0x5620676c81b0 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81af2c0 con 0x5620676d0390 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81ae520 con 0x5620676f1070 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4af3725740 10 client.0 _ll_register_callbacks cb 0x7f4ad8018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4ae759e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 0x562067aa8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4ae6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39436/0 (socket says 172.21.15.38:39436) 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4ae6d9d640 1 -- 172.21.15.38:0/3528091160 learned_addr learned my addr 172.21.15.38:0/3528091160 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.392+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067aa7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 -- 172.21.15.38:0/3528091160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 msgr2=0x562067aa7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067aa7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 -- 172.21.15.38:0/3528091160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 msgr2=0x562067aac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 -- 172.21.15.38:0/3528091160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562067b1f2d0 con 0x5620676f1070 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae659c640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067aa7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ae759e640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 0x562067aa8320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00314b0 tx=0x7f4ae0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4841bcb70693829d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ace7fc640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0035040 con 0x5620676f1070 2024-09-21T06:21:55.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ae0003980 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562067a0c8a0 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ae0003b80 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4af3725740 10 client.25660 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.393+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562067b20450 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x562067a0c8a0 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4ae005b070 con 0x5620676f1070 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 10 client.25660 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 10 client.25660 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 20 client.25660 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562067684da0 0x562067b22cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 4 client.25660 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562067a09cd0 con 0x562067684da0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.394+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562067684da0 0x562067b22cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4ace7fc640 10 client.25660 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4ae6d9d640 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562067684da0 0x562067b22cf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1960884e3ba7ede0 server_cookie=97c87be5f75ce9b8 in_seq=0 out_seq=0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4ace7fc640 1 -- 172.21.15.38:0/3528091160 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562067a09cd0 con 0x562067684da0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4ace7fc640 10 client.25660 handle_command_reply: tid=0 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 client.25660 shutdown 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 msgr2=0x562067aa8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 0x562067aa8320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00314b0 tx=0x7f4ae0009260 comp rx=0 tx=0).stop 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 shutdown_connections 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562067684da0 0x562067b22cf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5620676f1070 0x562067aa8320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5620676d0390 0x562067aa7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 --2- 172.21.15.38:0/3528091160 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5620676c81b0 0x562067aac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4ace7fc640 0 client.25660 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 >> 172.21.15.38:0/3528091160 conn(0x5620676e5460 msgr2=0x562067aa4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 shutdown_connections 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.395+0000 7f4af3725740 1 -- 172.21.15.38:0/3528091160 wait complete. 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4af3725740 20 client.25660 trim_cache size 0 max 16384 2024-09-21T06:21:55.403 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 msgr2=0x7f4ad40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 0x7f4ad40b8bc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0006010 tx=0x7f4ae0005df0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 msgr2=0x7f4ae819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000e9f0 tx=0x7f4ad000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 shutdown_connections 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ad40b66b0 0x7f4ad40b8bc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae8108d10 0x7f4ae819bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae81083c0 0x7f4ae819b980 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 --2- 172.21.15.38:0/3018921538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ae8102ad0 0x7f4ae819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 >> 172.21.15.38:0/3018921538 conn(0x7f4ae80796d0 msgr2=0x7f4ae8106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:55.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 shutdown_connections 2024-09-21T06:21:55.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:55.396+0000 7f4aed1b1640 1 -- 172.21.15.38:0/3018921538 wait complete. 2024-09-21T06:21:55.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:55 smithi044 ceph-mon[34369]: pgmap v386: 97 pgs: 97 active+clean; 173 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 552 op/s 2024-09-21T06:21:56.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:21:56.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:56 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:56.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:56 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:56.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:56 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:21:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 -- 172.21.15.38:0/660765983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31941083a0 msgr2=0x7f31941087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 --2- 172.21.15.38:0/660765983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31941083a0 0x7f31941087b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3188009900 tx=0x7f318802a410 comp rx=0 tx=0).stop 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 -- 172.21.15.38:0/660765983 shutdown_connections 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 --2- 172.21.15.38:0/660765983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 --2- 172.21.15.38:0/660765983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31941083a0 0x7f31941087b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 --2- 172.21.15.38:0/660765983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3194102a60 0x7f3194102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 -- 172.21.15.38:0/660765983 >> 172.21.15.38:0/660765983 conn(0x7f3194079730 msgr2=0x7f3194079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 -- 172.21.15.38:0/660765983 shutdown_connections 2024-09-21T06:21:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.134+0000 7f319b8b4640 1 -- 172.21.15.38:0/660765983 wait complete. 2024-09-21T06:21:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 Processor -- start 2024-09-21T06:21:57.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 -- start start 2024-09-21T06:21:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31941083a0 0x7f319419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3194112a80 con 0x7f3194102a60 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3194112900 con 0x7f3194108cf0 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f319b8b4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3194112c00 con 0x7f31941083a0 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3199650640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3199650640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39458/0 (socket says 172.21.15.38:39458) 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3199650640 1 -- 172.21.15.38:0/2509494223 learned_addr learned my addr 172.21.15.38:0/2509494223 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3199e51640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3198e4f640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31941083a0 0x7f319419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.135+0000 7f3199650640 1 -- 172.21.15.38:0/2509494223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31941083a0 msgr2=0x7f319419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199650640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31941083a0 0x7f319419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199650640 1 -- 172.21.15.38:0/2509494223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 msgr2=0x7f319419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199650640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199650640 1 -- 172.21.15.38:0/2509494223 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941a0510 con 0x7f3194102a60 2024-09-21T06:21:57.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199e51640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f3199650640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f318400db80 tx=0x7f318400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f31927fc640 1 -- 172.21.15.38:0/2509494223 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184017070 con 0x7f3194102a60 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f31927fc640 1 -- 172.21.15.38:0/2509494223 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3184003b70 con 0x7f3194102a60 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941a0800 con 0x7f3194102a60 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f31927fc640 1 -- 172.21.15.38:0/2509494223 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31840106c0 con 0x7f3194102a60 2024-09-21T06:21:57.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.136+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941a6f60 con 0x7f3194102a60 2024-09-21T06:21:57.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 Processor -- start 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 -- start start 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31927fc640 1 -- 172.21.15.38:0/2509494223 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3184004020 con 0x7f3194102a60 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 0x560676c5f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560676bd5ea0 con 0x5606768b8070 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560676bc52d0 con 0x560676897390 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.139+0000 7f31a1e28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560676bc90e0 con 0x56067688f1b0 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3199e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 0x560676c5f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40112/0 (socket says 172.21.15.38:40112) 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3199e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 0x560676c5f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39462/0 (socket says 172.21.15.38:39462) 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 -- 172.21.15.38:0/1847694037 learned_addr learned my addr 172.21.15.38:0/1847694037 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3199650640 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 -- 172.21.15.38:0/1847694037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 msgr2=0x560676c5f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 -- 172.21.15.38:0/1847694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 msgr2=0x560676c5f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 0x560676c5f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 -- 172.21.15.38:0/1847694037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560676923650 con 0x560676897390 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3199650640 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f3198e4f640 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f319406aaa0 tx=0x7f3188005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b51fc95f1f3e9970 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f31927fc640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 0x7f317c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.140+0000 7f317b7fe640 1 -- 172.21.15.38:0/1847694037 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188040070 con 0x560676897390 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f317b7fe640 1 -- 172.21.15.38:0/1847694037 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3188004020 con 0x560676897390 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f3199e51640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 0x7f317c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f317b7fe640 1 -- 172.21.15.38:0/1847694037 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188035040 con 0x560676897390 2024-09-21T06:21:57.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f31927fc640 1 -- 172.21.15.38:0/2509494223 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f31840e7400 con 0x7f3194102a60 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f31a1e28740 1 -- 172.21.15.38:0/1847694037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 msgr2=0x560676c5fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f319406aaa0 tx=0x7f3188005f10 comp rx=0 tx=0).stop 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.141+0000 7f3199e51640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 0x7f317c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f318c012560 tx=0x7f318c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 -- 172.21.15.38:0/1847694037 shutdown_connections 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560676897390 0x560676c5fd40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1847694037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5606768b8070 0x560676c5f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 -- 172.21.15.38:0/1847694037 >> 172.21.15.38:0/1847694037 conn(0x5606768ac460 msgr2=0x560676c5d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 -- 172.21.15.38:0/1847694037 shutdown_connections 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 -- 172.21.15.38:0/1847694037 wait complete. 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 -- start start 2024-09-21T06:21:57.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.142+0000 7f31a1e28740 1 Processor -- start 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56067688f1b0 0x560676c6a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560676897390 0x560676c6ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560676a26700 con 0x56067688f1b0 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560676b60160 con 0x5606768b8070 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560676c6da40 con 0x560676897390 2024-09-21T06:21:57.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f31a1e28740 10 client.0 _ll_register_callbacks cb 0x560676b799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199650640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56067688f1b0 0x560676c6a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40126/0 (socket says 172.21.15.38:40126) 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 -- 172.21.15.38:0/1838223219 learned_addr learned my addr 172.21.15.38:0/1838223219 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3198e4f640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560676897390 0x560676c6ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 -- 172.21.15.38:0/1838223219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560676897390 msgr2=0x560676c6ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560676897390 0x560676c6ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 -- 172.21.15.38:0/1838223219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56067688f1b0 msgr2=0x560676c6a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56067688f1b0 0x560676c6a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.143+0000 7f3199e51640 1 -- 172.21.15.38:0/1838223219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560676b8dc90 con 0x5606768b8070 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3199e51640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f318c003670 tx=0x7f318c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6473dcf4d390ab75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3178ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c00f7d0 con 0x5606768b8070 2024-09-21T06:21:57.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f318c00f970 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3188004020 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f318c00fb70 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f31a1e28740 10 client.25721 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560676c7db80 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.144+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3188004020 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f318c027070 con 0x5606768b8070 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 10 client.25721 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 10 client.25721 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 20 client.25721 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768769f0 0x560676c81150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 4 client.25721 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560676bd7df0 con 0x5606768769f0 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f3199650640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768769f0 0x560676c81150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f3178ff9640 10 client.25721 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.145+0000 7f3199650640 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768769f0 0x560676c81150 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0131e0a0de87e47 server_cookie=f29b8065b3aad8d4 in_seq=0 out_seq=0 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f3178ff9640 1 -- 172.21.15.38:0/1838223219 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560676bd7df0 con 0x5606768769f0 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f3178ff9640 10 client.25721 handle_command_reply: tid=0 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 client.25721 shutdown 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 msgr2=0x560676c76d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f318c003670 tx=0x7f318c004730 comp rx=0 tx=0).stop 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 shutdown_connections 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768769f0 0x560676c81150 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768b8070 0x560676c76d30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560676897390 0x560676c6ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 --2- 172.21.15.38:0/1838223219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56067688f1b0 0x560676c6a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f3178ff9640 0 client.25721 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 >> 172.21.15.38:0/1838223219 conn(0x5606768ac460 msgr2=0x560676c624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 shutdown_connections 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 1 -- 172.21.15.38:0/1838223219 wait complete. 2024-09-21T06:21:57.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.147+0000 7f31a1e28740 20 client.25721 trim_cache size 0 max 16384 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.160+0000 7f31a1e28740 1 Processor -- start 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 -- start start 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768769f0 0x560676c60a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f31941afe80 con 0x560676897390 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31941ad690 con 0x5606768769f0 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f31a1e28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31941ab4e0 con 0x56067688f1b0 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199650640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768769f0 0x560676c60a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39490/0 (socket says 172.21.15.38:39490) 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 -- 172.21.15.38:0/2989447902 learned_addr learned my addr 172.21.15.38:0/2989447902 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3198e4f640 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 -- 172.21.15.38:0/2989447902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 msgr2=0x560676c5c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 -- 172.21.15.38:0/2989447902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768769f0 msgr2=0x560676c60a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768769f0 0x560676c60a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.161+0000 7f3199e51640 1 -- 172.21.15.38:0/2989447902 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560676c57440 con 0x560676897390 2024-09-21T06:21:57.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.162+0000 7f3199e51640 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f318c0092e0 tx=0x7f318c003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec77b06799e1b91c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.162+0000 7f317affd640 1 -- 172.21.15.38:0/2989447902 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c036070 con 0x560676897390 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.162+0000 7f317affd640 1 -- 172.21.15.38:0/2989447902 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f318c00fe10 con 0x560676897390 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.162+0000 7f317affd640 1 -- 172.21.15.38:0/2989447902 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c029910 con 0x560676897390 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- 172.21.15.38:0/2989447902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 msgr2=0x560676c5cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f318c0092e0 tx=0x7f318c003e40 comp rx=0 tx=0).stop 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- 172.21.15.38:0/2989447902 shutdown_connections 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c5cca0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56067688f1b0 0x560676c5c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 --2- 172.21.15.38:0/2989447902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606768769f0 0x560676c60a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- 172.21.15.38:0/2989447902 >> 172.21.15.38:0/2989447902 conn(0x5606768ac460 msgr2=0x560676c602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- 172.21.15.38:0/2989447902 shutdown_connections 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- 172.21.15.38:0/2989447902 wait complete. 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 -- start start 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.163+0000 7f31a1e28740 1 Processor -- start 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 0x560676c6ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067688f1b0 0x560676c6f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c6f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f31941abb50 con 0x560676897390 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31941acfc0 con 0x56067688f1b0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31941ac220 con 0x5606768769f0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f31a1e28740 10 client.0 _ll_register_callbacks cb 0x7f318c009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199650640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 0x560676c6ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c6f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3198e4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067688f1b0 0x560676c6f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199650640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 0x560676c6ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:53986/0 (socket says 172.21.15.38:53986) 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199650640 1 -- 172.21.15.38:0/3575056630 learned_addr learned my addr 172.21.15.38:0/3575056630 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 -- 172.21.15.38:0/3575056630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 msgr2=0x560676c6ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 0x560676c6ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 -- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067688f1b0 msgr2=0x560676c6f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067688f1b0 0x560676c6f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.164+0000 7f3199e51640 1 -- 172.21.15.38:0/3575056630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560676ceab50 con 0x560676897390 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3199e51640 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c6f670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f318c012df0 tx=0x7f318c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac137f84b7e6677f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c03e030 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f318c01f940 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f318c00fe10 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f318c048050 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f31a1e28740 10 client.16080 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560676cebd60 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f318c00fe10 con 0x560676897390 2024-09-21T06:21:57.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.165+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f318c027070 con 0x560676897390 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 10 client.16080 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 20 client.16080 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768b8070 0x560676cee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 4 client.16080 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560676bd38a0 con 0x5606768b8070 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f3199650640 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768b8070 0x560676cee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f3178ff9640 10 client.16080 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f3199650640 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768b8070 0x560676cee3b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8c6741576caf09 server_cookie=3e580f21153619a in_seq=0 out_seq=0 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f3178ff9640 1 -- 172.21.15.38:0/3575056630 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560676bd38a0 con 0x5606768b8070 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f3178ff9640 10 client.16080 handle_command_reply: tid=0 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.166+0000 7f31a1e28740 1 client.16080 shutdown 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 msgr2=0x560676c6f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c6f670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f318c012df0 tx=0x7f318c00fa00 comp rx=0 tx=0).stop 2024-09-21T06:21:57.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 shutdown_connections 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5606768b8070 0x560676cee3b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560676897390 0x560676c6f670 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067688f1b0 0x560676c6f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 --2- 172.21.15.38:0/3575056630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606768769f0 0x560676c6ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 >> 172.21.15.38:0/3575056630 conn(0x5606768ac460 msgr2=0x560676c6bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f3178ff9640 0 client.16080 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 shutdown_connections 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 1 -- 172.21.15.38:0/3575056630 wait complete. 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f31a1e28740 20 client.16080 trim_cache size 0 max 16384 2024-09-21T06:21:57.173 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 msgr2=0x7f317c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 0x7f317c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f318c012560 tx=0x7f318c005f90 comp rx=0 tx=0).stop 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 msgr2=0x7f319419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.167+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f318400db80 tx=0x7f318400b630 comp rx=0 tx=0).stop 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 shutdown_connections 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f317c0b6680 0x7f317c0b8b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3194108cf0 0x7f319419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31941083a0 0x7f319419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 --2- 172.21.15.38:0/2509494223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3194102a60 0x7f319419a5a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 >> 172.21.15.38:0/2509494223 conn(0x7f3194079730 msgr2=0x7f319406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 shutdown_connections 2024-09-21T06:21:57.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:57.168+0000 7f319b8b4640 1 -- 172.21.15.38:0/2509494223 wait complete. 2024-09-21T06:21:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 -- 172.21.15.38:0/2341531300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103b10 msgr2=0x7f1d1c103f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2341531300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103b10 0x7f1d1c103f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009ca0 tx=0x7f1d0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 -- 172.21.15.38:0/2341531300 shutdown_connections 2024-09-21T06:21:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2341531300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c109d90 0x7f1d1c1105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2341531300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109440 0x7f1d1c109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2341531300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c103b10 0x7f1d1c103f20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 -- 172.21.15.38:0/2341531300 >> 172.21.15.38:0/2341531300 conn(0x7f1d1c0ff510 msgr2=0x7f1d1c101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.364+0000 7f1d21c70640 1 -- 172.21.15.38:0/2341531300 shutdown_connections 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.365+0000 7f1d21c70640 1 -- 172.21.15.38:0/2341531300 wait complete. 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.365+0000 7f1d21c70640 1 Processor -- start 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.365+0000 7f1d21c70640 1 -- start start 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c103b10 0x7f1d1c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109d90 0x7f1d1c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113b90 con 0x7f1d1c109440 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113a10 con 0x7f1d1c109d90 2024-09-21T06:21:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c113d10 con 0x7f1d1c103b10 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39502/0 (socket says 172.21.15.38:39502) 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 -- 172.21.15.38:0/2361027372 learned_addr learned my addr 172.21.15.38:0/2361027372 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109d90 0x7f1d1c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c103b10 0x7f1d1c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 -- 172.21.15.38:0/2361027372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c103b10 msgr2=0x7f1d1c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c103b10 0x7f1d1c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 -- 172.21.15.38:0/2361027372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109d90 msgr2=0x7f1d1c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109d90 0x7f1d1c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 -- 172.21.15.38:0/2361027372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c1a0540 con 0x7f1d1c109440 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d1affd640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000e9f0 tx=0x7f1d1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d18ff9640 1 -- 172.21.15.38:0/2361027372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000ccc0 con 0x7f1d1c109440 2024-09-21T06:21:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d18ff9640 1 -- 172.21.15.38:0/2361027372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d10010900 con 0x7f1d1c109440 2024-09-21T06:21:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.366+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c1a0830 con 0x7f1d1c109440 2024-09-21T06:21:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.367+0000 7f1d18ff9640 1 -- 172.21.15.38:0/2361027372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10018900 con 0x7f1d1c109440 2024-09-21T06:21:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.367+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c1a6fc0 con 0x7f1d1c109440 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.369+0000 7f1d18ff9640 1 -- 172.21.15.38:0/2361027372 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1d10010ab0 con 0x7f1d1c109440 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.369+0000 7f1d28bdd740 1 Processor -- start 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.369+0000 7f1d28bdd740 1 -- start start 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42dd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557eb42516f0 con 0x557eb3f371b0 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557eb4240b20 con 0x557eb3f164d0 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557eb4244930 con 0x557eb3f0e2f0 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39514/0 (socket says 172.21.15.38:39514) 2024-09-21T06:21:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1215150304 learned_addr learned my addr 172.21.15.38:0/1215150304 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1affd640 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1215150304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 msgr2=0x557eb42dcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42dcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1215150304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 msgr2=0x557eb42dd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42dd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 -- 172.21.15.38:0/1215150304 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb4206530 con 0x557eb3f371b0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d18ff9640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 0x7f1d040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400b6b0 tx=0x7f1d14004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769c20942dcf2a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.370+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 0x7f1d040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.371+0000 7f1d18ff9640 1 -- 172.21.15.38:0/2361027372 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d100e7a70 con 0x7f1d1c109440 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.371+0000 7f1d01ffb640 1 -- 172.21.15.38:0/1215150304 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14003b20 con 0x557eb3f371b0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.371+0000 7f1d01ffb640 1 -- 172.21.15.38:0/1215150304 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d14015070 con 0x557eb3f371b0 2024-09-21T06:21:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.371+0000 7f1d01ffb640 1 -- 172.21.15.38:0/1215150304 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14011640 con 0x557eb3f371b0 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- 172.21.15.38:0/1215150304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 msgr2=0x557eb42dc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400b6b0 tx=0x7f1d14004610 comp rx=0 tx=0).stop 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 0x7f1d040b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x557eb42db630 tx=0x7f1d0c0094a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- 172.21.15.38:0/1215150304 shutdown_connections 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42dd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42dcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/1215150304 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42dc9b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- 172.21.15.38:0/1215150304 >> 172.21.15.38:0/1215150304 conn(0x557eb3f2b300 msgr2=0x557eb42da8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- 172.21.15.38:0/1215150304 shutdown_connections 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- 172.21.15.38:0/1215150304 wait complete. 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 -- start start 2024-09-21T06:21:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.372+0000 7f1d28bdd740 1 Processor -- start 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42e8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb42f4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557eb4178ab0 con 0x557eb3f164d0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557eb41e6730 con 0x557eb3f371b0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557eb42eb130 con 0x557eb3f0e2f0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 10 client.0 _ll_register_callbacks cb 0x557eb423a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39520/0 (socket says 172.21.15.38:39520) 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 -- 172.21.15.38:0/3607934277 learned_addr learned my addr 172.21.15.38:0/3607934277 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb42f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 -- 172.21.15.38:0/3607934277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 msgr2=0x557eb42e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 -- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 msgr2=0x557eb42f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb42f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 -- 172.21.15.38:0/3607934277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb3fa2790 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d1affd640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d10000c00 tx=0x7f1d100eb1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c036d69a1fae2c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100a97e0 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d10010640 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.373+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d14015070 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d100a90b0 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557eb401b620 con 0x557eb3f164d0 2024-09-21T06:21:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d14015070 con 0x557eb3f164d0 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1d100a9290 con 0x557eb3f164d0 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 20 client.16092 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ef5d80 0x557eb42fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 4 client.16092 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eb4253640 con 0x557eb3ef5d80 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.374+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ef5d80 0x557eb42fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.375+0000 7f1cfaffd640 10 client.16092 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.375+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ef5d80 0x557eb42fa1f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abd70c56377c5050 server_cookie=c821789afa678b94 in_seq=0 out_seq=0 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1cfaffd640 1 -- 172.21.15.38:0/3607934277 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557eb4253640 con 0x557eb3ef5d80 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1cfaffd640 10 client.16092 handle_command_reply: tid=0 2024-09-21T06:21:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 client.16092 shutdown 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 msgr2=0x557eb42e8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1d10000c00 tx=0x7f1d100eb1b0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 shutdown_connections 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb42f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42e8590 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ef5d80 0x557eb42fa1f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1cfaffd640 0 client.16092 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/3607934277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 >> 172.21.15.38:0/3607934277 conn(0x557eb3f2b300 msgr2=0x557eb42dd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 shutdown_connections 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 1 -- 172.21.15.38:0/3607934277 wait complete. 2024-09-21T06:21:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.376+0000 7f1d28bdd740 20 client.16092 trim_cache size 0 max 16384 2024-09-21T06:21:57.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:57 smithi174 ceph-mon[34815]: pgmap v387: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 568 op/s 2024-09-21T06:21:57.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:57.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:57.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:21:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 Processor -- start 2024-09-21T06:21:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 -- start start 2024-09-21T06:21:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1b2120 con 0x557eb3f371b0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1af930 con 0x557eb3f164d0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1ad780 con 0x557eb3f0e2f0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39524/0 (socket says 172.21.15.38:39524) 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 -- 172.21.15.38:0/638784758 learned_addr learned my addr 172.21.15.38:0/638784758 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1affd640 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42d95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 -- 172.21.15.38:0/638784758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 msgr2=0x557eb42de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 -- 172.21.15.38:0/638784758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 msgr2=0x557eb42d95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42d95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.393+0000 7f1d1bfff640 1 -- 172.21.15.38:0/638784758 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb42decb0 con 0x557eb3f371b0 2024-09-21T06:21:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.394+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d14004290 tx=0x7f1d140056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebf7e9701249d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.394+0000 7f1d017fa640 1 -- 172.21.15.38:0/638784758 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14003ce0 con 0x557eb3f371b0 2024-09-21T06:21:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.394+0000 7f1d017fa640 1 -- 172.21.15.38:0/638784758 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d14028070 con 0x557eb3f371b0 2024-09-21T06:21:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.394+0000 7f1d017fa640 1 -- 172.21.15.38:0/638784758 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d140117c0 con 0x557eb3f371b0 2024-09-21T06:21:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- 172.21.15.38:0/638784758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 msgr2=0x557eb42e5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d14004290 tx=0x7f1d140056b0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- 172.21.15.38:0/638784758 shutdown_connections 2024-09-21T06:21:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f371b0 0x557eb42e5220 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f164d0 0x557eb42d95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/638784758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- 172.21.15.38:0/638784758 >> 172.21.15.38:0/638784758 conn(0x557eb3f2b300 msgr2=0x557eb42d8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- 172.21.15.38:0/638784758 shutdown_connections 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- 172.21.15.38:0/638784758 wait complete. 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.395+0000 7f1d28bdd740 1 -- start start 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 Processor -- start 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42edf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb435cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1addf0 con 0x557eb3f164d0 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1af260 con 0x557eb3f371b0 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1ae4c0 con 0x557eb3f0e2f0 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d28bdd740 10 client.0 _ll_register_callbacks cb 0x7f1d1000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39536/0 (socket says 172.21.15.38:39536) 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 -- 172.21.15.38:0/651528977 learned_addr learned my addr 172.21.15.38:0/651528977 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1bfff640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb435cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 -- 172.21.15.38:0/651528977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 msgr2=0x557eb42edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 -- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 msgr2=0x557eb435cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb435cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1affd640 1 -- 172.21.15.38:0/651528977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb435d410 con 0x557eb3f164d0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.396+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d1affd640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d100ad640 tx=0x7f1d10005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54063e477bb1497 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100c7020 con 0x557eb3f164d0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1d100acba0 con 0x557eb3f164d0 2024-09-21T06:21:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d14028070 con 0x557eb3f164d0 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d10098080 con 0x557eb3f164d0 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 10 client.16098 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557eb4364830 con 0x557eb3f164d0 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d14028070 con 0x557eb3f164d0 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1d100ac610 con 0x557eb3f164d0 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 20 client.16098 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ecb1c0 0x557eb4367080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 4 client.16098 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:21:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.397+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557eb424f0f0 con 0x557eb3ecb1c0 2024-09-21T06:21:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.398+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ecb1c0 0x557eb4367080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.398+0000 7f1cfaffd640 10 client.16098 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:57.398+0000 7f1d1b7fe640 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ecb1c0 0x557eb4367080 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eb5b78edd759d7d server_cookie=f303082c4c12edc5 in_seq=0 out_seq=0 2024-09-21T06:21:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:57 smithi044 ceph-mon[34369]: pgmap v387: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 568 op/s 2024-09-21T06:21:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:21:57.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:57 smithi038 ceph-mon[31215]: pgmap v387: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 568 op/s 2024-09-21T06:21:57.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:21:57.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:21:57.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:21:57.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:21:58.012 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1cfaffd640 1 -- 172.21.15.38:0/651528977 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557eb424f0f0 con 0x557eb3ecb1c0 2024-09-21T06:21:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1cfaffd640 10 client.16098 handle_command_reply: tid=0 2024-09-21T06:21:58.013 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 client.16098 shutdown 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 msgr2=0x557eb42ee4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d100ad640 tx=0x7f1d10005f10 comp rx=0 tx=0).stop 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 shutdown_connections 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557eb3f371b0 0x557eb435cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557eb3f164d0 0x557eb42ee4e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557eb3ecb1c0 0x557eb4367080 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 --2- 172.21.15.38:0/651528977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557eb3f0e2f0 0x557eb42edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 >> 172.21.15.38:0/651528977 conn(0x557eb3f2b300 msgr2=0x557eb42d9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1cfaffd640 0 client.16098 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 shutdown_connections 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.010+0000 7f1d28bdd740 1 -- 172.21.15.38:0/651528977 wait complete. 2024-09-21T06:21:58.014 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d28bdd740 20 client.16098 trim_cache size 0 max 16384 2024-09-21T06:21:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:{ 2024-09-21T06:21:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "message": "", 2024-09-21T06:21:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout: "return_code": 0 2024-09-21T06:21:58.015 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stdout:} 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 msgr2=0x7f1d040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 0x7f1d040b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x557eb42db630 tx=0x7f1d0c0094a0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 msgr2=0x7f1d1c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000e9f0 tx=0x7f1d1000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 shutdown_connections 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1d040b6680 0x7f1d040b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d1c109d90 0x7f1d1c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d1c109440 0x7f1d1c19abb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 --2- 172.21.15.38:0/2361027372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d1c103b10 0x7f1d1c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.016 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.011+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 >> 172.21.15.38:0/2361027372 conn(0x7f1d1c0ff510 msgr2=0x7f1d1c108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.012+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 shutdown_connections 2024-09-21T06:21:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi038.front.sepia.ceph.com.smithi038.stderr:2024-09-21T06:21:58.012+0000 7f1d21c70640 1 -- 172.21.15.38:0/2361027372 wait complete. 2024-09-21T06:21:58.276 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 -- 172.21.15.38:0/206674265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 msgr2=0x7f7f04102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/206674265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f04102e70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009900 tx=0x7f7ef402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 -- 172.21.15.38:0/206674265 shutdown_connections 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/206674265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 0x7f7f0410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/206674265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 0x7f7f041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/206674265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f04102e70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 -- 172.21.15.38:0/206674265 >> 172.21.15.38:0/206674265 conn(0x7f7f04079730 msgr2=0x7f7f04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 -- 172.21.15.38:0/206674265 shutdown_connections 2024-09-21T06:21:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.901+0000 7f7f0a27e640 1 -- 172.21.15.38:0/206674265 wait complete. 2024-09-21T06:21:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.902+0000 7f7f0a27e640 1 Processor -- start 2024-09-21T06:21:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.902+0000 7f7f0a27e640 1 -- start start 2024-09-21T06:21:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.902+0000 7f7f0a27e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.902+0000 7f7f0a27e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 0x7f7f0419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f0a27e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 0x7f7f0419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f0a27e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04112a80 con 0x7f7f04102a60 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f0a27e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04112900 con 0x7f7f04108cf0 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f0a27e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f04112c00 con 0x7f7f041083a0 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39566/0 (socket says 172.21.15.38:39566) 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 -- 172.21.15.38:0/3853227290 learned_addr learned my addr 172.21.15.38:0/3853227290 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 0x7f7f0419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 0x7f7f0419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 -- 172.21.15.38:0/3853227290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 msgr2=0x7f7f0419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 0x7f7f0419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 -- 172.21.15.38:0/3853227290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 msgr2=0x7f7f0419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 0x7f7f0419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 -- 172.21.15.38:0/3853227290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f041a03d0 con 0x7f7f04102a60 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f03fff640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005ab0 tx=0x7f7ef40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f017fa640 1 -- 172.21.15.38:0/3853227290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef403f030 con 0x7f7f04102a60 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.903+0000 7f7f017fa640 1 -- 172.21.15.38:0/3853227290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ef4003cd0 con 0x7f7f04102a60 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.904+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f041a0660 con 0x7f7f04102a60 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.904+0000 7f7f017fa640 1 -- 172.21.15.38:0/3853227290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4035070 con 0x7f7f04102a60 2024-09-21T06:21:58.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.904+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f041a0b40 con 0x7f7f04102a60 2024-09-21T06:21:58.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.906+0000 7f7f017fa640 1 -- 172.21.15.38:0/3853227290 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7ef4042030 con 0x7f7f04102a60 2024-09-21T06:21:58.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.906+0000 7f7f107f2740 1 Processor -- start 2024-09-21T06:21:58.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 -- start start 2024-09-21T06:21:58.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 0x55abb4a1b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 0x55abb4a1b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a1bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55abb4991ea0 con 0x55abb464b1b0 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55abb49812d0 con 0x55abb4653390 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f107f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55abb49850e0 con 0x55abb4674070 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 0x55abb4a1b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 0x55abb4a1b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39582/0 (socket says 172.21.15.38:39582) 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f03fff640 1 -- 172.21.15.38:0/3886248672 learned_addr learned my addr 172.21.15.38:0/3886248672 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 0x55abb4a1b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.907+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a1bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 -- 172.21.15.38:0/3886248672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 msgr2=0x55abb4a1bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a1bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 -- 172.21.15.38:0/3886248672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 msgr2=0x55abb4a1b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 0x55abb4a1b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 -- 172.21.15.38:0/3886248672 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb46df650 con 0x55abb4674070 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f017fa640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 0x7f7eec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 0x55abb4a1b2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009f00 tx=0x7f7efc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4112194e122f83e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f03fff640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 0x7f7eec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7eea7fc640 1 -- 172.21.15.38:0/3886248672 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc004d20 con 0x55abb4674070 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7f017fa640 1 -- 172.21.15.38:0/3853227290 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7ef4107b20 con 0x7f7f04102a60 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7eea7fc640 1 -- 172.21.15.38:0/3886248672 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7efc004030 con 0x55abb4674070 2024-09-21T06:21:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.908+0000 7f7eea7fc640 1 -- 172.21.15.38:0/3886248672 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005280 con 0x55abb4674070 2024-09-21T06:21:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 -- 172.21.15.38:0/3886248672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 msgr2=0x55abb4a1b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f03fff640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 0x7f7eec0b8bc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40c9fc0 tx=0x7f7ef410b670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 0x55abb4a1b2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009f00 tx=0x7f7efc011810 comp rx=0 tx=0).stop 2024-09-21T06:21:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 -- 172.21.15.38:0/3886248672 shutdown_connections 2024-09-21T06:21:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a1bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb464b1b0 0x55abb4a1b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3886248672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb4674070 0x55abb4a1b2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 -- 172.21.15.38:0/3886248672 >> 172.21.15.38:0/3886248672 conn(0x55abb4668460 msgr2=0x55abb4a191b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 -- 172.21.15.38:0/3886248672 shutdown_connections 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.909+0000 7f7f107f2740 1 -- 172.21.15.38:0/3886248672 wait complete. 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 -- start start 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 Processor -- start 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a26900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a27380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55abb47e2700 con 0x55abb4653390 2024-09-21T06:21:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55abb491c160 con 0x55abb4674070 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55abb4a29aa0 con 0x55abb464b1b0 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f107f2740 10 client.0 _ll_register_callbacks cb 0x55abb49359e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39584/0 (socket says 172.21.15.38:39584) 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f037fe640 1 -- 172.21.15.38:0/1298468795 learned_addr learned my addr 172.21.15.38:0/1298468795 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.910+0000 7f7f0881b640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a27380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f0881b640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a26900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 -- 172.21.15.38:0/1298468795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 msgr2=0x55abb4a26900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a26900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 -- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 msgr2=0x55abb4a27380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a27380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 -- 172.21.15.38:0/1298468795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb4949c90 con 0x55abb4653390 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f0881b640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a27380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f037fe640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8010820 tx=0x7f7ef8010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8796c1b756b6fa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7ee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800fb90 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7ef800fd30 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.911+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7efc004030 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7ef8005020 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55abb4a35760 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7efc004030 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7ef8023430 con 0x55abb4653390 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:58.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 20 client.16110 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:58.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb46329f0 0x55abb4a38d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 4 client.16110 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:21:58.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abb4993df0 con 0x55abb46329f0 2024-09-21T06:21:58.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.912+0000 7f7f0881b640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb46329f0 0x55abb4a38d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.913+0000 7f7ee37fe640 10 client.16110 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.913+0000 7f7f0881b640 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb46329f0 0x55abb4a38d10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3cfc545ac044bcf server_cookie=5a708703b99f7686 in_seq=0 out_seq=0 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.913+0000 7f7ee37fe640 1 -- 172.21.15.38:0/1298468795 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abb4993df0 con 0x55abb46329f0 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.913+0000 7f7ee37fe640 10 client.16110 handle_command_reply: tid=0 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.913+0000 7f7f107f2740 1 client.16110 shutdown 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 msgr2=0x55abb4a26e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8010820 tx=0x7f7ef8010ce0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 shutdown_connections 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a27380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a26e40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb46329f0 0x55abb4a38d10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 --2- 172.21.15.38:0/1298468795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a26900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7ee37fe640 0 client.16110 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:58.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 >> 172.21.15.38:0/1298468795 conn(0x55abb4668460 msgr2=0x55abb4a1e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 shutdown_connections 2024-09-21T06:21:58.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 1 -- 172.21.15.38:0/1298468795 wait complete. 2024-09-21T06:21:58.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.914+0000 7f7f107f2740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 Processor -- start 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 -- start start 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a1ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a28530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041b1f90 con 0x55abb4674070 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041af7a0 con 0x55abb4653390 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f107f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041ad5f0 con 0x55abb464b1b0 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f0881b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a28530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f0881b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39600/0 (socket says 172.21.15.38:39600) 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.928+0000 7f7f0881b640 1 -- 172.21.15.38:0/3115067262 learned_addr learned my addr 172.21.15.38:0/3115067262 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a1ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 -- 172.21.15.38:0/3115067262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 msgr2=0x55abb4a1ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a1ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 -- 172.21.15.38:0/3115067262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 msgr2=0x55abb4a28530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a28530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 -- 172.21.15.38:0/3115067262 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb4a279a0 con 0x55abb4674070 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a28530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:58.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7efc000f80 tx=0x7f7efc02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e9f14bcc1b652a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7ee9ffb640 1 -- 172.21.15.38:0/3115067262 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc01e040 con 0x55abb4674070 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7ee9ffb640 1 -- 172.21.15.38:0/3115067262 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7efc003e40 con 0x55abb4674070 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.929+0000 7f7ee9ffb640 1 -- 172.21.15.38:0/3115067262 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0054b0 con 0x55abb4674070 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- 172.21.15.38:0/3115067262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 msgr2=0x55abb4a23af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7efc000f80 tx=0x7f7efc02a040 comp rx=0 tx=0).stop 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- 172.21.15.38:0/3115067262 shutdown_connections 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4674070 0x55abb4a23af0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4653390 0x55abb4a28530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3115067262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a1ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- 172.21.15.38:0/3115067262 >> 172.21.15.38:0/3115067262 conn(0x55abb4668460 msgr2=0x55abb4a27e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- 172.21.15.38:0/3115067262 shutdown_connections 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- 172.21.15.38:0/3115067262 wait complete. 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.930+0000 7f7f107f2740 1 -- start start 2024-09-21T06:21:58.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 Processor -- start 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a2f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a2af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041adc60 con 0x55abb4653390 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041af0d0 con 0x55abb4674070 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f041ae330 con 0x55abb464b1b0 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f107f2740 10 client.0 _ll_register_callbacks cb 0x7f7ef800a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39608/0 (socket says 172.21.15.38:39608) 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f037fe640 1 -- 172.21.15.38:0/3450269136 learned_addr learned my addr 172.21.15.38:0/3450269136 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a2af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a2f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 -- 172.21.15.38:0/3450269136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 msgr2=0x55abb4a2f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a2f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 -- 172.21.15.38:0/3450269136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 msgr2=0x55abb4a2aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.931+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f0881b640 1 -- 172.21.15.38:0/3450269136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb4a2b710 con 0x55abb4674070 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f0881b640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a2af80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d40 tx=0x7f7efc011d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade9db99f0fc0819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7ee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc005210 con 0x55abb4674070 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7efc003e40 con 0x55abb4674070 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7efc0053b0 con 0x55abb4674070 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7efc0055b0 con 0x55abb4674070 2024-09-21T06:21:58.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f107f2740 10 client.25763 fetch_fsmap learned FSMap version 28 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55abb4aa3690 con 0x55abb4674070 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.932+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7efc003e40 con 0x55abb4674070 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7efc024040 con 0x55abb4674070 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 10 client.25763 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 20 client.25763 populate_metadata read hostname 'smithi038' 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb4607da0 0x55abb4aa5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 4 client.25763 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55abb498f8a0 con 0x55abb4607da0 2024-09-21T06:21:58.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb4607da0 0x55abb4aa5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:21:58.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7f037fe640 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb4607da0 0x55abb4aa5b70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7cfe9afe6b3637 server_cookie=cdbaa855fc1c0e60 in_seq=0 out_seq=0 2024-09-21T06:21:58.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.933+0000 7f7ee37fe640 10 client.25763 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:58.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7ee37fe640 1 -- 172.21.15.38:0/3450269136 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55abb498f8a0 con 0x55abb4607da0 2024-09-21T06:21:58.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7ee37fe640 10 client.25763 handle_command_reply: tid=0 2024-09-21T06:21:58.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 client.25763 shutdown 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 msgr2=0x55abb4a2af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a2af80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d40 tx=0x7f7efc011d30 comp rx=0 tx=0).stop 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 shutdown_connections 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55abb4674070 0x55abb4a2af80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55abb4653390 0x55abb4a2aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55abb4607da0 0x55abb4aa5b70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 --2- 172.21.15.38:0/3450269136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55abb464b1b0 0x55abb4a2f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7ee37fe640 0 client.25763 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 >> 172.21.15.38:0/3450269136 conn(0x55abb4668460 msgr2=0x55abb4a1ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 shutdown_connections 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 1 -- 172.21.15.38:0/3450269136 wait complete. 2024-09-21T06:21:58.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.934+0000 7f7f107f2740 20 client.25763 trim_cache size 0 max 16384 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 msgr2=0x7f7eec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 0x7f7eec0b8bc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40c9fc0 tx=0x7f7ef410b670 comp rx=0 tx=0).stop 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 msgr2=0x7f7f0419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005ab0 tx=0x7f7ef40042f0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 shutdown_connections 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7eec0b66b0 0x7f7eec0b8bc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f04108cf0 0x7f7f0419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f041083a0 0x7f7f0419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 --2- 172.21.15.38:0/3853227290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7f04102a60 0x7f7f0419a520 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:21:58.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 >> 172.21.15.38:0/3853227290 conn(0x7f7f04079730 msgr2=0x7f7f04101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:21:58.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 shutdown_connections 2024-09-21T06:21:58.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:21:58.935+0000 7f7f0a27e640 1 -- 172.21.15.38:0/3853227290 wait complete. 2024-09-21T06:21:59.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:21:59 smithi174 ceph-mon[34815]: pgmap v388: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 577 op/s 2024-09-21T06:21:59.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:21:59 smithi044 ceph-mon[34369]: pgmap v388: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 577 op/s 2024-09-21T06:21:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:21:59 smithi038 ceph-mon[31215]: pgmap v388: 97 pgs: 97 active+clean; 179 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 577 op/s 2024-09-21T06:22:00.726 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:22:00.726 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:22:01.005 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:01.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:01 smithi174 ceph-mon[34815]: pgmap v389: 97 pgs: 97 active+clean; 172 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 713 op/s 2024-09-21T06:22:01.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:01 smithi044 ceph-mon[34369]: pgmap v389: 97 pgs: 97 active+clean; 172 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 713 op/s 2024-09-21T06:22:01.441 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:01 smithi038 ceph-mon[31215]: pgmap v389: 97 pgs: 97 active+clean; 172 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 713 op/s 2024-09-21T06:22:01.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 -- 172.21.15.38:0/3200075490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad28103b90 msgr2=0x7fad28103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 --2- 172.21.15.38:0/3200075490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad28103b90 0x7fad28103fa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad18009900 tx=0x7fad1802a410 comp rx=0 tx=0).stop 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 -- 172.21.15.38:0/3200075490 shutdown_connections 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 --2- 172.21.15.38:0/3200075490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28109e20 0x7fad28110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 --2- 172.21.15.38:0/3200075490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad281094d0 0x7fad281098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 --2- 172.21.15.38:0/3200075490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad28103b90 0x7fad28103fa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 -- 172.21.15.38:0/3200075490 >> 172.21.15.38:0/3200075490 conn(0x7fad280ff600 msgr2=0x7fad28101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 -- 172.21.15.38:0/3200075490 shutdown_connections 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.452+0000 7fad2e860640 1 -- 172.21.15.38:0/3200075490 wait complete. 2024-09-21T06:22:01.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.453+0000 7fad2e860640 1 Processor -- start 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.453+0000 7fad2e860640 1 -- start start 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28103b90 0x7fad2819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 0x7fad2819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fad28113c80 con 0x7fad281094d0 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad28113b00 con 0x7fad28109e20 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2e860640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fad28113e00 con 0x7fad28103b90 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58702/0 (socket says 172.21.15.38:58702) 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 -- 172.21.15.38:0/865570923 learned_addr learned my addr 172.21.15.38:0/865570923 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad27fff640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28103b90 0x7fad2819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 0x7fad2819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 -- 172.21.15.38:0/865570923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28103b90 msgr2=0x7fad2819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28103b90 0x7fad2819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 -- 172.21.15.38:0/865570923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 msgr2=0x7fad2819fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 0x7fad2819fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 -- 172.21.15.38:0/865570923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad281a0540 con 0x7fad281094d0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 0x7fad2819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.454+0000 7fad277fe640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00d950 tx=0x7fad1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.455+0000 7fad257fa640 1 -- 172.21.15.38:0/865570923 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c017070 con 0x7fad281094d0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.455+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad281a0830 con 0x7fad281094d0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.455+0000 7fad257fa640 1 -- 172.21.15.38:0/865570923 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad1c009c30 con 0x7fad281094d0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.455+0000 7fad257fa640 1 -- 172.21.15.38:0/865570923 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0047a0 con 0x7fad281094d0 2024-09-21T06:22:01.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.455+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad281a6f90 con 0x7fad281094d0 2024-09-21T06:22:01.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.457+0000 7fad257fa640 1 -- 172.21.15.38:0/865570923 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fad1c004940 con 0x7fad281094d0 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 Processor -- start 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 -- start start 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 0x55ce70057970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce70057eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ce6ffcde60 con 0x55ce6fcb0350 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce6ffbd290 con 0x55ce6fc87490 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad34dd4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ce6ffc10a0 con 0x55ce6fc8f670 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad2cdfd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad27fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 0x55ce70057970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad2cdfd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58712/0 (socket says 172.21.15.38:58712) 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad2cdfd640 1 -- 172.21.15.38:0/2086150993 learned_addr learned my addr 172.21.15.38:0/2086150993 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad27fff640 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 0x55ce70057970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:54074/0 (socket says 172.21.15.38:54074) 2024-09-21T06:22:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad277fe640 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce70057eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.458+0000 7fad257fa640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 0x7fad100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 -- 172.21.15.38:0/2086150993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 msgr2=0x55ce70057eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce70057eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 -- 172.21.15.38:0/2086150993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 msgr2=0x55ce70057970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 0x55ce70057970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 -- 172.21.15.38:0/2086150993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6fd1b930 con 0x55ce6fcb0350 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 0x7fad100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad257fa640 1 -- 172.21.15.38:0/865570923 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fad1c0e7310 con 0x7fad281094d0 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad2000a980 tx=0x7fad2000ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2145027d6e39548e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad0e7fc640 1 -- 172.21.15.38:0/2086150993 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2001a040 con 0x55ce6fcb0350 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad0e7fc640 1 -- 172.21.15.38:0/2086150993 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad2000ee50 con 0x55ce6fcb0350 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.459+0000 7fad0e7fc640 1 -- 172.21.15.38:0/2086150993 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20020870 con 0x55ce6fcb0350 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 -- 172.21.15.38:0/2086150993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 msgr2=0x55ce70057430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 0x7fad100b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad20020000 tx=0x7fad20021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fad2000a980 tx=0x7fad2000ae40 comp rx=0 tx=0).stop 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 -- 172.21.15.38:0/2086150993 shutdown_connections 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce70057eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc87490 0x55ce70057970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 --2- 172.21.15.38:0/2086150993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fcb0350 0x55ce70057430 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 -- 172.21.15.38:0/2086150993 >> 172.21.15.38:0/2086150993 conn(0x55ce6fca4740 msgr2=0x55ce70055320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 -- 172.21.15.38:0/2086150993 shutdown_connections 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.460+0000 7fad34dd4740 1 -- 172.21.15.38:0/2086150993 wait complete. 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.461+0000 7fad34dd4740 1 -- start start 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.461+0000 7fad34dd4740 1 Processor -- start 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce700679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ce6fe1e890 con 0x55ce6fc87490 2024-09-21T06:22:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce6ff57d40 con 0x55ce6fcb0350 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ce70069f70 con 0x55ce6fc8f670 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad34dd4740 10 client.0 _ll_register_callbacks cb 0x55ce6ffbbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58724/0 (socket says 172.21.15.38:58724) 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 -- 172.21.15.38:0/1507625568 learned_addr learned my addr 172.21.15.38:0/1507625568 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad277fe640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce700679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 -- 172.21.15.38:0/1507625568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 msgr2=0x55ce700679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce700679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 -- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 msgr2=0x55ce700732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 -- 172.21.15.38:0/1507625568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce700738b0 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad27fff640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad1802a930 tx=0x7fad18031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc49adb4c132f5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.462+0000 7fad077fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18035040 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fad18004250 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad2000ee50 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad18004450 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce700761e0 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad2000ee50 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad18004ce0 con 0x55ce6fc87490 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:01.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 20 client.16128 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc6ecd0 0x55ce700796e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 4 client.16128 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.463+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce6ffcfdb0 con 0x55ce6fc6ecd0 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.464+0000 7fad277fe640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc6ecd0 0x55ce700796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.464+0000 7fad077fe640 10 client.16128 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:01.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.464+0000 7fad277fe640 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc6ecd0 0x55ce700796e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a518adc55d49fa server_cookie=3a289d0b981b486d in_seq=0 out_seq=0 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad077fe640 1 -- 172.21.15.38:0/1507625568 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce6ffcfdb0 con 0x55ce6fc6ecd0 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad077fe640 10 client.16128 handle_command_reply: tid=0 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 client.16128 shutdown 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 msgr2=0x55ce70067460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fad1802a930 tx=0x7fad18031510 comp rx=0 tx=0).stop 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 shutdown_connections 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc6ecd0 0x55ce700796e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc8f670 0x55ce700679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 --2- 172.21.15.38:0/1507625568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce70067460 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad077fe640 0 client.16128 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 >> 172.21.15.38:0/1507625568 conn(0x55ce6fca4740 msgr2=0x55ce70058e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 shutdown_connections 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 1 -- 172.21.15.38:0/1507625568 wait complete. 2024-09-21T06:22:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.466+0000 7fad34dd4740 20 client.16128 trim_cache size 0 max 16384 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 Processor -- start 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 -- start start 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc8f670 0x55ce70065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fcb0350 0x55ce70066020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fad281afe10 con 0x55ce6fc87490 2024-09-21T06:22:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad281ad620 con 0x55ce6fc8f670 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad34dd4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fad281ab470 con 0x55ce6fcb0350 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58740/0 (socket says 172.21.15.38:58740) 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 -- 172.21.15.38:0/3321941029 learned_addr learned my addr 172.21.15.38:0/3321941029 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad277fe640 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc8f670 0x55ce70065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fcb0350 0x55ce70066020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 -- 172.21.15.38:0/3321941029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fcb0350 msgr2=0x55ce70066020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fcb0350 0x55ce70066020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 -- 172.21.15.38:0/3321941029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc8f670 msgr2=0x55ce70065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc8f670 0x55ce70065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.486+0000 7fad27fff640 1 -- 172.21.15.38:0/3321941029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7005d490 con 0x55ce6fc87490 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.487+0000 7fad27fff640 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fad18006010 tx=0x7fad18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a093be8885379edc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.487+0000 7fad0dffb640 1 -- 172.21.15.38:0/3321941029 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18035030 con 0x55ce6fc87490 2024-09-21T06:22:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.487+0000 7fad0dffb640 1 -- 172.21.15.38:0/3321941029 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad18055070 con 0x55ce6fc87490 2024-09-21T06:22:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.487+0000 7fad0dffb640 1 -- 172.21.15.38:0/3321941029 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18046900 con 0x55ce6fc87490 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- 172.21.15.38:0/3321941029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 msgr2=0x55ce700731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fad18006010 tx=0x7fad18000bc0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- 172.21.15.38:0/3321941029 shutdown_connections 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fcb0350 0x55ce70066020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fc8f670 0x55ce70065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 --2- 172.21.15.38:0/3321941029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc87490 0x55ce700731a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- 172.21.15.38:0/3321941029 >> 172.21.15.38:0/3321941029 conn(0x55ce6fca4740 msgr2=0x55ce700623a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- 172.21.15.38:0/3321941029 shutdown_connections 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- 172.21.15.38:0/3321941029 wait complete. 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.488+0000 7fad34dd4740 1 -- start start 2024-09-21T06:22:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 Processor -- start 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc87490 0x55ce7006b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fad281abae0 con 0x55ce6fc8f670 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad281acf50 con 0x55ce6fcb0350 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fad281ac1b0 con 0x55ce6fc87490 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad34dd4740 10 client.0 _ll_register_callbacks cb 0x7fad18005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad2cdfd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58742/0 (socket says 172.21.15.38:58742) 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 -- 172.21.15.38:0/12947416 learned_addr learned my addr 172.21.15.38:0/12947416 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad27fff640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc87490 0x55ce7006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 -- 172.21.15.38:0/12947416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc87490 msgr2=0x55ce7006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc87490 0x55ce7006b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 -- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 msgr2=0x55ce700e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.489+0000 7fad277fe640 1 -- 172.21.15.38:0/12947416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce700e35e0 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad2cdfd640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad277fe640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0ad170 tx=0x7fad1c094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dc7233b429f929 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0a9830 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fad1c0d0d60 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad18055070 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad1c0accf0 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad34dd4740 10 client.16134 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ce700e4830 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad18055070 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.490+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad1c0981d0 con 0x55ce6fc8f670 2024-09-21T06:22:01.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 10 client.16134 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 20 client.16134 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc44080 0x55ce700e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 4 client.16134 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ce6ffcb860 con 0x55ce6fc44080 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad27fff640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc44080 0x55ce700e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad27fff640 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc44080 0x55ce700e6fd0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=107a613b6323ed8 server_cookie=662ec665790cfae6 in_seq=0 out_seq=0 2024-09-21T06:22:01.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.491+0000 7fad077fe640 10 client.16134 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.494+0000 7fad077fe640 1 -- 172.21.15.38:0/12947416 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ce6ffcb860 con 0x55ce6fc44080 2024-09-21T06:22:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.494+0000 7fad077fe640 10 client.16134 handle_command_reply: tid=0 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.494+0000 7fad34dd4740 1 client.16134 shutdown 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.494+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 msgr2=0x55ce7006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.494+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0ad170 tx=0x7fad1c094040 comp rx=0 tx=0).stop 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 shutdown_connections 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6fcb0350 0x55ce700e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ce6fc8f670 0x55ce7006bc20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ce6fc44080 0x55ce700e6fd0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 --2- 172.21.15.38:0/12947416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ce6fc87490 0x55ce7006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad077fe640 0 client.16134 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 >> 172.21.15.38:0/12947416 conn(0x55ce6fca4740 msgr2=0x55ce700623a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 shutdown_connections 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 1 -- 172.21.15.38:0/12947416 wait complete. 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.495+0000 7fad34dd4740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "c9d0ce09-15ac-453f-8dfd-01525a60349a", 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:22:01.501 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 msgr2=0x7fad100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 0x7fad100b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fad20020000 tx=0x7fad20021000 comp rx=0 tx=0).stop 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 msgr2=0x7fad2819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00d950 tx=0x7fad1c00de10 comp rx=0 tx=0).stop 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 shutdown_connections 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fad100b6680 0x7fad100b8b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad28109e20 0x7fad2819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad281094d0 0x7fad2819ab70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 --2- 172.21.15.38:0/865570923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad28103b90 0x7fad2819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 >> 172.21.15.38:0/865570923 conn(0x7fad280ff600 msgr2=0x7fad28101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 shutdown_connections 2024-09-21T06:22:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:01.496+0000 7fad2e860640 1 -- 172.21.15.38:0/865570923 wait complete. 2024-09-21T06:22:02.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:02 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:02.320 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:02 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:02.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:22:02.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:02 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:02.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:02 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:02.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:02 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:02.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:02 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:03.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 -- 172.21.15.38:0/395992093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 msgr2=0x7f12a4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 --2- 172.21.15.38:0/395992093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a4104dc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1298009900 tx=0x7f129802a410 comp rx=0 tx=0).stop 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 -- 172.21.15.38:0/395992093 shutdown_connections 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 --2- 172.21.15.38:0/395992093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 --2- 172.21.15.38:0/395992093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 --2- 172.21.15.38:0/395992093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a4104dc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 -- 172.21.15.38:0/395992093 >> 172.21.15.38:0/395992093 conn(0x7f12a4079730 msgr2=0x7f12a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 -- 172.21.15.38:0/395992093 shutdown_connections 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.113+0000 7f12aadfc640 1 -- 172.21.15.38:0/395992093 wait complete. 2024-09-21T06:22:03.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.114+0000 7f12aadfc640 1 Processor -- start 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.114+0000 7f12aadfc640 1 -- start start 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4113bd0 con 0x7f12a41049b0 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4113a50 con 0x7f12a410de10 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12aadfc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4113d50 con 0x7f12a4105300 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58774/0 (socket says 172.21.15.38:58774) 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 -- 172.21.15.38:0/515232768 learned_addr learned my addr 172.21.15.38:0/515232768 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a3fff640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a9399640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 -- 172.21.15.38:0/515232768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 msgr2=0x7f12a419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 -- 172.21.15.38:0/515232768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 msgr2=0x7f12a419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 -- 172.21.15.38:0/515232768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a41a0570 con 0x7f12a41049b0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a3fff640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a9399640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.115+0000 7f12a8b98640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1298005940 tx=0x7f1298004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.116+0000 7f12a1ffb640 1 -- 172.21.15.38:0/515232768 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129803f030 con 0x7f12a41049b0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.116+0000 7f12a1ffb640 1 -- 172.21.15.38:0/515232768 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1298004440 con 0x7f12a41049b0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.116+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a41a0800 con 0x7f12a41049b0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.116+0000 7f12a1ffb640 1 -- 172.21.15.38:0/515232768 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298035070 con 0x7f12a41049b0 2024-09-21T06:22:03.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.116+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a41a6fc0 con 0x7f12a41049b0 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.118+0000 7f12b1370740 1 Processor -- start 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.118+0000 7f12b1370740 1 -- start start 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a1ffb640 1 -- 172.21.15.38:0/515232768 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1298042030 con 0x7f12a41049b0 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 0x55901cfcf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55901cf44e50 con 0x55901cc27070 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55901cf34280 con 0x55901cc06390 2024-09-21T06:22:03.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12b1370740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55901cf38090 con 0x55901cbfe1b0 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a9399640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a9399640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58788/0 (socket says 172.21.15.38:58788) 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a9399640 1 -- 172.21.15.38:0/3165672847 learned_addr learned my addr 172.21.15.38:0/3165672847 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 0x55901cfcf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 -- 172.21.15.38:0/3165672847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 msgr2=0x55901cfceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 -- 172.21.15.38:0/3165672847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 msgr2=0x55901cfce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a3fff640 1 -- 172.21.15.38:0/3165672847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901cc92650 con 0x55901cc06390 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.119+0000 7f12a9399640 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 0x55901cfcf0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a406aaa0 tx=0x7f12900118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baada362d0cfb04b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f12a1ffb640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 0x7f12940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f128effd640 1 -- 172.21.15.38:0/3165672847 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004310 con 0x55901cc06390 2024-09-21T06:22:03.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f12a9399640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 0x7f12940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f128effd640 1 -- 172.21.15.38:0/3165672847 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12900044b0 con 0x55901cc06390 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f12a1ffb640 1 -- 172.21.15.38:0/515232768 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1298107970 con 0x7f12a41049b0 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.120+0000 7f128effd640 1 -- 172.21.15.38:0/3165672847 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900035f0 con 0x55901cc06390 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- 172.21.15.38:0/3165672847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 msgr2=0x55901cfcf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12a9399640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 0x7f12940b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f129c009fd0 tx=0x7f129c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 0x55901cfcf0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12a406aaa0 tx=0x7f12900118d0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- 172.21.15.38:0/3165672847 shutdown_connections 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc06390 0x55901cfcf0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 --2- 172.21.15.38:0/3165672847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- 172.21.15.38:0/3165672847 >> 172.21.15.38:0/3165672847 conn(0x55901cc1b460 msgr2=0x55901cfcc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- 172.21.15.38:0/3165672847 shutdown_connections 2024-09-21T06:22:03.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- 172.21.15.38:0/3165672847 wait complete. 2024-09-21T06:22:03.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.121+0000 7f12b1370740 1 -- start start 2024-09-21T06:22:03.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 Processor -- start 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfde0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfea490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55901cd95700 con 0x55901cc06390 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55901cecf110 con 0x55901cc27070 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55901cfe1160 con 0x55901cbfe1b0 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12b1370740 10 client.0 _ll_register_callbacks cb 0x55901cee8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfde0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58800/0 (socket says 172.21.15.38:58800) 2024-09-21T06:22:03.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12a3fff640 1 -- 172.21.15.38:0/389493791 learned_addr learned my addr 172.21.15.38:0/389493791 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.122+0000 7f12a9399640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 -- 172.21.15.38:0/389493791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 msgr2=0x55901cfde0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfde0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 -- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 msgr2=0x55901cfea490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfea490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 -- 172.21.15.38:0/389493791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901cefcc40 con 0x55901cc06390 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a8b98640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfde0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a9399640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfea490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12a3fff640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1290004c40 tx=0x7f1290004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fb8e325c7eb43e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f1283fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290027030 con 0x55901cc06390 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f12900035f0 con 0x55901cc06390 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12900044b0 con 0x55901cc06390 2024-09-21T06:22:03.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f129001d040 con 0x55901cc06390 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12b1370740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.123+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55901cfece70 con 0x55901cc06390 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12900044b0 con 0x55901cc06390 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1290005440 con 0x55901cc06390 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 20 client.16146 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbe59f0 0x55901cff01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 4 client.16146 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55901cf46da0 con 0x55901cbe59f0 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.124+0000 7f12a8b98640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbe59f0 0x55901cff01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.125+0000 7f12a8b98640 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbe59f0 0x55901cff01d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a7c83525f65da8 server_cookie=3e5bb8e77622acae in_seq=0 out_seq=0 2024-09-21T06:22:03.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.125+0000 7f1283fff640 10 client.16146 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:03.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.128+0000 7f1283fff640 1 -- 172.21.15.38:0/389493791 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55901cf46da0 con 0x55901cbe59f0 2024-09-21T06:22:03.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.128+0000 7f1283fff640 10 client.16146 handle_command_reply: tid=0 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 client.16146 shutdown 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 msgr2=0x55901cfde610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1290004c40 tx=0x7f1290004960 comp rx=0 tx=0).stop 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 shutdown_connections 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfea490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc06390 0x55901cfde610 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbe59f0 0x55901cff01d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f1283fff640 0 client.16146 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:03.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 --2- 172.21.15.38:0/389493791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cbfe1b0 0x55901cfde0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 >> 172.21.15.38:0/389493791 conn(0x55901cc1b460 msgr2=0x55901cfcab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 shutdown_connections 2024-09-21T06:22:03.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 1 -- 172.21.15.38:0/389493791 wait complete. 2024-09-21T06:22:03.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.129+0000 7f12b1370740 20 client.16146 trim_cache size 0 max 16384 2024-09-21T06:22:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.147+0000 7f12b1370740 1 Processor -- start 2024-09-21T06:22:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.147+0000 7f12b1370740 1 -- start start 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 0x55901cfde590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfcbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41afe20 con 0x55901cc27070 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41ad630 con 0x55901cbfe1b0 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12b1370740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41ab4a0 con 0x55901cc06390 2024-09-21T06:22:03.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a9399640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfcbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 0x55901cfde590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 0x55901cfde590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:54146/0 (socket says 172.21.15.38:54146) 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:42812/0 (socket says 172.21.15.38:42812) 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a8b98640 1 -- 172.21.15.38:0/1328542366 learned_addr learned my addr 172.21.15.38:0/1328542366 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a9399640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfcbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58810/0 (socket says 172.21.15.38:58810) 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 -- 172.21.15.38:0/1328542366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 msgr2=0x55901cfde590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 0x55901cfde590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 -- 172.21.15.38:0/1328542366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 msgr2=0x55901cfcbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfcbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.148+0000 7f12a3fff640 1 -- 172.21.15.38:0/1328542366 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901cfdc5d0 con 0x55901cc06390 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.149+0000 7f12a3fff640 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1290004c40 tx=0x7f1290009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6686c56c19fd06a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.149+0000 7f128e7fc640 1 -- 172.21.15.38:0/1328542366 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129003a070 con 0x55901cc06390 2024-09-21T06:22:03.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.149+0000 7f128e7fc640 1 -- 172.21.15.38:0/1328542366 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f129002e0c0 con 0x55901cc06390 2024-09-21T06:22:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.149+0000 7f128e7fc640 1 -- 172.21.15.38:0/1328542366 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290027070 con 0x55901cc06390 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- 172.21.15.38:0/1328542366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 msgr2=0x55901cfea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1290004c40 tx=0x7f1290009b70 comp rx=0 tx=0).stop 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- 172.21.15.38:0/1328542366 shutdown_connections 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cc27070 0x55901cfcbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfea390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 --2- 172.21.15.38:0/1328542366 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cbfe1b0 0x55901cfde590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- 172.21.15.38:0/1328542366 >> 172.21.15.38:0/1328542366 conn(0x55901cc1b460 msgr2=0x55901cfdde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- 172.21.15.38:0/1328542366 shutdown_connections 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- 172.21.15.38:0/1328542366 wait complete. 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 -- start start 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.150+0000 7f12b1370740 1 Processor -- start 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfe1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfe2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41abaf0 con 0x55901cbfe1b0 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41acf60 con 0x55901cc27070 2024-09-21T06:22:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12a41ac1c0 con 0x55901cc06390 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12b1370740 10 client.0 _ll_register_callbacks cb 0x7f129c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a9399640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfe2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58814/0 (socket says 172.21.15.38:58814) 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 -- 172.21.15.38:0/3673772994 learned_addr learned my addr 172.21.15.38:0/3673772994 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfe1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 -- 172.21.15.38:0/3673772994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 msgr2=0x55901cfe1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfe1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 -- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 msgr2=0x55901cfe2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfe2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.151+0000 7f12a8b98640 1 -- 172.21.15.38:0/3673772994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901d058ca0 con 0x55901cbfe1b0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12a8b98640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f12981051f0 tx=0x7f1298107b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7926a379cda447 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:03.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298049040 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f12980c9b60 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f129002e0c0 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12980cd060 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55901d059f30 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f129002e0c0 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f12980d6dd0 con 0x55901cbfe1b0 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.152+0000 7f12b1370740 20 client.16152 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbbada0 0x55901d05c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:03.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f12b1370740 4 client.16152 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:22:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55901cf42850 con 0x55901cbbada0 2024-09-21T06:22:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbbada0 0x55901d05c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f12a3fff640 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbbada0 0x55901d05c700 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a7450124a990a0c server_cookie=894db915f6301abe in_seq=0 out_seq=0 2024-09-21T06:22:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.153+0000 7f1283fff640 10 client.16152 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f1283fff640 1 -- 172.21.15.38:0/3673772994 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1714 (crc 0 0 0) 0x55901cf42850 con 0x55901cbbada0 2024-09-21T06:22:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f1283fff640 10 client.16152 handle_command_reply: tid=0 2024-09-21T06:22:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 client.16152 shutdown 2024-09-21T06:22:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 msgr2=0x55901cfe17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f12981051f0 tx=0x7f1298107b70 comp rx=0 tx=0).stop 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 shutdown_connections 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901cc27070 0x55901cfe2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901cbbada0 0x55901d05c700 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901cc06390 0x55901cfe1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 --2- 172.21.15.38:0/3673772994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901cbfe1b0 0x55901cfe17e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 >> 172.21.15.38:0/3673772994 conn(0x55901cc1b460 msgr2=0x55901cfcbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f1283fff640 0 client.16152 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 shutdown_connections 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 1 -- 172.21.15.38:0/3673772994 wait complete. 2024-09-21T06:22:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.158+0000 7f12b1370740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "scrub active (641 inodes in the stack)", 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "c9d0ce09-15ac-453f-8dfd-01525a60349a", 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:22:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:03.167 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:22:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 msgr2=0x7f12940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 0x7f12940b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f129c009fd0 tx=0x7f129c009500 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 msgr2=0x7f12a419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1298005940 tx=0x7f1298004040 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 shutdown_connections 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f12940b6680 0x7f12940b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12a410de10 0x7f12a419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12a4105300 0x7f12a419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 --2- 172.21.15.38:0/515232768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f12a41049b0 0x7f12a419a600 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 >> 172.21.15.38:0/515232768 conn(0x7f12a4079730 msgr2=0x7f12a41007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 shutdown_connections 2024-09-21T06:22:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:03.159+0000 7f12aadfc640 1 -- 172.21.15.38:0/515232768 wait complete. 2024-09-21T06:22:03.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:22:03.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:03.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: pgmap v390: 97 pgs: 97 active+clean; 163 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 860 op/s 2024-09-21T06:22:03.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:03.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:03 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: pgmap v390: 97 pgs: 97 active+clean; 163 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 860 op/s 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:03 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:22:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:03.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: pgmap v390: 97 pgs: 97 active+clean; 163 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 860 op/s 2024-09-21T06:22:03.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:03.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:03 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:03.946 INFO:tasks.cephfs.filesystem:scrub status for tag:c9d0ce09-15ac-453f-8dfd-01525a60349a - {'path': '/', 'tag': 'c9d0ce09-15ac-453f-8dfd-01525a60349a', 'options': 'recursive,force'} 2024-09-21T06:22:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:04 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:04 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:04.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:04 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:04.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:04 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:04.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:04 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:04.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:04 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:05 smithi044 ceph-mon[34369]: pgmap v391: 97 pgs: 97 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 1.12k op/s 2024-09-21T06:22:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:05 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:05 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:05 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:05 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:05 smithi038 ceph-mon[31215]: pgmap v391: 97 pgs: 97 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 1.12k op/s 2024-09-21T06:22:05.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:05 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:05.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:05 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:05.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:05 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:05 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:05 smithi174 ceph-mon[34815]: pgmap v391: 97 pgs: 97 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.9 MiB/s wr, 1.12k op/s 2024-09-21T06:22:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:05 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:05.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:05 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:05.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:05 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:05.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:05 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:07.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:07 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:07.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:07 smithi044 ceph-mon[34369]: pgmap v392: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-21T06:22:07.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:07 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:07.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:07 smithi038 ceph-mon[31215]: pgmap v392: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-21T06:22:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:07 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:07.666 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:07 smithi174 ceph-mon[34815]: pgmap v392: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-21T06:22:09.062 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-21T06:22:09.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:22:09.365 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:09 smithi038 ceph-mon[31215]: pgmap v393: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-21T06:22:09.366 DEBUG:teuthology.parallel:result is None 2024-09-21T06:22:09.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:22:09.401 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:22:09.401 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T06:22:09.412 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:22:09.412 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:09 smithi044 ceph-mon[34369]: pgmap v393: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-21T06:22:09.450 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T06:22:09.460 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T06:22:09.460 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:22:09.460 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:22:09.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T06:22:09.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T06:22:09.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:09 smithi174 ceph-mon[34815]: pgmap v393: 97 pgs: 97 active+clean; 157 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 1.06k op/s 2024-09-21T06:22:11.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:11 smithi038 ceph-mon[31215]: pgmap v394: 97 pgs: 97 active+clean; 163 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 1.11k op/s 2024-09-21T06:22:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:11 smithi174 ceph-mon[34815]: pgmap v394: 97 pgs: 97 active+clean; 163 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 1.11k op/s 2024-09-21T06:22:11.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:11 smithi044 ceph-mon[34369]: pgmap v394: 97 pgs: 97 active+clean; 163 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 1.11k op/s 2024-09-21T06:22:13.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:13 smithi038 ceph-mon[31215]: pgmap v395: 97 pgs: 97 active+clean; 167 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 890 op/s 2024-09-21T06:22:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:13 smithi174 ceph-mon[34815]: pgmap v395: 97 pgs: 97 active+clean; 167 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 890 op/s 2024-09-21T06:22:13.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:13 smithi044 ceph-mon[34369]: pgmap v395: 97 pgs: 97 active+clean; 167 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 890 op/s 2024-09-21T06:22:14.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:14 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:22:14.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:14 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:22:14.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:14 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:22:14.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:14 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:22:14.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:14 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:22:14.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:14 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:22:14.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:14 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:22:14.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:14 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:22:14.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:14 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:22:15.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:15 smithi038 ceph-mon[31215]: pgmap v396: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 707 op/s 2024-09-21T06:22:15.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:15 smithi174 ceph-mon[34815]: pgmap v396: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 707 op/s 2024-09-21T06:22:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:15 smithi044 ceph-mon[34369]: pgmap v396: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 707 op/s 2024-09-21T06:22:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:17 smithi038 ceph-mon[31215]: pgmap v397: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-21T06:22:17.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:17 smithi174 ceph-mon[34815]: pgmap v397: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-21T06:22:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:17 smithi044 ceph-mon[34369]: pgmap v397: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 435 op/s 2024-09-21T06:22:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:19 smithi038 ceph-mon[31215]: pgmap v398: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-09-21T06:22:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:19 smithi174 ceph-mon[34815]: pgmap v398: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-09-21T06:22:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:19 smithi044 ceph-mon[34369]: pgmap v398: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 351 op/s 2024-09-21T06:22:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:21 smithi038 ceph-mon[31215]: pgmap v399: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 240 op/s 2024-09-21T06:22:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:21 smithi174 ceph-mon[34815]: pgmap v399: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 240 op/s 2024-09-21T06:22:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:21 smithi044 ceph-mon[34369]: pgmap v399: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 240 op/s 2024-09-21T06:22:23.447 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:23 smithi174 ceph-mon[34815]: pgmap v400: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 479 KiB/s wr, 94 op/s 2024-09-21T06:22:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:23 smithi038 ceph-mon[31215]: pgmap v400: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 479 KiB/s wr, 94 op/s 2024-09-21T06:22:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:23 smithi044 ceph-mon[34369]: pgmap v400: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 479 KiB/s wr, 94 op/s 2024-09-21T06:22:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:25 smithi038 ceph-mon[31215]: pgmap v401: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 50 op/s 2024-09-21T06:22:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:25 smithi174 ceph-mon[34815]: pgmap v401: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 50 op/s 2024-09-21T06:22:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:25 smithi044 ceph-mon[34369]: pgmap v401: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 50 op/s 2024-09-21T06:22:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:27 smithi038 ceph-mon[31215]: pgmap v402: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:22:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:27 smithi174 ceph-mon[34815]: pgmap v402: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:22:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:27 smithi044 ceph-mon[34369]: pgmap v402: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:22:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:29 smithi038 ceph-mon[31215]: pgmap v403: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T06:22:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:29 smithi174 ceph-mon[34815]: pgmap v403: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T06:22:29.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:29 smithi044 ceph-mon[34369]: pgmap v403: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T06:22:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:31 smithi038 ceph-mon[31215]: pgmap v404: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:22:31.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:31 smithi174 ceph-mon[34815]: pgmap v404: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:22:31.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:31 smithi044 ceph-mon[34369]: pgmap v404: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:22:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:33 smithi038 ceph-mon[31215]: pgmap v405: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:22:33.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:33 smithi174 ceph-mon[34815]: pgmap v405: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:22:33.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:33 smithi044 ceph-mon[34369]: pgmap v405: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 8 op/s 2024-09-21T06:22:33.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:22:34.222 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 -- 172.21.15.38:0/57872455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 msgr2=0x7f314c1035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 --2- 172.21.15.38:0/57872455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c1035e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f313c009ca0 tx=0x7f313c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 -- 172.21.15.38:0/57872455 shutdown_connections 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 --2- 172.21.15.38:0/57872455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 --2- 172.21.15.38:0/57872455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 --2- 172.21.15.38:0/57872455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c1035e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 -- 172.21.15.38:0/57872455 >> 172.21.15.38:0/57872455 conn(0x7f314c079f90 msgr2=0x7f314c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 -- 172.21.15.38:0/57872455 shutdown_connections 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.733+0000 7f31538d3640 1 -- 172.21.15.38:0/57872455 wait complete. 2024-09-21T06:22:34.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 Processor -- start 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 -- start start 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f314c112b30 con 0x7f314c1031d0 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1129b0 con 0x7f314c108d50 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.734+0000 7f31538d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f314c112cb0 con 0x7f314c108400 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54240/0 (socket says 172.21.15.38:54240) 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 -- 172.21.15.38:0/1063609832 learned_addr learned my addr 172.21.15.38:0/1063609832 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f3151e70640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 -- 172.21.15.38:0/1063609832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 msgr2=0x7f314c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 -- 172.21.15.38:0/1063609832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 msgr2=0x7f314c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 -- 172.21.15.38:0/1063609832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c1a65e0 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f3151e70640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f315166f640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f313c006010 tx=0x7f313c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f314a7fc640 1 -- 172.21.15.38:0/1063609832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0316d0 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c1a6870 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f314a7fc640 1 -- 172.21.15.38:0/1063609832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f313c031870 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f314a7fc640 1 -- 172.21.15.38:0/1063609832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c02fc90 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.735+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c1a6db0 con 0x7f314c1031d0 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 Processor -- start 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 -- start start 2024-09-21T06:22:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f314a7fc640 1 -- 172.21.15.38:0/1063609832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f313c004040 con 0x7f314c1031d0 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1f2070 0x55eb5d599650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d59a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d50fe50 con 0x55eb5d1c91b0 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d4ff280 con 0x55eb5d1f2070 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.738+0000 7f3159e47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d503090 con 0x55eb5d1d1390 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54252/0 (socket says 172.21.15.38:54252) 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 -- 172.21.15.38:0/1774221586 learned_addr learned my addr 172.21.15.38:0/1774221586 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f3151e70640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1f2070 0x55eb5d599650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d59a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 -- 172.21.15.38:0/1774221586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 msgr2=0x55eb5d59a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d59a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 -- 172.21.15.38:0/1774221586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1f2070 msgr2=0x55eb5d599650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1f2070 0x55eb5d599650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 -- 172.21.15.38:0/1774221586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5d25d650 con 0x55eb5d1c91b0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d59a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f315166f640 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f313c106220 tx=0x7f313c10cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946e71c86c28e141 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.739+0000 7f314a7fc640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 0x7f31340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.740+0000 7f31337fe640 1 -- 172.21.15.38:0/1774221586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ce300 con 0x55eb5d1c91b0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.740+0000 7f3151e70640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 0x7f31340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.740+0000 7f31337fe640 1 -- 172.21.15.38:0/1774221586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f313c11a070 con 0x55eb5d1c91b0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.740+0000 7f31337fe640 1 -- 172.21.15.38:0/1774221586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ce4f0 con 0x55eb5d1c91b0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.740+0000 7f314a7fc640 1 -- 172.21.15.38:0/1063609832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f313c108ae0 con 0x7f314c1031d0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- 172.21.15.38:0/1774221586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 msgr2=0x55eb5d599b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3151e70640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 0x7f31340b8bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3144005fd0 tx=0x7f3144009420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f313c106220 tx=0x7f313c10cd00 comp rx=0 tx=0).stop 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- 172.21.15.38:0/1774221586 shutdown_connections 2024-09-21T06:22:34.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d59a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d599b90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 --2- 172.21.15.38:0/1774221586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1f2070 0x55eb5d599650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- 172.21.15.38:0/1774221586 >> 172.21.15.38:0/1774221586 conn(0x55eb5d1e6460 msgr2=0x55eb5d597540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- 172.21.15.38:0/1774221586 shutdown_connections 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- 172.21.15.38:0/1774221586 wait complete. 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 -- start start 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.741+0000 7f3159e47740 1 Processor -- start 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1f2070 0x55eb5d5b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d360700 con 0x55eb5d1c91b0 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d49a110 con 0x55eb5d1d1390 2024-09-21T06:22:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d50fe50 con 0x55eb5d1f2070 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3159e47740 10 client.0 _ll_register_callbacks cb 0x55eb5d4b3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54268/0 (socket says 172.21.15.38:54268) 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 -- 172.21.15.38:0/1339390306 learned_addr learned my addr 172.21.15.38:0/1339390306 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3151e70640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1f2070 0x55eb5d5b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 -- 172.21.15.38:0/1339390306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1f2070 msgr2=0x55eb5d5b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1f2070 0x55eb5d5b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 -- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1d1390 msgr2=0x55eb5d5a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 -- 172.21.15.38:0/1339390306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5d4c7c40 con 0x55eb5d1c91b0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f315166f640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f313c0b6070 tx=0x7f313c109fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646c4aa3f1812ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.742+0000 7f3130ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ce780 con 0x55eb5d1c91b0 2024-09-21T06:22:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f313c0baf40 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f313c11a070 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f313c0ca120 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 10 client.16164 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb5d5b3650 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f313c11a070 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f313c0cfce0 con 0x55eb5d1c91b0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 10 client.16164 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 10 client.16164 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 20 client.16164 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1b09f0 0x55eb5d5b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 4 client.16164 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5d511da0 con 0x55eb5d1b09f0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.743+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1b09f0 0x55eb5d5b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.744+0000 7f3130ff9640 10 client.16164 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:34.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.744+0000 7f3150e6e640 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1b09f0 0x55eb5d5b6b50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d22b749efd49b66 server_cookie=2438d9f80ff99224 in_seq=0 out_seq=0 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3130ff9640 1 -- 172.21.15.38:0/1339390306 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb5d511da0 con 0x55eb5d1b09f0 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3130ff9640 10 client.16164 handle_command_reply: tid=0 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 client.16164 shutdown 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 msgr2=0x55eb5d5a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f313c0b6070 tx=0x7f313c109fa0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 shutdown_connections 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1b09f0 0x55eb5d5b6b50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1f2070 0x55eb5d5b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 --2- 172.21.15.38:0/1339390306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a4d10 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3130ff9640 0 client.16164 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 >> 172.21.15.38:0/1339390306 conn(0x55eb5d1e6460 msgr2=0x55eb5d59c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 shutdown_connections 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 1 -- 172.21.15.38:0/1339390306 wait complete. 2024-09-21T06:22:34.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.745+0000 7f3159e47740 20 client.16164 trim_cache size 0 max 16384 2024-09-21T06:22:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 Processor -- start 2024-09-21T06:22:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 -- start start 2024-09-21T06:22:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1c91b0 0x55eb5d596b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5970b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1b2010 con 0x55eb5d1b09f0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1af820 con 0x55eb5d1c91b0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3159e47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1ad670 con 0x55eb5d1d1390 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54282/0 (socket says 172.21.15.38:54282) 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 -- 172.21.15.38:0/3002988743 learned_addr learned my addr 172.21.15.38:0/3002988743 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f3150e6e640 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1c91b0 0x55eb5d596b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 -- 172.21.15.38:0/3002988743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 msgr2=0x55eb5d5970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 -- 172.21.15.38:0/3002988743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1c91b0 msgr2=0x55eb5d596b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.763+0000 7f315166f640 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1c91b0 0x55eb5d596b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.764+0000 7f315166f640 1 -- 172.21.15.38:0/3002988743 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5d5a5810 con 0x55eb5d1b09f0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.764+0000 7f315166f640 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f313c10b040 tx=0x7f313c10cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8102c1bfb41de16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.764+0000 7f3132ffd640 1 -- 172.21.15.38:0/3002988743 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0b8e60 con 0x55eb5d1b09f0 2024-09-21T06:22:34.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.764+0000 7f3132ffd640 1 -- 172.21.15.38:0/3002988743 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f313c11a020 con 0x55eb5d1b09f0 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.764+0000 7f3132ffd640 1 -- 172.21.15.38:0/3002988743 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ca300 con 0x55eb5d1b09f0 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- 172.21.15.38:0/3002988743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 msgr2=0x55eb5d5a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f313c10b040 tx=0x7f313c10cd00 comp rx=0 tx=0).stop 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- 172.21.15.38:0/3002988743 shutdown_connections 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1c91b0 0x55eb5d596b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 --2- 172.21.15.38:0/3002988743 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a51d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- 172.21.15.38:0/3002988743 >> 172.21.15.38:0/3002988743 conn(0x55eb5d1e6460 msgr2=0x55eb5d5a4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- 172.21.15.38:0/3002988743 shutdown_connections 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- 172.21.15.38:0/3002988743 wait complete. 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 -- start start 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.765+0000 7f3159e47740 1 Processor -- start 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1adce0 con 0x55eb5d1c91b0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1af150 con 0x55eb5d1b09f0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1ae3b0 con 0x55eb5d1d1390 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3159e47740 10 client.0 _ll_register_callbacks cb 0x7f31440092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f315166f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54294/0 (socket says 172.21.15.38:54294) 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 -- 172.21.15.38:0/2510281474 learned_addr learned my addr 172.21.15.38:0/2510281474 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3151e70640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 -- 172.21.15.38:0/2510281474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 msgr2=0x55eb5d5a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 -- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 msgr2=0x55eb5d5a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f3150e6e640 1 -- 172.21.15.38:0/2510281474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5d620510 con 0x55eb5d1c91b0 2024-09-21T06:22:34.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.766+0000 7f315166f640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3150e6e640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f314c06a550 tx=0x7f3140010a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27b376b24fd90ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314001c7e0 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f314001e040 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f313c11a020 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f314001c980 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb5d621790 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f313c11a020 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f314000f480 con 0x55eb5d1c91b0 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 20 client.16170 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:34.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1f2070 0x55eb5d624030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 4 client.16170 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.767+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eb5d50d850 con 0x55eb5d1f2070 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f315166f640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1f2070 0x55eb5d624030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f315166f640 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1f2070 0x55eb5d624030 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83431e0049c2fe2f server_cookie=3301adbc1a6423f6 in_seq=0 out_seq=0 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f3130ff9640 10 client.16170 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f3130ff9640 1 -- 172.21.15.38:0/2510281474 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55eb5d50d850 con 0x55eb5d1f2070 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f3130ff9640 10 client.16170 handle_command_reply: tid=0 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.768+0000 7f3159e47740 1 client.16170 shutdown 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 msgr2=0x55eb5d5a9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f314c06a550 tx=0x7f3140010a80 comp rx=0 tx=0).stop 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 shutdown_connections 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55eb5d1f2070 0x55eb5d624030 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb5d1d1390 0x55eb5d5a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb5d1c91b0 0x55eb5d5a9050 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3130ff9640 0 client.16170 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 --2- 172.21.15.38:0/2510281474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb5d1b09f0 0x55eb5d5a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 >> 172.21.15.38:0/2510281474 conn(0x55eb5d1e6460 msgr2=0x55eb5d59c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 shutdown_connections 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 1 -- 172.21.15.38:0/2510281474 wait complete. 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f3159e47740 20 client.16170 trim_cache size 0 max 16384 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:22:34.780 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:34.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:34.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:34.783 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 msgr2=0x7f31340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.769+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 0x7f31340b8bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3144005fd0 tx=0x7f3144009420 comp rx=0 tx=0).stop 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 msgr2=0x7f314c19b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f313c006010 tx=0x7f313c003f10 comp rx=0 tx=0).stop 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 shutdown_connections 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f31340b66b0 0x7f31340b8bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f314c108d50 0x7f314c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f314c108400 0x7f314c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 --2- 172.21.15.38:0/1063609832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f314c1031d0 0x7f314c19b3e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:34.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 >> 172.21.15.38:0/1063609832 conn(0x7f314c079f90 msgr2=0x7f314c106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:34.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 shutdown_connections 2024-09-21T06:22:34.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:34.770+0000 7f31538d3640 1 -- 172.21.15.38:0/1063609832 wait complete. 2024-09-21T06:22:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:35 smithi038 ceph-mon[31215]: pgmap v406: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T06:22:35.561 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:22:35.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:22:35.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:35 smithi174 ceph-mon[34815]: pgmap v406: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T06:22:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:35 smithi044 ceph-mon[34369]: pgmap v406: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T06:22:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 -- 172.21.15.38:0/1941379151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c1094a0 msgr2=0x7fbf5c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 --2- 172.21.15.38:0/1941379151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c1098b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009900 tx=0x7fbf4402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 -- 172.21.15.38:0/1941379151 shutdown_connections 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 --2- 172.21.15.38:0/1941379151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c109df0 0x7fbf5c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 --2- 172.21.15.38:0/1941379151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c1098b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 --2- 172.21.15.38:0/1941379151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c103b60 0x7fbf5c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 -- 172.21.15.38:0/1941379151 >> 172.21.15.38:0/1941379151 conn(0x7fbf5c07b850 msgr2=0x7fbf5c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 -- 172.21.15.38:0/1941379151 shutdown_connections 2024-09-21T06:22:36.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.294+0000 7fbf6234d640 1 -- 172.21.15.38:0/1941379151 wait complete. 2024-09-21T06:22:36.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 Processor -- start 2024-09-21T06:22:36.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 -- start start 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c103b60 0x7fbf5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113c10 con 0x7fbf5c109df0 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113a90 con 0x7fbf5c1094a0 2024-09-21T06:22:36.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.295+0000 7fbf6234d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113d90 con 0x7fbf5c103b60 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54306/0 (socket says 172.21.15.38:54306) 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 -- 172.21.15.38:0/2921529380 learned_addr learned my addr 172.21.15.38:0/2921529380 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf53fff640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf5bfff640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c103b60 0x7fbf5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 -- 172.21.15.38:0/2921529380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c103b60 msgr2=0x7fbf5c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c103b60 0x7fbf5c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 -- 172.21.15.38:0/2921529380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c1094a0 msgr2=0x7fbf5c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 -- 172.21.15.38:0/2921529380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c1a8850 con 0x7fbf5c109df0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf608ea640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400cce0 tx=0x7fbf5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400f450 con 0x7fbf5c109df0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c1a8b40 con 0x7fbf5c109df0 2024-09-21T06:22:36.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf5400fac0 con 0x7fbf5c109df0 2024-09-21T06:22:36.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54018be0 con 0x7fbf5c109df0 2024-09-21T06:22:36.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.296+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c1a9050 con 0x7fbf5c109df0 2024-09-21T06:22:36.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.297+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c103f70 con 0x7fbf5c109df0 2024-09-21T06:22:36.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.300+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbf5400fc70 con 0x7fbf5c109df0 2024-09-21T06:22:36.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.301+0000 7fbf59ffb640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 0x7fbf480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:36.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.301+0000 7fbf5bfff640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 0x7fbf480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:36.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.301+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbf540e7e80 con 0x7fbf5c109df0 2024-09-21T06:22:36.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.301+0000 7fbf5bfff640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 0x7fbf480b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c077160 tx=0x7fbf4c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:36.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.304+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf54014030 con 0x7fbf5c109df0 2024-09-21T06:22:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.532+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf5c076a10 con 0x7fbf5c109df0 2024-09-21T06:22:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.533+0000 7fbf59ffb640 1 -- 172.21.15.38:0/2921529380 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11920 (secure 0 0 0) 0x7fbf5c076a10 con 0x7fbf5c109df0 2024-09-21T06:22:36.535 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:22:36.535 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"btime":"2024-09-21T06:21:43:078980+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:21:42.404223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:22:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 28 2024-09-21T06:22:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.535+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 msgr2=0x7fbf480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.535+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 0x7fbf480b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c077160 tx=0x7fbf4c008040 comp rx=0 tx=0).stop 2024-09-21T06:22:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.535+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 msgr2=0x7fbf5c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.535+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400cce0 tx=0x7fbf5400a620 comp rx=0 tx=0).stop 2024-09-21T06:22:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 shutdown_connections 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbf480b6680 0x7fbf480b8b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf5c109df0 0x7fbf5c076190 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf5c1094a0 0x7fbf5c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 --2- 172.21.15.38:0/2921529380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf5c103b60 0x7fbf5c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 >> 172.21.15.38:0/2921529380 conn(0x7fbf5c07b850 msgr2=0x7fbf5c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 shutdown_connections 2024-09-21T06:22:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:36.536+0000 7fbf6234d640 1 -- 172.21.15.38:0/2921529380 wait complete. 2024-09-21T06:22:37.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:22:37.437 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:37.559 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:37 smithi038 ceph-mon[31215]: pgmap v407: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T06:22:37.559 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:37 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2921529380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:37 smithi174 ceph-mon[34815]: pgmap v407: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T06:22:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:37 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2921529380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:37 smithi044 ceph-mon[34369]: pgmap v407: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-09-21T06:22:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:37 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2921529380' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:22:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 -- 172.21.15.38:0/3650108787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0109e40 msgr2=0x7f3fd0110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/3650108787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0109e40 0x7f3fd0110670 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009ca0 tx=0x7f3fc802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 -- 172.21.15.38:0/3650108787 shutdown_connections 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/3650108787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd0109e40 0x7f3fd0110670 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/3650108787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd01094f0 0x7f3fd0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/3650108787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 0x7f3fd0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 -- 172.21.15.38:0/3650108787 >> 172.21.15.38:0/3650108787 conn(0x7f3fd00ff600 msgr2=0x7f3fd0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 -- 172.21.15.38:0/3650108787 shutdown_connections 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.928+0000 7f3fd6f76640 1 -- 172.21.15.38:0/3650108787 wait complete. 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 Processor -- start 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 -- start start 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 0x7f3fd019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd0109e40 0x7f3fd019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0113c40 con 0x7f3fd01094f0 2024-09-21T06:22:37.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0113ac0 con 0x7f3fd0103bb0 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fd6f76640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0113dc0 con 0x7f3fd0109e40 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54318/0 (socket says 172.21.15.38:54318) 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.929+0000 7f3fcffff640 1 -- 172.21.15.38:0/6902736 learned_addr learned my addr 172.21.15.38:0/6902736 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 0x7f3fd019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fd5513640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd0109e40 0x7f3fd019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 -- 172.21.15.38:0/6902736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd0109e40 msgr2=0x7f3fd019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd0109e40 0x7f3fd019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 -- 172.21.15.38:0/6902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 msgr2=0x7f3fd019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 0x7f3fd019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 -- 172.21.15.38:0/6902736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01a04c0 con 0x7f3fd01094f0 2024-09-21T06:22:37.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcffff640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9c0 tx=0x7f3fbc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcdffb640 1 -- 172.21.15.38:0/6902736 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00ccc0 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcdffb640 1 -- 172.21.15.38:0/6902736 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fbc0054f0 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fcdffb640 1 -- 172.21.15.38:0/6902736 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc010430 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01a07b0 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.930+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01a6f10 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 Processor -- start 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 -- start start 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fcdffb640 1 -- 172.21.15.38:0/6902736 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3fbc0046c0 con 0x7f3fd01094f0 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27549be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55eb274bfea0 con 0x55eb27181390 2024-09-21T06:22:37.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb274af2d0 con 0x55eb271791b0 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.933+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb274b30e0 con 0x55eb271a2070 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54330/0 (socket says 172.21.15.38:54330) 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 -- 172.21.15.38:0/2134917816 learned_addr learned my addr 172.21.15.38:0/2134917816 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fd5513640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27549be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 -- 172.21.15.38:0/2134917816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 msgr2=0x55eb275496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 -- 172.21.15.38:0/2134917816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 msgr2=0x55eb27549be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27549be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 -- 172.21.15.38:0/2134917816 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb2720d650 con 0x55eb27181390 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27549be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:37.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcffff640 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0e52a0 tx=0x7f3fbc0ebca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2b280865f7b184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.934+0000 7f3fcdffb640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 0x7f3fc00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fbaffd640 1 -- 172.21.15.38:0/2134917816 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0f7070 con 0x55eb27181390 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fd5513640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 0x7f3fc00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fbaffd640 1 -- 172.21.15.38:0/2134917816 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fbc005340 con 0x55eb27181390 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fbaffd640 1 -- 172.21.15.38:0/2134917816 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0aa080 con 0x55eb27181390 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fcdffb640 1 -- 172.21.15.38:0/6902736 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3fbc0e7b60 con 0x7f3fd01094f0 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/2134917816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 msgr2=0x55eb2754a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.935+0000 7f3fd5513640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 0x7f3fc00b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005e30 tx=0x7f3fc8005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0e52a0 tx=0x7f3fbc0ebca0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/2134917816 shutdown_connections 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb2754a120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27549be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/2134917816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/2134917816 >> 172.21.15.38:0/2134917816 conn(0x55eb27196460 msgr2=0x55eb27547590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/2134917816 shutdown_connections 2024-09-21T06:22:37.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/2134917816 wait complete. 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 -- start start 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.936+0000 7f3fdd4ea740 1 Processor -- start 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb27181390 0x55eb27555240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55eb27310700 con 0x55eb271791b0 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb2744a160 con 0x55eb27181390 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb27557e80 con 0x55eb271a2070 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fdd4ea740 10 client.0 _ll_register_callbacks cb 0x55eb274639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54334/0 (socket says 172.21.15.38:54334) 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 -- 172.21.15.38:0/4191417144 learned_addr learned my addr 172.21.15.38:0/4191417144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fcffff640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb27181390 0x55eb27555240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd5513640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 -- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 msgr2=0x55eb275611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 -- 172.21.15.38:0/4191417144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb27181390 msgr2=0x55eb27555240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb27181390 0x55eb27555240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 -- 172.21.15.38:0/4191417144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb27477c90 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4013790 tx=0x7f3fc4013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab87a4757e60679a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3faffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.937+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4011dd0 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3fc4004020 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fbc005340 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fc4004220 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb27563bf0 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fbc005340 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3fc401a030 con 0x55eb271791b0 2024-09-21T06:22:37.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 10 client.16188 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 20 client.16188 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb271609f0 0x55eb27567210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 4 client.16188 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.938+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb274c1df0 con 0x55eb271609f0 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.939+0000 7f3fcffff640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb271609f0 0x55eb27567210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.939+0000 7f3faffff640 10 client.16188 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.939+0000 7f3fcffff640 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb271609f0 0x55eb27567210 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5200b78e92245567 server_cookie=72cc9571df9e46f4 in_seq=0 out_seq=0 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3faffff640 1 -- 172.21.15.38:0/4191417144 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb274c1df0 con 0x55eb271609f0 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3faffff640 10 client.16188 handle_command_reply: tid=0 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 client.16188 shutdown 2024-09-21T06:22:37.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 msgr2=0x55eb27554d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4013790 tx=0x7f3fc4013c50 comp rx=0 tx=0).stop 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 shutdown_connections 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb271609f0 0x55eb27567210 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271a2070 0x55eb275611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb27181390 0x55eb27555240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3faffff640 0 client.16188 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/4191417144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271791b0 0x55eb27554d00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 >> 172.21.15.38:0/4191417144 conn(0x55eb27196460 msgr2=0x55eb2754c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 shutdown_connections 2024-09-21T06:22:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/4191417144 wait complete. 2024-09-21T06:22:37.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.940+0000 7f3fdd4ea740 20 client.16188 trim_cache size 0 max 16384 2024-09-21T06:22:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 Processor -- start 2024-09-21T06:22:37.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 -- start start 2024-09-21T06:22:37.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27556be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb27181390 0x55eb2754a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01b1fa0 con 0x55eb271a2070 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01af7b0 con 0x55eb271791b0 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01ad600 con 0x55eb27181390 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd5513640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd5513640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54338/0 (socket says 172.21.15.38:54338) 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd5513640 1 -- 172.21.15.38:0/1415998556 learned_addr learned my addr 172.21.15.38:0/1415998556 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27556be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd5513640 1 -- 172.21.15.38:0/1415998556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb27181390 msgr2=0x55eb2754a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.954+0000 7f3fd5513640 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb27181390 0x55eb2754a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fd5513640 1 -- 172.21.15.38:0/1415998556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 msgr2=0x55eb27556be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fd5513640 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27556be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fd5513640 1 -- 172.21.15.38:0/1415998556 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb27557440 con 0x55eb271a2070 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fd5513640 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8032dc0 tx=0x7f3fc8041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce3b5587f9f666d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fba7fc640 1 -- 172.21.15.38:0/1415998556 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8031450 con 0x55eb271a2070 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fba7fc640 1 -- 172.21.15.38:0/1415998556 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fc8036040 con 0x55eb271a2070 2024-09-21T06:22:37.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.955+0000 7f3fba7fc640 1 -- 172.21.15.38:0/1415998556 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80305c0 con 0x55eb271a2070 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1415998556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 msgr2=0x55eb275610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8032dc0 tx=0x7f3fc8041000 comp rx=0 tx=0).stop 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1415998556 shutdown_connections 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb271a2070 0x55eb275610d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb27181390 0x55eb2754a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1415998556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271791b0 0x55eb27556be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1415998556 >> 172.21.15.38:0/1415998556 conn(0x55eb27196460 msgr2=0x55eb2754e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1415998556 shutdown_connections 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1415998556 wait complete. 2024-09-21T06:22:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 -- start start 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.956+0000 7f3fdd4ea740 1 Processor -- start 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271791b0 0x55eb27559340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271a2070 0x55eb27559dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01adc70 con 0x55eb27181390 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01af0e0 con 0x55eb271a2070 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd01ae340 con 0x55eb271791b0 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fdd4ea740 10 client.0 _ll_register_callbacks cb 0x7f3fc4009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54348/0 (socket says 172.21.15.38:54348) 2024-09-21T06:22:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 -- 172.21.15.38:0/1193157570 learned_addr learned my addr 172.21.15.38:0/1193157570 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271791b0 0x55eb27559340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fd5513640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271a2070 0x55eb27559dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 -- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271791b0 msgr2=0x55eb27559340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271791b0 0x55eb27559340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 -- 172.21.15.38:0/1193157570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271a2070 msgr2=0x55eb27559dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271a2070 0x55eb27559dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.957+0000 7f3fcffff640 1 -- 172.21.15.38:0/1193157570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb275d0dc0 con 0x55eb27181390 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fcffff640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c6a0 tx=0x7f3fbc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a38023abd563932 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc013e50 con 0x55eb27181390 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3fbc0b21b0 con 0x55eb27181390 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fc8036040 con 0x55eb27181390 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fbc096050 con 0x55eb27181390 2024-09-21T06:22:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 10 client.16194 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb275d2020 con 0x55eb27181390 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3fc8036040 con 0x55eb27181390 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3fbc0e55b0 con 0x55eb27181390 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 10 client.16194 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 10 client.16194 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 20 client.16194 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb27135da0 0x55eb275d4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 4 client.16194 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:22:37.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.958+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb274bd8a0 con 0x55eb27135da0 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb27135da0 0x55eb275d4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fd4d12640 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb27135da0 0x55eb275d4310 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acf26be28b4ad590 server_cookie=e0daa154dfc498b4 in_seq=0 out_seq=0 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3faffff640 10 client.16194 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3faffff640 1 -- 172.21.15.38:0/1193157570 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb274bd8a0 con 0x55eb27135da0 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3faffff640 10 client.16194 handle_command_reply: tid=0 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fdd4ea740 1 client.16194 shutdown 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 msgr2=0x55eb27559880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c6a0 tx=0x7f3fbc009310 comp rx=0 tx=0).stop 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 shutdown_connections 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.959+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55eb27135da0 0x55eb275d4310 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb271a2070 0x55eb27559dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55eb27181390 0x55eb27559880 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3faffff640 0 client.16194 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 --2- 172.21.15.38:0/1193157570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb271791b0 0x55eb27559340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 >> 172.21.15.38:0/1193157570 conn(0x55eb27196460 msgr2=0x55eb27556940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 shutdown_connections 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 1 -- 172.21.15.38:0/1193157570 wait complete. 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fdd4ea740 20 client.16194 trim_cache size 0 max 16384 2024-09-21T06:22:37.967 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 msgr2=0x7f3fc00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 0x7f3fc00b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005e30 tx=0x7f3fc8005c30 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 msgr2=0x7f3fd019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9c0 tx=0x7f3fbc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 shutdown_connections 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3fc00b6680 0x7f3fc00b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fd0109e40 0x7f3fd019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fd01094f0 0x7f3fd019aaf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.960+0000 7f3fd6f76640 1 --2- 172.21.15.38:0/6902736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3fd0103bb0 0x7f3fd019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.961+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 >> 172.21.15.38:0/6902736 conn(0x7f3fd00ff600 msgr2=0x7f3fd0108b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:37.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.961+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 shutdown_connections 2024-09-21T06:22:37.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:37.961+0000 7f3fd6f76640 1 -- 172.21.15.38:0/6902736 wait complete. 2024-09-21T06:22:38.661 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:22:38.917 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:39.294 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:39 smithi038 ceph-mon[31215]: pgmap v408: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 -- 172.21.15.38:0/4079670347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8104a20 msgr2=0x7f00b8104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/4079670347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8104a20 0x7f00b8104e30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a802a410 comp rx=0 tx=0).stop 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 -- 172.21.15.38:0/4079670347 shutdown_connections 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/4079670347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/4079670347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8105370 0x7f00b810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/4079670347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8104a20 0x7f00b8104e30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 -- 172.21.15.38:0/4079670347 >> 172.21.15.38:0/4079670347 conn(0x7f00b80796d0 msgr2=0x7f00b8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 -- 172.21.15.38:0/4079670347 shutdown_connections 2024-09-21T06:22:39.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.386+0000 7f00bcdc5640 1 -- 172.21.15.38:0/4079670347 wait complete. 2024-09-21T06:22:39.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 Processor -- start 2024-09-21T06:22:39.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 -- start start 2024-09-21T06:22:39.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8104a20 0x7f00b819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113bf0 con 0x7f00b8105370 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113a70 con 0x7f00b8104a20 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00bcdc5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113d70 con 0x7f00b810de50 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00b5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00b5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43184/0 (socket says 172.21.15.38:43184) 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.387+0000 7f00b5d9b640 1 -- 172.21.15.38:0/1942984920 learned_addr learned my addr 172.21.15.38:0/1942984920 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b659c640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8104a20 0x7f00b819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 -- 172.21.15.38:0/1942984920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 msgr2=0x7f00b819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 -- 172.21.15.38:0/1942984920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8104a20 msgr2=0x7f00b819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8104a20 0x7f00b819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 -- 172.21.15.38:0/1942984920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b81a04d0 con 0x7f00b8105370 2024-09-21T06:22:39.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c970 tx=0x7f00a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00af7fe640 1 -- 172.21.15.38:0/1942984920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0007bb0 con 0x7f00b8105370 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00af7fe640 1 -- 172.21.15.38:0/1942984920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a0007d50 con 0x7f00b8105370 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b81a07c0 con 0x7f00b8105370 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00af7fe640 1 -- 172.21.15.38:0/1942984920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a000f450 con 0x7f00b8105370 2024-09-21T06:22:39.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.388+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b81a6f20 con 0x7f00b8105370 2024-09-21T06:22:39.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.391+0000 7f00af7fe640 1 -- 172.21.15.38:0/1942984920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f00a00046c0 con 0x7f00b8105370 2024-09-21T06:22:39.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.391+0000 7f00c3339740 1 Processor -- start 2024-09-21T06:22:39.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.391+0000 7f00c3339740 1 -- start start 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b0fc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b0fcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d08b072ea0 con 0x55d08ad34390 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d08b0622d0 con 0x55d08ad2c1b0 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00c3339740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d08b0660e0 con 0x55d08ad55070 2024-09-21T06:22:39.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43190/0 (socket says 172.21.15.38:43190) 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 -- 172.21.15.38:0/3425411591 learned_addr learned my addr 172.21.15.38:0/3425411591 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b659c640 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b0fcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b0fc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 -- 172.21.15.38:0/3425411591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 msgr2=0x55d08b0fc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b0fc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 -- 172.21.15.38:0/3425411591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 msgr2=0x55d08b0fcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b0fcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00af7fe640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 0x7f00a40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.392+0000 7f00b5d9b640 1 -- 172.21.15.38:0/3425411591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08adc0650 con 0x55d08ad34390 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 0x7f00a40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00a00e4b60 tx=0x7f00a00a99d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fbb58c48aacf52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00af7fe640 1 -- 172.21.15.38:0/1942984920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f00a00e73f0 con 0x7f00b8105370 2024-09-21T06:22:39.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00acff9640 1 -- 172.21.15.38:0/3425411591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a001d030 con 0x55d08ad34390 2024-09-21T06:22:39.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00acff9640 1 -- 172.21.15.38:0/3425411591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a0005610 con 0x55d08ad34390 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.393+0000 7f00acff9640 1 -- 172.21.15.38:0/3425411591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a00acc10 con 0x55d08ad34390 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- 172.21.15.38:0/3425411591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 msgr2=0x55d08b0fd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00a00e4b60 tx=0x7f00a00a99d0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 0x7f00a40b8c10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f00b0005fd0 tx=0x7f00b0009590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- 172.21.15.38:0/3425411591 shutdown_connections 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad34390 0x55d08b0fd120 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b0fcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 --2- 172.21.15.38:0/3425411591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b0fc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- 172.21.15.38:0/3425411591 >> 172.21.15.38:0/3425411591 conn(0x55d08ad49460 msgr2=0x55d08b0fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- 172.21.15.38:0/3425411591 shutdown_connections 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- 172.21.15.38:0/3425411591 wait complete. 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.394+0000 7f00c3339740 1 -- start start 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 Processor -- start 2024-09-21T06:22:39.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b10c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b118540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d08aec3700 con 0x55d08ad2c1b0 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d08affd160 con 0x55d08ad34390 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d08b10f1e0 con 0x55d08ad55070 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00c3339740 10 client.0 _ll_register_callbacks cb 0x55d08b0169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43194/0 (socket says 172.21.15.38:43194) 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 -- 172.21.15.38:0/3294404311 learned_addr learned my addr 172.21.15.38:0/3294404311 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b10c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b118540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 -- 172.21.15.38:0/3294404311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 msgr2=0x55d08b118540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b118540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 -- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 msgr2=0x55d08b10c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.395+0000 7f00b659c640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b10c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f00b659c640 1 -- 172.21.15.38:0/3294404311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08b02ac90 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f00b659c640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a8031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61b1d9563fd8a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f009dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035040 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f00a8004240 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d08b074df0 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00a8004440 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f00c3339740 10 client.16206 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d08b11af60 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.396+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55d08b074df0 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f00a8004c30 con 0x55d08ad2c1b0 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 10 client.16206 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 10 client.16206 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 20 client.16206 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:39.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ad139f0 0x55d08b11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 4 client.16206 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:39.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d08b0708a0 con 0x55d08ad139f0 2024-09-21T06:22:39.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ad139f0 0x55d08b11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f009dffb640 10 client.16206 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.397+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ad139f0 0x55d08b11e4d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32ecb62659a3122a server_cookie=a07873a085ff3fb0 in_seq=0 out_seq=0 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f009dffb640 1 -- 172.21.15.38:0/3294404311 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d08b0708a0 con 0x55d08ad139f0 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f009dffb640 10 client.16206 handle_command_reply: tid=0 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 client.16206 shutdown 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 msgr2=0x55d08b10c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a8031880 comp rx=0 tx=0).stop 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 shutdown_connections 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ad139f0 0x55d08b11e4d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b118540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b10c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 --2- 172.21.15.38:0/3294404311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c1a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 >> 172.21.15.38:0/3294404311 conn(0x55d08ad49460 msgr2=0x55d08b0f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f009dffb640 0 client.16206 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.398+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 shutdown_connections 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.399+0000 7f00c3339740 1 -- 172.21.15.38:0/3294404311 wait complete. 2024-09-21T06:22:39.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.399+0000 7f00c3339740 20 client.16206 trim_cache size 0 max 16384 2024-09-21T06:22:39.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 Processor -- start 2024-09-21T06:22:39.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 -- start start 2024-09-21T06:22:39.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b101840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b101d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81afe30 con 0x55d08ad2c1b0 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81ad640 con 0x55d08ad34390 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00c3339740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81ab490 con 0x55d08ad55070 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43198/0 (socket says 172.21.15.38:43198) 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 -- 172.21.15.38:0/3263706177 learned_addr learned my addr 172.21.15.38:0/3263706177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 -- 172.21.15.38:0/3263706177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 msgr2=0x55d08b101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 -- 172.21.15.38:0/3263706177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 msgr2=0x55d08b101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.412+0000 7f00b659c640 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f00b659c640 1 -- 172.21.15.38:0/3263706177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b0fae80 con 0x55d08ad2c1b0 2024-09-21T06:22:39.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:39.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f00b659c640 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005240 tx=0x7f00a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e665f2ba44b1163b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f009ffff640 1 -- 172.21.15.38:0/3263706177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035040 con 0x55d08ad2c1b0 2024-09-21T06:22:39.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f009ffff640 1 -- 172.21.15.38:0/3263706177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a8054070 con 0x55d08ad2c1b0 2024-09-21T06:22:39.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.413+0000 7f009ffff640 1 -- 172.21.15.38:0/3263706177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80046c0 con 0x55d08ad2c1b0 2024-09-21T06:22:39.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- 172.21.15.38:0/3263706177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 msgr2=0x55d08b10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005240 tx=0x7f00a8001e70 comp rx=0 tx=0).stop 2024-09-21T06:22:39.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- 172.21.15.38:0/3263706177 shutdown_connections 2024-09-21T06:22:39.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad55070 0x55d08b101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad34390 0x55d08b101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 --2- 172.21.15.38:0/3263706177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad2c1b0 0x55d08b10c660 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- 172.21.15.38:0/3263706177 >> 172.21.15.38:0/3263706177 conn(0x55d08ad49460 msgr2=0x55d08b10bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- 172.21.15.38:0/3263706177 shutdown_connections 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- 172.21.15.38:0/3263706177 wait complete. 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 -- start start 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.414+0000 7f00c3339740 1 Processor -- start 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b1103a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad34390 0x55d08b1108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81abb00 con 0x55d08ad55070 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81acf70 con 0x55d08ad2c1b0 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81ac1d0 con 0x55d08ad34390 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00c3339740 10 client.0 _ll_register_callbacks cb 0x7f00a8031510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:39.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43208/0 (socket says 172.21.15.38:43208) 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b6d9d640 1 -- 172.21.15.38:0/2336301817 learned_addr learned my addr 172.21.15.38:0/2336301817 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b1103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad34390 0x55d08b1108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 -- 172.21.15.38:0/2336301817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad34390 msgr2=0x55d08b1108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad34390 0x55d08b1108e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 -- 172.21.15.38:0/2336301817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 msgr2=0x55d08b110e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 -- 172.21.15.38:0/2336301817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08b187e90 con 0x55d08ad2c1b0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b6d9d640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f00b659c640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b1103a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009830 tx=0x7f00a8005930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54c5c445b4d34fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.415+0000 7f009dffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035040 con 0x55d08ad2c1b0 2024-09-21T06:22:39.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a8054070 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f00a8003d80 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00a8003970 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 10 client.25850 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d08b189030 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a8054070 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f00a8060020 con 0x55d08ad2c1b0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 10 client.25850 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 10 client.25850 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 20 client.25850 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ace8da0 0x55d08b18b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 4 client.25850 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.416+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d08b06dcd0 con 0x55d08ace8da0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ace8da0 0x55d08b18b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f009dffb640 10 client.25850 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:22:39.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00b5d9b640 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ace8da0 0x55d08b18b730 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e1f73d60d5f0287 server_cookie=87a4a80f779ad9a9 in_seq=0 out_seq=0 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f009dffb640 1 -- 172.21.15.38:0/2336301817 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d08b06dcd0 con 0x55d08ace8da0 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f009dffb640 10 client.25850 handle_command_reply: tid=0 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 client.25850 shutdown 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 msgr2=0x55d08b1103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b1103a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009830 tx=0x7f00a8005930 comp rx=0 tx=0).stop 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 shutdown_connections 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55d08ace8da0 0x55d08b18b730 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d08ad55070 0x55d08b110e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f009dffb640 0 client.25850 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d08ad34390 0x55d08b1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 --2- 172.21.15.38:0/2336301817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d08ad2c1b0 0x55d08b1103a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.417+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 >> 172.21.15.38:0/2336301817 conn(0x55d08ad49460 msgr2=0x55d08b101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 shutdown_connections 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00c3339740 1 -- 172.21.15.38:0/2336301817 wait complete. 2024-09-21T06:22:39.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00c3339740 20 client.25850 trim_cache size 0 max 16384 2024-09-21T06:22:39.424 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:22:39.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 msgr2=0x7f00a40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 0x7f00a40b8c10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f00b0005fd0 tx=0x7f00b0009590 comp rx=0 tx=0).stop 2024-09-21T06:22:39.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 msgr2=0x7f00b819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c970 tx=0x7f00a000ce30 comp rx=0 tx=0).stop 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 shutdown_connections 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f00a40b6700 0x7f00a40b8c10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00b810de50 0x7f00b819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00b8105370 0x7f00b819ab00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 --2- 172.21.15.38:0/1942984920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00b8104a20 0x7f00b819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 >> 172.21.15.38:0/1942984920 conn(0x7f00b80796d0 msgr2=0x7f00b80ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 shutdown_connections 2024-09-21T06:22:39.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:39.418+0000 7f00bcdc5640 1 -- 172.21.15.38:0/1942984920 wait complete. 2024-09-21T06:22:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:39 smithi174 ceph-mon[34815]: pgmap v408: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-21T06:22:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:39 smithi044 ceph-mon[34369]: pgmap v408: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-21T06:22:40.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:22:40.453 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 -- 172.21.15.38:0/748230081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c01094e0 msgr2=0x7f81c01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 --2- 172.21.15.38:0/748230081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c01094e0 0x7f81c01098f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009900 tx=0x7f81b402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 -- 172.21.15.38:0/748230081 shutdown_connections 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 --2- 172.21.15.38:0/748230081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c0109e30 0x7f81c0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 --2- 172.21.15.38:0/748230081 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c01094e0 0x7f81c01098f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 --2- 172.21.15.38:0/748230081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 0x7f81c0103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 -- 172.21.15.38:0/748230081 >> 172.21.15.38:0/748230081 conn(0x7f81c00ff630 msgr2=0x7f81c0101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 -- 172.21.15.38:0/748230081 shutdown_connections 2024-09-21T06:22:40.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.862+0000 7f81c48b2640 1 -- 172.21.15.38:0/748230081 wait complete. 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.863+0000 7f81c48b2640 1 Processor -- start 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.863+0000 7f81c48b2640 1 -- start start 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.863+0000 7f81c48b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 0x7f81c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.863+0000 7f81c48b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 0x7f81c019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81c48b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81c48b2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0113c50 con 0x7f81c0109e30 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81c48b2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0113ad0 con 0x7f81c01094e0 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81c48b2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0113dd0 con 0x7f81c0103ba0 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43216/0 (socket says 172.21.15.38:43216) 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 -- 172.21.15.38:0/1828681758 learned_addr learned my addr 172.21.15.38:0/1828681758 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:40.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81be59c640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 0x7f81c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 0x7f81c019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 -- 172.21.15.38:0/1828681758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 msgr2=0x7f81c019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 0x7f81c019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 -- 172.21.15.38:0/1828681758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 msgr2=0x7f81c019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 0x7f81c019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 -- 172.21.15.38:0/1828681758 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c01a0550 con 0x7f81c0109e30 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 0x7f81c019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.864+0000 7f81bed9d640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f81b800b970 tx=0x7f81b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.865+0000 7f81af7fe640 1 -- 172.21.15.38:0/1828681758 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8019070 con 0x7f81c0109e30 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.865+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c01a0840 con 0x7f81c0109e30 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.865+0000 7f81af7fe640 1 -- 172.21.15.38:0/1828681758 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81b800cb40 con 0x7f81c0109e30 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.865+0000 7f81af7fe640 1 -- 172.21.15.38:0/1828681758 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8007650 con 0x7f81c0109e30 2024-09-21T06:22:40.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.865+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01a6fa0 con 0x7f81c0109e30 2024-09-21T06:22:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 Processor -- start 2024-09-21T06:22:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81af7fe640 1 -- 172.21.15.38:0/1828681758 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f81b801c070 con 0x7f81c0109e30 2024-09-21T06:22:40.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 -- start start 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da647070 0x5639da9ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5639da964ea0 con 0x5639da626390 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5639da9542d0 con 0x5639da647070 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81cae26740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5639da9580e0 con 0x5639da61e1b0 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.868+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43218/0 (socket says 172.21.15.38:43218) 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 -- 172.21.15.38:0/2361285980 learned_addr learned my addr 172.21.15.38:0/2361285980 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da647070 0x5639da9ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81be59c640 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81af7fe640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 0x7f81a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 -- 172.21.15.38:0/2361285980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 msgr2=0x5639da9eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 -- 172.21.15.38:0/2361285980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da647070 msgr2=0x5639da9ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da647070 0x5639da9ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 -- 172.21.15.38:0/2361285980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639da6b2650 con 0x5639da626390 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bed9d640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 0x7f81a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f81c006aa20 tx=0x7f81b40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5ced54cc4f86ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81af7fe640 1 -- 172.21.15.38:0/1828681758 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81b80e6b30 con 0x7f81c0109e30 2024-09-21T06:22:40.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.869+0000 7f81acff9640 1 -- 172.21.15.38:0/2361285980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035040 con 0x5639da626390 2024-09-21T06:22:40.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.870+0000 7f81acff9640 1 -- 172.21.15.38:0/2361285980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81b40035f0 con 0x5639da626390 2024-09-21T06:22:40.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.870+0000 7f81acff9640 1 -- 172.21.15.38:0/2361285980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b403d6e0 con 0x5639da626390 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.870+0000 7f81cae26740 1 -- 172.21.15.38:0/2361285980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 msgr2=0x5639da9ef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.870+0000 7f81bed9d640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 0x7f81a80b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81b80e43b0 tx=0x7f81b80a1310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.870+0000 7f81cae26740 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f81c006aa20 tx=0x7f81b40056d0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 -- 172.21.15.38:0/2361285980 shutdown_connections 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9ef120 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 --2- 172.21.15.38:0/2361285980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da647070 0x5639da9ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 -- 172.21.15.38:0/2361285980 >> 172.21.15.38:0/2361285980 conn(0x5639da63b460 msgr2=0x5639da9ec590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 -- 172.21.15.38:0/2361285980 shutdown_connections 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 -- 172.21.15.38:0/2361285980 wait complete. 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 -- start start 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.871+0000 7f81cae26740 1 Processor -- start 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da61e1b0 0x5639da9f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da647070 0x5639da9fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5639da7b5700 con 0x5639da626390 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5639da8ef160 con 0x5639da61e1b0 2024-09-21T06:22:40.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5639da9fce20 con 0x5639da647070 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 10 client.0 _ll_register_callbacks cb 0x5639da9089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43232/0 (socket says 172.21.15.38:43232) 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 -- 172.21.15.38:0/335998661 learned_addr learned my addr 172.21.15.38:0/335998661 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da61e1b0 0x5639da9f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 -- 172.21.15.38:0/335998661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da647070 msgr2=0x5639da9fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da647070 0x5639da9fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 -- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da61e1b0 msgr2=0x5639da9f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da61e1b0 0x5639da9f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 -- 172.21.15.38:0/335998661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639da91cc90 con 0x5639da626390 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81be59c640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f81b00114c0 tx=0x7f81b0011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56297c4622c338c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0004020 con 0x5639da626390 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81b00041c0 con 0x5639da626390 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.872+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b40035f0 con 0x5639da626390 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81b00043c0 con 0x5639da626390 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 10 client.16224 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:40.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639daa08b20 con 0x5639da626390 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81b40035f0 con 0x5639da626390 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f81b0003b20 con 0x5639da626390 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 10 client.16224 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 20 client.16224 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da6059f0 0x5639daa0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 4 client.16224 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:40.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639da966df0 con 0x5639da6059f0 2024-09-21T06:22:40.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.873+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da6059f0 0x5639daa0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.874+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da6059f0 0x5639daa0c170 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edfbd273277f747d server_cookie=ea660903f81f69ba in_seq=0 out_seq=0 2024-09-21T06:22:40.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.874+0000 7f81a5ffb640 10 client.16224 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:40.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81a5ffb640 1 -- 172.21.15.38:0/335998661 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639da966df0 con 0x5639da6059f0 2024-09-21T06:22:40.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81a5ffb640 10 client.16224 handle_command_reply: tid=0 2024-09-21T06:22:40.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 client.16224 shutdown 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 msgr2=0x5639da9fa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f81b00114c0 tx=0x7f81b0011980 comp rx=0 tx=0).stop 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 shutdown_connections 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da6059f0 0x5639daa0c170 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da647070 0x5639da9fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da626390 0x5639da9fa210 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 --2- 172.21.15.38:0/335998661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da61e1b0 0x5639da9f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 >> 172.21.15.38:0/335998661 conn(0x5639da63b460 msgr2=0x5639da9f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81a5ffb640 0 client.16224 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 shutdown_connections 2024-09-21T06:22:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 1 -- 172.21.15.38:0/335998661 wait complete. 2024-09-21T06:22:40.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.875+0000 7f81cae26740 20 client.16224 trim_cache size 0 max 16384 2024-09-21T06:22:40.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.888+0000 7f81cae26740 1 Processor -- start 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.888+0000 7f81cae26740 1 -- start start 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01b1fb0 con 0x5639da647070 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01af7c0 con 0x5639da626390 2024-09-21T06:22:40.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81cae26740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ad610 con 0x5639da61e1b0 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43244/0 (socket says 172.21.15.38:43244) 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 -- 172.21.15.38:0/1458432516 learned_addr learned my addr 172.21.15.38:0/1458432516 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81be59c640 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 -- 172.21.15.38:0/1458432516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 msgr2=0x5639da9fbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 -- 172.21.15.38:0/1458432516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 msgr2=0x5639da9efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 -- 172.21.15.38:0/1458432516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639da9faf90 con 0x5639da647070 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f81b40096c0 tx=0x7f81b4040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee5dfba2ff2a0f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81a7fff640 1 -- 172.21.15.38:0/1458432516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4057070 con 0x5639da647070 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.889+0000 7f81a7fff640 1 -- 172.21.15.38:0/1458432516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81b40054f0 con 0x5639da647070 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81a7fff640 1 -- 172.21.15.38:0/1458432516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035040 con 0x5639da647070 2024-09-21T06:22:40.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 -- 172.21.15.38:0/1458432516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 msgr2=0x5639da9f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f81b40096c0 tx=0x7f81b4040040 comp rx=0 tx=0).stop 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 -- 172.21.15.38:0/1458432516 shutdown_connections 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639da9f6ec0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 --2- 172.21.15.38:0/1458432516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 -- 172.21.15.38:0/1458432516 >> 172.21.15.38:0/1458432516 conn(0x5639da63b460 msgr2=0x5639da9ef6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 -- 172.21.15.38:0/1458432516 shutdown_connections 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.890+0000 7f81cae26740 1 -- 172.21.15.38:0/1458432516 wait complete. 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 -- start start 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 Processor -- start 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01adc80 con 0x5639da647070 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01af0f0 con 0x5639da626390 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ae350 con 0x5639da61e1b0 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81cae26740 10 client.0 _ll_register_callbacks cb 0x7f81b000bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43252/0 (socket says 172.21.15.38:43252) 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.891+0000 7f81bdd9b640 1 -- 172.21.15.38:0/711510242 learned_addr learned my addr 172.21.15.38:0/711510242 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81be59c640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 -- 172.21.15.38:0/711510242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 msgr2=0x5639da9fd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 -- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 msgr2=0x5639da9fdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9fdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 -- 172.21.15.38:0/711510242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639daa750b0 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81bdd9b640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e9b9a491923fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035070 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81b4031820 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b40054f0 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81b4061070 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81cae26740 10 client.16230 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.892+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5639daa76310 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81b40054f0 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f81b403a040 con 0x5639da647070 2024-09-21T06:22:40.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 10 client.16230 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 20 client.16230 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da5dada0 0x5639daa785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 4 client.16230 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639da9628a0 con 0x5639da5dada0 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.893+0000 7f81be59c640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da5dada0 0x5639daa785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81a5ffb640 10 client.16230 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81be59c640 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da5dada0 0x5639daa785b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1997e20e22925 server_cookie=75776c3a10e8b780 in_seq=0 out_seq=0 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81a5ffb640 1 -- 172.21.15.38:0/711510242 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639da9628a0 con 0x5639da5dada0 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81a5ffb640 10 client.16230 handle_command_reply: tid=0 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 client.16230 shutdown 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 msgr2=0x5639daa74b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b4005c90 comp rx=0 tx=0).stop 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 shutdown_connections 2024-09-21T06:22:40.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639da647070 0x5639daa74b20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639da626390 0x5639da9fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5639da5dada0 0x5639daa785b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 --2- 172.21.15.38:0/711510242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639da61e1b0 0x5639da9fd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81a5ffb640 0 client.16230 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 >> 172.21.15.38:0/711510242 conn(0x5639da63b460 msgr2=0x5639daa057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 shutdown_connections 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 1 -- 172.21.15.38:0/711510242 wait complete. 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.894+0000 7f81cae26740 20 client.16230 trim_cache size 0 max 16384 2024-09-21T06:22:40.905 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 msgr2=0x7f81a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 0x7f81a80b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81b80e43b0 tx=0x7f81b80a1310 comp rx=0 tx=0).stop 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 msgr2=0x7f81c019fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f81b800b970 tx=0x7f81b800be30 comp rx=0 tx=0).stop 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 shutdown_connections 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81a80b6680 0x7f81a80b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81c0109e30 0x7f81c019fe20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81c01094e0 0x7f81c019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 --2- 172.21.15.38:0/1828681758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81c0103ba0 0x7f81c019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:40.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 >> 172.21.15.38:0/1828681758 conn(0x7f81c00ff630 msgr2=0x7f81c0108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:40.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 shutdown_connections 2024-09-21T06:22:40.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:40.895+0000 7f81c48b2640 1 -- 172.21.15.38:0/1828681758 wait complete. 2024-09-21T06:22:41.578 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:41 smithi038 ceph-mon[31215]: pgmap v409: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1022 B/s wr, 6 op/s 2024-09-21T06:22:41.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:41 smithi174 ceph-mon[34815]: pgmap v409: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1022 B/s wr, 6 op/s 2024-09-21T06:22:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:41 smithi044 ceph-mon[34369]: pgmap v409: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1022 B/s wr, 6 op/s 2024-09-21T06:22:42.707 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:22:42.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:22:42.981 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:43.370 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:43 smithi038 ceph-mon[31215]: pgmap v410: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 937 B/s wr, 7 op/s 2024-09-21T06:22:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 -- 172.21.15.38:0/808643965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8102ac0 msgr2=0x7f66b8102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 --2- 172.21.15.38:0/808643965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8102ac0 0x7f66b8102ed0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009900 tx=0x7f66b402a410 comp rx=0 tx=0).stop 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 -- 172.21.15.38:0/808643965 shutdown_connections 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 --2- 172.21.15.38:0/808643965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8108d00 0x7f66b810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 --2- 172.21.15.38:0/808643965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 0x7f66b81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 --2- 172.21.15.38:0/808643965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8102ac0 0x7f66b8102ed0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 -- 172.21.15.38:0/808643965 >> 172.21.15.38:0/808643965 conn(0x7f66b8079720 msgr2=0x7f66b8079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 -- 172.21.15.38:0/808643965 shutdown_connections 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.464+0000 7f66c0339640 1 -- 172.21.15.38:0/808643965 wait complete. 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.465+0000 7f66c0339640 1 Processor -- start 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.465+0000 7f66c0339640 1 -- start start 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.465+0000 7f66c0339640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8102ac0 0x7f66b819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 0x7f66b819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8113c50 con 0x7f66b8108d00 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8113ad0 con 0x7f66b81083b0 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8113dd0 con 0x7f66b8102ac0 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43278/0 (socket says 172.21.15.38:43278) 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 -- 172.21.15.38:0/4199190569 learned_addr learned my addr 172.21.15.38:0/4199190569 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 0x7f66b819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be0d5640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8102ac0 0x7f66b819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 -- 172.21.15.38:0/4199190569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8102ac0 msgr2=0x7f66b819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8102ac0 0x7f66b819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 -- 172.21.15.38:0/4199190569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 msgr2=0x7f66b819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 0x7f66b819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 -- 172.21.15.38:0/4199190569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b81a0550 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66be8d6640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f66b000eaa0 tx=0x7f66b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66af7fe640 1 -- 172.21.15.38:0/4199190569 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b000cdb0 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b81a0840 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66af7fe640 1 -- 172.21.15.38:0/4199190569 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66b0005020 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66af7fe640 1 -- 172.21.15.38:0/4199190569 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b00116d0 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.466+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b81a6fa0 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.470+0000 7f66c68ad740 1 Processor -- start 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.470+0000 7f66af7fe640 1 -- 172.21.15.38:0/4199190569 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f66b00051d0 con 0x7f66b8108d00 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.470+0000 7f66c68ad740 1 -- start start 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.470+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c24e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be7e490 0x55d97c24e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66c68ad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d97c1c4e60 con 0x55d97be86670 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66c68ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d97c1b4290 con 0x55d97be7e490 2024-09-21T06:22:43.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66c68ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d97c1b80a0 con 0x55d97bea7350 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43284/0 (socket says 172.21.15.38:43284) 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 -- 172.21.15.38:0/3488310601 learned_addr learned my addr 172.21.15.38:0/3488310601 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c24e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66be0d5640 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be7e490 0x55d97c24e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 -- 172.21.15.38:0/3488310601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 msgr2=0x55d97c24e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c24e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 -- 172.21.15.38:0/3488310601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be7e490 msgr2=0x55d97c24e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be7e490 0x55d97c24e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 -- 172.21.15.38:0/3488310601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d97bf12930 con 0x55d97be86670 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66af7fe640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 0x7f66a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f66a80124c0 tx=0x7f66a8005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edce795565dc935 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66be0d5640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 0x7f66a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66af7fe640 1 -- 172.21.15.38:0/4199190569 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f66b00e7870 con 0x7f66b8108d00 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.471+0000 7f66acd9a640 1 -- 172.21.15.38:0/3488310601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8004230 con 0x55d97be86670 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.472+0000 7f66acd9a640 1 -- 172.21.15.38:0/3488310601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66a80043d0 con 0x55d97be86670 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.472+0000 7f66acd9a640 1 -- 172.21.15.38:0/3488310601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a80035f0 con 0x55d97be86670 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.472+0000 7f66c68ad740 1 -- 172.21.15.38:0/3488310601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 msgr2=0x55d97c24eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.472+0000 7f66c68ad740 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f66a80124c0 tx=0x7f66a8005c90 comp rx=0 tx=0).stop 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.472+0000 7f66be0d5640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 0x7f66a40b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- 172.21.15.38:0/3488310601 shutdown_connections 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c24eeb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be7e490 0x55d97c24e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- 172.21.15.38:0/3488310601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c24e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- 172.21.15.38:0/3488310601 >> 172.21.15.38:0/3488310601 conn(0x55d97be9b740 msgr2=0x55d97c24c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- 172.21.15.38:0/3488310601 shutdown_connections 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- 172.21.15.38:0/3488310601 wait complete. 2024-09-21T06:22:43.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- start start 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 Processor -- start 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be7e490 0x55d97c25a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c26a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d97c015890 con 0x55d97be86670 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d97c14ed40 con 0x55d97bea7350 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.473+0000 7f66c68ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d97c25cc10 con 0x55d97be7e490 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66c68ad740 10 client.0 _ll_register_callbacks cb 0x55d97c1b2c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43290/0 (socket says 172.21.15.38:43290) 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 -- 172.21.15.38:0/586899675 learned_addr learned my addr 172.21.15.38:0/586899675 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66be0d5640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be7e490 0x55d97c25a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66be8d6640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c26a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 -- 172.21.15.38:0/586899675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be7e490 msgr2=0x55d97c25a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be7e490 0x55d97c25a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 -- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 msgr2=0x55d97c26a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c26a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 -- 172.21.15.38:0/586899675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d97c26a920 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66be8d6640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c26a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f66a8005d00 tx=0x7f66a80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9d7d2528937c04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a802d060 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a80043d0 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.474+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f66a8004ef0 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66a80050f0 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 10 client.16242 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d97c26d250 con 0x55d97be86670 2024-09-21T06:22:43.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66a80043d0 con 0x55d97be86670 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f66a8032c80 con 0x55d97be86670 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 10 client.16242 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 20 client.16242 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97be65cd0 0x55d97c270610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 4 client.16242 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d97c1c6db0 con 0x55d97be65cd0 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.475+0000 7f66be0d5640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97be65cd0 0x55d97c270610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.476+0000 7f66be0d5640 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97be65cd0 0x55d97c270610 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74a80a23b5c51a50 server_cookie=4d2dc7d6bc7fdd44 in_seq=0 out_seq=0 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.476+0000 7f66a1ffb640 10 client.16242 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66a1ffb640 1 -- 172.21.15.38:0/586899675 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d97c1c6db0 con 0x55d97be65cd0 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66a1ffb640 10 client.16242 handle_command_reply: tid=0 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 client.16242 shutdown 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 msgr2=0x55d97c25a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f66a8005d00 tx=0x7f66a80049f0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 shutdown_connections 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c26a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be86670 0x55d97c25a5c0 secure :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f66a8005d00 tx=0x7f66a80049f0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97be65cd0 0x55d97c270610 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 --2- 172.21.15.38:0/586899675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be7e490 0x55d97c25a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.477+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 >> 172.21.15.38:0/586899675 conn(0x55d97be9b740 msgr2=0x55d97c251610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.478+0000 7f66a1ffb640 0 client.16242 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.478+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 shutdown_connections 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.478+0000 7f66c68ad740 1 -- 172.21.15.38:0/586899675 wait complete. 2024-09-21T06:22:43.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.478+0000 7f66c68ad740 20 client.16242 trim_cache size 0 max 16384 2024-09-21T06:22:43.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 Processor -- start 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 -- start start 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c253510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 0x55d97c253a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81afda0 con 0x55d97be7e490 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81ad5b0 con 0x55d97be3b080 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66c68ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81ab400 con 0x55d97bea7350 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66be0d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66be0d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43300/0 (socket says 172.21.15.38:43300) 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66be0d5640 1 -- 172.21.15.38:0/957908239 learned_addr learned my addr 172.21.15.38:0/957908239 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66be8d6640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 0x55d97c253a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.496+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c253510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 -- 172.21.15.38:0/957908239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 msgr2=0x55d97c253510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c253510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 -- 172.21.15.38:0/957908239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 msgr2=0x55d97c253a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 0x55d97c253a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 -- 172.21.15.38:0/957908239 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d97c2556d0 con 0x55d97be7e490 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be8d6640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 0x55d97c253a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c253510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66be0d5640 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f66b4005ab0 tx=0x7f66b403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eb890e3d3d727 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66a3fff640 1 -- 172.21.15.38:0/957908239 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4035050 con 0x55d97be7e490 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66a3fff640 1 -- 172.21.15.38:0/957908239 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66b4003cc0 con 0x55d97be7e490 2024-09-21T06:22:43.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.497+0000 7f66a3fff640 1 -- 172.21.15.38:0/957908239 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004ec0 con 0x55d97be7e490 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- 172.21.15.38:0/957908239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 msgr2=0x55d97c26a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f66b4005ab0 tx=0x7f66b403d000 comp rx=0 tx=0).stop 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- 172.21.15.38:0/957908239 shutdown_connections 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97be3b080 0x55d97c253a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97bea7350 0x55d97c253510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 --2- 172.21.15.38:0/957908239 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c26a290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- 172.21.15.38:0/957908239 >> 172.21.15.38:0/957908239 conn(0x55d97be9b740 msgr2=0x55d97c2586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- 172.21.15.38:0/957908239 shutdown_connections 2024-09-21T06:22:43.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- 172.21.15.38:0/957908239 wait complete. 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.498+0000 7f66c68ad740 1 -- start start 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 Processor -- start 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be3b080 0x55d97c275b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c2765c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81aba70 con 0x55d97be7e490 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81acee0 con 0x55d97bea7350 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66b81ac140 con 0x55d97be3b080 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66c68ad740 10 client.0 _ll_register_callbacks cb 0x7f66a80123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43306/0 (socket says 172.21.15.38:43306) 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 -- 172.21.15.38:0/491327209 learned_addr learned my addr 172.21.15.38:0/491327209 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66be0d5640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be3b080 0x55d97c275b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66be8d6640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c2765c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 -- 172.21.15.38:0/491327209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be3b080 msgr2=0x55d97c275b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be3b080 0x55d97c275b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 -- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 msgr2=0x55d97c2765c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.499+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c2765c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66bd8d4640 1 -- 172.21.15.38:0/491327209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d97c2627b0 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66be8d6640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c2765c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66bd8d4640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d97c259650 tx=0x7f66a800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af8d9e3236ec395 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a802d040 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f66a8004ef0 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b4003cc0 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f66a8040050 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66c68ad740 10 client.16248 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d97c2daf90 con 0x55d97be7e490 2024-09-21T06:22:43.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.500+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66b4003cc0 con 0x55d97be7e490 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f66a8029450 con 0x55d97be7e490 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 10 client.16248 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 20 client.16248 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97c2db6a0 0x55d97c2ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 4 client.16248 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d97c1c2860 con 0x55d97c2db6a0 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66be0d5640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97c2db6a0 0x55d97c2ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66a1ffb640 10 client.16248 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:43.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.501+0000 7f66be0d5640 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97c2db6a0 0x55d97c2ddac0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34e5bf74db8af19 server_cookie=f428720bc610e80d in_seq=0 out_seq=0 2024-09-21T06:22:43.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66a1ffb640 1 -- 172.21.15.38:0/491327209 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d97c1c2860 con 0x55d97c2db6a0 2024-09-21T06:22:43.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66a1ffb640 10 client.16248 handle_command_reply: tid=0 2024-09-21T06:22:43.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 client.16248 shutdown 2024-09-21T06:22:43.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 msgr2=0x55d97c276080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x55d97c259650 tx=0x7f66a800b390 comp rx=0 tx=0).stop 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 shutdown_connections 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d97bea7350 0x55d97c2765c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d97be7e490 0x55d97c276080 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d97c2db6a0 0x55d97c2ddac0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 --2- 172.21.15.38:0/491327209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d97be3b080 0x55d97c275b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 >> 172.21.15.38:0/491327209 conn(0x55d97be9b740 msgr2=0x55d97c24bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66a1ffb640 0 client.16248 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.503+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 shutdown_connections 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c68ad740 1 -- 172.21.15.38:0/491327209 wait complete. 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c68ad740 20 client.16248 trim_cache size 0 max 16384 2024-09-21T06:22:43.508 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:22:43.509 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:22:43.509 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "065314d2-be68-48ef-a133-ae9d6104dd56", 2024-09-21T06:22:43.509 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:22:43.509 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 msgr2=0x7f66a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 0x7f66a40b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000c00 tx=0x7f66b4005a20 comp rx=0 tx=0).stop 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 msgr2=0x7f66b819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f66b000eaa0 tx=0x7f66b000ef60 comp rx=0 tx=0).stop 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 shutdown_connections 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f66a40b6680 0x7f66a40b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66b8108d00 0x7f66b819fe20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66b81083b0 0x7f66b819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 --2- 172.21.15.38:0/4199190569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b8102ac0 0x7f66b819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:43.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 >> 172.21.15.38:0/4199190569 conn(0x7f66b8079720 msgr2=0x7f66b8106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:43.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 shutdown_connections 2024-09-21T06:22:43.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:43.504+0000 7f66c0339640 1 -- 172.21.15.38:0/4199190569 wait complete. 2024-09-21T06:22:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:43 smithi174 ceph-mon[34815]: pgmap v410: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 937 B/s wr, 7 op/s 2024-09-21T06:22:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:43 smithi044 ceph-mon[34369]: pgmap v410: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 937 B/s wr, 7 op/s 2024-09-21T06:22:44.225 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:22:44.485 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:22:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:44 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:22:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:44 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:44 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:22:44.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:44 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:44 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:22:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:44 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:44 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:22:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:44 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:44 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:22:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:44 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:44 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:22:44.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:44 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 -- 172.21.15.38:0/1919563787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3814102a60 msgr2=0x7f3814102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 --2- 172.21.15.38:0/1919563787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3814102a60 0x7f3814102e70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3810009900 tx=0x7f381002a410 comp rx=0 tx=0).stop 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 -- 172.21.15.38:0/1919563787 shutdown_connections 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 --2- 172.21.15.38:0/1919563787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814108cf0 0x7f381410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 --2- 172.21.15.38:0/1919563787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38141083a0 0x7f38141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 --2- 172.21.15.38:0/1919563787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3814102a60 0x7f3814102e70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.938+0000 7f381bc3b640 1 -- 172.21.15.38:0/1919563787 >> 172.21.15.38:0/1919563787 conn(0x7f3814079730 msgr2=0x7f3814079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.939+0000 7f381bc3b640 1 -- 172.21.15.38:0/1919563787 shutdown_connections 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.939+0000 7f381bc3b640 1 -- 172.21.15.38:0/1919563787 wait complete. 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.939+0000 7f381bc3b640 1 Processor -- start 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.939+0000 7f381bc3b640 1 -- start start 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814102a60 0x7f381419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3814108cf0 0x7f381419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113ba0 con 0x7f38141083a0 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113a20 con 0x7f3814108cf0 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381bc3b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113d20 con 0x7f3814102a60 2024-09-21T06:22:44.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43322/0 (socket says 172.21.15.38:43322) 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 -- 172.21.15.38:0/989594567 learned_addr learned my addr 172.21.15.38:0/989594567 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f381a1d8640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3814108cf0 0x7f381419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38199d7640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814102a60 0x7f381419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 -- 172.21.15.38:0/989594567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814102a60 msgr2=0x7f381419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814102a60 0x7f381419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 -- 172.21.15.38:0/989594567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3814108cf0 msgr2=0x7f381419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3814108cf0 0x7f381419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 -- 172.21.15.38:0/989594567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141a0480 con 0x7f38141083a0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.940+0000 7f38191d6640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f380400e9c0 tx=0x7f380400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.941+0000 7f380affd640 1 -- 172.21.15.38:0/989594567 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380400cd80 con 0x7f38141083a0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.941+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38141a0770 con 0x7f38141083a0 2024-09-21T06:22:44.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.941+0000 7f380affd640 1 -- 172.21.15.38:0/989594567 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f38040054f0 con 0x7f38141083a0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.941+0000 7f380affd640 1 -- 172.21.15.38:0/989594567 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804010690 con 0x7f38141083a0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.941+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141a6ed0 con 0x7f38141083a0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.943+0000 7f380affd640 1 -- 172.21.15.38:0/989594567 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f38040046c0 con 0x7f38141083a0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.943+0000 7f38221af740 1 Processor -- start 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 -- start start 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e161650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e1620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b9e0d7e50 con 0x561b9dd911b0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b9e0c7280 con 0x561b9dd99390 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38221af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b9e0cb090 con 0x561b9ddba070 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38199d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38199d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43332/0 (socket says 172.21.15.38:43332) 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38199d7640 1 -- 172.21.15.38:0/2311240962 learned_addr learned my addr 172.21.15.38:0/2311240962 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:44.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.944+0000 7f38191d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e1620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f381a1d8640 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f380affd640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 -- 172.21.15.38:0/2311240962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 msgr2=0x561b9e161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e161650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 -- 172.21.15.38:0/2311240962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 msgr2=0x561b9e1620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e1620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 -- 172.21.15.38:0/2311240962 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9de25650 con 0x561b9dd911b0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f380affd640 1 -- 172.21.15.38:0/989594567 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f38040e7bf0 con 0x7f38141083a0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f381a1d8640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.945+0000 7f38199d7640 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3810009900 tx=0x7f3810005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7035afdbe8b6267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.946+0000 7f381a1d8640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 0x7f38000b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f380c005fd0 tx=0x7f380c014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.946+0000 7f37fffff640 1 -- 172.21.15.38:0/2311240962 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810035040 con 0x561b9dd911b0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.946+0000 7f37fffff640 1 -- 172.21.15.38:0/2311240962 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3810004020 con 0x561b9dd911b0 2024-09-21T06:22:44.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.946+0000 7f37fffff640 1 -- 172.21.15.38:0/2311240962 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810005490 con 0x561b9dd911b0 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- 172.21.15.38:0/2311240962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 msgr2=0x561b9e161b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3810009900 tx=0x7f3810005e60 comp rx=0 tx=0).stop 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- 172.21.15.38:0/2311240962 shutdown_connections 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e1620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e161b90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 --2- 172.21.15.38:0/2311240962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e161650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- 172.21.15.38:0/2311240962 >> 172.21.15.38:0/2311240962 conn(0x561b9ddae460 msgr2=0x561b9e15f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- 172.21.15.38:0/2311240962 shutdown_connections 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- 172.21.15.38:0/2311240962 wait complete. 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 -- start start 2024-09-21T06:22:44.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.947+0000 7f38221af740 1 Processor -- start 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e16cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e16d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b9df28700 con 0x561b9dd99390 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b9e062110 con 0x561b9ddba070 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b9e16fdd0 con 0x561b9dd911b0 2024-09-21T06:22:44.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38221af740 10 client.0 _ll_register_callbacks cb 0x561b9e07b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43334/0 (socket says 172.21.15.38:43334) 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38191d6640 1 -- 172.21.15.38:0/2542393092 learned_addr learned my addr 172.21.15.38:0/2542393092 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f38199d7640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e16cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.948+0000 7f381a1d8640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e16d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 -- 172.21.15.38:0/2542393092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 msgr2=0x561b9e16cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e16cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 -- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 msgr2=0x561b9e16d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e16d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 -- 172.21.15.38:0/2542393092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b9e08fc40 con 0x561b9dd99390 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38191d6640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f380400c6a0 tx=0x7f38040d1280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f368f4f491b3b7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f37fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040ad410 con 0x561b9dd99390 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f38040e5b10 con 0x561b9dd99390 2024-09-21T06:22:44.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3810004020 con 0x561b9dd99390 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38040a9230 con 0x561b9dd99390 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38221af740 10 client.16260 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b9e17ba90 con 0x561b9dd99390 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.949+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3810004020 con 0x561b9dd99390 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f38040cfad0 con 0x561b9dd99390 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 10 client.16260 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 20 client.16260 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd789f0 0x561b9e17ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 4 client.16260 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b9e0d9da0 con 0x561b9dd789f0 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38199d7640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd789f0 0x561b9e17ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f37fd7fa640 10 client.16260 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.950+0000 7f38199d7640 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd789f0 0x561b9e17ef60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dade3fa4fed345b0 server_cookie=75eba3e7aafeda44 in_seq=0 out_seq=0 2024-09-21T06:22:44.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.951+0000 7f37fd7fa640 1 -- 172.21.15.38:0/2542393092 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b9e0d9da0 con 0x561b9dd789f0 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.951+0000 7f37fd7fa640 10 client.16260 handle_command_reply: tid=0 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.951+0000 7f38221af740 1 client.16260 shutdown 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.951+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 msgr2=0x561b9e16d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.951+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f380400c6a0 tx=0x7f38040d1280 comp rx=0 tx=0).stop 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 shutdown_connections 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e16d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16d1c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd789f0 0x561b9e17ef60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 --2- 172.21.15.38:0/2542393092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e16cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f37fd7fa640 0 client.16260 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 >> 172.21.15.38:0/2542393092 conn(0x561b9ddae460 msgr2=0x561b9e1647e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 shutdown_connections 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 1 -- 172.21.15.38:0/2542393092 wait complete. 2024-09-21T06:22:44.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.952+0000 7f38221af740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T06:22:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 Processor -- start 2024-09-21T06:22:44.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 -- start start 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e165110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e169e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f38141afda0 con 0x561b9dd99390 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38141ad5b0 con 0x561b9ddba070 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.969+0000 7f38221af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38141ab400 con 0x561b9dd911b0 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43348/0 (socket says 172.21.15.38:43348) 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 -- 172.21.15.38:0/1671783997 learned_addr learned my addr 172.21.15.38:0/1671783997 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38199d7640 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e165110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 -- 172.21.15.38:0/1671783997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 msgr2=0x561b9e165110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f381a1d8640 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e165110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 -- 172.21.15.38:0/1671783997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 msgr2=0x561b9e169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e169e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 -- 172.21.15.38:0/1671783997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9e1644b0 con 0x561b9dd99390 2024-09-21T06:22:44.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f38191d6640 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f38040d12f0 tx=0x7f38040d5190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379feb6a69b248a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f37ff7fe640 1 -- 172.21.15.38:0/1671783997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040ad230 con 0x561b9dd99390 2024-09-21T06:22:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f37ff7fe640 1 -- 172.21.15.38:0/1671783997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f38040ad5d0 con 0x561b9dd99390 2024-09-21T06:22:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.970+0000 7f37ff7fe640 1 -- 172.21.15.38:0/1671783997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040e5b10 con 0x561b9dd99390 2024-09-21T06:22:44.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 -- 172.21.15.38:0/1671783997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 msgr2=0x561b9e16e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f38040d12f0 tx=0x7f38040d5190 comp rx=0 tx=0).stop 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 -- 172.21.15.38:0/1671783997 shutdown_connections 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9ddba070 0x561b9e169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd99390 0x561b9e16e8b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 --2- 172.21.15.38:0/1671783997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9dd911b0 0x561b9e165110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 -- 172.21.15.38:0/1671783997 >> 172.21.15.38:0/1671783997 conn(0x561b9ddae460 msgr2=0x561b9e16e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 -- 172.21.15.38:0/1671783997 shutdown_connections 2024-09-21T06:22:44.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.971+0000 7f38221af740 1 -- 172.21.15.38:0/1671783997 wait complete. 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 -- start start 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 Processor -- start 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e173530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e173a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f38141aba70 con 0x561b9dd911b0 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38141acee0 con 0x561b9dd99390 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38141ac140 con 0x561b9ddba070 2024-09-21T06:22:44.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38221af740 10 client.0 _ll_register_callbacks cb 0x7f380400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.972+0000 7f38199d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43352/0 (socket says 172.21.15.38:43352) 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 -- 172.21.15.38:0/295562996 learned_addr learned my addr 172.21.15.38:0/295562996 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38191d6640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e173530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f381a1d8640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e173a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 -- 172.21.15.38:0/295562996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 msgr2=0x561b9e173a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e173a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 -- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 msgr2=0x561b9e173530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e173530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 -- 172.21.15.38:0/295562996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b9e1e8970 con 0x561b9dd911b0 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38199d7640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f381002a450 tx=0x7f3810031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e604fcff0daee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f37fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381005d020 con 0x561b9dd911b0 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3810004040 con 0x561b9dd911b0 2024-09-21T06:22:44.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38040ad5d0 con 0x561b9dd911b0 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3810035040 con 0x561b9dd911b0 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38221af740 10 client.16266 fetch_fsmap learned FSMap version 28 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.973+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b9e1e9bf0 con 0x561b9dd911b0 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f38040ad5d0 con 0x561b9dd911b0 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f38100035f0 con 0x561b9dd911b0 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 10 client.16266 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 20 client.16266 populate_metadata read hostname 'smithi038' 2024-09-21T06:22:44.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd4dda0 0x561b9e1ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 4 client.16266 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b9e0d5850 con 0x561b9dd4dda0 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.974+0000 7f38191d6640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd4dda0 0x561b9e1ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38191d6640 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd4dda0 0x561b9e1ebfc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361c6d0c3005a5eb server_cookie=bc9af0d24e082300 in_seq=0 out_seq=0 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f37fd7fa640 10 client.16266 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f37fd7fa640 1 -- 172.21.15.38:0/295562996 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x561b9e0d5850 con 0x561b9dd4dda0 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f37fd7fa640 10 client.16266 handle_command_reply: tid=0 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 client.16266 shutdown 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 msgr2=0x561b9e172ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f381002a450 tx=0x7f3810031650 comp rx=0 tx=0).stop 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 shutdown_connections 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b9dd4dda0 0x561b9e1ebfc0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9ddba070 0x561b9e173a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9dd99390 0x561b9e173530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 --2- 172.21.15.38:0/295562996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9dd911b0 0x561b9e172ff0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f37fd7fa640 0 client.16266 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 >> 172.21.15.38:0/295562996 conn(0x561b9ddae460 msgr2=0x561b9e162fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 shutdown_connections 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 1 -- 172.21.15.38:0/295562996 wait complete. 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.975+0000 7f38221af740 20 client.16266 trim_cache size 0 max 16384 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:22:44.988 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "065314d2-be68-48ef-a133-ae9d6104dd56", 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.989 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.990 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.991 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:22:44.992 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:44.993 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:22:44.994 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:22:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 msgr2=0x7f38000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 0x7f38000b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f380c005fd0 tx=0x7f380c014040 comp rx=0 tx=0).stop 2024-09-21T06:22:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 msgr2=0x7f381419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:22:44.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f380400e9c0 tx=0x7f380400ee80 comp rx=0 tx=0).stop 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 shutdown_connections 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3814108cf0 0x7f381419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38141083a0 0x7f381419aab0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 --2- 172.21.15.38:0/989594567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3814102a60 0x7f381419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 >> 172.21.15.38:0/989594567 conn(0x7f3814079730 msgr2=0x7f38141013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 shutdown_connections 2024-09-21T06:22:44.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:22:44.976+0000 7f381bc3b640 1 -- 172.21.15.38:0/989594567 wait complete. 2024-09-21T06:22:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:45 smithi174 ceph-mon[34815]: pgmap v411: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:45 smithi044 ceph-mon[34369]: pgmap v411: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:45 smithi038 ceph-mon[31215]: pgmap v411: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:45.799 INFO:tasks.cephfs.filesystem:scrub status for tag:065314d2-be68-48ef-a133-ae9d6104dd56 - {'path': '/', 'tag': '065314d2-be68-48ef-a133-ae9d6104dd56', 'options': 'recursive,force'} 2024-09-21T06:22:47.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:47 smithi174 ceph-mon[34815]: pgmap v412: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:47 smithi044 ceph-mon[34369]: pgmap v412: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:47 smithi038 ceph-mon[31215]: pgmap v412: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 937 B/s wr, 6 op/s 2024-09-21T06:22:48.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:48 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:22:48.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:48 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:22:48.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:48 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:22:49.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:49 smithi174 ceph-mon[34815]: pgmap v413: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:22:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:49 smithi044 ceph-mon[34369]: pgmap v413: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:22:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:49 smithi038 ceph-mon[31215]: pgmap v413: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:22:51.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:51 smithi174 ceph-mon[34815]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:51.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:51 smithi044 ceph-mon[34369]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:51 smithi038 ceph-mon[31215]: pgmap v414: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:53.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:53 smithi174 ceph-mon[34815]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:22:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:53 smithi044 ceph-mon[34369]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:22:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:53 smithi038 ceph-mon[31215]: pgmap v415: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:22:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:55 smithi174 ceph-mon[34815]: pgmap v416: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:55 smithi044 ceph-mon[34369]: pgmap v416: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:55 smithi038 ceph-mon[31215]: pgmap v416: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:57 smithi174 ceph-mon[34815]: pgmap v417: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:57.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:22:57.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:57 smithi044 ceph-mon[34369]: pgmap v417: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:22:57.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:57 smithi038 ceph-mon[31215]: pgmap v417: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:22:57.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:22:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:22:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:22:57.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:22:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:22:59 smithi174 ceph-mon[34815]: pgmap v418: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:22:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:22:59 smithi044 ceph-mon[34369]: pgmap v418: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:22:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:22:59 smithi038 ceph-mon[31215]: pgmap v418: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T06:23:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:01 smithi174 ceph-mon[34815]: pgmap v419: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:23:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:01 smithi044 ceph-mon[34369]: pgmap v419: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:23:01.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:01 smithi038 ceph-mon[31215]: pgmap v419: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:23:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:03 smithi174 ceph-mon[34815]: pgmap v420: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:23:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:03 smithi044 ceph-mon[34369]: pgmap v420: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:23:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:03 smithi038 ceph-mon[31215]: pgmap v420: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:23:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:05 smithi174 ceph-mon[34815]: pgmap v421: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T06:23:05.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:05 smithi044 ceph-mon[34369]: pgmap v421: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T06:23:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:05 smithi038 ceph-mon[31215]: pgmap v421: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T06:23:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:07 smithi174 ceph-mon[34815]: pgmap v422: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:07.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:07 smithi044 ceph-mon[34369]: pgmap v422: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:07 smithi038 ceph-mon[31215]: pgmap v422: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:09 smithi174 ceph-mon[34815]: pgmap v423: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:09 smithi044 ceph-mon[34369]: pgmap v423: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:09.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:09 smithi038 ceph-mon[31215]: pgmap v423: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:11.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:11 smithi174 ceph-mon[34815]: pgmap v424: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:11 smithi044 ceph-mon[34369]: pgmap v424: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:11 smithi038 ceph-mon[31215]: pgmap v424: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:13 smithi174 ceph-mon[34815]: pgmap v425: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:13.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:13 smithi044 ceph-mon[34369]: pgmap v425: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:13 smithi038 ceph-mon[31215]: pgmap v425: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:23:15.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:15 smithi174 ceph-mon[34815]: pgmap v426: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:15 smithi044 ceph-mon[34369]: pgmap v426: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:15.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:15 smithi038 ceph-mon[31215]: pgmap v426: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:23:15.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:23:16.076 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.524+0000 7fadd0ae2640 1 -- 172.21.15.38:0/4131571552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc102a60 msgr2=0x7fadcc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.524+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/4131571552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc102a60 0x7fadcc102e70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009900 tx=0x7fadbc02a410 comp rx=0 tx=0).stop 2024-09-21T06:23:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 -- 172.21.15.38:0/4131571552 shutdown_connections 2024-09-21T06:23:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/4131571552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 0x7fadcc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/4131571552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc1083a0 0x7fadcc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/4131571552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc102a60 0x7fadcc102e70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 -- 172.21.15.38:0/4131571552 >> 172.21.15.38:0/4131571552 conn(0x7fadcc079730 msgr2=0x7fadcc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 -- 172.21.15.38:0/4131571552 shutdown_connections 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 -- 172.21.15.38:0/4131571552 wait complete. 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.525+0000 7fadd0ae2640 1 Processor -- start 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 -- start start 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc102a60 0x7fadcc10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 0x7fadcc110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113ba0 con 0x7fadcc1083a0 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113a20 con 0x7fadcc102a60 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadd0ae2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113d20 con 0x7fadcc108cf0 2024-09-21T06:23:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadc1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadc1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58948/0 (socket says 172.21.15.38:58948) 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadc1d9b640 1 -- 172.21.15.38:0/3122392929 learned_addr learned my addr 172.21.15.38:0/3122392929 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadca59c640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc102a60 0x7fadcc10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadcad9d640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 0x7fadcc110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadc1d9b640 1 -- 172.21.15.38:0/3122392929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 msgr2=0x7fadcc110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.526+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 0x7fadcc110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc1d9b640 1 -- 172.21.15.38:0/3122392929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc102a60 msgr2=0x7fadcc10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc102a60 0x7fadcc10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc1d9b640 1 -- 172.21.15.38:0/3122392929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1a87d0 con 0x7fadcc1083a0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fadb4005fd0 tx=0x7fadb400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc3fff640 1 -- 172.21.15.38:0/3122392929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4017070 con 0x7fadcc1083a0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc3fff640 1 -- 172.21.15.38:0/3122392929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadb4009c30 con 0x7fadcc1083a0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadc3fff640 1 -- 172.21.15.38:0/3122392929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4003de0 con 0x7fadcc1083a0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1a8ac0 con 0x7fadcc1083a0 2024-09-21T06:23:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.527+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a8fb0 con 0x7fadcc1083a0 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 Processor -- start 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 -- start start 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 0x560732669270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 0x560732669cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5607325dfe50 con 0x5607322991b0 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.530+0000 7fadd7056740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5607325cf280 con 0x5607322a1390 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadd7056740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607325d3090 con 0x5607322c2070 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58954/0 (socket says 172.21.15.38:58954) 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 -- 172.21.15.38:0/1124221835 learned_addr learned my addr 172.21.15.38:0/1124221835 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadc3fff640 1 -- 172.21.15.38:0/3122392929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fadb4003f80 con 0x7fadcc1083a0 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadcad9d640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 0x560732669270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 -- 172.21.15.38:0/1124221835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 msgr2=0x560732669270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 0x560732669270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 -- 172.21.15.38:0/1124221835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 msgr2=0x560732669cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 0x560732669cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 0x560732669cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 -- 172.21.15.38:0/1124221835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073232d650 con 0x5607322991b0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadcad9d640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 0x560732669270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 0x560732669cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.531+0000 7fadca59c640 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02a930 tx=0x7fadbc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbabd72a2ecac613 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadc0d99640 1 -- 172.21.15.38:0/1124221835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc040070 con 0x5607322991b0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadc0d99640 1 -- 172.21.15.38:0/1124221835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadbc004020 con 0x5607322991b0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadc0d99640 1 -- 172.21.15.38:0/1124221835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035040 con 0x5607322991b0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadc3fff640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 0x7fadb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadcad9d640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 0x7fadb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.532+0000 7fadc3fff640 1 -- 172.21.15.38:0/3122392929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fadb40e73b0 con 0x7fadcc1083a0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadcad9d640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 0x7fadb80b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005fd0 tx=0x7fadc4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 -- 172.21.15.38:0/1124221835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 msgr2=0x5607326697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02a930 tx=0x7fadbc005f10 comp rx=0 tx=0).stop 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 -- 172.21.15.38:0/1124221835 shutdown_connections 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322a1390 0x560732669cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x5607326697b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 --2- 172.21.15.38:0/1124221835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322c2070 0x560732669270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 -- 172.21.15.38:0/1124221835 >> 172.21.15.38:0/1124221835 conn(0x5607322b6460 msgr2=0x560732667160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 -- 172.21.15.38:0/1124221835 shutdown_connections 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.533+0000 7fadd7056740 1 -- 172.21.15.38:0/1124221835 wait complete. 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 -- start start 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 Processor -- start 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732674d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x5607326752b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560732430700 con 0x5607322991b0 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56073256a110 con 0x5607322c2070 2024-09-21T06:23:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607326779f0 con 0x5607322a1390 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadd7056740 10 client.0 _ll_register_callbacks cb 0x560732583990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58958/0 (socket says 172.21.15.38:58958) 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.534+0000 7fadca59c640 1 -- 172.21.15.38:0/3311866336 learned_addr learned my addr 172.21.15.38:0/3311866336 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadcad9d640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x5607326752b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732674d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 -- 172.21.15.38:0/3311866336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 msgr2=0x560732674d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732674d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 -- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 msgr2=0x5607326752b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x5607326752b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 -- 172.21.15.38:0/3311866336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560732597c40 con 0x5607322991b0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732674d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadca59c640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fadbc006010 tx=0x7fadbc004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba0ec53d5a1d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc052060 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fadbc031d80 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadbc004020 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.535+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadbc040070 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 10 client.16278 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560732683570 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadbc004020 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fadbc004b50 con 0x5607322991b0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 10 client.16278 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 10 client.16278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 20 client.16278 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5607322809f0 0x5607326868d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 4 client.16278 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607325e1da0 con 0x5607322809f0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.536+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5607322809f0 0x5607326868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.537+0000 7fadb1ffb640 10 client.16278 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.537+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5607322809f0 0x5607326868d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a093ea741bc2f47 server_cookie=c061b40e9b64cd84 in_seq=0 out_seq=0 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadb1ffb640 1 -- 172.21.15.38:0/3311866336 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607325e1da0 con 0x5607322809f0 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadb1ffb640 10 client.16278 handle_command_reply: tid=0 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 client.16278 shutdown 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 msgr2=0x560732674830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fadbc006010 tx=0x7fadbc004400 comp rx=0 tx=0).stop 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 shutdown_connections 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x5607326752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5607322809f0 0x5607326868d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732674d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 --2- 172.21.15.38:0/3311866336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x560732674830 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 >> 172.21.15.38:0/3311866336 conn(0x5607322b6460 msgr2=0x56073266c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadb1ffb640 0 client.16278 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 shutdown_connections 2024-09-21T06:23:16.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 1 -- 172.21.15.38:0/3311866336 wait complete. 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.538+0000 7fadd7056740 20 client.16278 trim_cache size 0 max 16384 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 Processor -- start 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 -- start start 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732676460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x560732666710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b4160 con 0x5607322991b0 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b1970 con 0x5607322c2070 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadd7056740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1af7c0 con 0x5607322a1390 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58972/0 (socket says 172.21.15.38:58972) 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.556+0000 7fadca59c640 1 -- 172.21.15.38:0/1793839473 learned_addr learned my addr 172.21.15.38:0/1793839473 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732676460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadcad9d640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x560732666710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 -- 172.21.15.38:0/1793839473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 msgr2=0x560732676460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732676460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 -- 172.21.15.38:0/1793839473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 msgr2=0x560732666710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x560732666710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 -- 172.21.15.38:0/1793839473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560732280c20 con 0x5607322991b0 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732676460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadca59c640 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009800 tx=0x7fadbc005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347692fc577e6b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadb3fff640 1 -- 172.21.15.38:0/1793839473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc052040 con 0x5607322991b0 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadb3fff640 1 -- 172.21.15.38:0/1793839473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadbc0054c0 con 0x5607322991b0 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.557+0000 7fadb3fff640 1 -- 172.21.15.38:0/1793839473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035050 con 0x5607322991b0 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- 172.21.15.38:0/1793839473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 msgr2=0x56073266ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009800 tx=0x7fadbc005e90 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- 172.21.15.38:0/1793839473 shutdown_connections 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322c2070 0x560732666710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732676460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 --2- 172.21.15.38:0/1793839473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322991b0 0x56073266ac60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- 172.21.15.38:0/1793839473 >> 172.21.15.38:0/1793839473 conn(0x5607322b6460 msgr2=0x560732675d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- 172.21.15.38:0/1793839473 shutdown_connections 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- 172.21.15.38:0/1793839473 wait complete. 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.558+0000 7fadd7056740 1 -- start start 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 Processor -- start 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322991b0 0x560732687270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732687830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1afe30 con 0x5607322c2070 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b12a0 con 0x5607322991b0 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b0500 con 0x5607322a1390 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadd7056740 10 client.0 _ll_register_callbacks cb 0x7fadbc005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58984/0 (socket says 172.21.15.38:58984) 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 -- 172.21.15.38:0/872480493 learned_addr learned my addr 172.21.15.38:0/872480493 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadc1d9b640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732687830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadca59c640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322991b0 0x560732687270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 -- 172.21.15.38:0/872480493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 msgr2=0x560732687830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732687830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 -- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322991b0 msgr2=0x560732687270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322991b0 0x560732687270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.559+0000 7fadcad9d640 1 -- 172.21.15.38:0/872480493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607326e96f0 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadcad9d640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fadc4012a10 tx=0x7fadc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3160203cf6493e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4021dd0 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fadc4003970 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadbc0054c0 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadc4003b70 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadd7056740 10 client.16284 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5607326f0a00 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.560+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fadbc0054c0 con 0x5607322c2070 2024-09-21T06:23:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fadc401f5f0 con 0x5607322c2070 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 10 client.16284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 20 client.16284 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560732255da0 0x5607326f3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 4 client.16284 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5607325dd850 con 0x560732255da0 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadca59c640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560732255da0 0x5607326f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadb1ffb640 10 client.16284 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.561+0000 7fadca59c640 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560732255da0 0x5607326f3250 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8231cbfe9dca8428 server_cookie=531c950da68a5a40 in_seq=0 out_seq=0 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadb1ffb640 1 -- 172.21.15.38:0/872480493 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5607325dd850 con 0x560732255da0 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadb1ffb640 10 client.16284 handle_command_reply: tid=0 2024-09-21T06:23:16.619 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:23:16.620 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:23:16.621 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:16.622 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 client.16284 shutdown 2024-09-21T06:23:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 msgr2=0x5607326e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fadc4012a10 tx=0x7fadc4004a40 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 shutdown_connections 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5607322c2070 0x5607326e9080 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560732255da0 0x5607326f3250 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadb1ffb640 0 client.16284 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607322a1390 0x560732687830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 --2- 172.21.15.38:0/872480493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607322991b0 0x560732687270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 >> 172.21.15.38:0/872480493 conn(0x5607322b6460 msgr2=0x56073266aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 shutdown_connections 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 1 -- 172.21.15.38:0/872480493 wait complete. 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.562+0000 7fadd7056740 20 client.16284 trim_cache size 0 max 16384 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 msgr2=0x7fadb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 0x7fadb80b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005fd0 tx=0x7fadc4009500 comp rx=0 tx=0).stop 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 msgr2=0x7fadcc1104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fadb4005fd0 tx=0x7fadb400dde0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 shutdown_connections 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fadb80b6680 0x7fadb80b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc108cf0 0x7fadcc110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadcc1083a0 0x7fadcc1104f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 --2- 172.21.15.38:0/3122392929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadcc102a60 0x7fadcc10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 >> 172.21.15.38:0/3122392929 conn(0x7fadcc079730 msgr2=0x7fadcc1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 shutdown_connections 2024-09-21T06:23:16.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:16.563+0000 7fadd0ae2640 1 -- 172.21.15.38:0/3122392929 wait complete. 2024-09-21T06:23:17.411 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:23:17.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:23:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:17 smithi038 ceph-mon[31215]: pgmap v427: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T06:23:17.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:17 smithi174 ceph-mon[34815]: pgmap v427: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T06:23:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:17 smithi044 ceph-mon[34369]: pgmap v427: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T06:23:17.682 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 -- 172.21.15.38:0/1744515045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 msgr2=0x7fdfa0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1744515045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa0110300 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009ca0 tx=0x7fdf9802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 -- 172.21.15.38:0/1744515045 shutdown_connections 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1744515045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa0110300 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1744515045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 0x7fdfa010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1744515045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa0104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 -- 172.21.15.38:0/1744515045 >> 172.21.15.38:0/1744515045 conn(0x7fdfa0079730 msgr2=0x7fdfa0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 -- 172.21.15.38:0/1744515045 shutdown_connections 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.190+0000 7fdfa492b640 1 -- 172.21.15.38:0/1744515045 wait complete. 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 Processor -- start 2024-09-21T06:23:18.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 -- start start 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 0x7fdfa019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa0113bb0 con 0x7fdfa010de30 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa0113a30 con 0x7fdfa01052b0 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdfa492b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa0113d30 con 0x7fdfa0104880 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.191+0000 7fdf9ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58996/0 (socket says 172.21.15.38:58996) 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 -- 172.21.15.38:0/1923506617 learned_addr learned my addr 172.21.15.38:0/1923506617 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9dd9b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 0x7fdfa019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9e59c640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 -- 172.21.15.38:0/1923506617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 msgr2=0x7fdfa019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 -- 172.21.15.38:0/1923506617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 msgr2=0x7fdfa019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:18.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 0x7fdfa019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 -- 172.21.15.38:0/1923506617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa01a04f0 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9e59c640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf9ed9d640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdf98005e30 tx=0x7fdf98003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98031650 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf980317f0 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa01a0780 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9802fb70 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.192+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01a6f40 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.194+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa006b4c0 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.195+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdf9802fd70 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.196+0000 7fdf8f7fe640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 0x7fdf880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.196+0000 7fdf9e59c640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 0x7fdf880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.196+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdf981089a0 con 0x7fdfa010de30 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.196+0000 7fdf9e59c640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 0x7fdf880b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdf900058c0 tx=0x7fdf90005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:18.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.200+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf980cef70 con 0x7fdfa010de30 2024-09-21T06:23:18.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.426+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfa01086d0 con 0x7fdfa010de30 2024-09-21T06:23:18.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.427+0000 7fdf8f7fe640 1 -- 172.21.15.38:0/1923506617 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11920 (secure 0 0 0) 0x7fdf980d3350 con 0x7fdfa010de30 2024-09-21T06:23:18.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:23:18.430 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"btime":"2024-09-21T06:21:43:078980+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:21:42.404223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:23:18.430 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 28 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 msgr2=0x7fdf880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 0x7fdf880b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdf900058c0 tx=0x7fdf90005850 comp rx=0 tx=0).stop 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 msgr2=0x7fdfa019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdf98005e30 tx=0x7fdf98003f90 comp rx=0 tx=0).stop 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 shutdown_connections 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf880b6680 0x7fdf880b8b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfa010de30 0x7fdfa019fdc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfa01052b0 0x7fdfa019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 --2- 172.21.15.38:0/1923506617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdfa0104880 0x7fdfa019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 >> 172.21.15.38:0/1923506617 conn(0x7fdfa0079730 msgr2=0x7fdfa0105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.429+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 shutdown_connections 2024-09-21T06:23:18.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:18.430+0000 7fdfa492b640 1 -- 172.21.15.38:0/1923506617 wait complete. 2024-09-21T06:23:19.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:23:19.390 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:19.644 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:19 smithi038 ceph-mon[31215]: pgmap v428: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:23:19.644 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1923506617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:23:19.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:19 smithi174 ceph-mon[34815]: pgmap v428: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:23:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1923506617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:23:19.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:19 smithi044 ceph-mon[34369]: pgmap v428: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:23:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1923506617' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.864+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/4274054144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e341094b0 msgr2=0x7f4e341098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.864+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/4274054144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e341094b0 0x7f4e341098c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009900 tx=0x7f4e2402a410 comp rx=0 tx=0).stop 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/4274054144 shutdown_connections 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/4274054144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e34109e00 0x7f4e34110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/4274054144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e341094b0 0x7f4e341098c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/4274054144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 0x7f4e34103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/4274054144 >> 172.21.15.38:0/4274054144 conn(0x7f4e3407b910 msgr2=0x7f4e3407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/4274054144 shutdown_connections 2024-09-21T06:23:19.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/4274054144 wait complete. 2024-09-21T06:23:19.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.865+0000 7f4e3a0e4640 1 Processor -- start 2024-09-21T06:23:19.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 -- start start 2024-09-21T06:23:19.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 0x7f4e3419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e341094b0 0x7f4e3419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e34113be0 con 0x7f4e34109e00 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e34113a60 con 0x7f4e34103bc0 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e3a0e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e34113d60 con 0x7f4e341094b0 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41874/0 (socket says 172.21.15.38:41874) 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 -- 172.21.15.38:0/476864022 learned_addr learned my addr 172.21.15.38:0/476864022 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e337fe640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 0x7f4e3419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e341094b0 0x7f4e3419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 -- 172.21.15.38:0/476864022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e341094b0 msgr2=0x7f4e3419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e341094b0 0x7f4e3419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 -- 172.21.15.38:0/476864022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 msgr2=0x7f4e3419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 0x7f4e3419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.866+0000 7f4e33fff640 1 -- 172.21.15.38:0/476864022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e341a04a0 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e33fff640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00eaa0 tx=0x7f4e2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e30ff9640 1 -- 172.21.15.38:0/476864022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00cdb0 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e341a0790 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e30ff9640 1 -- 172.21.15.38:0/476864022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e2c005020 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e30ff9640 1 -- 172.21.15.38:0/476864022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0116b0 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.867+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e341a6ef0 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e30ff9640 1 -- 172.21.15.38:0/476864022 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4e2c0051d0 con 0x7f4e34109e00 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 Processor -- start 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 -- start start 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438956a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x564043895be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56404380bea0 con 0x5640434cd390 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5640437fb2d0 con 0x5640434ee070 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e40658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5640437ff0e0 con 0x5640434c51b0 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41888/0 (socket says 172.21.15.38:41888) 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e32ffd640 1 -- 172.21.15.38:0/2314990110 learned_addr learned my addr 172.21.15.38:0/2314990110 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.870+0000 7f4e337fe640 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x564043895be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e30ff9640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 0x7f4e200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 -- 172.21.15.38:0/2314990110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 msgr2=0x564043895be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e33fff640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 0x7f4e200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x564043895be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 -- 172.21.15.38:0/2314990110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 msgr2=0x5640438956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 -- 172.21.15.38:0/2314990110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564043559650 con 0x5640434cd390 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e30ff9640 1 -- 172.21.15.38:0/476864022 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e2c0e7810 con 0x7f4e34109e00 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4e24033000 tx=0x7f4e24000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4382c1b66ced6c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e29ffb640 1 -- 172.21.15.38:0/2314990110 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24035070 con 0x5640434cd390 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e33fff640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 0x7f4e200b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0a9d60 tx=0x7f4e2c07a440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e29ffb640 1 -- 172.21.15.38:0/2314990110 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e24004030 con 0x5640434cd390 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.871+0000 7f4e29ffb640 1 -- 172.21.15.38:0/2314990110 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24005480 con 0x5640434cd390 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 -- 172.21.15.38:0/2314990110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 msgr2=0x564043896120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4e24033000 tx=0x7f4e24000bc0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 -- 172.21.15.38:0/2314990110 shutdown_connections 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043896120 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x564043895be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 --2- 172.21.15.38:0/2314990110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 -- 172.21.15.38:0/2314990110 >> 172.21.15.38:0/2314990110 conn(0x5640434e2460 msgr2=0x564043893590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 -- 172.21.15.38:0/2314990110 shutdown_connections 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.872+0000 7f4e40658740 1 -- 172.21.15.38:0/2314990110 wait complete. 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 -- start start 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 Processor -- start 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434cd390 0x5640438a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56404365c700 con 0x5640434c51b0 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564043796160 con 0x5640434ee070 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.873+0000 7f4e40658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5640438a8150 con 0x5640434cd390 2024-09-21T06:23:19.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e40658740 10 client.0 _ll_register_callbacks cb 0x5640437af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41896/0 (socket says 172.21.15.38:41896) 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 -- 172.21.15.38:0/1021470507 learned_addr learned my addr 172.21.15.38:0/1021470507 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e337fe640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434cd390 0x5640438a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 -- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434cd390 msgr2=0x5640438a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434cd390 0x5640438a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 -- 172.21.15.38:0/1021470507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 msgr2=0x5640438b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 -- 172.21.15.38:0/1021470507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640437c3c90 con 0x5640434c51b0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4e2402a930 tx=0x7f4e24009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50363fa2f24026fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24050030 con 0x5640434c51b0 2024-09-21T06:23:19.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e24004030 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.874+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e24031d50 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e24035050 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 10 client.16302 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640438b3f10 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e24004030 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4e24004780 con 0x5640434c51b0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 10 client.16302 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 10 client.16302 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 20 client.16302 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5640434ac9f0 0x5640438b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 4 client.16302 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.875+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56404380ddf0 con 0x5640434ac9f0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.876+0000 7f4e337fe640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5640434ac9f0 0x5640438b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.876+0000 7f4e12ffd640 10 client.16302 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:23:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.876+0000 7f4e337fe640 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5640434ac9f0 0x5640438b7270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eec7d92249e5328a server_cookie=7ef7de808a841ec6 in_seq=0 out_seq=0 2024-09-21T06:23:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e12ffd640 1 -- 172.21.15.38:0/1021470507 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56404380ddf0 con 0x5640434ac9f0 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e12ffd640 10 client.16302 handle_command_reply: tid=0 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 client.16302 shutdown 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 msgr2=0x5640438a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4e2402a930 tx=0x7f4e24009650 comp rx=0 tx=0).stop 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 shutdown_connections 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5640434ac9f0 0x5640438b7270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x5640438b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434cd390 0x5640438a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 --2- 172.21.15.38:0/1021470507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438a5180 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 >> 172.21.15.38:0/1021470507 conn(0x5640434e2460 msgr2=0x564043898830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e12ffd640 0 client.16302 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:23:19.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 shutdown_connections 2024-09-21T06:23:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 1 -- 172.21.15.38:0/1021470507 wait complete. 2024-09-21T06:23:19.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.877+0000 7f4e40658740 20 client.16302 trim_cache size 0 max 16384 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 Processor -- start 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 -- start start 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x5640438a5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x564043893100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341afce0 con 0x5640434cd390 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341ad4f0 con 0x5640434ee070 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e40658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341ab360 con 0x5640434c51b0 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41912/0 (socket says 172.21.15.38:41912) 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 -- 172.21.15.38:0/473260550 learned_addr learned my addr 172.21.15.38:0/473260550 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x5640438a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x564043893100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 -- 172.21.15.38:0/473260550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 msgr2=0x5640438a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x5640438a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 -- 172.21.15.38:0/473260550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 msgr2=0x564043893100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x564043893100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e337fe640 1 -- 172.21.15.38:0/473260550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640434acc20 con 0x5640434cd390 2024-09-21T06:23:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.891+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x564043893100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.892+0000 7f4e337fe640 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009730 tx=0x7f4e1c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd67c6357a96c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.892+0000 7f4e297fa640 1 -- 172.21.15.38:0/473260550 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c01f430 con 0x5640434cd390 2024-09-21T06:23:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.892+0000 7f4e297fa640 1 -- 172.21.15.38:0/473260550 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e1c01faa0 con 0x5640434cd390 2024-09-21T06:23:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.892+0000 7f4e297fa640 1 -- 172.21.15.38:0/473260550 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c025af0 con 0x5640434cd390 2024-09-21T06:23:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.892+0000 7f4e40658740 1 -- 172.21.15.38:0/473260550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 msgr2=0x564043892bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009730 tx=0x7f4e1c005f90 comp rx=0 tx=0).stop 2024-09-21T06:23:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 -- 172.21.15.38:0/473260550 shutdown_connections 2024-09-21T06:23:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434ee070 0x564043893100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434cd390 0x564043892bc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 --2- 172.21.15.38:0/473260550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434c51b0 0x5640438a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 -- 172.21.15.38:0/473260550 >> 172.21.15.38:0/473260550 conn(0x5640434e2460 msgr2=0x5640438a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 -- 172.21.15.38:0/473260550 shutdown_connections 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 -- 172.21.15.38:0/473260550 wait complete. 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 -- start start 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.893+0000 7f4e40658740 1 Processor -- start 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 0x5640438b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434ee070 0x5640438b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341ab9b0 con 0x5640434c51b0 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341ace20 con 0x5640434cd390 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e341ac080 con 0x5640434ee070 2024-09-21T06:23:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e40658740 10 client.0 _ll_register_callbacks cb 0x7f4e1c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41928/0 (socket says 172.21.15.38:41928) 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 -- 172.21.15.38:0/3836423970 learned_addr learned my addr 172.21.15.38:0/3836423970 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e337fe640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 0x5640438b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434ee070 0x5640438b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 -- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434ee070 msgr2=0x5640438b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434ee070 0x5640438b8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 -- 172.21.15.38:0/3836423970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 msgr2=0x5640438b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 0x5640438b7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e32ffd640 1 -- 172.21.15.38:0/3836423970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640438b8ce0 con 0x5640434c51b0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.894+0000 7f4e337fe640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 0x5640438b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e32ffd640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e2402a930 tx=0x7f4e2404c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fdca8af202b5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:19.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24050040 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e24031d50 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e1c01faa0 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4e24004990 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e40658740 10 client.16308 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5640439219a0 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e1c01faa0 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.895+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4e240036c0 con 0x5640434c51b0 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 10 client.16308 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 10 client.16308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 20 client.16308 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564043481da0 0x5640439240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 4 client.16308 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640438098a0 con 0x564043481da0 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e337fe640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564043481da0 0x5640439240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e337fe640 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564043481da0 0x5640439240e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88543ee3848aefa5 server_cookie=32bf7e66a909b47b in_seq=0 out_seq=0 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.896+0000 7f4e12ffd640 10 client.16308 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e12ffd640 1 -- 172.21.15.38:0/3836423970 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640438098a0 con 0x564043481da0 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e12ffd640 10 client.16308 handle_command_reply: tid=0 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 client.16308 shutdown 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 msgr2=0x5640438baae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4e2402a930 tx=0x7f4e2404c040 comp rx=0 tx=0).stop 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 shutdown_connections 2024-09-21T06:23:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x564043481da0 0x5640439240e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640434ee070 0x5640438b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5640434cd390 0x5640438b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 --2- 172.21.15.38:0/3836423970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5640434c51b0 0x5640438baae0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 >> 172.21.15.38:0/3836423970 conn(0x5640434e2460 msgr2=0x564043898830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e12ffd640 0 client.16308 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 shutdown_connections 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 1 -- 172.21.15.38:0/3836423970 wait complete. 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.897+0000 7f4e40658740 20 client.16308 trim_cache size 0 max 16384 2024-09-21T06:23:19.904 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 msgr2=0x7f4e200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 0x7f4e200b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c0a9d60 tx=0x7f4e2c07a440 comp rx=0 tx=0).stop 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 msgr2=0x7f4e3419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00eaa0 tx=0x7f4e2c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 shutdown_connections 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e200b6680 0x7f4e200b8b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e34109e00 0x7f4e3419fd70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e341094b0 0x7f4e3419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 --2- 172.21.15.38:0/476864022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e34103bc0 0x7f4e3419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 >> 172.21.15.38:0/476864022 conn(0x7f4e3407b910 msgr2=0x7f4e341074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 shutdown_connections 2024-09-21T06:23:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:19.898+0000 7f4e3a0e4640 1 -- 172.21.15.38:0/476864022 wait complete. 2024-09-21T06:23:20.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:23:20.874 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 -- 172.21.15.38:0/1107330593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90103ba0 msgr2=0x7f2e90103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 --2- 172.21.15.38:0/1107330593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90103ba0 0x7f2e90103fb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009900 tx=0x7f2e8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:23:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 -- 172.21.15.38:0/1107330593 shutdown_connections 2024-09-21T06:23:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 --2- 172.21.15.38:0/1107330593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90109e30 0x7f2e90110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 --2- 172.21.15.38:0/1107330593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e901098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 --2- 172.21.15.38:0/1107330593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90103ba0 0x7f2e90103fb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 -- 172.21.15.38:0/1107330593 >> 172.21.15.38:0/1107330593 conn(0x7f2e900ff630 msgr2=0x7f2e90101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 -- 172.21.15.38:0/1107330593 shutdown_connections 2024-09-21T06:23:21.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.339+0000 7f2e987f5640 1 -- 172.21.15.38:0/1107330593 wait complete. 2024-09-21T06:23:21.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 Processor -- start 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 -- start start 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90103ba0 0x7f2e9019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e9019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90113c70 con 0x7f2e90109e30 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90113af0 con 0x7f2e90103ba0 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e987f5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90113df0 con 0x7f2e901094e0 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.340+0000 7f2e96d92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41938/0 (socket says 172.21.15.38:41938) 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 -- 172.21.15.38:0/2648633839 learned_addr learned my addr 172.21.15.38:0/2648633839 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96591640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90103ba0 0x7f2e9019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e9019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 -- 172.21.15.38:0/2648633839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 msgr2=0x7f2e9019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e9019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 -- 172.21.15.38:0/2648633839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90103ba0 msgr2=0x7f2e9019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90103ba0 0x7f2e9019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 -- 172.21.15.38:0/2648633839 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901a0670 con 0x7f2e90109e30 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e9019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e96d92640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800cad0 tx=0x7f2e8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e877fe640 1 -- 172.21.15.38:0/2648633839 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800ae20 con 0x7f2e90109e30 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e877fe640 1 -- 172.21.15.38:0/2648633839 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e88005020 con 0x7f2e90109e30 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901a0960 con 0x7f2e90109e30 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e877fe640 1 -- 172.21.15.38:0/2648633839 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800f6b0 con 0x7f2e90109e30 2024-09-21T06:23:21.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.341+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901a70c0 con 0x7f2e90109e30 2024-09-21T06:23:21.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.344+0000 7f2e877fe640 1 -- 172.21.15.38:0/2648633839 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2e880051d0 con 0x7f2e90109e30 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.344+0000 7f2e9ed69740 1 Processor -- start 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.344+0000 7f2e9ed69740 1 -- start start 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bcf1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bcf2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56221bc67ea0 con 0x56221b94a070 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56221bc572d0 con 0x56221b929390 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56221bc5b0e0 con 0x56221b9211b0 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41952/0 (socket says 172.21.15.38:41952) 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 -- 172.21.15.38:0/2405133361 learned_addr learned my addr 172.21.15.38:0/2405133361 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:21.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e96591640 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bcf1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bcf2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 -- 172.21.15.38:0/2405133361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 msgr2=0x56221bcf1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bcf1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e877fe640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 0x7f2e7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 -- 172.21.15.38:0/2405133361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 msgr2=0x56221bcf2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bcf2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.345+0000 7f2e95d90640 1 -- 172.21.15.38:0/2405133361 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221b9b5650 con 0x56221b94a070 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e96d92640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 0x7f2e7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2e80007ed0 tx=0x7f2e800073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba5a89dc32cfc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e877fe640 1 -- 172.21.15.38:0/2648633839 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2e880e76f0 con 0x7f2e90109e30 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e84ff9640 1 -- 172.21.15.38:0/2405133361 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8001c070 con 0x56221b94a070 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e84ff9640 1 -- 172.21.15.38:0/2405133361 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e80010040 con 0x56221b94a070 2024-09-21T06:23:21.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.346+0000 7f2e84ff9640 1 -- 172.21.15.38:0/2405133361 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e800146a0 con 0x56221b94a070 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2405133361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 msgr2=0x56221bcf16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e96d92640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 0x7f2e7c0b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e880e4f70 tx=0x7f2e8807a270 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2e80007ed0 tx=0x7f2e800073c0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2405133361 shutdown_connections 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bcf2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bcf1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2405133361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b94a070 0x56221bcf16a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2405133361 >> 172.21.15.38:0/2405133361 conn(0x56221b93e460 msgr2=0x56221bcef590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2405133361 shutdown_connections 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2405133361 wait complete. 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 -- start start 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.347+0000 7f2e9ed69740 1 Processor -- start 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b9211b0 0x56221bcfcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd09170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56221bab8700 con 0x56221b929390 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56221bbf2160 con 0x56221b9211b0 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56221bcffe80 con 0x56221b94a070 2024-09-21T06:23:21.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e9ed69740 10 client.0 _ll_register_callbacks cb 0x56221bc0b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41958/0 (socket says 172.21.15.38:41958) 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 -- 172.21.15.38:0/1249735965 learned_addr learned my addr 172.21.15.38:0/1249735965 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b9211b0 0x56221bcfcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd09170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 -- 172.21.15.38:0/1249735965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 msgr2=0x56221bd09170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd09170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 -- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b9211b0 msgr2=0x56221bcfcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b9211b0 0x56221bcfcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.348+0000 7f2e96591640 1 -- 172.21.15.38:0/1249735965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221bc1fc90 con 0x56221b929390 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e96591640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009900 tx=0x7f2e8c031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a986586a401687b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:21.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c035040 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2e8c004240 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e80010040 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c004440 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 10 client.16320 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56221bd0bb50 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e80010040 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e8c004c60 con 0x56221b929390 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 10 client.16320 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 10 client.16320 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 20 client.16320 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b9089f0 0x56221bd0f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 4 client.16320 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.349+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56221bc69df0 con 0x56221b9089f0 2024-09-21T06:23:21.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.350+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b9089f0 0x56221bd0f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.350+0000 7f2e79ffb640 10 client.16320 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.350+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b9089f0 0x56221bd0f020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c5730af2f1ef47d server_cookie=7925ebd16ca630d in_seq=0 out_seq=0 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e79ffb640 1 -- 172.21.15.38:0/1249735965 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56221bc69df0 con 0x56221b9089f0 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e79ffb640 10 client.16320 handle_command_reply: tid=0 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 client.16320 shutdown 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 msgr2=0x56221bcfd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009900 tx=0x7f2e8c031510 comp rx=0 tx=0).stop 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 shutdown_connections 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b9089f0 0x56221bd0f020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd09170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfd250 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1249735965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b9211b0 0x56221bcfcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 >> 172.21.15.38:0/1249735965 conn(0x56221b93e460 msgr2=0x56221bcf4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e79ffb640 0 client.16320 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 shutdown_connections 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.351+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1249735965 wait complete. 2024-09-21T06:23:21.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.352+0000 7f2e9ed69740 20 client.16320 trim_cache size 0 max 16384 2024-09-21T06:23:21.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 Processor -- start 2024-09-21T06:23:21.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 -- start start 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bd09070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b94a070 0x56221bcfd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901b2010 con 0x56221b929390 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901af820 con 0x56221b94a070 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901ad690 con 0x56221b9211b0 2024-09-21T06:23:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41962/0 (socket says 172.21.15.38:41962) 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 -- 172.21.15.38:0/1438119515 learned_addr learned my addr 172.21.15.38:0/1438119515 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b94a070 0x56221bcfd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bd09070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 -- 172.21.15.38:0/1438119515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 msgr2=0x56221bd09070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bd09070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 -- 172.21.15.38:0/1438119515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b94a070 msgr2=0x56221bcfd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b94a070 0x56221bcfd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e96591640 1 -- 172.21.15.38:0/1438119515 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221bcf3990 con 0x56221b929390 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.365+0000 7f2e95d90640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bd09070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.366+0000 7f2e96591640 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0096c0 tx=0x7f2e8c003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f539516939ad79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.366+0000 7f2e7bfff640 1 -- 172.21.15.38:0/1438119515 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c035070 con 0x56221b929390 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.366+0000 7f2e7bfff640 1 -- 172.21.15.38:0/1438119515 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e8c03d450 con 0x56221b929390 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.366+0000 7f2e7bfff640 1 -- 172.21.15.38:0/1438119515 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c047690 con 0x56221b929390 2024-09-21T06:23:21.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1438119515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 msgr2=0x56221bcfcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0096c0 tx=0x7f2e8c003a70 comp rx=0 tx=0).stop 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1438119515 shutdown_connections 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b94a070 0x56221bcfd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b929390 0x56221bcfcac0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/1438119515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b9211b0 0x56221bd09070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1438119515 >> 172.21.15.38:0/1438119515 conn(0x56221b93e460 msgr2=0x56221bcfb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1438119515 shutdown_connections 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- 172.21.15.38:0/1438119515 wait complete. 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 -- start start 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 Processor -- start 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.367+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bd01030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd01740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901adce0 con 0x56221b9211b0 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901af150 con 0x56221b929390 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901ae3b0 con 0x56221b94a070 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 10 client.0 _ll_register_callbacks cb 0x7f2e8c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41970/0 (socket says 172.21.15.38:41970) 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 -- 172.21.15.38:0/2523038553 learned_addr learned my addr 172.21.15.38:0/2523038553 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e96591640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bd01030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 -- 172.21.15.38:0/2523038553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 msgr2=0x56221bd01740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd01740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 -- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 msgr2=0x56221bd01030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bd01030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 -- 172.21.15.38:0/2523038553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221bd78a20 con 0x56221b9211b0 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e96591640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bd01030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e95d90640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000f9e0 tx=0x7f2e80007470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7471ed7d75779e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8001c040 con 0x56221b9211b0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2e80005bc0 con 0x56221b9211b0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.368+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e8c03d450 con 0x56221b9211b0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2e8003c050 con 0x56221b9211b0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 10 client.16326 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56221bd79b20 con 0x56221b9211b0 2024-09-21T06:23:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e8c03d450 con 0x56221b9211b0 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2e80022040 con 0x56221b9211b0 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 10 client.16326 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 10 client.16326 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 20 client.16326 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b8ddda0 0x56221bd7c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 4 client.16326 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56221bc658a0 con 0x56221b8ddda0 2024-09-21T06:23:21.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.369+0000 7f2e96591640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b8ddda0 0x56221bd7c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e79ffb640 10 client.16326 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e96591640 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b8ddda0 0x56221bd7c190 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dff7add1fb8e2aed server_cookie=51e8c529ca2ed6c2 in_seq=0 out_seq=0 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e79ffb640 1 -- 172.21.15.38:0/2523038553 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56221bc658a0 con 0x56221b8ddda0 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e79ffb640 10 client.16326 handle_command_reply: tid=0 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 client.16326 shutdown 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 msgr2=0x56221bd05b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000f9e0 tx=0x7f2e80007470 comp rx=0 tx=0).stop 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 shutdown_connections 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x56221b8ddda0 0x56221bd7c190 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56221b94a070 0x56221bd01740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56221b929390 0x56221bd01030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e79ffb640 0 client.16326 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 --2- 172.21.15.38:0/2523038553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56221b9211b0 0x56221bd05b00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 >> 172.21.15.38:0/2523038553 conn(0x56221b93e460 msgr2=0x56221bcfcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 shutdown_connections 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.370+0000 7f2e9ed69740 1 -- 172.21.15.38:0/2523038553 wait complete. 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e9ed69740 20 client.16326 trim_cache size 0 max 16384 2024-09-21T06:23:21.385 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 msgr2=0x7f2e7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 0x7f2e7c0b8b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2e880e4f70 tx=0x7f2e8807a270 comp rx=0 tx=0).stop 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 msgr2=0x7f2e9019ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800cad0 tx=0x7f2e8800cf90 comp rx=0 tx=0).stop 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 shutdown_connections 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2e7c0b6680 0x7f2e7c0b8b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e90109e30 0x7f2e9019ff40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2e901094e0 0x7f2e9019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 --2- 172.21.15.38:0/2648633839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e90103ba0 0x7f2e9019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:21.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 >> 172.21.15.38:0/2648633839 conn(0x7f2e900ff630 msgr2=0x7f2e90101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:21.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 shutdown_connections 2024-09-21T06:23:21.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:21.371+0000 7f2e987f5640 1 -- 172.21.15.38:0/2648633839 wait complete. 2024-09-21T06:23:21.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:21 smithi174 ceph-mon[34815]: pgmap v429: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:23:21.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:21 smithi044 ceph-mon[34369]: pgmap v429: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:23:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:21 smithi038 ceph-mon[31215]: pgmap v429: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:23:22.113 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:23:22.372 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:22.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.847+0000 7f94f7d3e640 1 -- 172.21.15.38:0/481493713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f01094f0 msgr2=0x7f94f0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.847+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/481493713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f01094f0 0x7f94f0109900 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009900 tx=0x7f94e002a410 comp rx=0 tx=0).stop 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 -- 172.21.15.38:0/481493713 shutdown_connections 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/481493713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 0x7f94f0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/481493713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f01094f0 0x7f94f0109900 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/481493713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f0103bb0 0x7f94f0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 -- 172.21.15.38:0/481493713 >> 172.21.15.38:0/481493713 conn(0x7f94f00ff600 msgr2=0x7f94f0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 -- 172.21.15.38:0/481493713 shutdown_connections 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.848+0000 7f94f7d3e640 1 -- 172.21.15.38:0/481493713 wait complete. 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 Processor -- start 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 -- start start 2024-09-21T06:23:22.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 0x7f94f019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 0x7f94f019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0113c60 con 0x7f94f0103bb0 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0113ae0 con 0x7f94f0109e40 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f7d3e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94f0113de0 con 0x7f94f01094f0 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f5ada640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f5ada640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41980/0 (socket says 172.21.15.38:41980) 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f5ada640 1 -- 172.21.15.38:0/694450412 learned_addr learned my addr 172.21.15.38:0/694450412 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.849+0000 7f94f62db640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 0x7f94f019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f52d9640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 0x7f94f019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 -- 172.21.15.38:0/694450412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 msgr2=0x7f94f019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 0x7f94f019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 -- 172.21.15.38:0/694450412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 msgr2=0x7f94f019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 0x7f94f019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 -- 172.21.15.38:0/694450412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f01a0580 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f52d9640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 0x7f94f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f5ada640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b4a0 tx=0x7f94ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94e6ffd640 1 -- 172.21.15.38:0/694450412 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec014070 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94e6ffd640 1 -- 172.21.15.38:0/694450412 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94ec010ae0 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94e6ffd640 1 -- 172.21.15.38:0/694450412 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec017ce0 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f01a0870 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.850+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f01a6fd0 con 0x7f94f0103bb0 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 Processor -- start 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 -- start start 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8de1b0 0x55b1efcaebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b1efc24ea0 con 0x55b1ef8de1b0 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b1efc142d0 con 0x55b1ef907070 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.853+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b1efc180e0 con 0x55b1ef8e6390 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94e6ffd640 1 -- 172.21.15.38:0/694450412 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f94ec017070 con 0x7f94f0103bb0 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f62db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f5ada640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8de1b0 0x55b1efcaebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:46146/0 (socket says 172.21.15.38:46146) 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 -- 172.21.15.38:0/2793378789 learned_addr learned my addr 172.21.15.38:0/2793378789 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f62db640 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:33272/0 (socket says 172.21.15.38:33272) 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 -- 172.21.15.38:0/2793378789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 msgr2=0x55b1efcae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 -- 172.21.15.38:0/2793378789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8de1b0 msgr2=0x55b1efcaebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8de1b0 0x55b1efcaebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f52d9640 1 -- 172.21.15.38:0/2793378789 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ef972650 con 0x55b1ef8e6390 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.854+0000 7f94f62db640 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:23:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94f52d9640 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94f006cbc0 tx=0x7f94e0032d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1091d5a16aaf0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94e6ffd640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 0x7f94dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94dbfff640 1 -- 172.21.15.38:0/2793378789 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e003f070 con 0x55b1ef8e6390 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94f62db640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 0x7f94dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94e6ffd640 1 -- 172.21.15.38:0/694450412 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f94ec0e6cb0 con 0x7f94f0103bb0 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94dbfff640 1 -- 172.21.15.38:0/2793378789 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94e0031710 con 0x55b1ef8e6390 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.855+0000 7f94dbfff640 1 -- 172.21.15.38:0/2793378789 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0035070 con 0x55b1ef8e6390 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 -- 172.21.15.38:0/2793378789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 msgr2=0x55b1efcaf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94f006cbc0 tx=0x7f94e0032d10 comp rx=0 tx=0).stop 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94f62db640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 0x7f94dc0b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94e8005fd0 tx=0x7f94e8009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 -- 172.21.15.38:0/2793378789 shutdown_connections 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8e6390 0x55b1efcaf120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8de1b0 0x55b1efcaebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/2793378789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 -- 172.21.15.38:0/2793378789 >> 172.21.15.38:0/2793378789 conn(0x55b1ef8fb460 msgr2=0x55b1efcac590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 -- 172.21.15.38:0/2793378789 shutdown_connections 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.856+0000 7f94fe2b2740 1 -- 172.21.15.38:0/2793378789 wait complete. 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 -- start start 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 Processor -- start 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b1efa75700 con 0x55b1ef907070 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b1efbaf160 con 0x55b1ef8e6390 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b1efcbce20 con 0x55b1ef8de1b0 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94fe2b2740 10 client.0 _ll_register_callbacks cb 0x55b1efbc89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94f62db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94f62db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42000/0 (socket says 172.21.15.38:42000) 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.857+0000 7f94f62db640 1 -- 172.21.15.38:0/568390245 learned_addr learned my addr 172.21.15.38:0/568390245 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:22.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f5ada640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f52d9640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 -- 172.21.15.38:0/568390245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 msgr2=0x55b1efcb9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 -- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 msgr2=0x55b1efcba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 -- 172.21.15.38:0/568390245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1efbdcc90 con 0x55b1ef907070 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f52d9640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94f62db640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009b40 tx=0x7f94e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36e7bc5674bf25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8020620 con 0x55b1ef907070 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f94e80207c0 con 0x55b1ef907070 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e0031710 con 0x55b1ef907070 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94e80209c0 con 0x55b1ef907070 2024-09-21T06:23:22.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94fe2b2740 10 client.16338 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.858+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1efcc8b70 con 0x55b1ef907070 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94e0031710 con 0x55b1ef907070 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f94e800f040 con 0x55b1ef907070 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 10 client.16338 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 20 client.16338 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef8c59f0 0x55b1efccc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 4 client.16338 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1efc26df0 con 0x55b1ef8c59f0 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.859+0000 7f94f5ada640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef8c59f0 0x55b1efccc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.860+0000 7f94f5ada640 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef8c59f0 0x55b1efccc170 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd4d787ddd3b746 server_cookie=4441f7057c7a84b4 in_seq=0 out_seq=0 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.860+0000 7f94d97fa640 10 client.16338 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.860+0000 7f94d97fa640 1 -- 172.21.15.38:0/568390245 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1efc26df0 con 0x55b1ef8c59f0 2024-09-21T06:23:22.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94d97fa640 10 client.16338 handle_command_reply: tid=0 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 client.16338 shutdown 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 msgr2=0x55b1efcc6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009b40 tx=0x7f94e8004a40 comp rx=0 tx=0).stop 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 shutdown_connections 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcc6110 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef8c59f0 0x55b1efccc170 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/568390245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94d97fa640 0 client.16338 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 >> 172.21.15.38:0/568390245 conn(0x55b1ef8fb460 msgr2=0x55b1efcb1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 shutdown_connections 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 1 -- 172.21.15.38:0/568390245 wait complete. 2024-09-21T06:23:22.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.861+0000 7f94fe2b2740 20 client.16338 trim_cache size 0 max 16384 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.874+0000 7f94fe2b2740 1 Processor -- start 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.874+0000 7f94fe2b2740 1 -- start start 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.874+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.874+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcabeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01b20a0 con 0x55b1ef8e6390 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01af8b0 con 0x55b1ef907070 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01ad700 con 0x55b1ef8de1b0 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42014/0 (socket says 172.21.15.38:42014) 2024-09-21T06:23:22.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 -- 172.21.15.38:0/3494523620 learned_addr learned my addr 172.21.15.38:0/3494523620 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f5ada640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f62db640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcabeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 -- 172.21.15.38:0/3494523620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 msgr2=0x55b1efcb1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 -- 172.21.15.38:0/3494523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 msgr2=0x55b1efcabeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcabeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 -- 172.21.15.38:0/3494523620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1efcbc4e0 con 0x55b1ef8e6390 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f62db640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcabeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94f52d9640 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009900 tx=0x7f94e00316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f6a59d9a0c33b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94db7fe640 1 -- 172.21.15.38:0/3494523620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e003f040 con 0x55b1ef8e6390 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94db7fe640 1 -- 172.21.15.38:0/3494523620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94e0005510 con 0x55b1ef8e6390 2024-09-21T06:23:22.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.875+0000 7f94db7fe640 1 -- 172.21.15.38:0/3494523620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0035040 con 0x55b1ef8e6390 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3494523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 msgr2=0x55b1efcc6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009900 tx=0x7f94e00316a0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3494523620 shutdown_connections 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef907070 0x55b1efcabeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef8e6390 0x55b1efcc6010 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3494523620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcb1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3494523620 >> 172.21.15.38:0/3494523620 conn(0x55b1ef8fb460 msgr2=0x55b1efcb17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3494523620 shutdown_connections 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.876+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3494523620 wait complete. 2024-09-21T06:23:22.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 -- start start 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 Processor -- start 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcc29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcbde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01add70 con 0x55b1ef907070 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01af1e0 con 0x55b1ef8e6390 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94f01ae440 con 0x55b1ef8de1b0 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94fe2b2740 10 client.0 _ll_register_callbacks cb 0x7f94e8009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94f62db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94f62db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42024/0 (socket says 172.21.15.38:42024) 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94f62db640 1 -- 172.21.15.38:0/3213913972 learned_addr learned my addr 172.21.15.38:0/3213913972 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.877+0000 7f94f5ada640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcc29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f52d9640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcbde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 -- 172.21.15.38:0/3213913972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 msgr2=0x55b1efcc29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcc29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 -- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 msgr2=0x55b1efcbde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcbde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 -- 172.21.15.38:0/3213913972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1efcbeca0 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94f62db640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f94e801fcd0 tx=0x7f94e8011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e9a163bb271a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8020d60 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f94e8004ab0 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94e0005510 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94e8004cb0 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94fe2b2740 10 client.16344 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.878+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1efd36b50 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94e0005510 con 0x55b1ef907070 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f94e8039070 con 0x55b1ef907070 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 10 client.16344 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 20 client.16344 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef89ada0 0x55b1efd39360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 4 client.16344 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1efc228a0 con 0x55b1ef89ada0 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.879+0000 7f94f5ada640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef89ada0 0x55b1efd39360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94f5ada640 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef89ada0 0x55b1efd39360 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51e725c4f55dfbf server_cookie=3be2dca5e67d7ab6 in_seq=0 out_seq=0 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94d97fa640 10 client.16344 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94d97fa640 1 -- 172.21.15.38:0/3213913972 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1efc228a0 con 0x55b1ef89ada0 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94d97fa640 10 client.16344 handle_command_reply: tid=0 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 client.16344 shutdown 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 msgr2=0x55b1efcbe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f94e801fcd0 tx=0x7f94e8011bb0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 shutdown_connections 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b1ef907070 0x55b1efcbe510 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b1ef8e6390 0x55b1efcbde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b1ef89ada0 0x55b1efd39360 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 --2- 172.21.15.38:0/3213913972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b1ef8de1b0 0x55b1efcc29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94d97fa640 0 client.16344 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 >> 172.21.15.38:0/3213913972 conn(0x55b1ef8fb460 msgr2=0x55b1efcb9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 shutdown_connections 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 1 -- 172.21.15.38:0/3213913972 wait complete. 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.880+0000 7f94fe2b2740 20 client.16344 trim_cache size 0 max 16384 2024-09-21T06:23:22.886 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 msgr2=0x7f94dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 0x7f94dc0b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94e8005fd0 tx=0x7f94e8009600 comp rx=0 tx=0).stop 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 msgr2=0x7f94f019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00b4a0 tx=0x7f94ec00b960 comp rx=0 tx=0).stop 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 shutdown_connections 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94dc0b6680 0x7f94dc0b8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94f0109e40 0x7f94f019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94f01094f0 0x7f94f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 --2- 172.21.15.38:0/694450412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94f0103bb0 0x7f94f019a610 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 >> 172.21.15.38:0/694450412 conn(0x7f94f00ff600 msgr2=0x7f94f0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 shutdown_connections 2024-09-21T06:23:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:22.881+0000 7f94f7d3e640 1 -- 172.21.15.38:0/694450412 wait complete. 2024-09-21T06:23:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:23 smithi038 ceph-mon[31215]: pgmap v430: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:23:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:23 smithi044 ceph-mon[34369]: pgmap v430: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:23:23.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:23 smithi174 ceph-mon[34815]: pgmap v430: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:23:24.691 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:23:24.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:23:24.962 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 -- 172.21.15.38:0/2490841146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8109e40 msgr2=0x7feed8110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 --2- 172.21.15.38:0/2490841146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8109e40 0x7feed8110670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feed0009ca0 tx=0x7feed002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 -- 172.21.15.38:0/2490841146 shutdown_connections 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 --2- 172.21.15.38:0/2490841146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed8109e40 0x7feed8110670 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 --2- 172.21.15.38:0/2490841146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed81094f0 0x7feed8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 --2- 172.21.15.38:0/2490841146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8103bb0 0x7feed8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 -- 172.21.15.38:0/2490841146 >> 172.21.15.38:0/2490841146 conn(0x7feed80ff600 msgr2=0x7feed8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 -- 172.21.15.38:0/2490841146 shutdown_connections 2024-09-21T06:23:25.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 -- 172.21.15.38:0/2490841146 wait complete. 2024-09-21T06:23:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.459+0000 7feedd6a7640 1 Processor -- start 2024-09-21T06:23:25.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 -- start start 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed8103bb0 0x7feed8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8109e40 0x7feed8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113c20 con 0x7feed81094f0 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113aa0 con 0x7feed8109e40 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feedd6a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113da0 con 0x7feed8103bb0 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42036/0 (socket says 172.21.15.38:42036) 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 -- 172.21.15.38:0/223172048 learned_addr learned my addr 172.21.15.38:0/223172048 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feed6ffd640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed8103bb0 0x7feed8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feed77fe640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8109e40 0x7feed8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 -- 172.21.15.38:0/223172048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed8103bb0 msgr2=0x7feed8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed8103bb0 0x7feed8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 -- 172.21.15.38:0/223172048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8109e40 msgr2=0x7feed8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8109e40 0x7feed8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.460+0000 7feecffff640 1 -- 172.21.15.38:0/223172048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed81a8810 con 0x7feed81094f0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feecffff640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feec000d950 tx=0x7feec000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feed4ff9640 1 -- 172.21.15.38:0/223172048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0017070 con 0x7feed81094f0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feed4ff9640 1 -- 172.21.15.38:0/223172048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec0009c30 con 0x7feed81094f0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feed4ff9640 1 -- 172.21.15.38:0/223172048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00047a0 con 0x7feed81094f0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed81a8b00 con 0x7feed81094f0 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.461+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81a9040 con 0x7feed81094f0 2024-09-21T06:23:25.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.463+0000 7feee3c1b740 1 Processor -- start 2024-09-21T06:23:25.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 -- start start 2024-09-21T06:23:25.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feed4ff9640 1 -- 172.21.15.38:0/223172048 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7feec0004020 con 0x7feed81094f0 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b565d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b5295670 0x55b5b565deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5b55d3e60 con 0x55b5b52b6350 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5b55c3290 con 0x55b5b5295670 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feee3c1b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5b55c70a0 con 0x55b5b528d490 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feed77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feed77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42048/0 (socket says 172.21.15.38:42048) 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feed77fe640 1 -- 172.21.15.38:0/4246362291 learned_addr learned my addr 172.21.15.38:0/4246362291 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feed6ffd640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b565d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.464+0000 7feecffff640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b5295670 0x55b5b565deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 -- 172.21.15.38:0/4246362291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 msgr2=0x55b5b565d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b565d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 -- 172.21.15.38:0/4246362291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b5295670 msgr2=0x55b5b565deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b5295670 0x55b5b565deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 -- 172.21.15.38:0/4246362291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b5321930 con 0x55b5b52b6350 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed6ffd640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b565d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed4ff9640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 0x7feec40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed77fe640 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feed00098b0 tx=0x7feed00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893f92b8b4772b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed6ffd640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 0x7feec40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feed4ff9640 1 -- 172.21.15.38:0/223172048 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feec00e72a0 con 0x7feed81094f0 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feecd7fa640 1 -- 172.21.15.38:0/4246362291 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed0031d40 con 0x55b5b52b6350 2024-09-21T06:23:25.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feecd7fa640 1 -- 172.21.15.38:0/4246362291 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feed0036030 con 0x55b5b52b6350 2024-09-21T06:23:25.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.465+0000 7feecd7fa640 1 -- 172.21.15.38:0/4246362291 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00042a0 con 0x55b5b52b6350 2024-09-21T06:23:25.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 -- 172.21.15.38:0/4246362291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 msgr2=0x55b5b565d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feed6ffd640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 0x7feec40b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55b5b565c0b0 tx=0x7feec800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feed00098b0 tx=0x7feed00098e0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 -- 172.21.15.38:0/4246362291 shutdown_connections 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b5295670 0x55b5b565deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b565d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4246362291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b565d430 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 -- 172.21.15.38:0/4246362291 >> 172.21.15.38:0/4246362291 conn(0x55b5b52aa740 msgr2=0x55b5b565b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 -- 172.21.15.38:0/4246362291 shutdown_connections 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.466+0000 7feee3c1b740 1 -- 172.21.15.38:0/4246362291 wait complete. 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 -- start start 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 Processor -- start 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b56690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 0x55b5b5674d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5424890 con 0x55b5b5295670 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5b555dd40 con 0x55b5b52b6350 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5b566ba30 con 0x55b5b528d490 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feee3c1b740 10 client.0 _ll_register_callbacks cb 0x55b5b55c1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.467+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42064/0 (socket says 172.21.15.38:42064) 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 -- 172.21.15.38:0/1677353267 learned_addr learned my addr 172.21.15.38:0/1677353267 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feed6ffd640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b56690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feed77fe640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 0x55b5b5674d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 -- 172.21.15.38:0/1677353267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 msgr2=0x55b5b56690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b56690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 -- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 msgr2=0x55b5b5674d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 0x55b5b5674d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 -- 172.21.15.38:0/1677353267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b56753c0 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feed77fe640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 0x55b5b5674d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feecffff640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7feec0005fd0 tx=0x7feec000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d804304299d9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feebe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00acf40 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feec00eace0 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feed0036030 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feec00ac8e0 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.468+0000 7feee3c1b740 10 client.16356 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b5677d80 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feed0036030 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feec00a8ac0 con 0x55b5b5295670 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 10 client.16356 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 20 client.16356 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:25.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b5274cd0 0x55b5b567b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 4 client.16356 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b55d5db0 con 0x55b5b5274cd0 2024-09-21T06:23:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.469+0000 7feed6ffd640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b5274cd0 0x55b5b567b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.470+0000 7feebe7fc640 10 client.16356 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:25.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.470+0000 7feed6ffd640 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b5274cd0 0x55b5b567b2a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b848cd6f062df94e server_cookie=f82e523af17bc6c3 in_seq=0 out_seq=0 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feebe7fc640 1 -- 172.21.15.38:0/1677353267 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5b55d5db0 con 0x55b5b5274cd0 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feebe7fc640 10 client.16356 handle_command_reply: tid=0 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 client.16356 shutdown 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 msgr2=0x55b5b5669690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7feec0005fd0 tx=0x7feec000b6e0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 shutdown_connections 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b52b6350 0x55b5b5674d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5669690 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b5274cd0 0x55b5b567b2a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 --2- 172.21.15.38:0/1677353267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b528d490 0x55b5b56690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feebe7fc640 0 client.16356 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 >> 172.21.15.38:0/1677353267 conn(0x55b5b52aa740 msgr2=0x55b5b5660610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 shutdown_connections 2024-09-21T06:23:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 1 -- 172.21.15.38:0/1677353267 wait complete. 2024-09-21T06:23:25.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.471+0000 7feee3c1b740 20 client.16356 trim_cache size 0 max 16384 2024-09-21T06:23:25.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 Processor -- start 2024-09-21T06:23:25.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 -- start start 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b5674c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b52b6350 0x55b5b5662a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feed81b4170 con 0x55b5b5295670 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed81b1980 con 0x55b5b528d490 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feee3c1b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feed81af7d0 con 0x55b5b52b6350 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feecffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42074/0 (socket says 172.21.15.38:42074) 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.489+0000 7feecffff640 1 -- 172.21.15.38:0/933657293 learned_addr learned my addr 172.21.15.38:0/933657293 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:25.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feed6ffd640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b5674c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feed77fe640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b52b6350 0x55b5b5662a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 -- 172.21.15.38:0/933657293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b52b6350 msgr2=0x55b5b5662a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b52b6350 0x55b5b5662a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 -- 172.21.15.38:0/933657293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 msgr2=0x55b5b5674c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b5674c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 -- 172.21.15.38:0/933657293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b565f720 con 0x55b5b5295670 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feed6ffd640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b5674c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feecffff640 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7feec0009610 tx=0x7feec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64466179008d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feeccff9640 1 -- 172.21.15.38:0/933657293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0014030 con 0x55b5b5295670 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feeccff9640 1 -- 172.21.15.38:0/933657293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec00d0040 con 0x55b5b5295670 2024-09-21T06:23:25.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.490+0000 7feeccff9640 1 -- 172.21.15.38:0/933657293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00acac0 con 0x55b5b5295670 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- 172.21.15.38:0/933657293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 msgr2=0x55b5b5662540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7feec0009610 tx=0x7feec00046c0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- 172.21.15.38:0/933657293 shutdown_connections 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b52b6350 0x55b5b5662a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b5295670 0x55b5b5662540 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 --2- 172.21.15.38:0/933657293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b5674c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- 172.21.15.38:0/933657293 >> 172.21.15.38:0/933657293 conn(0x55b5b52aa740 msgr2=0x55b5b5667750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- 172.21.15.38:0/933657293 shutdown_connections 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- 172.21.15.38:0/933657293 wait complete. 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.491+0000 7feee3c1b740 1 -- start start 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 Processor -- start 2024-09-21T06:23:25.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b566d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b5295670 0x55b5b566dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7feed81afe40 con 0x55b5b52b6350 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed81b12b0 con 0x55b5b528d490 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feed81b0510 con 0x55b5b5295670 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feee3c1b740 10 client.0 _ll_register_callbacks cb 0x7feec0004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42080/0 (socket says 172.21.15.38:42080) 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 -- 172.21.15.38:0/4097164824 learned_addr learned my addr 172.21.15.38:0/4097164824 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed6ffd640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b566d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feecffff640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b5295670 0x55b5b566dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 -- 172.21.15.38:0/4097164824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b5295670 msgr2=0x55b5b566dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b5295670 0x55b5b566dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 -- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 msgr2=0x55b5b566d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:25.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b566d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.492+0000 7feed77fe640 1 -- 172.21.15.38:0/4097164824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b56df410 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feed77fe640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7feed002ade0 tx=0x7feed0031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0947f8d0834c813 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feebe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed004a040 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feed0031450 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feec00d0040 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feed0031650 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feee3c1b740 10 client.16362 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b56e6870 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.493+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec00d0040 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feed0043070 con 0x55b5b52b6350 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 10 client.16362 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:25.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 20 client.16362 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b524a080 0x55b5b56e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 4 client.16362 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b5b55d1860 con 0x55b5b524a080 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feed6ffd640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b524a080 0x55b5b56e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feed6ffd640 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b524a080 0x55b5b56e8e50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28337580f401a6d3 server_cookie=76296db75b205efe in_seq=0 out_seq=0 2024-09-21T06:23:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.494+0000 7feebe7fc640 10 client.16362 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feebe7fc640 1 -- 172.21.15.38:0/4097164824 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b5b55d1860 con 0x55b5b524a080 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feebe7fc640 10 client.16362 handle_command_reply: tid=0 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 client.16362 shutdown 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 msgr2=0x55b5b56deda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7feed002ade0 tx=0x7feed0031f90 comp rx=0 tx=0).stop 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 shutdown_connections 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5b52b6350 0x55b5b56deda0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5b524a080 0x55b5b56e8e50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5b5295670 0x55b5b566dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 --2- 172.21.15.38:0/4097164824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5b528d490 0x55b5b566d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 >> 172.21.15.38:0/4097164824 conn(0x55b5b52aa740 msgr2=0x55b5b5662540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feebe7fc640 0 client.16362 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 shutdown_connections 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.496+0000 7feee3c1b740 1 -- 172.21.15.38:0/4097164824 wait complete. 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feee3c1b740 20 client.16362 trim_cache size 0 max 16384 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "cfe6246a-cfbc-4d5b-93df-8465c32cabff", 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:23:25.501 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 msgr2=0x7feec40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 0x7feec40b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55b5b565c0b0 tx=0x7feec800b390 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 msgr2=0x7feed8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feec000d950 tx=0x7feec000de10 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 shutdown_connections 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7feec40b6680 0x7feec40b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed8109e40 0x7feed8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feed81094f0 0x7feed8075c50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 --2- 172.21.15.38:0/223172048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feed8103bb0 0x7feed8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 >> 172.21.15.38:0/223172048 conn(0x7feed80ff600 msgr2=0x7feed8106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 shutdown_connections 2024-09-21T06:23:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:25.497+0000 7feedd6a7640 1 -- 172.21.15.38:0/223172048 wait complete. 2024-09-21T06:23:25.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:25 smithi038 ceph-mon[31215]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:25 smithi174 ceph-mon[34815]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:25.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:25 smithi044 ceph-mon[34369]: pgmap v431: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:26.258 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:23:26.517 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:26.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:26 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:23:26.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:26 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:26 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:23:26.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:26 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:26 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:23:26.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:26 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:26 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:23:26.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:26 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:26 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:23:26.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:26 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:26 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:23:26.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:26 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 -- 172.21.15.38:0/3530526829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 msgr2=0x7f27ec1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/3530526829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec1087c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009900 tx=0x7f27e002a410 comp rx=0 tx=0).stop 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 -- 172.21.15.38:0/3530526829 shutdown_connections 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/3530526829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec108d00 0x7f27ec10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/3530526829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec1087c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/3530526829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec102ac0 0x7f27ec102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 -- 172.21.15.38:0/3530526829 >> 172.21.15.38:0/3530526829 conn(0x7f27ec079720 msgr2=0x7f27ec079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 -- 172.21.15.38:0/3530526829 shutdown_connections 2024-09-21T06:23:26.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.966+0000 7f27f1ab2640 1 -- 172.21.15.38:0/3530526829 wait complete. 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 Processor -- start 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 -- start start 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec102ac0 0x7f27ec19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 0x7f27ec19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec113c20 con 0x7f27ec1083b0 2024-09-21T06:23:26.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec113aa0 con 0x7f27ec102ac0 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27f1ab2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec113da0 con 0x7f27ec108d00 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42090/0 (socket says 172.21.15.38:42090) 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27eaffd640 1 -- 172.21.15.38:0/118259400 learned_addr learned my addr 172.21.15.38:0/118259400 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27ebfff640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 0x7f27ec19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.967+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec102ac0 0x7f27ec19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 -- 172.21.15.38:0/118259400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 msgr2=0x7f27ec19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 0x7f27ec19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 -- 172.21.15.38:0/118259400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec102ac0 msgr2=0x7f27ec19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec102ac0 0x7f27ec19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 -- 172.21.15.38:0/118259400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec1a0580 con 0x7f27ec1083b0 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27ebfff640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 0x7f27ec19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27eaffd640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005940 tx=0x7f27e0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:26.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27e8ff9640 1 -- 172.21.15.38:0/118259400 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e003f030 con 0x7f27ec1083b0 2024-09-21T06:23:26.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec1a0810 con 0x7f27ec1083b0 2024-09-21T06:23:26.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27e8ff9640 1 -- 172.21.15.38:0/118259400 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27e0003cd0 con 0x7f27ec1083b0 2024-09-21T06:23:26.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27e8ff9640 1 -- 172.21.15.38:0/118259400 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0035070 con 0x7f27ec1083b0 2024-09-21T06:23:26.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.968+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec1a6fd0 con 0x7f27ec1083b0 2024-09-21T06:23:26.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 Processor -- start 2024-09-21T06:23:26.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 -- start start 2024-09-21T06:23:26.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27e8ff9640 1 -- 172.21.15.38:0/118259400 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f27e0042030 con 0x7f27ec1083b0 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef2d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cc4eea2e50 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cc4ee92280 con 0x55cc4eb64390 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27f8026740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cc4ee96090 con 0x55cc4eb85070 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42104/0 (socket says 172.21.15.38:42104) 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1955549500 learned_addr learned my addr 172.21.15.38:0/1955549500 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27eaffd640 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef2d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.971+0000 7f27ebfff640 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1955549500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 msgr2=0x55cc4ef2c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef2c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1955549500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 msgr2=0x55cc4ef2d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:26.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef2d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1955549500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4ebf0650 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00b820 tx=0x7f27dc00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f818b9065dfb86d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:26.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27e8ff9640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 0x7f27d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27ebfff640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 0x7f27d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27d1ffb640 1 -- 172.21.15.38:0/1955549500 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00d950 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27e8ff9640 1 -- 172.21.15.38:0/118259400 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f27e0107de0 con 0x7f27ec1083b0 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27d1ffb640 1 -- 172.21.15.38:0/1955549500 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27dc019070 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.972+0000 7f27d1ffb640 1 -- 172.21.15.38:0/1955549500 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0123e0 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 -- 172.21.15.38:0/1955549500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 msgr2=0x55cc4ef2cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00b820 tx=0x7f27dc00bce0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27ebfff640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 0x7f27d40b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27e400af80 tx=0x7f27e400a730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 -- 172.21.15.38:0/1955549500 shutdown_connections 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef2d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef2cb90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 --2- 172.21.15.38:0/1955549500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef2c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 -- 172.21.15.38:0/1955549500 >> 172.21.15.38:0/1955549500 conn(0x55cc4eb79460 msgr2=0x55cc4ef2a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 -- 172.21.15.38:0/1955549500 shutdown_connections 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.973+0000 7f27f8026740 1 -- 172.21.15.38:0/1955549500 wait complete. 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 -- start start 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 Processor -- start 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef38250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef44150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cc4ecf3700 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cc4ee2d110 con 0x55cc4eb64390 2024-09-21T06:23:26.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.974+0000 7f27f8026740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cc4ef3ae30 con 0x55cc4eb85070 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27f8026740 10 client.0 _ll_register_callbacks cb 0x55cc4ee46990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42112/0 (socket says 172.21.15.38:42112) 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1083674991 learned_addr learned my addr 172.21.15.38:0/1083674991 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eaffd640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef38250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27ebfff640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef44150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1083674991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 msgr2=0x55cc4ef44150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef44150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 msgr2=0x55cc4ef38250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef38250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 -- 172.21.15.38:0/1083674991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4ee5ac40 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27ebfff640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef44150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f27dc004810 tx=0x7f27dc014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01d24d11246fd60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27caffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:26.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc023070 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f27dc00dd60 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.975+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27dc019070 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27dc02f050 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 10 client.16374 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc4ef46b10 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27dc019070 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f27dc013070 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 10 client.16374 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 20 client.16374 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb439f0 0x55cc4ef49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 4 client.16374 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.976+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc4eea4da0 con 0x55cc4eb439f0 2024-09-21T06:23:26.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.977+0000 7f27eaffd640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb439f0 0x55cc4ef49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.977+0000 7f27eaffd640 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb439f0 0x55cc4ef49e70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbbd7745b8d12098 server_cookie=8159bc064f2d117 in_seq=0 out_seq=0 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.977+0000 7f27caffd640 10 client.16374 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27caffd640 1 -- 172.21.15.38:0/1083674991 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc4eea4da0 con 0x55cc4eb439f0 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27caffd640 10 client.16374 handle_command_reply: tid=0 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 client.16374 shutdown 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 msgr2=0x55cc4ef37d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f27dc004810 tx=0x7f27dc014660 comp rx=0 tx=0).stop 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 shutdown_connections 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb439f0 0x55cc4ef49e70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4ef44150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27caffd640 0 client.16374 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef38250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 --2- 172.21.15.38:0/1083674991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef37d10 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 >> 172.21.15.38:0/1083674991 conn(0x55cc4eb79460 msgr2=0x55cc4ef2f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 shutdown_connections 2024-09-21T06:23:26.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 1 -- 172.21.15.38:0/1083674991 wait complete. 2024-09-21T06:23:26.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.978+0000 7f27f8026740 20 client.16374 trim_cache size 0 max 16384 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 Processor -- start 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 -- start start 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef44050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b20e0 con 0x55cc4eb85070 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1af8f0 con 0x55cc4eb64390 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27f8026740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1ad740 con 0x55cc4eb5c1b0 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42120/0 (socket says 172.21.15.38:42120) 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27ebfff640 1 -- 172.21.15.38:0/4093931793 learned_addr learned my addr 172.21.15.38:0/4093931793 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:26.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.996+0000 7f27eaffd640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef44050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 -- 172.21.15.38:0/4093931793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 msgr2=0x55cc4ef381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 -- 172.21.15.38:0/4093931793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 msgr2=0x55cc4ef44050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef44050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 -- 172.21.15.38:0/4093931793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4ef38fd0 con 0x55cc4eb85070 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27ebfff640 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f27e400aa80 tx=0x7f27e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f106345f589bcb79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27d17fa640 1 -- 172.21.15.38:0/4093931793 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004b20 con 0x55cc4eb85070 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27d17fa640 1 -- 172.21.15.38:0/4093931793 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27e4004cc0 con 0x55cc4eb85070 2024-09-21T06:23:27.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.997+0000 7f27d17fa640 1 -- 172.21.15.38:0/4093931793 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40057d0 con 0x55cc4eb85070 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- 172.21.15.38:0/4093931793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 msgr2=0x55cc4ef34f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f27e400aa80 tx=0x7f27e4014000 comp rx=0 tx=0).stop 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- 172.21.15.38:0/4093931793 shutdown_connections 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb85070 0x55cc4ef34f00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb64390 0x55cc4ef44050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 --2- 172.21.15.38:0/4093931793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- 172.21.15.38:0/4093931793 >> 172.21.15.38:0/4093931793 conn(0x55cc4eb79460 msgr2=0x55cc4ef37ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- 172.21.15.38:0/4093931793 shutdown_connections 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- 172.21.15.38:0/4093931793 wait complete. 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.998+0000 7f27f8026740 1 -- start start 2024-09-21T06:23:27.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 Processor -- start 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef3c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4efb36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1addb0 con 0x55cc4eb64390 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1af220 con 0x55cc4eb5c1b0 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1ae480 con 0x55cc4eb85070 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27f8026740 10 client.0 _ll_register_callbacks cb 0x7f27e010b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42126/0 (socket says 172.21.15.38:42126) 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 -- 172.21.15.38:0/3064440294 learned_addr learned my addr 172.21.15.38:0/3064440294 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef3c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27ebfff640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4efb36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 -- 172.21.15.38:0/3064440294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 msgr2=0x55cc4efb36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:27.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4efb36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 -- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb5c1b0 msgr2=0x55cc4ef3c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef3c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:26.999+0000 7f27eaffd640 1 -- 172.21.15.38:0/3064440294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4efb3c10 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27eaffd640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f27e0105610 tx=0x7f27e010b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9d452a29dd3b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0049040 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f27e0105830 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e4004cc0 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f27e00c9b50 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 10 client.16380 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc4efb4d10 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27e4004cc0 con 0x55cc4eb64390 2024-09-21T06:23:27.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f27e00c9f20 con 0x55cc4eb64390 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 10 client.16380 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 20 client.16380 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb18da0 0x55cc4efb74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 4 client.16380 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.000+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc4eea0850 con 0x55cc4eb18da0 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb18da0 0x55cc4efb74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27eb7fe640 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb18da0 0x55cc4efb74b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ab88850a71a3e12 server_cookie=1c09813877dfa23e in_seq=0 out_seq=0 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27caffd640 10 client.16380 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27caffd640 1 -- 172.21.15.38:0/3064440294 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55cc4eea0850 con 0x55cc4eb18da0 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27caffd640 10 client.16380 handle_command_reply: tid=0 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.001+0000 7f27f8026740 1 client.16380 shutdown 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 msgr2=0x55cc4ef3c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f27e0105610 tx=0x7f27e010b930 comp rx=0 tx=0).stop 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 shutdown_connections 2024-09-21T06:23:27.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cc4eb18da0 0x55cc4efb74b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cc4eb85070 0x55cc4efb36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cc4eb64390 0x55cc4ef3c970 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27caffd640 0 client.16380 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 --2- 172.21.15.38:0/3064440294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc4eb5c1b0 0x55cc4ef3c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 >> 172.21.15.38:0/3064440294 conn(0x55cc4eb79460 msgr2=0x55cc4ef2d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 shutdown_connections 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 1 -- 172.21.15.38:0/3064440294 wait complete. 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.002+0000 7f27f8026740 20 client.16380 trim_cache size 0 max 16384 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:23:27.008 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "cfe6246a-cfbc-4d5b-93df-8465c32cabff", 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.009 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.010 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.011 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:23:27.012 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:23:27.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 msgr2=0x7f27d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 0x7f27d40b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27e400af80 tx=0x7f27e400a730 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 msgr2=0x7f27ec19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005940 tx=0x7f27e0004360 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 shutdown_connections 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f27d40b6680 0x7f27d40b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27ec108d00 0x7f27ec19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f27ec1083b0 0x7f27ec19abb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 --2- 172.21.15.38:0/118259400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec102ac0 0x7f27ec19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 >> 172.21.15.38:0/118259400 conn(0x7f27ec079720 msgr2=0x7f27ec106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 shutdown_connections 2024-09-21T06:23:27.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:27.003+0000 7f27f1ab2640 1 -- 172.21.15.38:0/118259400 wait complete. 2024-09-21T06:23:27.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:27 smithi038 ceph-mon[31215]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:27.841 INFO:tasks.cephfs.filesystem:scrub status for tag:cfe6246a-cfbc-4d5b-93df-8465c32cabff - {'path': '/', 'tag': 'cfe6246a-cfbc-4d5b-93df-8465c32cabff', 'options': 'recursive,force'} 2024-09-21T06:23:27.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:27 smithi174 ceph-mon[34815]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:27.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:27 smithi044 ceph-mon[34369]: pgmap v432: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:28.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:28 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:23:28.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:28 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:23:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:28 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:23:29.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:29 smithi038 ceph-mon[31215]: pgmap v433: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:23:29.806 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:29 smithi044 ceph-mon[34369]: pgmap v433: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:23:29.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:29 smithi174 ceph-mon[34815]: pgmap v433: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:23:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:31 smithi038 ceph-mon[31215]: pgmap v434: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:23:31.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:31 smithi174 ceph-mon[34815]: pgmap v434: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:23:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:31 smithi044 ceph-mon[34369]: pgmap v434: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 6 op/s 2024-09-21T06:23:33.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:33 smithi038 ceph-mon[31215]: pgmap v435: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:33.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:33 smithi174 ceph-mon[34815]: pgmap v435: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:33 smithi044 ceph-mon[34369]: pgmap v435: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:35.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:35 smithi038 ceph-mon[31215]: pgmap v436: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:23:35.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:35 smithi174 ceph-mon[34815]: pgmap v436: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:23:35.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:35 smithi044 ceph-mon[34369]: pgmap v436: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:23:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:37 smithi038 ceph-mon[31215]: pgmap v437: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:23:37.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:37 smithi174 ceph-mon[34815]: pgmap v437: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:23:37.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:37 smithi044 ceph-mon[34369]: pgmap v437: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:23:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:39 smithi038 ceph-mon[31215]: pgmap v438: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:39.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:39 smithi174 ceph-mon[34815]: pgmap v438: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:39.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:39 smithi044 ceph-mon[34369]: pgmap v438: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:23:41.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:41 smithi038 ceph-mon[31215]: pgmap v439: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-21T06:23:41.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:41 smithi174 ceph-mon[34815]: pgmap v439: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-21T06:23:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:41 smithi044 ceph-mon[34369]: pgmap v439: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-21T06:23:43.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:43 smithi038 ceph-mon[31215]: pgmap v440: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:23:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:43 smithi174 ceph-mon[34815]: pgmap v440: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:23:43.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:43 smithi044 ceph-mon[34369]: pgmap v440: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:23:45.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:45 smithi174 ceph-mon[34815]: pgmap v441: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:45.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:45 smithi044 ceph-mon[34369]: pgmap v441: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:45.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:45 smithi038 ceph-mon[31215]: pgmap v441: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:47.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:47 smithi174 ceph-mon[34815]: pgmap v442: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:47 smithi044 ceph-mon[34369]: pgmap v442: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:47.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:47 smithi038 ceph-mon[31215]: pgmap v442: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:49.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:49 smithi174 ceph-mon[34815]: pgmap v443: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:49.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:49 smithi044 ceph-mon[34369]: pgmap v443: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:49.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:49 smithi038 ceph-mon[31215]: pgmap v443: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:51.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:51 smithi174 ceph-mon[34815]: pgmap v444: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:51.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:51 smithi044 ceph-mon[34369]: pgmap v444: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:51.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:51 smithi038 ceph-mon[31215]: pgmap v444: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:53.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:53 smithi174 ceph-mon[34815]: pgmap v445: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:53 smithi044 ceph-mon[34369]: pgmap v445: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:53.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:53 smithi038 ceph-mon[31215]: pgmap v445: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:55.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:55 smithi174 ceph-mon[34815]: pgmap v446: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:55 smithi044 ceph-mon[34369]: pgmap v446: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:55 smithi038 ceph-mon[31215]: pgmap v446: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:23:57.842 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:23:57.867 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:57 smithi038 ceph-mon[31215]: pgmap v447: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:57.867 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:57.867 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:57.868 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:57.868 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:57 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:23:57.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:57 smithi174 ceph-mon[34815]: pgmap v447: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:57 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:23:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:57 smithi044 ceph-mon[34369]: pgmap v447: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:23:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:23:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:23:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:23:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:57 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:23:58.105 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.626+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/2980755701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0109e40 msgr2=0x7fe4f0110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.626+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/2980755701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0109e40 0x7fe4f0110670 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009900 tx=0x7fe4e802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.626+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/2980755701 shutdown_connections 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.626+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/2980755701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0109e40 0x7fe4f0110670 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.627+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/2980755701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.627+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/2980755701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0103bb0 0x7fe4f0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.627+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/2980755701 >> 172.21.15.38:0/2980755701 conn(0x7fe4f00ff600 msgr2=0x7fe4f0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.627+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/2980755701 shutdown_connections 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.627+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/2980755701 wait complete. 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 Processor -- start 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 -- start start 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0109e40 0x7fe4f019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0113c40 con 0x7fe4f0103bb0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0113ac0 con 0x7fe4f01094f0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4f4d8f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0113dc0 con 0x7fe4f0109e40 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52512/0 (socket says 172.21.15.38:52512) 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.628+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1504138054 learned_addr learned my addr 172.21.15.38:0/1504138054 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0109e40 0x7fe4f019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1504138054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0109e40 msgr2=0x7fe4f019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0109e40 0x7fe4f019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1504138054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 msgr2=0x7fe4f019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1504138054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f01a03e0 con 0x7fe4f0103bb0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000cce0 tx=0x7fe4e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4df7fe640 1 -- 172.21.15.38:0/1504138054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0004b20 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4df7fe640 1 -- 172.21.15.38:0/1504138054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4e0004cc0 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f01a06d0 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4df7fe640 1 -- 172.21.15.38:0/1504138054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000f850 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.629+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f01a6ef0 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 Processor -- start 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 -- start start 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4df7fe640 1 -- 172.21.15.38:0/1504138054 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe4e0005610 con 0x7fe4f0103bb0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 0x562e44d05650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4493d390 0x562e44d060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562e44c7be50 con 0x562e449351b0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e44c6b280 con 0x562e4495e070 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4fb303740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562e44c6f090 con 0x562e4493d390 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52528/0 (socket says 172.21.15.38:52528) 2024-09-21T06:23:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.632+0000 7fe4ee59c640 1 -- 172.21.15.38:0/3867317016 learned_addr learned my addr 172.21.15.38:0/3867317016 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 0x562e44d05650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4493d390 0x562e44d060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 -- 172.21.15.38:0/3867317016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4493d390 msgr2=0x562e44d060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4493d390 0x562e44d060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 -- 172.21.15.38:0/3867317016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 msgr2=0x562e44d05650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 0x562e44d05650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 -- 172.21.15.38:0/3867317016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e449c9650 con 0x562e449351b0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 0x562e44d05650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00e4f70 tx=0x7fe4e00eddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2772ec42361ebcd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4df7fe640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 0x7fe4d80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 0x7fe4d80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4dcff9640 1 -- 172.21.15.38:0/3867317016 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00a9d50 con 0x562e449351b0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4dcff9640 1 -- 172.21.15.38:0/3867317016 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4dcff9640 1 -- 172.21.15.38:0/3867317016 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00ab3f0 con 0x562e449351b0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.633+0000 7fe4df7fe640 1 -- 172.21.15.38:0/1504138054 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe4e00e7830 con 0x7fe4f0103bb0 2024-09-21T06:23:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 -- 172.21.15.38:0/3867317016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 msgr2=0x562e44d05b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00e4f70 tx=0x7fe4e00eddb0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 0x7fe4d80b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005ab0 tx=0x7fe4e8005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 -- 172.21.15.38:0/3867317016 shutdown_connections 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4493d390 0x562e44d060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d05b90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 --2- 172.21.15.38:0/3867317016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4495e070 0x562e44d05650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 -- 172.21.15.38:0/3867317016 >> 172.21.15.38:0/3867317016 conn(0x562e44952460 msgr2=0x562e44d03540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 -- 172.21.15.38:0/3867317016 shutdown_connections 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.634+0000 7fe4fb303740 1 -- 172.21.15.38:0/3867317016 wait complete. 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 -- start start 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 Processor -- start 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562e44acc700 con 0x562e449351b0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e44c06110 con 0x562e4493d390 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562e44d13e30 con 0x562e4495e070 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4fb303740 10 client.0 _ll_register_callbacks cb 0x562e44c1f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52538/0 (socket says 172.21.15.38:52538) 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1760690227 learned_addr learned my addr 172.21.15.38:0/1760690227 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.635+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1760690227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 msgr2=0x562e44d117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d117a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 msgr2=0x562e44d11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d11220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 -- 172.21.15.38:0/1760690227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e44c33c40 con 0x562e449351b0 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:23:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00ad400 tx=0x7fe4e000af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152ee2d69da1ace2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001d070 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe4e00a9970 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe4e00ab650 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4fb303740 10 client.16392 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e44d1fb30 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.636+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe4e00e7ce0 con 0x562e449351b0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 10 client.16392 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 20 client.16392 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e4491c9f0 0x562e44d22e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 4 client.16392 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e44c7dda0 con 0x562e4491c9f0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e4491c9f0 0x562e44d22e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e4491c9f0 0x562e44d22e90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff0093a301f2104 server_cookie=bbcf31a95050e555 in_seq=0 out_seq=0 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.637+0000 7fe4d5ffb640 10 client.16392 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/1760690227 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e44c7dda0 con 0x562e4491c9f0 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4d5ffb640 10 client.16392 handle_command_reply: tid=0 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 client.16392 shutdown 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 msgr2=0x562e44d10ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00ad400 tx=0x7fe4e000af30 comp rx=0 tx=0).stop 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 shutdown_connections 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e4491c9f0 0x562e44d22e90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4d5ffb640 0 client.16392 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 --2- 172.21.15.38:0/1760690227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d10ce0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.638+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 >> 172.21.15.38:0/1760690227 conn(0x562e44952460 msgr2=0x562e44d087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.639+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 shutdown_connections 2024-09-21T06:23:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.639+0000 7fe4fb303740 1 -- 172.21.15.38:0/1760690227 wait complete. 2024-09-21T06:23:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.639+0000 7fe4fb303740 20 client.16392 trim_cache size 0 max 16384 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.656+0000 7fe4fb303740 1 Processor -- start 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.656+0000 7fe4fb303740 1 -- start start 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d0e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01b1e80 con 0x562e449351b0 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01af690 con 0x562e4493d390 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4fb303740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01ad500 con 0x562e4495e070 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52546/0 (socket says 172.21.15.38:52546) 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 -- 172.21.15.38:0/4131546717 learned_addr learned my addr 172.21.15.38:0/4131546717 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d0e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 -- 172.21.15.38:0/4131546717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 msgr2=0x562e44d0e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d0e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 -- 172.21.15.38:0/4131546717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 msgr2=0x562e44d0ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d0ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 -- 172.21.15.38:0/4131546717 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e44d0f1e0 con 0x562e449351b0 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00aa970 tx=0x7fe4e0005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5379b1fbe742c311 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4d7fff640 1 -- 172.21.15.38:0/4131546717 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0058070 con 0x562e449351b0 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4d7fff640 1 -- 172.21.15.38:0/4131546717 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.657+0000 7fe4d7fff640 1 -- 172.21.15.38:0/4131546717 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001d070 con 0x562e449351b0 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 -- 172.21.15.38:0/4131546717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 msgr2=0x562e44d12910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00aa970 tx=0x7fe4e0005900 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 -- 172.21.15.38:0/4131546717 shutdown_connections 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d0e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d0ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 --2- 172.21.15.38:0/4131546717 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d12910 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 -- 172.21.15.38:0/4131546717 >> 172.21.15.38:0/4131546717 conn(0x562e44952460 msgr2=0x562e44d12200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 -- 172.21.15.38:0/4131546717 shutdown_connections 2024-09-21T06:23:58.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.658+0000 7fe4fb303740 1 -- 172.21.15.38:0/4131546717 wait complete. 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 -- start start 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 Processor -- start 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d24830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d8c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01adb50 con 0x562e449351b0 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01aefc0 con 0x562e4493d390 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01ae220 con 0x562e4495e070 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4fb303740 10 client.0 _ll_register_callbacks cb 0x7fe4e00edb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4ee59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52556/0 (socket says 172.21.15.38:52556) 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4ee59c640 1 -- 172.21.15.38:0/419517161 learned_addr learned my addr 172.21.15.38:0/419517161 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:23:58.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d24830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.659+0000 7fe4eed9d640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d8c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 -- 172.21.15.38:0/419517161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 msgr2=0x562e44d8c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d8c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 -- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 msgr2=0x562e44d24830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d24830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 -- 172.21.15.38:0/419517161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e44d8cb50 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4ee59c640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00edc40 tx=0x7fe4e00a9c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee071bec7170621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001d070 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe4e00b6ea0 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe4e0058040 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 10 client.16398 fetch_fsmap learned FSMap version 28 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e44d8cb50 con 0x562e449351b0 2024-09-21T06:23:58.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe4e00f4070 con 0x562e449351b0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe4e00efc80 con 0x562e449351b0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 10 client.16398 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.660+0000 7fe4fb303740 20 client.16398 populate_metadata read hostname 'smithi038' 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e448f1da0 0x562e44d8ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4fb303740 4 client.16398 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e44c79850 con 0x562e448f1da0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e448f1da0 0x562e44d8ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4edd9b640 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e448f1da0 0x562e44d8ffb0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=796da7fab6a9c45b server_cookie=37fec5908ebeca01 in_seq=0 out_seq=0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4d5ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4d5ffb640 1 -- 172.21.15.38:0/419517161 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x562e44c79850 con 0x562e448f1da0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4d5ffb640 10 client.16398 handle_command_reply: tid=0 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.661+0000 7fe4fb303740 1 client.16398 shutdown 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 msgr2=0x562e44d242b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00edc40 tx=0x7fe4e00a9c00 comp rx=0 tx=0).stop 2024-09-21T06:23:58.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 shutdown_connections 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562e448f1da0 0x562e44d8ffb0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e4495e070 0x562e44d8c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e4493d390 0x562e44d24830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 --2- 172.21.15.38:0/419517161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e449351b0 0x562e44d242b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 >> 172.21.15.38:0/419517161 conn(0x562e44952460 msgr2=0x562e44d1c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4d5ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 shutdown_connections 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 1 -- 172.21.15.38:0/419517161 wait complete. 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4fb303740 20 client.16398 trim_cache size 0 max 16384 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:23:58.668 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.669 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.670 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.671 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:23:58.672 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 msgr2=0x7fe4d80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 0x7fe4d80b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8005ab0 tx=0x7fe4e8005a20 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 msgr2=0x7fe4f019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.662+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000cce0 tx=0x7fe4e000a620 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 shutdown_connections 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe4d80b66b0 0x7fe4d80b8bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4f0109e40 0x7fe4f019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4f01094f0 0x7fe4f019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 --2- 172.21.15.38:0/1504138054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4f0103bb0 0x7fe4f019a530 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 >> 172.21.15.38:0/1504138054 conn(0x7fe4f00ff600 msgr2=0x7fe4f0106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 shutdown_connections 2024-09-21T06:23:58.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:23:58.663+0000 7fe4f4d8f640 1 -- 172.21.15.38:0/1504138054 wait complete. 2024-09-21T06:23:59.562 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:23:59.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:23:59.866 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:23:59.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:23:59 smithi174 ceph-mon[34815]: pgmap v448: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:59.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:23:59 smithi044 ceph-mon[34369]: pgmap v448: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:23:59.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:23:59 smithi038 ceph-mon[31215]: pgmap v448: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:00.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 -- 172.21.15.38:0/79190209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c108d10 msgr2=0x7f176c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 --2- 172.21.15.38:0/79190209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c108d10 0x7f176c10f540 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1764009ca0 tx=0x7f176402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 -- 172.21.15.38:0/79190209 shutdown_connections 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 --2- 172.21.15.38:0/79190209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c108d10 0x7f176c10f540 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 --2- 172.21.15.38:0/79190209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 --2- 172.21.15.38:0/79190209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c102a80 0x7f176c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 -- 172.21.15.38:0/79190209 >> 172.21.15.38:0/79190209 conn(0x7f176c079740 msgr2=0x7f176c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 -- 172.21.15.38:0/79190209 shutdown_connections 2024-09-21T06:24:00.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 -- 172.21.15.38:0/79190209 wait complete. 2024-09-21T06:24:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.325+0000 7f177454f640 1 Processor -- start 2024-09-21T06:24:00.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 -- start start 2024-09-21T06:24:00.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:00.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:00.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c108d10 0x7f176c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:00.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f176c112ac0 con 0x7f176c102a80 2024-09-21T06:24:00.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f176c112940 con 0x7f176c1083c0 2024-09-21T06:24:00.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f177454f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f176c112c40 con 0x7f176c108d10 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56856/0 (socket says 172.21.15.38:56856) 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 -- 172.21.15.38:0/4194139115 learned_addr learned my addr 172.21.15.38:0/4194139115 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f1771aea640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f1772aec640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c108d10 0x7f176c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 -- 172.21.15.38:0/4194139115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c108d10 msgr2=0x7f176c19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c108d10 0x7f176c19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 -- 172.21.15.38:0/4194139115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 msgr2=0x7f176c19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f17722eb640 1 -- 172.21.15.38:0/4194139115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c1a6600 con 0x7f176c102a80 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.326+0000 7f1771aea640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f17722eb640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f176800c970 tx=0x7f176800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768007bb0 con 0x7f176c102a80 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c1a68f0 con 0x7f176c102a80 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1768007d50 con 0x7f176c102a80 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176800f450 con 0x7f176c102a80 2024-09-21T06:24:00.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.327+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c1a6e30 con 0x7f176c102a80 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.328+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c103d00 con 0x7f176c102a80 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.330+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f17680046c0 con 0x7f176c102a80 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.330+0000 7f17637fe640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 0x7f17580b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.331+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17680e7810 con 0x7f176c102a80 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.331+0000 7f1771aea640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 0x7f17580b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.331+0000 7f1771aea640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 0x7f17580b8bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f176c105f20 tx=0x7f175c00b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:00.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.334+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1768014030 con 0x7f176c102a80 2024-09-21T06:24:00.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.562+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f176c06bf50 con 0x7f176c102a80 2024-09-21T06:24:00.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.562+0000 7f17637fe640 1 -- 172.21.15.38:0/4194139115 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11920 (secure 0 0 0) 0x7f17680adde0 con 0x7f176c102a80 2024-09-21T06:24:00.564 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:24:00.564 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"btime":"2024-09-21T06:21:43:078980+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:21:42.404223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:24:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 28 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 msgr2=0x7f17580b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 0x7f17580b8bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f176c105f20 tx=0x7f175c00b5f0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 msgr2=0x7f176c19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f176800c970 tx=0x7f176800ce30 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 shutdown_connections 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17580b66b0 0x7f17580b8bc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f176c108d10 0x7f176c19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1083c0 0x7f176c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 --2- 172.21.15.38:0/4194139115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176c102a80 0x7f176c19b370 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 >> 172.21.15.38:0/4194139115 conn(0x7f176c079740 msgr2=0x7f176c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:00.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 shutdown_connections 2024-09-21T06:24:00.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:00.565+0000 7f177454f640 1 -- 172.21.15.38:0/4194139115 wait complete. 2024-09-21T06:24:01.162 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:24:01.425 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:01.791 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:01 smithi038 ceph-mon[31215]: pgmap v449: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:01.791 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:01 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4194139115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 -- 172.21.15.38:0/4124053793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a81083d0 msgr2=0x7f60a81087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 --2- 172.21.15.38:0/4124053793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a81083d0 0x7f60a81087e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f609c009900 tx=0x7f609c02a410 comp rx=0 tx=0).stop 2024-09-21T06:24:01.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 -- 172.21.15.38:0/4124053793 shutdown_connections 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 --2- 172.21.15.38:0/4124053793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 --2- 172.21.15.38:0/4124053793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a81083d0 0x7f60a81087e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 --2- 172.21.15.38:0/4124053793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a8102a90 0x7f60a8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 -- 172.21.15.38:0/4124053793 >> 172.21.15.38:0/4124053793 conn(0x7f60a8079750 msgr2=0x7f60a8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 -- 172.21.15.38:0/4124053793 shutdown_connections 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.882+0000 7f60ad110640 1 -- 172.21.15.38:0/4124053793 wait complete. 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.883+0000 7f60ad110640 1 Processor -- start 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.883+0000 7f60ad110640 1 -- start start 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a81083d0 0x7f60a819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8112b00 con 0x7f60a8102a90 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8112980 con 0x7f60a81083d0 2024-09-21T06:24:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60ad110640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8112c80 con 0x7f60a8108d20 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56878/0 (socket says 172.21.15.38:56878) 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3742200505 learned_addr learned my addr 172.21.15.38:0/3742200505 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a659c640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a81083d0 0x7f60a819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a759e640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3742200505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 msgr2=0x7f60a819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3742200505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a81083d0 msgr2=0x7f60a819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a81083d0 0x7f60a819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3742200505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a81a0490 con 0x7f60a8102a90 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a759e640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.884+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f609800d950 tx=0x7f609800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.885+0000 7f608ffff640 1 -- 172.21.15.38:0/3742200505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098017070 con 0x7f60a8102a90 2024-09-21T06:24:01.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.885+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a81a0780 con 0x7f60a8102a90 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.885+0000 7f608ffff640 1 -- 172.21.15.38:0/3742200505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6098009c30 con 0x7f60a8102a90 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.885+0000 7f608ffff640 1 -- 172.21.15.38:0/3742200505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609800f6b0 con 0x7f60a8102a90 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.885+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a81a6fa0 con 0x7f60a8102a90 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.887+0000 7f60b3684740 1 Processor -- start 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 -- start start 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f608ffff640 1 -- 172.21.15.38:0/3742200505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f60980109c0 con 0x7f60a8102a90 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c112120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56200c087ea0 con 0x56200bd411b0 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56200c0772d0 con 0x56200bd49390 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60b3684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56200c07b0e0 con 0x56200bd6a070 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56884/0 (socket says 172.21.15.38:56884) 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3981009744 learned_addr learned my addr 172.21.15.38:0/3981009744 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a659c640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a759e640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3981009744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 msgr2=0x56200c1116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.888+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3981009744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 msgr2=0x56200c112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c112120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f60a6d9d640 1 -- 172.21.15.38:0/3981009744 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56200bdd5650 con 0x56200bd411b0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f60980e49c0 tx=0x7f60980ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cbcb92de15bfaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f60a659c640 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f608d7fa640 1 -- 172.21.15.38:0/3981009744 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60980fb070 con 0x56200bd411b0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f608d7fa640 1 -- 172.21.15.38:0/3981009744 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60980e95a0 con 0x56200bd411b0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f608d7fa640 1 -- 172.21.15.38:0/3981009744 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60980f3ad0 con 0x56200bd411b0 2024-09-21T06:24:01.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f608ffff640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 0x7f60900b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.889+0000 7f60a759e640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 0x7f60900b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f608ffff640 1 -- 172.21.15.38:0/3742200505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f60980e72b0 con 0x7f60a8102a90 2024-09-21T06:24:01.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:01 smithi174 ceph-mon[34815]: pgmap v449: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:01.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:01 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4194139115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:01.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 -- 172.21.15.38:0/3981009744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 msgr2=0x56200c111be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f60980e49c0 tx=0x7f60980ef9b0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60a759e640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 0x7f60900b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007f10 tx=0x7f60a00076a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 -- 172.21.15.38:0/3981009744 shutdown_connections 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c111be0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 --2- 172.21.15.38:0/3981009744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 -- 172.21.15.38:0/3981009744 >> 172.21.15.38:0/3981009744 conn(0x56200bd5e460 msgr2=0x56200c10f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 -- 172.21.15.38:0/3981009744 shutdown_connections 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.890+0000 7f60b3684740 1 -- 172.21.15.38:0/3981009744 wait complete. 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 -- start start 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 Processor -- start 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd411b0 0x56200c121170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c12d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56200bed8700 con 0x56200bd49390 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56200c012160 con 0x56200bd6a070 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56200c1241b0 con 0x56200bd411b0 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60b3684740 10 client.0 _ll_register_callbacks cb 0x56200c02b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56894/0 (socket says 172.21.15.38:56894) 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a659c640 1 -- 172.21.15.38:0/2072382285 learned_addr learned my addr 172.21.15.38:0/2072382285 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a759e640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c12d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd411b0 0x56200c121170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a659c640 1 -- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd411b0 msgr2=0x56200c121170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.891+0000 7f60a659c640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd411b0 0x56200c121170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60a659c640 1 -- 172.21.15.38:0/2072382285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 msgr2=0x56200c12d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60a659c640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c12d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60a659c640 1 -- 172.21.15.38:0/2072382285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56200c03fc90 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60a659c640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f609c009900 tx=0x7f609c004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f806b1471eb2573 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f608aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c035040 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f609c005220 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60980e95a0 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f609c005420 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60b3684740 10 client.16416 fetch_fsmap learned FSMap version 28 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56200c12ff00 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.892+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60980e95a0 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f609c003a10 con 0x56200bd49390 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 10 client.16416 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 10 client.16416 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 20 client.16416 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bd289f0 0x56200c133460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 4 client.16416 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56200c089df0 con 0x56200bd289f0 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bd289f0 0x56200c133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bd289f0 0x56200c133460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2bb3aff1952e2f2 server_cookie=7f94a0d3ef44c464 in_seq=0 out_seq=0 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.893+0000 7f608aff5640 10 client.16416 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f608aff5640 1 -- 172.21.15.38:0/2072382285 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56200c089df0 con 0x56200bd289f0 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f608aff5640 10 client.16416 handle_command_reply: tid=0 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 client.16416 shutdown 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 msgr2=0x56200c1216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f609c009900 tx=0x7f609c004550 comp rx=0 tx=0).stop 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 shutdown_connections 2024-09-21T06:24:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bd289f0 0x56200c133460 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c12d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd49390 0x56200c1216b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 --2- 172.21.15.38:0/2072382285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd411b0 0x56200c121170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.894+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 >> 172.21.15.38:0/2072382285 conn(0x56200bd5e460 msgr2=0x56200c1147f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.895+0000 7f608aff5640 0 client.16416 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.895+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 shutdown_connections 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.895+0000 7f60b3684740 1 -- 172.21.15.38:0/2072382285 wait complete. 2024-09-21T06:24:01.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.895+0000 7f60b3684740 20 client.16416 trim_cache size 0 max 16384 2024-09-21T06:24:01.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:01 smithi044 ceph-mon[34369]: pgmap v449: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:01.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:01 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4194139115' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:01.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 Processor -- start 2024-09-21T06:24:01.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 -- start start 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd49390 0x56200c10ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c10f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81afe00 con 0x56200bd411b0 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81ad610 con 0x56200bd6a070 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60b3684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81ab480 con 0x56200bd49390 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56898/0 (socket says 172.21.15.38:56898) 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60a6d9d640 1 -- 172.21.15.38:0/1936790182 learned_addr learned my addr 172.21.15.38:0/1936790182 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60a659c640 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd49390 0x56200c10ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.908+0000 7f60a759e640 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c10f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 -- 172.21.15.38:0/1936790182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd49390 msgr2=0x56200c10ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd49390 0x56200c10ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 -- 172.21.15.38:0/1936790182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 msgr2=0x56200c10f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c10f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 -- 172.21.15.38:0/1936790182 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56200bd28c20 con 0x56200bd411b0 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f60980aa3f0 tx=0x7f60980eae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19defc3a95c22fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f608cff9640 1 -- 172.21.15.38:0/1936790182 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098020040 con 0x56200bd411b0 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f608cff9640 1 -- 172.21.15.38:0/1936790182 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60980ef150 con 0x56200bd411b0 2024-09-21T06:24:01.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.909+0000 7f608cff9640 1 -- 172.21.15.38:0/1936790182 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60980acc90 con 0x56200bd411b0 2024-09-21T06:24:01.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- 172.21.15.38:0/1936790182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 msgr2=0x56200c121630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f60980aa3f0 tx=0x7f60980eae00 comp rx=0 tx=0).stop 2024-09-21T06:24:01.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- 172.21.15.38:0/1936790182 shutdown_connections 2024-09-21T06:24:01.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd6a070 0x56200c10f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd49390 0x56200c10ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 --2- 172.21.15.38:0/1936790182 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c121630 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- 172.21.15.38:0/1936790182 >> 172.21.15.38:0/1936790182 conn(0x56200bd5e460 msgr2=0x56200c120f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- 172.21.15.38:0/1936790182 shutdown_connections 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- 172.21.15.38:0/1936790182 wait complete. 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 -- start start 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.910+0000 7f60b3684740 1 Processor -- start 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c124fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81abad0 con 0x56200bd411b0 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81acf40 con 0x56200bd49390 2024-09-21T06:24:01.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f60a81ac1a0 con 0x56200bd6a070 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60b3684740 10 client.0 _ll_register_callbacks cb 0x7f609c0041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56904/0 (socket says 172.21.15.38:56904) 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 -- 172.21.15.38:0/2635974075 learned_addr learned my addr 172.21.15.38:0/2635974075 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a759e640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a659c640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c124fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 -- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 msgr2=0x56200c1254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1254e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 -- 172.21.15.38:0/2635974075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 msgr2=0x56200c124fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c124fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 -- 172.21.15.38:0/2635974075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56200c125b50 con 0x56200bd411b0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f60a6d9d640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6098094010 tx=0x7f6098010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9131fbd98c5579d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f608aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.911+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098098030 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f60980eabd0 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56200c0858a0 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6098020070 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 10 client.16422 fetch_fsmap learned FSMap version 28 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56200c19dc60 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x56200c0858a0 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f60980a93f0 con 0x56200bd411b0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 10 client.16422 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 10 client.16422 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 20 client.16422 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bcfdda0 0x56200c19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 4 client.16422 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56200c082cd0 con 0x56200bcfdda0 2024-09-21T06:24:01.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.912+0000 7f60a659c640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bcfdda0 0x56200c19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60a659c640 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bcfdda0 0x56200c19fef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8a8c835df40dfed server_cookie=cf7a05a66a2d3af0 in_seq=0 out_seq=0 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f608aff5640 10 client.16422 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f608aff5640 1 -- 172.21.15.38:0/2635974075 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56200c082cd0 con 0x56200bcfdda0 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f608aff5640 10 client.16422 handle_command_reply: tid=0 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 client.16422 shutdown 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 msgr2=0x56200c129af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6098094010 tx=0x7f6098010d60 comp rx=0 tx=0).stop 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 shutdown_connections 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56200bcfdda0 0x56200c19fef0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56200bd6a070 0x56200c1254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f608aff5640 0 client.16422 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56200bd49390 0x56200c124fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 --2- 172.21.15.38:0/2635974075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56200bd411b0 0x56200c129af0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.913+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 >> 172.21.15.38:0/2635974075 conn(0x56200bd5e460 msgr2=0x56200c1126d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 shutdown_connections 2024-09-21T06:24:01.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60b3684740 1 -- 172.21.15.38:0/2635974075 wait complete. 2024-09-21T06:24:01.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60b3684740 20 client.16422 trim_cache size 0 max 16384 2024-09-21T06:24:01.920 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 msgr2=0x7f60900b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 0x7f60900b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60a0007f10 tx=0x7f60a00076a0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 msgr2=0x7f60a819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f609800d950 tx=0x7f609800de10 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 shutdown_connections 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f60900b66b0 0x7f60900b8bc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60a8108d20 0x7f60a819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60a81083d0 0x7f60a819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 --2- 172.21.15.38:0/3742200505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f60a8102a90 0x7f60a819a5e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 >> 172.21.15.38:0/3742200505 conn(0x7f60a8079750 msgr2=0x7f60a806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 shutdown_connections 2024-09-21T06:24:01.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:01.914+0000 7f60ad110640 1 -- 172.21.15.38:0/3742200505 wait complete. 2024-09-21T06:24:02.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:24:03.024 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.496+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1549710352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c109e10 msgr2=0x7f8a9c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.496+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1549710352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c109e10 0x7f8a9c110640 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009ca0 tx=0x7f8a9402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1549710352 shutdown_connections 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1549710352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c109e10 0x7f8a9c110640 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1549710352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1549710352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c103b80 0x7f8a9c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1549710352 >> 172.21.15.38:0/1549710352 conn(0x7f8a9c0ff610 msgr2=0x7f8a9c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1549710352 shutdown_connections 2024-09-21T06:24:03.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1549710352 wait complete. 2024-09-21T06:24:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 Processor -- start 2024-09-21T06:24:03.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.497+0000 7f8aa1c3e640 1 -- start start 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 0x7f8a9c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c109e10 0x7f8a9c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c113c10 con 0x7f8a9c1094c0 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c113a90 con 0x7f8a9c109e10 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8aa1c3e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c113d90 con 0x7f8a9c103b80 2024-09-21T06:24:03.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56920/0 (socket says 172.21.15.38:56920) 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 -- 172.21.15.38:0/1117292396 learned_addr learned my addr 172.21.15.38:0/1117292396 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 0x7f8a9c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c109e10 0x7f8a9c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 -- 172.21.15.38:0/1117292396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 msgr2=0x7f8a9c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 0x7f8a9c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 -- 172.21.15.38:0/1117292396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c109e10 msgr2=0x7f8a9c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c109e10 0x7f8a9c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a92ffd640 1 -- 172.21.15.38:0/1117292396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c1a04d0 con 0x7f8a9c1094c0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.498+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 0x7f8a9c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400e9c0 tx=0x7f8a8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8a997fa640 1 -- 172.21.15.38:0/1117292396 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400ccc0 con 0x7f8a9c1094c0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c1a07c0 con 0x7f8a9c1094c0 2024-09-21T06:24:03.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8a997fa640 1 -- 172.21.15.38:0/1117292396 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a840054f0 con 0x7f8a9c1094c0 2024-09-21T06:24:03.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8a997fa640 1 -- 172.21.15.38:0/1117292396 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84010430 con 0x7f8a9c1094c0 2024-09-21T06:24:03.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.499+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c1a6f20 con 0x7f8a9c1094c0 2024-09-21T06:24:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 Processor -- start 2024-09-21T06:24:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8a997fa640 1 -- 172.21.15.38:0/1117292396 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8a840046c0 con 0x7f8a9c1094c0 2024-09-21T06:24:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 -- start start 2024-09-21T06:24:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea921b0 0x55c2cee62be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea9a390 0x55c2cee63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c2cedd8ea0 con 0x55c2ceabb070 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c2cedc82d0 con 0x55c2cea9a390 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2cedcc0e0 con 0x55c2cea921b0 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56932/0 (socket says 172.21.15.38:56932) 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.503+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3206936298 learned_addr learned my addr 172.21.15.38:0/3206936298 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea9a390 0x55c2cee63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea921b0 0x55c2cee62be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3206936298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea921b0 msgr2=0x55c2cee62be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea921b0 0x55c2cee62be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3206936298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea9a390 msgr2=0x55c2cee63120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea9a390 0x55c2cee63120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3206936298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ceb26650 con 0x55c2ceabb070 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a997fa640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 0x7f8a880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8a9402f4c0 tx=0x7f8a94009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a2e78c079cb3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 0x7f8a880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.504+0000 7f8a91ffb640 1 -- 172.21.15.38:0/3206936298 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94031d40 con 0x55c2ceabb070 2024-09-21T06:24:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.505+0000 7f8a997fa640 1 -- 172.21.15.38:0/1117292396 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8a840e7a40 con 0x7f8a9c1094c0 2024-09-21T06:24:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.505+0000 7f8a91ffb640 1 -- 172.21.15.38:0/3206936298 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a94036030 con 0x55c2ceabb070 2024-09-21T06:24:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.505+0000 7f8a91ffb640 1 -- 172.21.15.38:0/3206936298 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a940042a0 con 0x55c2ceabb070 2024-09-21T06:24:03.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3206936298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 msgr2=0x55c2cee626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 0x7f8a880b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55c2cee61320 tx=0x7f8a8c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8a9402f4c0 tx=0x7f8a94009800 comp rx=0 tx=0).stop 2024-09-21T06:24:03.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3206936298 shutdown_connections 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea9a390 0x55c2cee63120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea921b0 0x55c2cee62be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3206936298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee626a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3206936298 >> 172.21.15.38:0/3206936298 conn(0x55c2ceaaf460 msgr2=0x55c2cee60590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3206936298 shutdown_connections 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3206936298 wait complete. 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.506+0000 7f8aa81b2740 1 -- start start 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 Processor -- start 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea921b0 0x55c2cee6dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee6e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55c2cec29700 con 0x55c2ceabb070 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c2ced63160 con 0x55c2cea921b0 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2cee750b0 con 0x55c2cea9a390 2024-09-21T06:24:03.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8aa81b2740 10 client.0 _ll_register_callbacks cb 0x55c2ced7c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8a9bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56944/0 (socket says 172.21.15.38:56944) 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.507+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3682068357 learned_addr learned my addr 172.21.15.38:0/3682068357 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea921b0 0x55c2cee6dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee6e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3682068357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 msgr2=0x55c2cee6e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee6e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea921b0 msgr2=0x55c2cee6dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea921b0 0x55c2cee6dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 -- 172.21.15.38:0/3682068357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ced90c90 con 0x55c2ceabb070 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8a94031ae0 tx=0x7f8a94031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2e46db33a3e10b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a7affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9404a040 con 0x55c2ceabb070 2024-09-21T06:24:03.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.508+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a94036030 con 0x55c2ceabb070 2024-09-21T06:24:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8a94003b70 con 0x55c2ceabb070 2024-09-21T06:24:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a94009360 con 0x55c2ceabb070 2024-09-21T06:24:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 10 client.16434 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:03.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2cee80d80 con 0x55c2ceabb070 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a94036030 con 0x55c2ceabb070 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8a9404d030 con 0x55c2ceabb070 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 10 client.16434 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 10 client.16434 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 20 client.16434 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea799f0 0x55c2cee840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 4 client.16434 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.509+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2ceddadf0 con 0x55c2cea799f0 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.510+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea799f0 0x55c2cee840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.510+0000 7f8a7affd640 10 client.16434 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:03.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.510+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea799f0 0x55c2cee840e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52187b0e420d5880 server_cookie=96360d9c94996a5c in_seq=0 out_seq=0 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.511+0000 7f8a7affd640 1 -- 172.21.15.38:0/3682068357 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2ceddadf0 con 0x55c2cea799f0 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.511+0000 7f8a7affd640 10 client.16434 handle_command_reply: tid=0 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.511+0000 7f8aa81b2740 1 client.16434 shutdown 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.511+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 msgr2=0x55c2cee6e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.511+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8a94031ae0 tx=0x7f8a94031df0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 shutdown_connections 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea799f0 0x55c2cee840e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2ceabb070 0x55c2cee6e7f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee6e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8a7affd640 0 client.16434 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3682068357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2cea921b0 0x55c2cee6dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 >> 172.21.15.38:0/3682068357 conn(0x55c2ceaaf460 msgr2=0x55c2cee65880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 shutdown_connections 2024-09-21T06:24:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3682068357 wait complete. 2024-09-21T06:24:03.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.512+0000 7f8aa81b2740 20 client.16434 trim_cache size 0 max 16384 2024-09-21T06:24:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.525+0000 7f8aa81b2740 1 Processor -- start 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.525+0000 7f8aa81b2740 1 -- start start 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee7d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee7df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1afd30 con 0x55c2cea921b0 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ad570 con 0x55c2ceabb070 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8aa81b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ab3e0 con 0x55c2cea9a390 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56948/0 (socket says 172.21.15.38:56948) 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/2507955457 learned_addr learned my addr 172.21.15.38:0/2507955457 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee7df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee7d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/2507955457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 msgr2=0x55c2cee7d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee7d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/2507955457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 msgr2=0x55c2cee7df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee7df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/2507955457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2cee60f00 con 0x55c2cea921b0 2024-09-21T06:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.526+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bfd0 tx=0x7f8a8c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e48f245d5109d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.527+0000 7f8a917fa640 1 -- 172.21.15.38:0/2507955457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c004020 con 0x55c2cea921b0 2024-09-21T06:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.527+0000 7f8a917fa640 1 -- 172.21.15.38:0/2507955457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a8c01eda0 con 0x55c2cea921b0 2024-09-21T06:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.527+0000 7f8a917fa640 1 -- 172.21.15.38:0/2507955457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0039e0 con 0x55c2cea921b0 2024-09-21T06:24:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- 172.21.15.38:0/2507955457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 msgr2=0x55c2cee64090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bfd0 tx=0x7f8a8c011f90 comp rx=0 tx=0).stop 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- 172.21.15.38:0/2507955457 shutdown_connections 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee7df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee7d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/2507955457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee64090 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- 172.21.15.38:0/2507955457 >> 172.21.15.38:0/2507955457 conn(0x55c2ceaaf460 msgr2=0x55c2cee7d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- 172.21.15.38:0/2507955457 shutdown_connections 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- 172.21.15.38:0/2507955457 wait complete. 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.528+0000 7f8aa81b2740 1 -- start start 2024-09-21T06:24:03.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 Processor -- start 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56960/0 (socket says 172.21.15.38:56960) 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/3260362817 learned_addr learned my addr 172.21.15.38:0/3260362817 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee76660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1aba30 con 0x55c2cea921b0 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.529+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1acea0 con 0x55c2ceabb070 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c1ac100 con 0x55c2cea9a390 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee76660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8aa81b2740 10 client.0 _ll_register_callbacks cb 0x7f8a8c00bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/3260362817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 msgr2=0x55c2cee760a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee760a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 msgr2=0x55c2cee76660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee76660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2cee76df0 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c01eda0 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9bfff640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee76660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a9b7fe640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bfa0 tx=0x7f8a8c010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b08543e15b9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.530+0000 7f8a7affd640 10 client.16440 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8a7affd640 1 -- 172.21.15.38:0/3260362817 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c03f060 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8a7affd640 1 -- 172.21.15.38:0/3260362817 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8a8c01ea50 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8a7affd640 1 -- 172.21.15.38:0/3260362817 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c02a470 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 10 client.16440 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c2ceeee7d0 con 0x55c2cea921b0 2024-09-21T06:24:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8a7affd640 1 -- 172.21.15.38:0/3260362817 <== mon.0 v2:172.21.15.38:3300/0 4 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f8a8c02a610 con 0x55c2cea921b0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 10 client.16440 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 10 client.16440 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 20 client.16440 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea4eda0 0x55c2ceef0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 4 client.16440 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2cedd68a0 con 0x55c2cea4eda0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.531+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea4eda0 0x55c2ceef0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8a92ffd640 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea4eda0 0x55c2ceef0ea0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3266fbb7c494a230 server_cookie=93d922f2d9a8d671 in_seq=0 out_seq=0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8a7affd640 10 client.16440 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8a7affd640 1 -- 172.21.15.38:0/3260362817 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2cedd68a0 con 0x55c2cea4eda0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8a7affd640 10 client.16440 handle_command_reply: tid=0 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 client.16440 shutdown 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 msgr2=0x55c2cee7aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00bfa0 tx=0x7f8a8c010b80 comp rx=0 tx=0).stop 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 shutdown_connections 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55c2cea4eda0 0x55c2ceef0ea0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c2ceabb070 0x55c2cee76660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2cea9a390 0x55c2cee760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 --2- 172.21.15.38:0/3260362817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c2cea921b0 0x55c2cee7aba0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.532+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 >> 172.21.15.38:0/3260362817 conn(0x55c2ceaaf460 msgr2=0x55c2cee7dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8a7affd640 0 client.16440 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 shutdown_connections 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa81b2740 1 -- 172.21.15.38:0/3260362817 wait complete. 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa81b2740 20 client.16440 trim_cache size 0 max 16384 2024-09-21T06:24:03.538 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 msgr2=0x7f8a880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 0x7f8a880b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55c2cee61320 tx=0x7f8a8c00b410 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 msgr2=0x7f8a9c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.533+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400e9c0 tx=0x7f8a8400ee80 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 shutdown_connections 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8a880b6680 0x7f8a880b8b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a9c109e10 0x7f8a9c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8a9c1094c0 0x7f8a9c19ab00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 --2- 172.21.15.38:0/1117292396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8a9c103b80 0x7f8a9c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 >> 172.21.15.38:0/1117292396 conn(0x7f8a9c0ff610 msgr2=0x7f8a9c108ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 shutdown_connections 2024-09-21T06:24:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:03.534+0000 7f8aa1c3e640 1 -- 172.21.15.38:0/1117292396 wait complete. 2024-09-21T06:24:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:03 smithi038 ceph-mon[31215]: pgmap v450: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:24:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:03 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:03.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:03 smithi174 ceph-mon[34815]: pgmap v450: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:24:03.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:03 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:03.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:03 smithi044 ceph-mon[34369]: pgmap v450: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:24:03.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:03 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:04.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:24:04.383 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:04.799 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:04 smithi038 ceph-mon[31215]: pgmap v451: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 -- 172.21.15.38:0/2670382793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4301083a0 msgr2=0x7fa4301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 --2- 172.21.15.38:0/2670382793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4301083a0 0x7fa4301087b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa418009900 tx=0x7fa41802a410 comp rx=0 tx=0).stop 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 -- 172.21.15.38:0/2670382793 shutdown_connections 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 --2- 172.21.15.38:0/2670382793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa430108cf0 0x7fa43010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 --2- 172.21.15.38:0/2670382793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4301083a0 0x7fa4301087b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 --2- 172.21.15.38:0/2670382793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430102a60 0x7fa430102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 -- 172.21.15.38:0/2670382793 >> 172.21.15.38:0/2670382793 conn(0x7fa430079730 msgr2=0x7fa430079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 -- 172.21.15.38:0/2670382793 shutdown_connections 2024-09-21T06:24:04.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.802+0000 7fa43600a640 1 -- 172.21.15.38:0/2670382793 wait complete. 2024-09-21T06:24:04.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 Processor -- start 2024-09-21T06:24:04.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 -- start start 2024-09-21T06:24:04.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 0x7fa43019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430108cf0 0x7fa43019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa430113ba0 con 0x7fa430102a60 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa430113a20 con 0x7fa4301083a0 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa43600a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa430113d20 con 0x7fa430108cf0 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56980/0 (socket says 172.21.15.38:56980) 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.803+0000 7fa42f7fe640 1 -- 172.21.15.38:0/1286670349 learned_addr learned my addr 172.21.15.38:0/1286670349 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa427fff640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 0x7fa43019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42ffff640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430108cf0 0x7fa43019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 -- 172.21.15.38:0/1286670349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430108cf0 msgr2=0x7fa43019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430108cf0 0x7fa43019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 -- 172.21.15.38:0/1286670349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 msgr2=0x7fa43019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 0x7fa43019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 -- 172.21.15.38:0/1286670349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4301a0520 con 0x7fa430102a60 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa427fff640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 0x7fa43019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d950 tx=0x7fa42000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42d7fa640 1 -- 172.21.15.38:0/1286670349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420017070 con 0x7fa430102a60 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42d7fa640 1 -- 172.21.15.38:0/1286670349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa420009c30 con 0x7fa430102a60 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa42d7fa640 1 -- 172.21.15.38:0/1286670349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42000f6b0 con 0x7fa430102a60 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4301a0810 con 0x7fa430102a60 2024-09-21T06:24:04.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.804+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4301a6f70 con 0x7fa430102a60 2024-09-21T06:24:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa42d7fa640 1 -- 172.21.15.38:0/1286670349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa4200109c0 con 0x7fa430102a60 2024-09-21T06:24:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 Processor -- start 2024-09-21T06:24:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 -- start start 2024-09-21T06:24:04.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 0x564c79c28d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564c79b9eea0 con 0x564c798581b0 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c79b8e2d0 con 0x564c79860390 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.807+0000 7fa43c57e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564c79b920e0 con 0x564c79881070 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56996/0 (socket says 172.21.15.38:56996) 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 -- 172.21.15.38:0/731616173 learned_addr learned my addr 172.21.15.38:0/731616173 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42ffff640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa427fff640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 0x564c79c28d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42d7fa640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 0x7fa41c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 -- 172.21.15.38:0/731616173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 msgr2=0x564c79c282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 -- 172.21.15.38:0/731616173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 msgr2=0x564c79c28d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 0x564c79c28d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 -- 172.21.15.38:0/731616173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c798ec650 con 0x564c798581b0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa427fff640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 0x564c79c28d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42ffff640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 0x7fa41c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa4200e4af0 tx=0x7fa4200ad470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc305f4da6e76d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.808+0000 7fa42d7fa640 1 -- 172.21.15.38:0/1286670349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4200e7410 con 0x7fa430102a60 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.809+0000 7fa425ffb640 1 -- 172.21.15.38:0/731616173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420020070 con 0x564c798581b0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.809+0000 7fa425ffb640 1 -- 172.21.15.38:0/731616173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4200acd90 con 0x564c798581b0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.809+0000 7fa42ffff640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 0x7fa41c0b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa428005fd0 tx=0x7fa428004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.809+0000 7fa425ffb640 1 -- 172.21.15.38:0/731616173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200ad980 con 0x564c798581b0 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- 172.21.15.38:0/731616173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 msgr2=0x564c79c28800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa4200e4af0 tx=0x7fa4200ad470 comp rx=0 tx=0).stop 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- 172.21.15.38:0/731616173 shutdown_connections 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79860390 0x564c79c28d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c28800 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 --2- 172.21.15.38:0/731616173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- 172.21.15.38:0/731616173 >> 172.21.15.38:0/731616173 conn(0x564c79875460 msgr2=0x564c79c261b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- 172.21.15.38:0/731616173 shutdown_connections 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- 172.21.15.38:0/731616173 wait complete. 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 -- start start 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.810+0000 7fa43c57e740 1 Processor -- start 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 0x564c79c38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79881070 0x564c79c38800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564c799ef700 con 0x564c798581b0 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c79b29160 con 0x564c79881070 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564c79c3ada0 con 0x564c79860390 2024-09-21T06:24:04.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa43c57e740 10 client.0 _ll_register_callbacks cb 0x564c79b429e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56998/0 (socket says 172.21.15.38:56998) 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 -- 172.21.15.38:0/740313979 learned_addr learned my addr 172.21.15.38:0/740313979 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa427fff640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 0x564c79c38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42ffff640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79881070 0x564c79c38800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 -- 172.21.15.38:0/740313979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 msgr2=0x564c79c38280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 0x564c79c38280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 -- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79881070 msgr2=0x564c79c38800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79881070 0x564c79c38800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 -- 172.21.15.38:0/740313979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c79b56c90 con 0x564c798581b0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa427fff640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 0x564c79c38280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa4200aa4f0 tx=0x7fa4200a9780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bfa34b0ff6f8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.811+0000 7fa40effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420020040 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4200c2f40 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4200acd90 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4200ad050 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 10 client.16452 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564c79c46ae0 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4200acd90 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fa4200ad4e0 con 0x564c798581b0 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 10 client.16452 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 10 client.16452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 20 client.16452 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c7983f9f0 0x564c79c49e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 4 client.16452 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.812+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c79ba0df0 con 0x564c7983f9f0 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.813+0000 7fa427fff640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c7983f9f0 0x564c79c49e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.813+0000 7fa427fff640 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c7983f9f0 0x564c79c49e40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c58839ffcf14afa server_cookie=a349ef2208c03a83 in_seq=0 out_seq=0 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.813+0000 7fa40effd640 10 client.16452 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa40effd640 1 -- 172.21.15.38:0/740313979 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c79ba0df0 con 0x564c7983f9f0 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa40effd640 10 client.16452 handle_command_reply: tid=0 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 client.16452 shutdown 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 msgr2=0x564c79c37d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa4200aa4f0 tx=0x7fa4200a9780 comp rx=0 tx=0).stop 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 shutdown_connections 2024-09-21T06:24:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c79881070 0x564c79c38800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c7983f9f0 0x564c79c49e40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79860390 0x564c79c38280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 --2- 172.21.15.38:0/740313979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c798581b0 0x564c79c37d40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 >> 172.21.15.38:0/740313979 conn(0x564c79875460 msgr2=0x564c79c29cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa40effd640 0 client.16452 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 shutdown_connections 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 1 -- 172.21.15.38:0/740313979 wait complete. 2024-09-21T06:24:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.814+0000 7fa43c57e740 20 client.16452 trim_cache size 0 max 16384 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 Processor -- start 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 -- start start 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c39c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c34f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301afda0 con 0x564c79860390 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301ad5e0 con 0x564c798581b0 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa43c57e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301ab430 con 0x564c79881070 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57012/0 (socket says 172.21.15.38:57012) 2024-09-21T06:24:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 -- 172.21.15.38:0/1824835947 learned_addr learned my addr 172.21.15.38:0/1824835947 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa42ffff640 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c34f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c39c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 -- 172.21.15.38:0/1824835947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 msgr2=0x564c79c34f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c34f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 -- 172.21.15.38:0/1824835947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 msgr2=0x564c79c39c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c39c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.828+0000 7fa427fff640 1 -- 172.21.15.38:0/1824835947 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c79c39000 con 0x564c79860390 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.829+0000 7fa427fff640 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa418005940 tx=0x7fa4180058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3563c4f77e6043 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.829+0000 7fa4257fa640 1 -- 172.21.15.38:0/1824835947 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418035050 con 0x564c79860390 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.829+0000 7fa4257fa640 1 -- 172.21.15.38:0/1824835947 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa418005040 con 0x564c79860390 2024-09-21T06:24:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.829+0000 7fa4257fa640 1 -- 172.21.15.38:0/1824835947 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418004920 con 0x564c79860390 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- 172.21.15.38:0/1824835947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 msgr2=0x564c79c29a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa418005940 tx=0x7fa4180058b0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- 172.21.15.38:0/1824835947 shutdown_connections 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c34f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c29a00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 --2- 172.21.15.38:0/1824835947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c39c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- 172.21.15.38:0/1824835947 >> 172.21.15.38:0/1824835947 conn(0x564c79875460 msgr2=0x564c79c292f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- 172.21.15.38:0/1824835947 shutdown_connections 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- 172.21.15.38:0/1824835947 wait complete. 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 -- start start 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.830+0000 7fa43c57e740 1 Processor -- start 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c40640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301abaa0 con 0x564c79860390 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301acf10 con 0x564c798581b0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301ac170 con 0x564c79881070 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa43c57e740 10 client.0 _ll_register_callbacks cb 0x7fa428009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57028/0 (socket says 172.21.15.38:57028) 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 -- 172.21.15.38:0/2905910534 learned_addr learned my addr 172.21.15.38:0/2905910534 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa42ffff640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c40640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 -- 172.21.15.38:0/2905910534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 msgr2=0x564c79c3e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c3e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 -- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 msgr2=0x564c79c40640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c40640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 -- 172.21.15.38:0/2905910534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c79c3e610 con 0x564c79860390 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa427fff640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa418032fd0 tx=0x7fa418004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496f60ac38ab47a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:04.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.831+0000 7fa40effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418051070 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa418032040 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa418005040 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa418035020 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 10 client.16458 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564c79cb4330 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa418005040 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fa418031590 con 0x564c79860390 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 10 client.16458 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 20 client.16458 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c79814da0 0x564c79cb6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 4 client.16458 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:04.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.832+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c79b9c8a0 con 0x564c79814da0 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c79814da0 0x564c79cb6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa42f7fe640 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c79814da0 0x564c79cb6a50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f131514074d947af server_cookie=45e502c5649eea3c in_seq=0 out_seq=0 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa40effd640 10 client.16458 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa40effd640 1 -- 172.21.15.38:0/2905910534 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c79b9c8a0 con 0x564c79814da0 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa40effd640 10 client.16458 handle_command_reply: tid=0 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 client.16458 shutdown 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 msgr2=0x564c79c3db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa418032fd0 tx=0x7fa418004580 comp rx=0 tx=0).stop 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 shutdown_connections 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564c79814da0 0x564c79cb6a50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564c79881070 0x564c79c3e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564c79860390 0x564c79c3db60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 --2- 172.21.15.38:0/2905910534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c798581b0 0x564c79c40640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.833+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 >> 172.21.15.38:0/2905910534 conn(0x564c79875460 msgr2=0x564c79c39960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa40effd640 0 client.16458 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 shutdown_connections 2024-09-21T06:24:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43c57e740 1 -- 172.21.15.38:0/2905910534 wait complete. 2024-09-21T06:24:04.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43c57e740 20 client.16458 trim_cache size 0 max 16384 2024-09-21T06:24:04.841 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 msgr2=0x7fa41c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 0x7fa41c0b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa428005fd0 tx=0x7fa428004a40 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 msgr2=0x7fa43019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d950 tx=0x7fa42000de10 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 shutdown_connections 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa41c0b6680 0x7fa41c0b8b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa430108cf0 0x7fa43019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4301083a0 0x7fa43019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 --2- 172.21.15.38:0/1286670349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa430102a60 0x7fa43019a5b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 >> 172.21.15.38:0/1286670349 conn(0x7fa430079730 msgr2=0x7fa4301052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 shutdown_connections 2024-09-21T06:24:04.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:04.834+0000 7fa43600a640 1 -- 172.21.15.38:0/1286670349 wait complete. 2024-09-21T06:24:04.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:04 smithi174 ceph-mon[34815]: pgmap v451: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:04.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:04 smithi044 ceph-mon[34369]: pgmap v451: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:06.662 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:24:06.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:24:06.936 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:06.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:06 smithi038 ceph-mon[31215]: pgmap v452: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:07.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:06 smithi174 ceph-mon[34815]: pgmap v452: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:07.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:06 smithi044 ceph-mon[34369]: pgmap v452: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2839620883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 msgr2=0x7ff9d4104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2839620883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d4104cd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009900 tx=0x7ff9c402a410 comp rx=0 tx=0).stop 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2839620883 shutdown_connections 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2839620883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 0x7ff9d4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2839620883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2839620883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d4104cd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2839620883 >> 172.21.15.38:0/2839620883 conn(0x7ff9d4079760 msgr2=0x7ff9d4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2839620883 shutdown_connections 2024-09-21T06:24:07.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.387+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2839620883 wait complete. 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 Processor -- start 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 -- start start 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 0x7ff9d419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4113bf0 con 0x7ff9d41048c0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4113a70 con 0x7ff9d41052a0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d8a43640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4113d70 con 0x7ff9d410de70 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.388+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57034/0 (socket says 172.21.15.38:57034) 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 -- 172.21.15.38:0/2456068212 learned_addr learned my addr 172.21.15.38:0/2456068212 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 0x7ff9d419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 -- 172.21.15.38:0/2456068212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 msgr2=0x7ff9d419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 0x7ff9d419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 -- 172.21.15.38:0/2456068212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 msgr2=0x7ff9d419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 -- 172.21.15.38:0/2456068212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d41a0470 con 0x7ff9d41048c0 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:07.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d259c640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4005940 tx=0x7ff9c4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2456068212 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c403f030 con 0x7ff9d41048c0 2024-09-21T06:24:07.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2456068212 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff9c4003cd0 con 0x7ff9d41048c0 2024-09-21T06:24:07.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d41a0700 con 0x7ff9d41048c0 2024-09-21T06:24:07.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2456068212 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4035070 con 0x7ff9d41048c0 2024-09-21T06:24:07.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.389+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41a0be0 con 0x7ff9d41048c0 2024-09-21T06:24:07.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.393+0000 7ff9defb7740 1 Processor -- start 2024-09-21T06:24:07.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.393+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2456068212 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff9c4042030 con 0x7ff9d41048c0 2024-09-21T06:24:07.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.393+0000 7ff9defb7740 1 -- start start 2024-09-21T06:24:07.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be34c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be34ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5600be2c2e60 con 0x5600bdf7c490 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5600be2b2290 con 0x5600bdf84670 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9defb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600be2b60a0 con 0x5600bdfa5350 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57044/0 (socket says 172.21.15.38:57044) 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d259c640 1 -- 172.21.15.38:0/171694152 learned_addr learned my addr 172.21.15.38:0/171694152 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be34ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be34c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9c37fe640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 0x7ff9bc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/171694152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 msgr2=0x5600be34c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be34c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/171694152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 msgr2=0x5600be34c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/171694152 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600be010930 con 0x5600bdf84670 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d259c640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 0x7ff9bc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.394+0000 7ff9c37fe640 1 -- 172.21.15.38:0/2456068212 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff9c4107d50 con 0x7ff9d41048c0 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.395+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be34ceb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80058c0 tx=0x7ff9c800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442bab850d65eff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.395+0000 7ff9c0ff9640 1 -- 172.21.15.38:0/171694152 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8005220 con 0x5600bdf84670 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.395+0000 7ff9c0ff9640 1 -- 172.21.15.38:0/171694152 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff9c8004c70 con 0x5600bdf84670 2024-09-21T06:24:07.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.395+0000 7ff9c0ff9640 1 -- 172.21.15.38:0/171694152 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8010720 con 0x5600bdf84670 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- 172.21.15.38:0/171694152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 msgr2=0x5600be34ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be34ceb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80058c0 tx=0x7ff9c800e720 comp rx=0 tx=0).stop 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 0x7ff9bc0b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc003a30 tx=0x7ff9cc004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- 172.21.15.38:0/171694152 shutdown_connections 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be34ceb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be34c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 --2- 172.21.15.38:0/171694152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be34c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- 172.21.15.38:0/171694152 >> 172.21.15.38:0/171694152 conn(0x5600bdf99740 msgr2=0x5600be34a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- 172.21.15.38:0/171694152 shutdown_connections 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- 172.21.15.38:0/171694152 wait complete. 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 -- start start 2024-09-21T06:24:07.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.396+0000 7ff9defb7740 1 Processor -- start 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 0x5600be35c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be368270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5600be113890 con 0x5600bdf84670 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5600be24cd40 con 0x5600bdfa5350 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600be35ef10 con 0x5600bdf7c490 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9defb7740 10 client.0 _ll_register_callbacks cb 0x5600be2b0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57050/0 (socket says 172.21.15.38:57050) 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/1041335850 learned_addr learned my addr 172.21.15.38:0/1041335850 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d259c640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 0x5600be35c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be368270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/1041335850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 msgr2=0x5600be35c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 0x5600be35c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 msgr2=0x5600be368270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be368270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d1d9b640 1 -- 172.21.15.38:0/1041335850 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600be3687b0 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.397+0000 7ff9d259c640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 0x5600be35c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca462b87e0928d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c802a060 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c8004c70 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff9c80104a0 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff9c8005450 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9defb7740 10 client.16470 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600be36b0b0 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff9c8004c70 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff9c801a4f0 con 0x5600bdf84670 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9defb7740 10 client.16470 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:07.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.398+0000 7ff9defb7740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9defb7740 20 client.16470 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf63cd0 0x5600be36e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9defb7740 4 client.16470 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600be2c4db0 con 0x5600bdf63cd0 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9d259c640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf63cd0 0x5600be36e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9b9ffb640 10 client.16470 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:07.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.399+0000 7ff9d259c640 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf63cd0 0x5600be36e470 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbf164f45a7420be server_cookie=bc9b796194110afc in_seq=0 out_seq=0 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/1041335850 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600be2c4db0 con 0x5600bdf63cd0 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9b9ffb640 10 client.16470 handle_command_reply: tid=0 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 client.16470 shutdown 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 msgr2=0x5600be35c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8005050 comp rx=0 tx=0).stop 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 shutdown_connections 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be368270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf84670 0x5600be35c8b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf63cd0 0x5600be36e470 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 --2- 172.21.15.38:0/1041335850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf7c490 0x5600be35c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 >> 172.21.15.38:0/1041335850 conn(0x5600bdf99740 msgr2=0x5600be34de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9b9ffb640 0 client.16470 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.400+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 shutdown_connections 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.401+0000 7ff9defb7740 1 -- 172.21.15.38:0/1041335850 wait complete. 2024-09-21T06:24:07.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.401+0000 7ff9defb7740 20 client.16470 trim_cache size 0 max 16384 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 Processor -- start 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 -- start start 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be357830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be35a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41afda0 con 0x5600bdf7c490 2024-09-21T06:24:07.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41ad5e0 con 0x5600bdf84670 2024-09-21T06:24:07.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.418+0000 7ff9defb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41ab430 con 0x5600bdfa5350 2024-09-21T06:24:07.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57064/0 (socket says 172.21.15.38:57064) 2024-09-21T06:24:07.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 -- 172.21.15.38:0/3499581463 learned_addr learned my addr 172.21.15.38:0/3499581463 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:07.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be357830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 -- 172.21.15.38:0/3499581463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 msgr2=0x5600be35a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be35a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be35a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 -- 172.21.15.38:0/3499581463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 msgr2=0x5600be357830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be357830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 -- 172.21.15.38:0/3499581463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600be3685b0 con 0x5600bdf7c490 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be35a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be357830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4032fd0 tx=0x7ff9c410a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119a1357ee6ff325 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9bbfff640 1 -- 172.21.15.38:0/3499581463 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4049040 con 0x5600bdf7c490 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9bbfff640 1 -- 172.21.15.38:0/3499581463 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff9c40cd730 con 0x5600bdf7c490 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.419+0000 7ff9bbfff640 1 -- 172.21.15.38:0/3499581463 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40ce320 con 0x5600bdf7c490 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 -- 172.21.15.38:0/3499581463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 msgr2=0x5600be3572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4032fd0 tx=0x7ff9c410a260 comp rx=0 tx=0).stop 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 -- 172.21.15.38:0/3499581463 shutdown_connections 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdfa5350 0x5600be35a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdf84670 0x5600be357830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3499581463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be3572f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 -- 172.21.15.38:0/3499581463 >> 172.21.15.38:0/3499581463 conn(0x5600bdf99740 msgr2=0x5600be35c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 -- 172.21.15.38:0/3499581463 shutdown_connections 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.420+0000 7ff9defb7740 1 -- 172.21.15.38:0/3499581463 wait complete. 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 -- start start 2024-09-21T06:24:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 Processor -- start 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf84670 0x5600be3606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be360c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41abaa0 con 0x5600bdf7c490 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41acf10 con 0x5600bdfa5350 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d41ac170 con 0x5600bdf84670 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9defb7740 10 client.0 _ll_register_callbacks cb 0x7ff9c8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:07.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9d259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57078/0 (socket says 172.21.15.38:57078) 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.421+0000 7ff9d259c640 1 -- 172.21.15.38:0/3358236909 learned_addr learned my addr 172.21.15.38:0/3358236909 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf84670 0x5600be3606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be360c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 -- 172.21.15.38:0/3358236909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf84670 msgr2=0x5600be3606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf84670 0x5600be3606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 -- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 msgr2=0x5600be360c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be360c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 -- 172.21.15.38:0/3358236909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600be3d7c40 con 0x5600bdf7c490 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d2d9d640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be360c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9d259c640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000c00 tx=0x7ff9c403b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac61fab1f7b4dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4049070 con 0x5600bdf7c490 2024-09-21T06:24:07.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff9c403b4f0 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c40cd730 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff9c40cd9f0 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9defb7740 10 client.16476 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600be3d8db0 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.422+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff9c40cd730 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff9c40f10d0 con 0x5600bdf7c490 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 10 client.16476 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 20 client.16476 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf39080 0x5600be3db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 4 client.16476 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5600be2c0860 con 0x5600bdf39080 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf39080 0x5600be3db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9d1d9b640 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf39080 0x5600be3db4c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b55f88a1d08b2c10 server_cookie=23bd6a344219f6fd in_seq=0 out_seq=0 2024-09-21T06:24:07.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.423+0000 7ff9b9ffb640 10 client.16476 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:07.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.425+0000 7ff9b9ffb640 1 -- 172.21.15.38:0/3358236909 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5600be2c0860 con 0x5600bdf39080 2024-09-21T06:24:07.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.425+0000 7ff9b9ffb640 10 client.16476 handle_command_reply: tid=0 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.425+0000 7ff9defb7740 1 client.16476 shutdown 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.425+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 msgr2=0x5600be360180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.425+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000c00 tx=0x7ff9c403b890 comp rx=0 tx=0).stop 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 shutdown_connections 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600bdfa5350 0x5600be360c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5600bdf39080 0x5600be3db4c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600bdf84670 0x5600be3606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 --2- 172.21.15.38:0/3358236909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600bdf7c490 0x5600be360180 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9b9ffb640 0 client.16476 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 >> 172.21.15.38:0/3358236909 conn(0x5600bdf99740 msgr2=0x5600be35c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 shutdown_connections 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 1 -- 172.21.15.38:0/3358236909 wait complete. 2024-09-21T06:24:07.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9defb7740 20 client.16476 trim_cache size 0 max 16384 2024-09-21T06:24:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:07.431 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:24:07.431 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "d4479779-ee77-40df-91a5-049be9f3de7a", 2024-09-21T06:24:07.431 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:24:07.431 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 msgr2=0x7ff9bc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 0x7ff9bc0b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc003a30 tx=0x7ff9cc004a40 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 msgr2=0x7ff9d419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4005940 tx=0x7ff9c4004360 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 shutdown_connections 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff9bc0b66b0 0x7ff9bc0b8bc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff9d410de70 0x7ff9d419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9d41052a0 0x7ff9d419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 --2- 172.21.15.38:0/2456068212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9d41048c0 0x7ff9d419a5c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.426+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 >> 172.21.15.38:0/2456068212 conn(0x7ff9d4079760 msgr2=0x7ff9d4100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.427+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 shutdown_connections 2024-09-21T06:24:07.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:07.427+0000 7ff9d8a43640 1 -- 172.21.15.38:0/2456068212 wait complete. 2024-09-21T06:24:08.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:24:08.454 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:08.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 -- 172.21.15.38:0/1063528464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 msgr2=0x7f4d34075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 --2- 172.21.15.38:0/1063528464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d34075b40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009900 tx=0x7f4d2402a410 comp rx=0 tx=0).stop 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 -- 172.21.15.38:0/1063528464 shutdown_connections 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 --2- 172.21.15.38:0/1063528464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 0x7f4d34112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 --2- 172.21.15.38:0/1063528464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 --2- 172.21.15.38:0/1063528464 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d34075b40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 -- 172.21.15.38:0/1063528464 >> 172.21.15.38:0/1063528464 conn(0x7f4d340ff610 msgr2=0x7f4d34101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 -- 172.21.15.38:0/1063528464 shutdown_connections 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.910+0000 7f4d38d13640 1 -- 172.21.15.38:0/1063528464 wait complete. 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 Processor -- start 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 -- start start 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 0x7f4d341a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34115e00 con 0x7f4d34075730 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34115c80 con 0x7f4d34110160 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d38d13640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34115f80 con 0x7f4d34076080 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57092/0 (socket says 172.21.15.38:57092) 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d3259c640 1 -- 172.21.15.38:0/318376424 learned_addr learned my addr 172.21.15.38:0/318376424 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 0x7f4d341a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.911+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 -- 172.21.15.38:0/318376424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 msgr2=0x7f4d3419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 -- 172.21.15.38:0/318376424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 msgr2=0x7f4d341a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 0x7f4d341a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 -- 172.21.15.38:0/318376424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341a2740 con 0x7f4d34075730 2024-09-21T06:24:08.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d3259c640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4d24005ab0 tx=0x7f4d240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d2bfff640 1 -- 172.21.15.38:0/318376424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2403f030 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d2bfff640 1 -- 172.21.15.38:0/318376424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d24003cd0 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341a29d0 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d2bfff640 1 -- 172.21.15.38:0/318376424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24035070 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.912+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341a9190 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 Processor -- start 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 -- start start 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d2bfff640 1 -- 172.21.15.38:0/318376424 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d24042030 con 0x7f4d34075730 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 0x561883370270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883370cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5618832e6e50 con 0x561882fa01b0 2024-09-21T06:24:08.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5618832d6280 con 0x561882fc9070 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.915+0000 7f4d3f287740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5618832da090 con 0x561882fa8390 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57096/0 (socket says 172.21.15.38:57096) 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 -- 172.21.15.38:0/1484651948 learned_addr learned my addr 172.21.15.38:0/1484651948 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883370cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 0x561883370270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 -- 172.21.15.38:0/1484651948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 msgr2=0x561883370cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883370cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 -- 172.21.15.38:0/1484651948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 msgr2=0x561883370270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 0x561883370270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 -- 172.21.15.38:0/1484651948 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883034650 con 0x561882fa01b0 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 0x561883370270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:08.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d2bfff640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 0x7f4d200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4d24105300 tx=0x7f4d2410be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6547032c1d281ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.916+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 0x7f4d200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.917+0000 7f4d28d99640 1 -- 172.21.15.38:0/1484651948 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240ca0e0 con 0x561882fa01b0 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.917+0000 7f4d28d99640 1 -- 172.21.15.38:0/1484651948 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d240cd5a0 con 0x561882fa01b0 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.917+0000 7f4d28d99640 1 -- 172.21.15.38:0/1484651948 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240dde30 con 0x561882fa01b0 2024-09-21T06:24:08.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.917+0000 7f4d2bfff640 1 -- 172.21.15.38:0/318376424 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d24107bc0 con 0x7f4d34075730 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- 172.21.15.38:0/1484651948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 msgr2=0x5618833707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 0x7f4d200b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c005fd0 tx=0x7f4d2c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4d24105300 tx=0x7f4d2410be90 comp rx=0 tx=0).stop 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- 172.21.15.38:0/1484651948 shutdown_connections 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883370cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x5618833707b0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1484651948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fc9070 0x561883370270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- 172.21.15.38:0/1484651948 >> 172.21.15.38:0/1484651948 conn(0x561882fbd460 msgr2=0x56188336e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- 172.21.15.38:0/1484651948 shutdown_connections 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- 172.21.15.38:0/1484651948 wait complete. 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 -- start start 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.918+0000 7f4d3f287740 1 Processor -- start 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x56188337be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561883137700 con 0x561882fc9070 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561883271110 con 0x561882fa01b0 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56188337e810 con 0x561882fa8390 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3f287740 10 client.0 _ll_register_callbacks cb 0x56188328a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:08.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57108/0 (socket says 172.21.15.38:57108) 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 -- 172.21.15.38:0/10336008 learned_addr learned my addr 172.21.15.38:0/10336008 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d3259c640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x56188337be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 -- 172.21.15.38:0/10336008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 msgr2=0x56188337be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x56188337be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 -- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 msgr2=0x56188337b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 -- 172.21.15.38:0/10336008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56188329ec40 con 0x561882fc9070 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c010710 tx=0x7f4d2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baca525e86a4f79b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.919+0000 7f4d19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c01d890 con 0x561882fc9070 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d240cd5a0 con 0x561882fc9070 2024-09-21T06:24:08.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d2c01da30 con 0x561882fc9070 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d2c01dc30 con 0x561882fc9070 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 10 client.16488 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56188338a4d0 con 0x561882fc9070 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d240cd5a0 con 0x561882fc9070 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d2c00f040 con 0x561882fc9070 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 10 client.16488 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 20 client.16488 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f879f0 0x56188338da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 4 client.16488 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.920+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618832e8da0 con 0x561882f879f0 2024-09-21T06:24:08.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.921+0000 7f4d3259c640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f879f0 0x56188338da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.921+0000 7f4d3259c640 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f879f0 0x56188338da40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97740a70a8e53e90 server_cookie=f5cefb9e789aa597 in_seq=0 out_seq=0 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.921+0000 7f4d19ffb640 10 client.16488 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d19ffb640 1 -- 172.21.15.38:0/10336008 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618832e8da0 con 0x561882f879f0 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d19ffb640 10 client.16488 handle_command_reply: tid=0 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 client.16488 shutdown 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 msgr2=0x56188337c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c010710 tx=0x7f4d2c004a40 comp rx=0 tx=0).stop 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 shutdown_connections 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x56188337c3d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f879f0 0x56188338da40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x56188337be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 --2- 172.21.15.38:0/10336008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 >> 172.21.15.38:0/10336008 conn(0x561882fbd460 msgr2=0x561883373400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d19ffb640 0 client.16488 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:08.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 shutdown_connections 2024-09-21T06:24:08.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.922+0000 7f4d3f287740 1 -- 172.21.15.38:0/10336008 wait complete. 2024-09-21T06:24:08.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.923+0000 7f4d3f287740 20 client.16488 trim_cache size 0 max 16384 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 Processor -- start 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 -- start start 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883378b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b41e0 con 0x561882fc9070 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b1a20 con 0x561882fa01b0 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.940+0000 7f4d3f287740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341af870 con 0x561882fa8390 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57110/0 (socket says 172.21.15.38:57110) 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 -- 172.21.15.38:0/2311929208 learned_addr learned my addr 172.21.15.38:0/2311929208 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:08.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d3259c640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883378b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 -- 172.21.15.38:0/2311929208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 msgr2=0x561883378b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883378b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 -- 172.21.15.38:0/2311929208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 msgr2=0x56188337d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 -- 172.21.15.38:0/2311929208 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56188337a870 con 0x561882fc9070 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883378b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d3259c640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c012e00 tx=0x7f4d2c01d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556d80b73a8679c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d1bfff640 1 -- 172.21.15.38:0/2311929208 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0111a0 con 0x561882fc9070 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d1bfff640 1 -- 172.21.15.38:0/2311929208 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d2c01d690 con 0x561882fc9070 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.941+0000 7f4d1bfff640 1 -- 172.21.15.38:0/2311929208 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005040 con 0x561882fc9070 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 -- 172.21.15.38:0/2311929208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 msgr2=0x561883379040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c012e00 tx=0x7f4d2c01d490 comp rx=0 tx=0).stop 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 -- 172.21.15.38:0/2311929208 shutdown_connections 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fc9070 0x561883379040 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fa8390 0x561883378b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 --2- 172.21.15.38:0/2311929208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa01b0 0x56188337d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 -- 172.21.15.38:0/2311929208 >> 172.21.15.38:0/2311929208 conn(0x561882fbd460 msgr2=0x56188337ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 -- 172.21.15.38:0/2311929208 shutdown_connections 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.942+0000 7f4d3f287740 1 -- 172.21.15.38:0/2311929208 wait complete. 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 -- start start 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 Processor -- start 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 0x56188337fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fc9070 0x5618833803b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341afee0 con 0x561882fa01b0 2024-09-21T06:24:08.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b1350 con 0x561882fa8390 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b05b0 con 0x561882fc9070 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3f287740 10 client.0 _ll_register_callbacks cb 0x7f4d2c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57116/0 (socket says 172.21.15.38:57116) 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.943+0000 7f4d3259c640 1 -- 172.21.15.38:0/1795579855 learned_addr learned my addr 172.21.15.38:0/1795579855 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 0x56188337fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d32d9d640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fc9070 0x5618833803b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 -- 172.21.15.38:0/1795579855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fc9070 msgr2=0x5618833803b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fc9070 0x5618833803b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 -- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 msgr2=0x56188337fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 0x56188337fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 -- 172.21.15.38:0/1795579855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618833f7430 con 0x561882fa01b0 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 0x56188337fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:08.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3259c640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4d240cda20 tx=0x7f4d24003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd87f085d962e856 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24049040 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d2410b8f0 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d2c01d690 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d240de030 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3f287740 10 client.16494 fetch_fsmap learned FSMap version 29 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5618833f86a0 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.944+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d2c01d690 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d24105610 con 0x561882fa01b0 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 10 client.16494 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T06:24:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 20 client.16494 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f5cda0 0x5618833fac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 4 client.16494 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5618832e4850 con 0x561882f5cda0 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f5cda0 0x5618833fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d29d9b640 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f5cda0 0x5618833fac40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae4543c7d1da900 server_cookie=97d749a70ef0f8c in_seq=0 out_seq=0 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.945+0000 7f4d19ffb640 10 client.16494 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d19ffb640 1 -- 172.21.15.38:0/1795579855 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x5618832e4850 con 0x561882f5cda0 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d19ffb640 10 client.16494 handle_command_reply: tid=0 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 client.16494 shutdown 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 msgr2=0x56188337f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4d240cda20 tx=0x7f4d24003e80 comp rx=0 tx=0).stop 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 shutdown_connections 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561882f5cda0 0x5618833fac40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561882fc9070 0x5618833803b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561882fa8390 0x56188337fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 --2- 172.21.15.38:0/1795579855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561882fa01b0 0x56188337f930 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 >> 172.21.15.38:0/1795579855 conn(0x561882fbd460 msgr2=0x5618833868d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d19ffb640 0 client.16494 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 shutdown_connections 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 1 -- 172.21.15.38:0/1795579855 wait complete. 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.946+0000 7f4d3f287740 20 client.16494 trim_cache size 0 max 16384 2024-09-21T06:24:08.955 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:24:08.956 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.957 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:24:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.959 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:08.960 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:08.961 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:08.961 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:08.961 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:08.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 msgr2=0x7f4d200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 0x7f4d200b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c005fd0 tx=0x7f4d2c009600 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 msgr2=0x7f4d3419c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4d24005ab0 tx=0x7f4d240042f0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 shutdown_connections 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d200b6680 0x7f4d200b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d34110160 0x7f4d341a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d34076080 0x7f4d3419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 --2- 172.21.15.38:0/318376424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d34075730 0x7f4d3419c7d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 >> 172.21.15.38:0/318376424 conn(0x7f4d340ff610 msgr2=0x7f4d34109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 shutdown_connections 2024-09-21T06:24:08.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:08.947+0000 7f4d38d13640 1 -- 172.21.15.38:0/318376424 wait complete. 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: pgmap v453: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:24:09.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:08 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: pgmap v453: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:24:09.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:08 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:24:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:24:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:24:09.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:09.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: pgmap v453: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:24:09.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:08 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:24:09.786 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:24:09.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:24:10.046 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:10.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 -- 172.21.15.38:0/3181390216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 msgr2=0x7f9204102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:10.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 --2- 172.21.15.38:0/3181390216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 0x7f9204102e90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009900 tx=0x7f91f402a410 comp rx=0 tx=0).stop 2024-09-21T06:24:10.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 -- 172.21.15.38:0/3181390216 shutdown_connections 2024-09-21T06:24:10.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 --2- 172.21.15.38:0/3181390216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f920410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 --2- 172.21.15.38:0/3181390216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92041083c0 0x7f92041087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 --2- 172.21.15.38:0/3181390216 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 0x7f9204102e90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 -- 172.21.15.38:0/3181390216 >> 172.21.15.38:0/3181390216 conn(0x7f9204079740 msgr2=0x7f9204079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 -- 172.21.15.38:0/3181390216 shutdown_connections 2024-09-21T06:24:10.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.542+0000 7f920acd6640 1 -- 172.21.15.38:0/3181390216 wait complete. 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 Processor -- start 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 -- start start 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204102a80 0x7f920410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f9204110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113c20 con 0x7f92041083c0 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113aa0 con 0x7f9204102a80 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.543+0000 7f920acd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113da0 con 0x7f9204108d10 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51368/0 (socket says 172.21.15.38:51368) 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 -- 172.21.15.38:0/4127442931 learned_addr learned my addr 172.21.15.38:0/4127442931 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9209273640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f9204110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9208a72640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204102a80 0x7f920410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 -- 172.21.15.38:0/4127442931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 msgr2=0x7f9204110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f9204110a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 -- 172.21.15.38:0/4127442931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204102a80 msgr2=0x7f920410ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204102a80 0x7f920410ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 -- 172.21.15.38:0/4127442931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92041a88b0 con 0x7f92041083c0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9203fff640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00d770 tx=0x7f91ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec017070 con 0x7f92041083c0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041a8ba0 con 0x7f92041083c0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91ec009c30 con 0x7f92041083c0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.544+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00f620 con 0x7f92041083c0 2024-09-21T06:24:10.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.545+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041a9130 con 0x7f92041083c0 2024-09-21T06:24:10.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.546+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9204103d00 con 0x7f92041083c0 2024-09-21T06:24:10.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.547+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f91ec01a070 con 0x7f92041083c0 2024-09-21T06:24:10.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.548+0000 7f9201ffb640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:10.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.548+0000 7f9208a72640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:10.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.548+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f91ec0e7080 con 0x7f92041083c0 2024-09-21T06:24:10.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.549+0000 7f9208a72640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9204111a20 tx=0x7f91f40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:10.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.551+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91ec009de0 con 0x7f92041083c0 2024-09-21T06:24:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.776+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92041112d0 con 0x7f92041083c0 2024-09-21T06:24:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.776+0000 7f9201ffb640 1 -- 172.21.15.38:0/4127442931 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f92041112d0 con 0x7f92041083c0 2024-09-21T06:24:10.778 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:24:10.778 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"btime":"2024-09-21T06:24:02:527333+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:02.400907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24728,24695,24667]},"id":1}]} 2024-09-21T06:24:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 msgr2=0x7f91f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9204111a20 tx=0x7f91f40058d0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 msgr2=0x7f9204110510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00d770 tx=0x7f91ec00dc30 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 shutdown_connections 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f9204110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f9204110510 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 --2- 172.21.15.38:0/4127442931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204102a80 0x7f920410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 >> 172.21.15.38:0/4127442931 conn(0x7f9204079740 msgr2=0x7f9204101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 shutdown_connections 2024-09-21T06:24:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:10.779+0000 7f920acd6640 1 -- 172.21.15.38:0/4127442931 wait complete. 2024-09-21T06:24:11.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:10 smithi038 ceph-mon[31215]: pgmap v454: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:11.071 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:10 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4127442931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:11.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:10 smithi174 ceph-mon[34815]: pgmap v454: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:11.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:10 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4127442931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:10 smithi044 ceph-mon[34369]: pgmap v454: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:24:11.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:10 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4127442931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:11.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:24:11.742 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:12.135 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:11 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:12.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:11 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:12.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:11 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 -- 172.21.15.38:0/223815251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c110200 msgr2=0x7f6b7c112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 --2- 172.21.15.38:0/223815251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c110200 0x7f6b7c112620 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ca0 tx=0x7f6b7402a950 comp rx=0 tx=0).stop 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 -- 172.21.15.38:0/223815251 shutdown_connections 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 --2- 172.21.15.38:0/223815251 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c110200 0x7f6b7c112620 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 --2- 172.21.15.38:0/223815251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 --2- 172.21.15.38:0/223815251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 0x7f6b7c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 -- 172.21.15.38:0/223815251 >> 172.21.15.38:0/223815251 conn(0x7f6b7c079760 msgr2=0x7f6b7c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 -- 172.21.15.38:0/223815251 shutdown_connections 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.229+0000 7f6b83975640 1 -- 172.21.15.38:0/223815251 wait complete. 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 Processor -- start 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 -- start start 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 0x7f6b7c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c110200 0x7f6b7c1a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c115e10 con 0x7f6b7c102fa0 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c115c90 con 0x7f6b7c110200 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b83975640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c115f90 con 0x7f6b7c102650 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b80f10640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b80f10640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51374/0 (socket says 172.21.15.38:51374) 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b80f10640 1 -- 172.21.15.38:0/141713790 learned_addr learned my addr 172.21.15.38:0/141713790 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b81711640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 0x7f6b7c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.230+0000 7f6b81f12640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c110200 0x7f6b7c1a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 -- 172.21.15.38:0/141713790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 msgr2=0x7f6b7c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 0x7f6b7c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 -- 172.21.15.38:0/141713790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c110200 msgr2=0x7f6b7c1a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c110200 0x7f6b7c1a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 -- 172.21.15.38:0/141713790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c1a2630 con 0x7f6b7c102fa0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b80f10640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c920 tx=0x7f6b6c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b727fc640 1 -- 172.21.15.38:0/141713790 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c007c70 con 0x7f6b7c102fa0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b727fc640 1 -- 172.21.15.38:0/141713790 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b6c007e10 con 0x7f6b7c102fa0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b727fc640 1 -- 172.21.15.38:0/141713790 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0188c0 con 0x7f6b7c102fa0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1a2920 con 0x7f6b7c102fa0 2024-09-21T06:24:12.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.231+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1a9140 con 0x7f6b7c102fa0 2024-09-21T06:24:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 Processor -- start 2024-09-21T06:24:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 -- start start 2024-09-21T06:24:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be4436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be444120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637be3b9ea0 con 0x5637be0731b0 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637be3a92d0 con 0x5637be09c070 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.234+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5637be3ad0e0 con 0x5637be07b390 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51388/0 (socket says 172.21.15.38:51388) 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 -- 172.21.15.38:0/1733604231 learned_addr learned my addr 172.21.15.38:0/1733604231 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b727fc640 1 -- 172.21.15.38:0/141713790 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6b6c018a60 con 0x7f6b7c102fa0 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81f12640 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be4436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 -- 172.21.15.38:0/1733604231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 msgr2=0x5637be444120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be444120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 -- 172.21.15.38:0/1733604231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 msgr2=0x5637be4436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be4436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 -- 172.21.15.38:0/1733604231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637be107650 con 0x5637be0731b0 2024-09-21T06:24:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b81711640 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b760 tx=0x7f6b7800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6357f614bb5306 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.235+0000 7f6b677fe640 1 -- 172.21.15.38:0/1733604231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78003dd0 con 0x5637be0731b0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b677fe640 1 -- 172.21.15.38:0/1733604231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b78015070 con 0x5637be0731b0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b677fe640 1 -- 172.21.15.38:0/1733604231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78011440 con 0x5637be0731b0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b727fc640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 0x7f6b680b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b81f12640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 0x7f6b680b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b727fc640 1 -- 172.21.15.38:0/141713790 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b6c0e7680 con 0x7f6b7c102fa0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1733604231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 msgr2=0x5637be443be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b81f12640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 0x7f6b680b8bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b74006010 tx=0x7f6b74005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.236+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b760 tx=0x7f6b7800bc20 comp rx=0 tx=0).stop 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1733604231 shutdown_connections 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be444120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be443be0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1733604231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be4436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1733604231 >> 172.21.15.38:0/1733604231 conn(0x5637be090460 msgr2=0x5637be441590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1733604231 shutdown_connections 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1733604231 wait complete. 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 -- start start 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.237+0000 7f6b89ee9740 1 Processor -- start 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be44f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be45b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637be20a700 con 0x5637be0731b0 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637be344160 con 0x5637be09c070 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5637be451e80 con 0x5637be07b390 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b89ee9740 10 client.0 _ll_register_callbacks cb 0x5637be35d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51404/0 (socket says 172.21.15.38:51404) 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 -- 172.21.15.38:0/2572070315 learned_addr learned my addr 172.21.15.38:0/2572070315 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:12.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81f12640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be45b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b80f10640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be44f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 -- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 msgr2=0x5637be44f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be44f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 -- 172.21.15.38:0/2572070315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 msgr2=0x5637be45b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be45b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 -- 172.21.15.38:0/2572070315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637be371c90 con 0x5637be0731b0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81f12640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be45b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b81711640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6b78004b50 tx=0x7f6b780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc38129e59ea3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.238+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78028060 con 0x5637be0731b0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b78011640 con 0x5637be0731b0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b78015070 con 0x5637be0731b0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b78003e60 con 0x5637be0731b0 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 10 client.16512 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637be45dc50 con 0x5637be0731b0 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b78015070 con 0x5637be0731b0 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b78022070 con 0x5637be0731b0 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 10 client.16512 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 10 client.16512 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 20 client.16512 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be05a9f0 0x5637be461060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 4 client.16512 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.239+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637be3bbdf0 con 0x5637be05a9f0 2024-09-21T06:24:12.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.240+0000 7f6b80f10640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be05a9f0 0x5637be461060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.240+0000 7f6b80f10640 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be05a9f0 0x5637be461060 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=add5a9df15b2f6f6 server_cookie=149bc540aaf75cef in_seq=0 out_seq=0 2024-09-21T06:24:12.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.240+0000 7f6b64ff9640 10 client.16512 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b64ff9640 1 -- 172.21.15.38:0/2572070315 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637be3bbdf0 con 0x5637be05a9f0 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b64ff9640 10 client.16512 handle_command_reply: tid=0 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 client.16512 shutdown 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 msgr2=0x5637be44ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6b78004b50 tx=0x7f6b780048f0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 shutdown_connections 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be05a9f0 0x5637be461060 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be45b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be44f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/2572070315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be44ee20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b64ff9640 0 client.16512 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 >> 172.21.15.38:0/2572070315 conn(0x5637be090460 msgr2=0x5637be446830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 shutdown_connections 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 1 -- 172.21.15.38:0/2572070315 wait complete. 2024-09-21T06:24:12.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.241+0000 7f6b89ee9740 20 client.16512 trim_cache size 0 max 16384 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 Processor -- start 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 -- start start 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be0731b0 0x5637be4415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be07b390 0x5637be45b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1b4150 con 0x5637be09c070 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1b19c0 con 0x5637be07b390 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1af810 con 0x5637be0731b0 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51408/0 (socket says 172.21.15.38:51408) 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 -- 172.21.15.38:0/3880588073 learned_addr learned my addr 172.21.15.38:0/3880588073 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81711640 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be0731b0 0x5637be4415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b80f10640 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be07b390 0x5637be45b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 -- 172.21.15.38:0/3880588073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be0731b0 msgr2=0x5637be4415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be0731b0 0x5637be4415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 -- 172.21.15.38:0/3880588073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be07b390 msgr2=0x5637be45b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be07b390 0x5637be45b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.255+0000 7f6b81f12640 1 -- 172.21.15.38:0/3880588073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637be451d60 con 0x5637be09c070 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.256+0000 7f6b81f12640 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6b74035000 tx=0x7f6b74042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a280f486f67d71f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.256+0000 7f6b66ffd640 1 -- 172.21.15.38:0/3880588073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74056070 con 0x5637be09c070 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.256+0000 7f6b66ffd640 1 -- 172.21.15.38:0/3880588073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b74004510 con 0x5637be09c070 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.256+0000 7f6b66ffd640 1 -- 172.21.15.38:0/3880588073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74034040 con 0x5637be09c070 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- 172.21.15.38:0/3880588073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 msgr2=0x5637be4467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6b74035000 tx=0x7f6b74042000 comp rx=0 tx=0).stop 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- 172.21.15.38:0/3880588073 shutdown_connections 2024-09-21T06:24:12.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be09c070 0x5637be4467a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be07b390 0x5637be45b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/3880588073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be0731b0 0x5637be4415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- 172.21.15.38:0/3880588073 >> 172.21.15.38:0/3880588073 conn(0x5637be090460 msgr2=0x5637be440eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- 172.21.15.38:0/3880588073 shutdown_connections 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- 172.21.15.38:0/3880588073 wait complete. 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 -- start start 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.257+0000 7f6b89ee9740 1 Processor -- start 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be461db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be462350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1afe80 con 0x5637be0731b0 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1b12f0 con 0x5637be09c070 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1b0550 con 0x5637be07b390 2024-09-21T06:24:12.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b89ee9740 10 client.0 _ll_register_callbacks cb 0x7f6b740099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51424/0 (socket says 172.21.15.38:51424) 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 -- 172.21.15.38:0/1490691845 learned_addr learned my addr 172.21.15.38:0/1490691845 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b80f10640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be461db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81f12640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be462350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 -- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 msgr2=0x5637be461db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be461db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 -- 172.21.15.38:0/1490691845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 msgr2=0x5637be462350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be462350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 -- 172.21.15.38:0/1490691845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637be462ae0 con 0x5637be0731b0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b81711640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b3f0 tx=0x7f6b78004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7db2fe1af17a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.258+0000 7f6b64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78028040 con 0x5637be0731b0 2024-09-21T06:24:12.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b78019830 con 0x5637be0731b0 2024-09-21T06:24:12.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b74004510 con 0x5637be0731b0 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b7803c050 con 0x5637be0731b0 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 10 client.16518 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637be4cb790 con 0x5637be0731b0 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b74004510 con 0x5637be0731b0 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b78022070 con 0x5637be0731b0 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 10 client.16518 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:12.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 10 client.16518 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 20 client.16518 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be02fda0 0x5637be4cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 4 client.16518 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.259+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637be3b78a0 con 0x5637be02fda0 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b80f10640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be02fda0 0x5637be4cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b64ff9640 10 client.16518 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b80f10640 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be02fda0 0x5637be4cdf80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f6fa139ddc575525 server_cookie=d19b468b8bff2e51 in_seq=0 out_seq=0 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b64ff9640 1 -- 172.21.15.38:0/1490691845 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637be3b78a0 con 0x5637be02fda0 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b64ff9640 10 client.16518 handle_command_reply: tid=0 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.260+0000 7f6b89ee9740 1 client.16518 shutdown 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 msgr2=0x5637be4648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b3f0 tx=0x7f6b78004960 comp rx=0 tx=0).stop 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 shutdown_connections 2024-09-21T06:24:12.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5637be02fda0 0x5637be4cdf80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637be09c070 0x5637be462350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637be07b390 0x5637be461db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 --2- 172.21.15.38:0/1490691845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637be0731b0 0x5637be4648e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 >> 172.21.15.38:0/1490691845 conn(0x5637be090460 msgr2=0x5637be4467a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b64ff9640 0 client.16518 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 shutdown_connections 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 1 -- 172.21.15.38:0/1490691845 wait complete. 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b89ee9740 20 client.16518 trim_cache size 0 max 16384 2024-09-21T06:24:12.266 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 msgr2=0x7f6b680b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 0x7f6b680b8bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b74006010 tx=0x7f6b74005d80 comp rx=0 tx=0).stop 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 msgr2=0x7f6b7c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.261+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c920 tx=0x7f6b6c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 shutdown_connections 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b680b66b0 0x7f6b680b8bc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b7c110200 0x7f6b7c1a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b7c102fa0 0x7f6b7c19cd20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 --2- 172.21.15.38:0/141713790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b7c102650 0x7f6b7c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:12.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 >> 172.21.15.38:0/141713790 conn(0x7f6b7c079760 msgr2=0x7f6b7c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:12.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 shutdown_connections 2024-09-21T06:24:12.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:12.262+0000 7f6b83975640 1 -- 172.21.15.38:0/141713790 wait complete. 2024-09-21T06:24:12.961 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:24:13.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:12 smithi174 ceph-mon[34815]: pgmap v455: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:24:13.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:12 smithi044 ceph-mon[34369]: pgmap v455: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:24:13.217 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:13.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:12 smithi038 ceph-mon[31215]: pgmap v455: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 -- 172.21.15.38:0/4285335352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 msgr2=0x7f4a24103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/4285335352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a24103f70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009900 tx=0x7f4a1c02a410 comp rx=0 tx=0).stop 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 -- 172.21.15.38:0/4285335352 shutdown_connections 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/4285335352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a24109df0 0x7f4a24110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/4285335352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a241094a0 0x7f4a241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/4285335352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a24103f70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 -- 172.21.15.38:0/4285335352 >> 172.21.15.38:0/4285335352 conn(0x7f4a2407b850 msgr2=0x7f4a2407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 -- 172.21.15.38:0/4285335352 shutdown_connections 2024-09-21T06:24:13.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.762+0000 7f4a2ba43640 1 -- 172.21.15.38:0/4285335352 wait complete. 2024-09-21T06:24:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 Processor -- start 2024-09-21T06:24:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 -- start start 2024-09-21T06:24:13.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a241094a0 0x7f4a2419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 0x7f4a2419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24113bf0 con 0x7f4a24103b60 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24113a70 con 0x7f4a241094a0 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a2ba43640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24113d70 con 0x7f4a24109df0 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.763+0000 7f4a297df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51448/0 (socket says 172.21.15.38:51448) 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 -- 172.21.15.38:0/1307501606 learned_addr learned my addr 172.21.15.38:0/1307501606 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a28fde640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a241094a0 0x7f4a2419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 0x7f4a2419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 -- 172.21.15.38:0/1307501606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 msgr2=0x7f4a2419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 0x7f4a2419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 -- 172.21.15.38:0/1307501606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a241094a0 msgr2=0x7f4a2419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a241094a0 0x7f4a2419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 -- 172.21.15.38:0/1307501606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a241a0550 con 0x7f4a24103b60 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 0x7f4a2419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a297df640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005ab0 tx=0x7f4a1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a227fc640 1 -- 172.21.15.38:0/1307501606 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c03f030 con 0x7f4a24103b60 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a241a07e0 con 0x7f4a24103b60 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a227fc640 1 -- 172.21.15.38:0/1307501606 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a1c003cd0 con 0x7f4a24103b60 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a227fc640 1 -- 172.21.15.38:0/1307501606 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c035070 con 0x7f4a24103b60 2024-09-21T06:24:13.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.764+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a241a6fa0 con 0x7f4a24103b60 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 Processor -- start 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 -- start start 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a227fc640 1 -- 172.21.15.38:0/1307501606 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4a1c042030 con 0x7f4a24103b60 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b5151b0 0x55b69b8e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b51d390 0x55b69b8e6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b69b85bea0 con 0x55b69b53e070 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b69b84b2d0 con 0x55b69b51d390 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.767+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b69b84f0e0 con 0x55b69b5151b0 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51458/0 (socket says 172.21.15.38:51458) 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 -- 172.21.15.38:0/3685719853 learned_addr learned my addr 172.21.15.38:0/3685719853 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:13.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a28fde640 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b51d390 0x55b69b8e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a297df640 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b5151b0 0x55b69b8e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 -- 172.21.15.38:0/3685719853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b5151b0 msgr2=0x55b69b8e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b5151b0 0x55b69b8e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 -- 172.21.15.38:0/3685719853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b51d390 msgr2=0x55b69b8e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b51d390 0x55b69b8e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 -- 172.21.15.38:0/3685719853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69b5a9650 con 0x55b69b53e070 2024-09-21T06:24:13.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4a14008dd0 tx=0x7f4a1400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2cb7e1dd078382 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.768+0000 7f4a0b7fe640 1 -- 172.21.15.38:0/3685719853 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400f830 con 0x55b69b53e070 2024-09-21T06:24:13.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.769+0000 7f4a227fc640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 0x7f4a0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.769+0000 7f4a0b7fe640 1 -- 172.21.15.38:0/3685719853 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a1400de20 con 0x55b69b53e070 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.769+0000 7f4a0b7fe640 1 -- 172.21.15.38:0/3685719853 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400ed70 con 0x55b69b53e070 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.769+0000 7f4a297df640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 0x7f4a0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.769+0000 7f4a227fc640 1 -- 172.21.15.38:0/1307501606 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4a1c107c60 con 0x7f4a24103b60 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- 172.21.15.38:0/3685719853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 msgr2=0x55b69b8e56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a297df640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 0x7f4a0c0b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c1054e0 tx=0x7f4a1c0044e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4a14008dd0 tx=0x7f4a1400d710 comp rx=0 tx=0).stop 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- 172.21.15.38:0/3685719853 shutdown_connections 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b51d390 0x55b69b8e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b5151b0 0x55b69b8e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/3685719853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8e56a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- 172.21.15.38:0/3685719853 >> 172.21.15.38:0/3685719853 conn(0x55b69b532460 msgr2=0x55b69b8e3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- 172.21.15.38:0/3685719853 shutdown_connections 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- 172.21.15.38:0/3685719853 wait complete. 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 -- start start 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.770+0000 7f4a31fb7740 1 Processor -- start 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b53e070 0x55b69b9015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b69b6ac700 con 0x55b69b51d390 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b69b7e6160 con 0x55b69b5151b0 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b69b8f8290 con 0x55b69b53e070 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a31fb7740 10 client.0 _ll_register_callbacks cb 0x55b69b7ff9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51462/0 (socket says 172.21.15.38:51462) 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 -- 172.21.15.38:0/2199612128 learned_addr learned my addr 172.21.15.38:0/2199612128 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:13.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b53e070 0x55b69b9015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 -- 172.21.15.38:0/2199612128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b53e070 msgr2=0x55b69b9015b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b53e070 0x55b69b9015b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 -- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 msgr2=0x55b69b8f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 -- 172.21.15.38:0/2199612128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69b813c90 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a28fde640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800be80 tx=0x7f4a18012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ba853b9c18ad08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.771+0000 7f4a08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18005220 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4a180053c0 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a1400de20 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a180055c0 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 10 client.16530 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b69b904010 con 0x55b69b51d390 2024-09-21T06:24:13.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a1400de20 con 0x55b69b51d390 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4a18019030 con 0x55b69b51d390 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 10 client.16530 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 10 client.16530 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 20 client.16530 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.772+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4fc9f0 0x55b69b9075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.773+0000 7f4a31fb7740 4 client.16530 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.773+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69b85ddf0 con 0x55b69b4fc9f0 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.773+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4fc9f0 0x55b69b9075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.773+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4fc9f0 0x55b69b9075e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62f9e5827cafccfe server_cookie=5478c33fb6d38dbf in_seq=0 out_seq=0 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.773+0000 7f4a08ff9640 10 client.16530 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a08ff9640 1 -- 172.21.15.38:0/2199612128 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b69b85ddf0 con 0x55b69b4fc9f0 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a08ff9640 10 client.16530 handle_command_reply: tid=0 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 client.16530 shutdown 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 msgr2=0x55b69b8f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800be80 tx=0x7f4a18012820 comp rx=0 tx=0).stop 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 shutdown_connections 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4fc9f0 0x55b69b9075e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b53e070 0x55b69b9015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b51d390 0x55b69b8f12e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a08ff9640 0 client.16530 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:13.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2199612128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.774+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 >> 172.21.15.38:0/2199612128 conn(0x55b69b532460 msgr2=0x55b69b8e8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.775+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 shutdown_connections 2024-09-21T06:24:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.775+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2199612128 wait complete. 2024-09-21T06:24:13.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.775+0000 7f4a31fb7740 20 client.16530 trim_cache size 0 max 16384 2024-09-21T06:24:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 Processor -- start 2024-09-21T06:24:13.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 -- start start 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b9014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241afdd0 con 0x55b69b53e070 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241ad640 con 0x55b69b5151b0 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.788+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241ab490 con 0x55b69b51d390 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51474/0 (socket says 172.21.15.38:51474) 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 -- 172.21.15.38:0/2513268884 learned_addr learned my addr 172.21.15.38:0/2513268884 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a28fde640 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b9014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 -- 172.21.15.38:0/2513268884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 msgr2=0x55b69b9014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b9014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 -- 172.21.15.38:0/2513268884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 msgr2=0x55b69b8e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 -- 172.21.15.38:0/2513268884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69b8f2060 con 0x55b69b53e070 2024-09-21T06:24:13.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400e9c0 tx=0x7f4a1400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90a61c14d09116e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a0affd640 1 -- 172.21.15.38:0/2513268884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14022040 con 0x55b69b53e070 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a0affd640 1 -- 172.21.15.38:0/2513268884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a14018480 con 0x55b69b53e070 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.789+0000 7f4a0affd640 1 -- 172.21.15.38:0/2513268884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1402a6c0 con 0x55b69b53e070 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2513268884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 msgr2=0x55b69b8edf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400e9c0 tx=0x7f4a1400e950 comp rx=0 tx=0).stop 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2513268884 shutdown_connections 2024-09-21T06:24:13.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8edf90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b9014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/2513268884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2513268884 >> 172.21.15.38:0/2513268884 conn(0x55b69b532460 msgr2=0x55b69b8e87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2513268884 shutdown_connections 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.790+0000 7f4a31fb7740 1 -- 172.21.15.38:0/2513268884 wait complete. 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 -- start start 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 Processor -- start 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b8f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241abb00 con 0x55b69b53e070 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241acf70 con 0x55b69b5151b0 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241ac1d0 con 0x55b69b51d390 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a31fb7740 10 client.0 _ll_register_callbacks cb 0x7f4a1800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:13.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a29fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51478/0 (socket says 172.21.15.38:51478) 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.791+0000 7f4a29fe0640 1 -- 172.21.15.38:0/743804478 learned_addr learned my addr 172.21.15.38:0/743804478 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a28fde640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b8f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 -- 172.21.15.38:0/743804478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 msgr2=0x55b69b8f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b8f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 -- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 msgr2=0x55b69b8f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 -- 172.21.15.38:0/743804478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69b971030 con 0x55b69b53e070 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a28fde640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b8f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a29fe0640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4a140089c0 tx=0x7f4a14018d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623b4440b912f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400e9f0 con 0x55b69b53e070 2024-09-21T06:24:13.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4a1400eb90 con 0x55b69b53e070 2024-09-21T06:24:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a14018480 con 0x55b69b53e070 2024-09-21T06:24:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a1400ed90 con 0x55b69b53e070 2024-09-21T06:24:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a31fb7740 10 client.16536 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.792+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b69b9722b0 con 0x55b69b53e070 2024-09-21T06:24:13.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a14018480 con 0x55b69b53e070 2024-09-21T06:24:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4a1403a070 con 0x55b69b53e070 2024-09-21T06:24:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 10 client.16536 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:13.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 10 client.16536 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 20 client.16536 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4d1da0 0x55b69b974950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 4 client.16536 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b69b8f1690 con 0x55b69b4d1da0 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.793+0000 7f4a28fde640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4d1da0 0x55b69b974950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a08ff9640 10 client.16536 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a28fde640 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4d1da0 0x55b69b974950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e633c55a08f7d848 server_cookie=118fa41c148017c2 in_seq=0 out_seq=0 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a08ff9640 1 -- 172.21.15.38:0/743804478 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b69b8f1690 con 0x55b69b4d1da0 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a08ff9640 10 client.16536 handle_command_reply: tid=0 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 client.16536 shutdown 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 msgr2=0x55b69b8f9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4a140089c0 tx=0x7f4a14018d70 comp rx=0 tx=0).stop 2024-09-21T06:24:13.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 shutdown_connections 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b69b4d1da0 0x55b69b974950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b69b53e070 0x55b69b8f9fb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b69b51d390 0x55b69b8f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a08ff9640 0 client.16536 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 --2- 172.21.15.38:0/743804478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b69b5151b0 0x55b69b8f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 >> 172.21.15.38:0/743804478 conn(0x55b69b532460 msgr2=0x55b69b8e66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 shutdown_connections 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 1 -- 172.21.15.38:0/743804478 wait complete. 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.794+0000 7f4a31fb7740 20 client.16536 trim_cache size 0 max 16384 2024-09-21T06:24:13.800 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 msgr2=0x7f4a0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 0x7f4a0c0b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c1054e0 tx=0x7f4a1c0044e0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 msgr2=0x7f4a2419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c005ab0 tx=0x7f4a1c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 shutdown_connections 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4a0c0b6680 0x7f4a0c0b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a24109df0 0x7f4a2419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a241094a0 0x7f4a2419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 --2- 172.21.15.38:0/1307501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a24103b60 0x7f4a2419a5e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:13.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 >> 172.21.15.38:0/1307501606 conn(0x7f4a2407b850 msgr2=0x7f4a24107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:13.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 shutdown_connections 2024-09-21T06:24:13.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:13.795+0000 7f4a2ba43640 1 -- 172.21.15.38:0/1307501606 wait complete. 2024-09-21T06:24:14.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:24:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:15.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:14 smithi174 ceph-mon[34815]: pgmap v456: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:24:15.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:14 smithi044 ceph-mon[34369]: pgmap v456: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:24:15.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:14 smithi038 ceph-mon[31215]: pgmap v456: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:24:15.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 -- 172.21.15.38:0/3712867047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 msgr2=0x7f46a4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3712867047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a4110640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f469c009ca0 tx=0x7f469c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 -- 172.21.15.38:0/3712867047 shutdown_connections 2024-09-21T06:24:15.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3712867047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a4110640 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3712867047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a41094c0 0x7f46a41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3712867047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a4103b80 0x7f46a4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 -- 172.21.15.38:0/3712867047 >> 172.21.15.38:0/3712867047 conn(0x7f46a40ff5d0 msgr2=0x7f46a4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 -- 172.21.15.38:0/3712867047 shutdown_connections 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.311+0000 7f46ab40b640 1 -- 172.21.15.38:0/3712867047 wait complete. 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 Processor -- start 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 -- start start 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a4103b80 0x7f46a419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 0x7f46a419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4113c60 con 0x7f46a4109e10 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4113ae0 con 0x7f46a4103b80 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46ab40b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4113de0 con 0x7f46a41094c0 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51502/0 (socket says 172.21.15.38:51502) 2024-09-21T06:24:15.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 -- 172.21.15.38:0/3539974418 learned_addr learned my addr 172.21.15.38:0/3539974418 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a89a6640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 0x7f46a419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a91a7640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a4103b80 0x7f46a419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 -- 172.21.15.38:0/3539974418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 msgr2=0x7f46a419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 0x7f46a419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 -- 172.21.15.38:0/3539974418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a4103b80 msgr2=0x7f46a419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a4103b80 0x7f46a419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a99a8640 1 -- 172.21.15.38:0/3539974418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a41a0400 con 0x7f46a4109e10 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.312+0000 7f46a89a6640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 0x7f46a419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:15.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f46a99a8640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f469c033040 tx=0x7f469c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f469a7fc640 1 -- 172.21.15.38:0/3539974418 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c031650 con 0x7f46a4109e10 2024-09-21T06:24:15.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f469a7fc640 1 -- 172.21.15.38:0/3539974418 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f469c0317f0 con 0x7f46a4109e10 2024-09-21T06:24:15.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a41a0690 con 0x7f46a4109e10 2024-09-21T06:24:15.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f469a7fc640 1 -- 172.21.15.38:0/3539974418 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c02fa40 con 0x7f46a4109e10 2024-09-21T06:24:15.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.313+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a41a6f10 con 0x7f46a4109e10 2024-09-21T06:24:15.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 Processor -- start 2024-09-21T06:24:15.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f469a7fc640 1 -- 172.21.15.38:0/3539974418 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f469c02fc40 con 0x7f46a4109e10 2024-09-21T06:24:15.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 -- start start 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cb91b0 0x5653a1089be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a108a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5653a0fffea0 con 0x5653a0ce2070 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5653a0fef2d0 con 0x5653a0cb91b0 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46b197f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5653a0ff30e0 con 0x5653a0cc1390 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46a89a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46a89a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51508/0 (socket says 172.21.15.38:51508) 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46a89a6640 1 -- 172.21.15.38:0/1597093542 learned_addr learned my addr 172.21.15.38:0/1597093542 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.316+0000 7f46a91a7640 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cb91b0 0x5653a1089be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a108a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 -- 172.21.15.38:0/1597093542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 msgr2=0x5653a108a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a108a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 -- 172.21.15.38:0/1597093542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cb91b0 msgr2=0x5653a1089be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cb91b0 0x5653a1089be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 -- 172.21.15.38:0/1597093542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653a0d4d650 con 0x5653a0ce2070 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f469a7fc640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 0x7f46900b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a91a7640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 0x7f46900b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4694012460 tx=0x7f46940085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687e5412d98b7846 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f469a7fc640 1 -- 172.21.15.38:0/3539974418 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f469c108900 con 0x7f46a4109e10 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f468f7fe640 1 -- 172.21.15.38:0/1597093542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694018030 con 0x5653a0ce2070 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f468f7fe640 1 -- 172.21.15.38:0/1597093542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46940054f0 con 0x5653a0ce2070 2024-09-21T06:24:15.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.317+0000 7f468f7fe640 1 -- 172.21.15.38:0/1597093542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46940108a0 con 0x5653a0ce2070 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 -- 172.21.15.38:0/1597093542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 msgr2=0x5653a10896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4694012460 tx=0x7f46940085e0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46a91a7640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 0x7f46900b8c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5653a1088320 tx=0x7f46a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 -- 172.21.15.38:0/1597093542 shutdown_connections 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a108a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cb91b0 0x5653a1089be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 --2- 172.21.15.38:0/1597093542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0ce2070 0x5653a10896a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 -- 172.21.15.38:0/1597093542 >> 172.21.15.38:0/1597093542 conn(0x5653a0cd6460 msgr2=0x5653a1087590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 -- 172.21.15.38:0/1597093542 shutdown_connections 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.318+0000 7f46b197f740 1 -- 172.21.15.38:0/1597093542 wait complete. 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.319+0000 7f46b197f740 1 -- start start 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.319+0000 7f46b197f740 1 Processor -- start 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.319+0000 7f46b197f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1095230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1095770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5653a0e50700 con 0x5653a0cb91b0 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5653a0f8a160 con 0x5653a0cc1390 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5653a1097e80 con 0x5653a0ce2070 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46b197f740 10 client.0 _ll_register_callbacks cb 0x5653a0fa39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51516/0 (socket says 172.21.15.38:51516) 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 -- 172.21.15.38:0/1766227167 learned_addr learned my addr 172.21.15.38:0/1766227167 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1095230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a99a8640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 -- 172.21.15.38:0/1766227167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 msgr2=0x5653a1095770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1095770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 -- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 msgr2=0x5653a1095230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1095230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 -- 172.21.15.38:0/1766227167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653a0fb7c90 con 0x5653a0cb91b0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1095230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f46a91a7640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f46a0020a10 tx=0x7f46a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa01e6ee9dbb8804 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.320+0000 7f468cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a002d060 con 0x5653a0cb91b0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f46a0018030 con 0x5653a0cb91b0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46940054f0 con 0x5653a0cb91b0 2024-09-21T06:24:15.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f46a0011940 con 0x5653a0cb91b0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 10 client.16548 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653a10a7f70 con 0x5653a0cb91b0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46940054f0 con 0x5653a0cb91b0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f46a001dc40 con 0x5653a0cb91b0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 10 client.16548 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 20 client.16548 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0ca09f0 0x5653a10ab560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 4 client.16548 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.321+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653a1001df0 con 0x5653a0ca09f0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.322+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0ca09f0 0x5653a10ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.322+0000 7f46a89a6640 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0ca09f0 0x5653a10ab560 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8b128ef4b559f3 server_cookie=17a8b103a9589114 in_seq=0 out_seq=0 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.322+0000 7f468cff9640 10 client.16548 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:15.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f468cff9640 1 -- 172.21.15.38:0/1766227167 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653a1001df0 con 0x5653a0ca09f0 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f468cff9640 10 client.16548 handle_command_reply: tid=0 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 client.16548 shutdown 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 msgr2=0x5653a1094cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f46a0020a10 tx=0x7f46a0004730 comp rx=0 tx=0).stop 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 shutdown_connections 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0ca09f0 0x5653a10ab560 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1095770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1095230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 --2- 172.21.15.38:0/1766227167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a1094cf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 >> 172.21.15.38:0/1766227167 conn(0x5653a0cd6460 msgr2=0x5653a108c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f468cff9640 0 client.16548 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 shutdown_connections 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.323+0000 7f46b197f740 1 -- 172.21.15.38:0/1766227167 wait complete. 2024-09-21T06:24:15.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.324+0000 7f46b197f740 20 client.16548 trim_cache size 0 max 16384 2024-09-21T06:24:15.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 Processor -- start 2024-09-21T06:24:15.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 -- start start 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a1096920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 0x5653a1086bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41afc90 con 0x5653a0cb91b0 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ad500 con 0x5653a0ce2070 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46b197f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ab370 con 0x5653a0cc1390 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51530/0 (socket says 172.21.15.38:51530) 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a91a7640 1 -- 172.21.15.38:0/550992618 learned_addr learned my addr 172.21.15.38:0/550992618 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a89a6640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a1096920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a99a8640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 0x5653a1086bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a91a7640 1 -- 172.21.15.38:0/550992618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 msgr2=0x5653a1096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.337+0000 7f46a91a7640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a1096920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f46a91a7640 1 -- 172.21.15.38:0/550992618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 msgr2=0x5653a1086bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f46a91a7640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 0x5653a1086bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f46a91a7640 1 -- 172.21.15.38:0/550992618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653a108bbc0 con 0x5653a0cb91b0 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f46a99a8640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 0x5653a1086bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f46a91a7640 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f46a0019040 tx=0x7f46a00207d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50f739edea4e1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f468effd640 1 -- 172.21.15.38:0/550992618 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0011ce0 con 0x5653a0cb91b0 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f468effd640 1 -- 172.21.15.38:0/550992618 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46a0011e80 con 0x5653a0cb91b0 2024-09-21T06:24:15.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.338+0000 7f468effd640 1 -- 172.21.15.38:0/550992618 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00038e0 con 0x5653a0cb91b0 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- 172.21.15.38:0/550992618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 msgr2=0x5653a108b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f46a0019040 tx=0x7f46a00207d0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- 172.21.15.38:0/550992618 shutdown_connections 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0ce2070 0x5653a1086bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0cc1390 0x5653a1096920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 --2- 172.21.15.38:0/550992618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a108b090 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- 172.21.15.38:0/550992618 >> 172.21.15.38:0/550992618 conn(0x5653a0cd6460 msgr2=0x5653a1096210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- 172.21.15.38:0/550992618 shutdown_connections 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- 172.21.15.38:0/550992618 wait complete. 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 -- start start 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.339+0000 7f46b197f740 1 Processor -- start 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1099720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1099c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ab9c0 con 0x5653a0cb91b0 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ace30 con 0x5653a0cc1390 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46a41ac090 con 0x5653a0ce2070 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46b197f740 10 client.0 _ll_register_callbacks cb 0x7f46a00208a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51546/0 (socket says 172.21.15.38:51546) 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 -- 172.21.15.38:0/2303176986 learned_addr learned my addr 172.21.15.38:0/2303176986 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a99a8640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a89a6640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1099720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 -- 172.21.15.38:0/2303176986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 msgr2=0x5653a1099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1099c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 -- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 msgr2=0x5653a1099720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1099720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.340+0000 7f46a91a7640 1 -- 172.21.15.38:0/2303176986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653a1115020 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46a91a7640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f46a0012cb0 tx=0x7f46a0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f868190f1300f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a002d040 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f46a0004040 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653a0ffd8a0 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f46a0004240 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 10 client.16554 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5653a1116210 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5653a0ffd8a0 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f46a003a020 con 0x5653a0cb91b0 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 10 client.16554 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 20 client.16554 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0c75da0 0x5653a1118910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 4 client.16554 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.341+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653a0ffacd0 con 0x5653a0c75da0 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f46a89a6640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0c75da0 0x5653a1118910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f46a89a6640 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0c75da0 0x5653a1118910 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6a435f1534de2d server_cookie=31050ab23fef24ae in_seq=0 out_seq=0 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f468cff9640 10 client.16554 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f468cff9640 1 -- 172.21.15.38:0/2303176986 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653a0ffacd0 con 0x5653a0c75da0 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f468cff9640 10 client.16554 handle_command_reply: tid=0 2024-09-21T06:24:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f46b197f740 1 client.16554 shutdown 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.342+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 msgr2=0x5653a10991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f46a0012cb0 tx=0x7f46a0011de0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 shutdown_connections 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5653a0c75da0 0x5653a1118910 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5653a0ce2070 0x5653a1099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653a0cc1390 0x5653a1099720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f468cff9640 0 client.16554 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 --2- 172.21.15.38:0/2303176986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5653a0cb91b0 0x5653a10991e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 >> 172.21.15.38:0/2303176986 conn(0x5653a0cd6460 msgr2=0x5653a108ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 shutdown_connections 2024-09-21T06:24:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 1 -- 172.21.15.38:0/2303176986 wait complete. 2024-09-21T06:24:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46b197f740 20 client.16554 trim_cache size 0 max 16384 2024-09-21T06:24:15.349 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 msgr2=0x7f46900b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 0x7f46900b8c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5653a1088320 tx=0x7f46a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 msgr2=0x7f46a419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f469c033040 tx=0x7f469c003ce0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 shutdown_connections 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f46900b6730 0x7f46900b8c40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f46a4109e10 0x7f46a419fd90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46a41094c0 0x7f46a419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 --2- 172.21.15.38:0/3539974418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46a4103b80 0x7f46a419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.343+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 >> 172.21.15.38:0/3539974418 conn(0x7f46a40ff5d0 msgr2=0x7f46a4106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.344+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 shutdown_connections 2024-09-21T06:24:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:15.344+0000 7f46ab40b640 1 -- 172.21.15.38:0/3539974418 wait complete. 2024-09-21T06:24:17.087 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:24:17.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:24:17.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:16 smithi174 ceph-mon[34815]: pgmap v457: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:24:17.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:16 smithi044 ceph-mon[34369]: pgmap v457: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:24:17.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:16 smithi038 ceph-mon[31215]: pgmap v457: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:24:17.360 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 -- 172.21.15.38:0/2670525740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 msgr2=0x7f3500110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 --2- 172.21.15.38:0/2670525740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f3500110330 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009ca0 tx=0x7f34f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 -- 172.21.15.38:0/2670525740 shutdown_connections 2024-09-21T06:24:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 --2- 172.21.15.38:0/2670525740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f3500110330 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 --2- 172.21.15.38:0/2670525740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 0x7f350010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 --2- 172.21.15.38:0/2670525740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f3500104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 -- 172.21.15.38:0/2670525740 >> 172.21.15.38:0/2670525740 conn(0x7f3500079730 msgr2=0x7f3500079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 -- 172.21.15.38:0/2670525740 shutdown_connections 2024-09-21T06:24:17.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.857+0000 7f3504ae9640 1 -- 172.21.15.38:0/2670525740 wait complete. 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 Processor -- start 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 -- start start 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f350019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 0x7f350019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3500113be0 con 0x7f350010de40 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3500113a60 con 0x7f35001049e0 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f3504ae9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3500113d60 con 0x7f3500105330 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.858+0000 7f34fed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51568/0 (socket says 172.21.15.38:51568) 2024-09-21T06:24:17.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 -- 172.21.15.38:0/1340792215 learned_addr learned my addr 172.21.15.38:0/1340792215 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fe59c640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f350019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 0x7f350019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 -- 172.21.15.38:0/1340792215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 msgr2=0x7f350019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 0x7f350019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 -- 172.21.15.38:0/1340792215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 msgr2=0x7f350019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f350019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 -- 172.21.15.38:0/1340792215 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001a03e0 con 0x7f350010de40 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fe59c640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f350019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34fed9d640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005e30 tx=0x7f34f8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34ef7fe640 1 -- 172.21.15.38:0/1340792215 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8031650 con 0x7f350010de40 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34ef7fe640 1 -- 172.21.15.38:0/1340792215 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34f80317f0 con 0x7f350010de40 2024-09-21T06:24:17.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f34ef7fe640 1 -- 172.21.15.38:0/1340792215 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f802fb70 con 0x7f350010de40 2024-09-21T06:24:17.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35001a0670 con 0x7f350010de40 2024-09-21T06:24:17.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.859+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35001a0bb0 con 0x7f350010de40 2024-09-21T06:24:17.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.862+0000 7f34ef7fe640 1 -- 172.21.15.38:0/1340792215 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f34f802fd30 con 0x7f350010de40 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.862+0000 7f350b05d740 1 Processor -- start 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.862+0000 7f350b05d740 1 -- start start 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dee602de60 con 0x55dee5d10350 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dee601d290 con 0x55dee5ce7490 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f350b05d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dee60210a0 con 0x55dee5cef670 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51574/0 (socket says 172.21.15.38:51574) 2024-09-21T06:24:17.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 -- 172.21.15.38:0/4074105837 learned_addr learned my addr 172.21.15.38:0/4074105837 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fe59c640 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34ef7fe640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 0x7f34e80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fed9d640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 0x7f34e80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 -- 172.21.15.38:0/4074105837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 msgr2=0x55dee60b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 -- 172.21.15.38:0/4074105837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 msgr2=0x55dee60b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34fdd9b640 1 -- 172.21.15.38:0/4074105837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee5d7b930 con 0x55dee5d10350 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.863+0000 7f34ef7fe640 1 -- 172.21.15.38:0/1340792215 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f34f8108a80 con 0x7f350010de40 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.864+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f34f400bfa0 tx=0x7f34f400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe25368881d46e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.864+0000 7f34ecff9640 1 -- 172.21.15.38:0/4074105837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4019030 con 0x55dee5d10350 2024-09-21T06:24:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.864+0000 7f34ecff9640 1 -- 172.21.15.38:0/4074105837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34f4011910 con 0x55dee5d10350 2024-09-21T06:24:17.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.864+0000 7f34ecff9640 1 -- 172.21.15.38:0/4074105837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f401d7e0 con 0x55dee5d10350 2024-09-21T06:24:17.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- 172.21.15.38:0/4074105837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 msgr2=0x55dee60b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f34f400bfa0 tx=0x7f34f400b650 comp rx=0 tx=0).stop 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f34fed9d640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 0x7f34e80b8bc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f34f80ce5f0 tx=0x7f34f802a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- 172.21.15.38:0/4074105837 shutdown_connections 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 --2- 172.21.15.38:0/4074105837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60b7430 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- 172.21.15.38:0/4074105837 >> 172.21.15.38:0/4074105837 conn(0x55dee5d04740 msgr2=0x55dee60b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- 172.21.15.38:0/4074105837 shutdown_connections 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- 172.21.15.38:0/4074105837 wait complete. 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 -- start start 2024-09-21T06:24:17.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.865+0000 7f350b05d740 1 Processor -- start 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dee5e7e890 con 0x55dee5d10350 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dee5fb7d40 con 0x55dee5ce7490 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dee60c5c10 con 0x55dee5cef670 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f350b05d740 10 client.0 _ll_register_callbacks cb 0x55dee601bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51576/0 (socket says 172.21.15.38:51576) 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 -- 172.21.15.38:0/95726268 learned_addr learned my addr 172.21.15.38:0/95726268 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fe59c640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 -- 172.21.15.38:0/95726268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 msgr2=0x55dee60c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 -- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 msgr2=0x55dee60c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.866+0000 7f34fdd9b640 1 -- 172.21.15.38:0/95726268 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee60cf510 con 0x55dee5d10350 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f34f401d4c0 tx=0x7f34f401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752613a2d90fd687 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4019040 con 0x55dee5d10350 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f34f40116e0 con 0x55dee5d10350 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f4011910 con 0x55dee5d10350 2024-09-21T06:24:17.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34f4011ac0 con 0x55dee5d10350 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 10 client.16566 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dee60d1e40 con 0x55dee5d10350 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34f4011910 con 0x55dee5d10350 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f34f40047e0 con 0x55dee5d10350 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 10 client.16566 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 10 client.16566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.867+0000 7f350b05d740 20 client.16566 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ccecd0 0x55dee60d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f350b05d740 4 client.16566 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dee602fdb0 con 0x55dee5ccecd0 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f34fe59c640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ccecd0 0x55dee60d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f34fe59c640 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ccecd0 0x55dee60d52b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efc925573e5d7b7 server_cookie=93aef786b940050e in_seq=0 out_seq=0 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.868+0000 7f34e5ffb640 10 client.16566 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f34e5ffb640 1 -- 172.21.15.38:0/95726268 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dee602fdb0 con 0x55dee5ccecd0 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f34e5ffb640 10 client.16566 handle_command_reply: tid=0 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 client.16566 shutdown 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 msgr2=0x55dee60cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f34f401d4c0 tx=0x7f34f401d3c0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 shutdown_connections 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60cef00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ccecd0 0x55dee60d52b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f34e5ffb640 0 client.16566 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:17.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 --2- 172.21.15.38:0/95726268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 >> 172.21.15.38:0/95726268 conn(0x55dee5d04740 msgr2=0x55dee60ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.869+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 shutdown_connections 2024-09-21T06:24:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.870+0000 7f350b05d740 1 -- 172.21.15.38:0/95726268 wait complete. 2024-09-21T06:24:17.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.870+0000 7f350b05d740 20 client.16566 trim_cache size 0 max 16384 2024-09-21T06:24:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.887+0000 7f350b05d740 1 Processor -- start 2024-09-21T06:24:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.887+0000 7f350b05d740 1 -- start start 2024-09-21T06:24:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 0x55dee60bc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5d10350 0x55dee60bca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f35001b1eb0 con 0x55dee5ce7490 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35001af720 con 0x55dee5cef670 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f350b05d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35001ad570 con 0x55dee5d10350 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51586/0 (socket says 172.21.15.38:51586) 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 -- 172.21.15.38:0/39975146 learned_addr learned my addr 172.21.15.38:0/39975146 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fe59c640 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 0x55dee60bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 -- 172.21.15.38:0/39975146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5d10350 msgr2=0x55dee60bca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5d10350 0x55dee60bca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 -- 172.21.15.38:0/39975146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 msgr2=0x55dee60bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 0x55dee60bc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 -- 172.21.15.38:0/39975146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee60b5860 con 0x55dee5ce7490 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fe59c640 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 0x55dee60bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.888+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f34f40059f0 tx=0x7f34f400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224abe95a9223e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.889+0000 7f34e7fff640 1 -- 172.21.15.38:0/39975146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4019040 con 0x55dee5ce7490 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.889+0000 7f34e7fff640 1 -- 172.21.15.38:0/39975146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34f4022040 con 0x55dee5ce7490 2024-09-21T06:24:17.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.889+0000 7f34e7fff640 1 -- 172.21.15.38:0/39975146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4004020 con 0x55dee5ce7490 2024-09-21T06:24:17.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.889+0000 7f350b05d740 1 -- 172.21.15.38:0/39975146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 msgr2=0x55dee60c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.889+0000 7f350b05d740 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f34f40059f0 tx=0x7f34f400b830 comp rx=0 tx=0).stop 2024-09-21T06:24:17.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- 172.21.15.38:0/39975146 shutdown_connections 2024-09-21T06:24:17.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5d10350 0x55dee60bca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5cef670 0x55dee60bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- 172.21.15.38:0/39975146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5ce7490 0x55dee60c4d80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- 172.21.15.38:0/39975146 >> 172.21.15.38:0/39975146 conn(0x55dee5d04740 msgr2=0x55dee60baba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- 172.21.15.38:0/39975146 shutdown_connections 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- 172.21.15.38:0/39975146 wait complete. 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- start start 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 Processor -- start 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.890+0000 7f350b05d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f35001adbe0 con 0x55dee5d10350 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f350b05d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35001af050 con 0x55dee5ce7490 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f350b05d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35001ae2b0 con 0x55dee5cef670 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f350b05d740 10 client.0 _ll_register_callbacks cb 0x7f34f0008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fe59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51594/0 (socket says 172.21.15.38:51594) 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 -- 172.21.15.38:0/3354182314 learned_addr learned my addr 172.21.15.38:0/3354182314 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 -- 172.21.15.38:0/3354182314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 msgr2=0x55dee60c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 -- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 msgr2=0x55dee60cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 -- 172.21.15.38:0/3354182314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee613eb40 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fe59c640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34fdd9b640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f34f4004190 tx=0x7f34f40134b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa20300445e40181 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.891+0000 7f34e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f403c070 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f34f40043c0 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f4022040 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f34f403f040 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 10 client.16572 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dee613fc50 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f34f4022040 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f34f401d7e0 con 0x55dee5d10350 2024-09-21T06:24:17.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 10 client.16572 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 20 client.16572 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ca4080 0x55dee61421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 4 client.16572 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.893+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dee602b860 con 0x55dee5ca4080 2024-09-21T06:24:17.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.894+0000 7f34fe59c640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ca4080 0x55dee61421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:17.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.894+0000 7f34fe59c640 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ca4080 0x55dee61421b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cf519f90b602d4 server_cookie=5139879feb096e2a in_seq=0 out_seq=0 2024-09-21T06:24:17.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.894+0000 7f34e5ffb640 10 client.16572 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:17.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f34e5ffb640 1 -- 172.21.15.38:0/3354182314 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dee602b860 con 0x55dee5ca4080 2024-09-21T06:24:17.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f34e5ffb640 10 client.16572 handle_command_reply: tid=0 2024-09-21T06:24:17.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 client.16572 shutdown 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 msgr2=0x55dee60c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f34f4004190 tx=0x7f34f40134b0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 shutdown_connections 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dee5d10350 0x55dee60c7400 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dee5ca4080 0x55dee61421b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dee5cef670 0x55dee60c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 --2- 172.21.15.38:0/3354182314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dee5ce7490 0x55dee60cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 >> 172.21.15.38:0/3354182314 conn(0x55dee5d04740 msgr2=0x55dee60baba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f34e5ffb640 0 client.16572 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 shutdown_connections 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 1 -- 172.21.15.38:0/3354182314 wait complete. 2024-09-21T06:24:17.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.896+0000 7f350b05d740 20 client.16572 trim_cache size 0 max 16384 2024-09-21T06:24:17.902 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:17.902 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:24:17.902 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "b873fa6b-504a-4971-89b8-6ffa0a1b827c", 2024-09-21T06:24:17.902 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:24:17.902 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 msgr2=0x7f34e80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 0x7f34e80b8bc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f34f80ce5f0 tx=0x7f34f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 msgr2=0x7f350019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f34f8005e30 tx=0x7f34f8003f90 comp rx=0 tx=0).stop 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 shutdown_connections 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f34e80b66b0 0x7f34e80b8bc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f350010de40 0x7f350019fd70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3500105330 0x7f350019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 --2- 172.21.15.38:0/1340792215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35001049e0 0x7f350019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 >> 172.21.15.38:0/1340792215 conn(0x7f3500079730 msgr2=0x7f35000ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 shutdown_connections 2024-09-21T06:24:17.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:17.897+0000 7f3504ae9640 1 -- 172.21.15.38:0/1340792215 wait complete. 2024-09-21T06:24:18.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:24:18.963 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: pgmap v458: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.145 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:18 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: pgmap v458: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:18 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: pgmap v458: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:19.176 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:18 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:24:19.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 -- 172.21.15.38:0/1308098855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc1083a0 msgr2=0x7fbcbc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 --2- 172.21.15.38:0/1308098855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc1087b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009900 tx=0x7fbca402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 -- 172.21.15.38:0/1308098855 shutdown_connections 2024-09-21T06:24:19.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 --2- 172.21.15.38:0/1308098855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 --2- 172.21.15.38:0/1308098855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc1087b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 --2- 172.21.15.38:0/1308098855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc102a60 0x7fbcbc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 -- 172.21.15.38:0/1308098855 >> 172.21.15.38:0/1308098855 conn(0x7fbcbc079730 msgr2=0x7fbcbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 -- 172.21.15.38:0/1308098855 shutdown_connections 2024-09-21T06:24:19.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.386+0000 7fbcc182c640 1 -- 172.21.15.38:0/1308098855 wait complete. 2024-09-21T06:24:19.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 Processor -- start 2024-09-21T06:24:19.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 -- start start 2024-09-21T06:24:19.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc112a80 con 0x7fbcbc102a60 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc112900 con 0x7fbcbc1083a0 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcc182c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc112c00 con 0x7fbcbc108cf0 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcbaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcbaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44840/0 (socket says 172.21.15.38:44840) 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.387+0000 7fbcbaffd640 1 -- 172.21.15.38:0/465476845 learned_addr learned my addr 172.21.15.38:0/465476845 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 -- 172.21.15.38:0/465476845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 msgr2=0x7fbcbc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 -- 172.21.15.38:0/465476845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc1083a0 msgr2=0x7fbcbc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 -- 172.21.15.38:0/465476845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc1a0410 con 0x7fbcbc102a60 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcbaffd640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c920 tx=0x7fbcac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcc082a640 1 -- 172.21.15.38:0/465476845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac007c70 con 0x7fbcbc102a60 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcc082a640 1 -- 172.21.15.38:0/465476845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcac007e10 con 0x7fbcbc102a60 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc1a0700 con 0x7fbcbc102a60 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcc082a640 1 -- 172.21.15.38:0/465476845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0188c0 con 0x7fbcbc102a60 2024-09-21T06:24:19.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.388+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1a6f20 con 0x7fbcbc102a60 2024-09-21T06:24:19.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 Processor -- start 2024-09-21T06:24:19.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 -- start start 2024-09-21T06:24:19.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4edf67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ed6ce50 con 0x55fb4ea4f070 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ed5c280 con 0x55fb4ea2e390 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ed60090 con 0x55fb4ea261b0 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcc082a640 1 -- 172.21.15.38:0/465476845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbcac00f450 con 0x7fbcbc102a60 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44854/0 (socket says 172.21.15.38:44854) 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.391+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/15752637 learned_addr learned my addr 172.21.15.38:0/15752637 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/15752637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 msgr2=0x55fb4edf67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4edf67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/15752637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 msgr2=0x55fb4edf6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/15752637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4eaba650 con 0x55fb4ea4f070 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400af70 tx=0x7fbcb400e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2332086346c1bd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcb1ffb640 1 -- 172.21.15.38:0/15752637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4003b70 con 0x55fb4ea4f070 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcb1ffb640 1 -- 172.21.15.38:0/15752637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb4010b10 con 0x55fb4ea4f070 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.392+0000 7fbcb1ffb640 1 -- 172.21.15.38:0/15752637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400fc10 con 0x55fb4ea4f070 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc082a640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 0x7fbca80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcbaffd640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 0x7fbca80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc082a640 1 -- 172.21.15.38:0/465476845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbcac0e7820 con 0x7fbcbc102a60 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 -- 172.21.15.38:0/15752637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 msgr2=0x55fb4edf6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400af70 tx=0x7fbcb400e7e0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 -- 172.21.15.38:0/15752637 shutdown_connections 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcbaffd640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 0x7fbca80b8c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0aa960 tx=0x7fbcac07a3a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4edf67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/15752637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4edf6270 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 -- 172.21.15.38:0/15752637 >> 172.21.15.38:0/15752637 conn(0x55fb4ea43460 msgr2=0x55fb4edf4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 -- 172.21.15.38:0/15752637 shutdown_connections 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.393+0000 7fbcc7da0740 1 -- 172.21.15.38:0/15752637 wait complete. 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.394+0000 7fbcc7da0740 1 -- start start 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.394+0000 7fbcc7da0740 1 Processor -- start 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.394+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4ee05d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.394+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4ee062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.394+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ebbd700 con 0x55fb4ea4f070 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ecf7110 con 0x55fb4ea2e390 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb4ee08d80 con 0x55fb4ea261b0 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcc7da0740 10 client.0 _ll_register_callbacks cb 0x55fb4ed10990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44868/0 (socket says 172.21.15.38:44868) 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/3650385693 learned_addr learned my addr 172.21.15.38:0/3650385693 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4ee05d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4ee062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/3650385693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 msgr2=0x55fb4ee05d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4ee05d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 msgr2=0x55fb4ee062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4ee062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/3650385693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4ed24c40 con 0x55fb4ea4f070 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4ee062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400acd0 tx=0x7fbcb400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7709c5846b3f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.395+0000 7fbc9affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4023040 con 0x55fb4ea4f070 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbcb4010840 con 0x55fb4ea4f070 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb4010b10 con 0x55fb4ea4f070 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcb4004a40 con 0x55fb4ea4f070 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 10 client.16584 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb4ee14b00 con 0x55fb4ea4f070 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb4010b10 con 0x55fb4ea4f070 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbcb4004400 con 0x55fb4ea4f070 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 10 client.16584 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 20 client.16584 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4ea0d9f0 0x55fb4ee17ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 4 client.16584 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.396+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb4ed6eda0 con 0x55fb4ea0d9f0 2024-09-21T06:24:19.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.397+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4ea0d9f0 0x55fb4ee17ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.397+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4ea0d9f0 0x55fb4ee17ec0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ada35d4acac9d6 server_cookie=331283f93ce38a4f in_seq=0 out_seq=0 2024-09-21T06:24:19.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.397+0000 7fbc9affd640 10 client.16584 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbc9affd640 1 -- 172.21.15.38:0/3650385693 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb4ed6eda0 con 0x55fb4ea0d9f0 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbc9affd640 10 client.16584 handle_command_reply: tid=0 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 client.16584 shutdown 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 msgr2=0x55fb4ee120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400acd0 tx=0x7fbcb400f7f0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 shutdown_connections 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee120b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4ee062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4ea0d9f0 0x55fb4ee17ec0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/3650385693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea261b0 0x55fb4ee05d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 >> 172.21.15.38:0/3650385693 conn(0x55fb4ea43460 msgr2=0x55fb4edf9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbc9affd640 0 client.16584 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:19.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 shutdown_connections 2024-09-21T06:24:19.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 1 -- 172.21.15.38:0/3650385693 wait complete. 2024-09-21T06:24:19.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.398+0000 7fbcc7da0740 20 client.16584 trim_cache size 0 max 16384 2024-09-21T06:24:19.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 Processor -- start 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 -- start start 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea4f070 0x55fb4edf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1afd30 con 0x55fb4ea261b0 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1ad5a0 con 0x55fb4ea2e390 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1ab3f0 con 0x55fb4ea4f070 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44874/0 (socket says 172.21.15.38:44874) 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/824088485 learned_addr learned my addr 172.21.15.38:0/824088485 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.416+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/824088485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea4f070 msgr2=0x55fb4edf9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea4f070 0x55fb4edf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/824088485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 msgr2=0x55fb4edf9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/824088485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4ee04cd0 con 0x55fb4ea261b0 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40048f0 tx=0x7fbcb400f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5303bdc8e93412da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcb17fa640 1 -- 172.21.15.38:0/824088485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb401a460 con 0x55fb4ea261b0 2024-09-21T06:24:19.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcb17fa640 1 -- 172.21.15.38:0/824088485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb401ac30 con 0x55fb4ea261b0 2024-09-21T06:24:19.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.417+0000 7fbcb17fa640 1 -- 172.21.15.38:0/824088485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40108a0 con 0x55fb4ea261b0 2024-09-21T06:24:19.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- 172.21.15.38:0/824088485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 msgr2=0x55fb4ee06230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40048f0 tx=0x7fbcb400f700 comp rx=0 tx=0).stop 2024-09-21T06:24:19.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- 172.21.15.38:0/824088485 shutdown_connections 2024-09-21T06:24:19.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea4f070 0x55fb4edf9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea2e390 0x55fb4edf9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/824088485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea261b0 0x55fb4ee06230 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- 172.21.15.38:0/824088485 >> 172.21.15.38:0/824088485 conn(0x55fb4ea43460 msgr2=0x55fb4ee05b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- 172.21.15.38:0/824088485 shutdown_connections 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- 172.21.15.38:0/824088485 wait complete. 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.418+0000 7fbcc7da0740 1 -- start start 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 Processor -- start 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea261b0 0x55fb4ee097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea2e390 0x55fb4ee09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1aba60 con 0x55fb4ea4f070 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1aced0 con 0x55fb4ea261b0 2024-09-21T06:24:19.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc1ac130 con 0x55fb4ea2e390 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcc7da0740 10 client.0 _ll_register_callbacks cb 0x7fbcb4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44882/0 (socket says 172.21.15.38:44882) 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/1534229248 learned_addr learned my addr 172.21.15.38:0/1534229248 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea2e390 0x55fb4ee09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea261b0 0x55fb4ee097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/1534229248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea2e390 msgr2=0x55fb4ee09d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea2e390 0x55fb4ee09d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea261b0 msgr2=0x55fb4ee097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea261b0 0x55fb4ee097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.419+0000 7fbcbb7fe640 1 -- 172.21.15.38:0/1534229248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4ee80ca0 con 0x55fb4ea4f070 2024-09-21T06:24:19.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcbb7fe640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4004d50 tx=0x7fbcb402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a682d24b1693a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb401a760 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbcb401a900 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb401ac30 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcb4010640 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 10 client.16590 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb4ee81f40 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcb401ac30 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbcb4045440 con 0x55fb4ea4f070 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 10 client.16590 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:19.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 20 client.16590 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.420+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4e9e2da0 0x55fb4ee846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbcc7da0740 4 client.16590 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb4ed6a850 con 0x55fb4e9e2da0 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4e9e2da0 0x55fb4ee846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbc9affd640 10 client.16590 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbcb3fff640 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4e9e2da0 0x55fb4ee846a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a40cb29decb4a0 server_cookie=2a06d9c1a769a4d7 in_seq=0 out_seq=0 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbc9affd640 1 -- 172.21.15.38:0/1534229248 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55fb4ed6a850 con 0x55fb4e9e2da0 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbc9affd640 10 client.16590 handle_command_reply: tid=0 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.421+0000 7fbcc7da0740 1 client.16590 shutdown 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 msgr2=0x55fb4ee80760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4004d50 tx=0x7fbcb402c040 comp rx=0 tx=0).stop 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 shutdown_connections 2024-09-21T06:24:19.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fb4ea4f070 0x55fb4ee80760 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fb4e9e2da0 0x55fb4ee846a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb4ea2e390 0x55fb4ee09d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 --2- 172.21.15.38:0/1534229248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb4ea261b0 0x55fb4ee097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 >> 172.21.15.38:0/1534229248 conn(0x55fb4ea43460 msgr2=0x55fb4edf9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbc9affd640 0 client.16590 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 shutdown_connections 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 1 -- 172.21.15.38:0/1534229248 wait complete. 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc7da0740 20 client.16590 trim_cache size 0 max 16384 2024-09-21T06:24:19.429 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.430 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.431 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:24:19.432 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.434 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:19.435 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 msgr2=0x7fbca80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 0x7fbca80b8c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0aa960 tx=0x7fbcac07a3a0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 msgr2=0x7fbcbc19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.422+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c920 tx=0x7fbcac00cde0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 shutdown_connections 2024-09-21T06:24:19.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbca80b6730 0x7fbca80b8c40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcbc108cf0 0x7fbcbc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcbc1083a0 0x7fbcbc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 --2- 172.21.15.38:0/465476845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcbc102a60 0x7fbcbc19a560 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 >> 172.21.15.38:0/465476845 conn(0x7fbcbc079730 msgr2=0x7fbcbc1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 shutdown_connections 2024-09-21T06:24:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:19.423+0000 7fbcc182c640 1 -- 172.21.15.38:0/465476845 wait complete. 2024-09-21T06:24:20.324 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:24:20.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:24:20.586 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:20.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:20 smithi038 ceph-mon[31215]: pgmap v459: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:24:21.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 -- 172.21.15.38:0/2722705401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 msgr2=0x7fd45810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 --2- 172.21.15.38:0/2722705401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45810f540 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd450009ca0 tx=0x7fd45002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 -- 172.21.15.38:0/2722705401 shutdown_connections 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 --2- 172.21.15.38:0/2722705401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45810f540 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 --2- 172.21.15.38:0/2722705401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4581083c0 0x7fd4581087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 --2- 172.21.15.38:0/2722705401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd458102a80 0x7fd458102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.084+0000 7fd45e169640 1 -- 172.21.15.38:0/2722705401 >> 172.21.15.38:0/2722705401 conn(0x7fd458079740 msgr2=0x7fd458079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.085+0000 7fd45e169640 1 -- 172.21.15.38:0/2722705401 shutdown_connections 2024-09-21T06:24:21.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.085+0000 7fd45e169640 1 -- 172.21.15.38:0/2722705401 wait complete. 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.085+0000 7fd45e169640 1 Processor -- start 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.085+0000 7fd45e169640 1 -- start start 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd458102a80 0x7fd45819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4581083c0 0x7fd45819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd458113bb0 con 0x7fd458108d10 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd458113a30 con 0x7fd458102a80 2024-09-21T06:24:21.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd45e169640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd458113d30 con 0x7fd4581083c0 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44902/0 (socket says 172.21.15.38:44902) 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 -- 172.21.15.38:0/3168665570 learned_addr learned my addr 172.21.15.38:0/3168665570 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd4577fe640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd458102a80 0x7fd45819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd456ffd640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4581083c0 0x7fd45819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 -- 172.21.15.38:0/3168665570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4581083c0 msgr2=0x7fd45819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4581083c0 0x7fd45819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 -- 172.21.15.38:0/3168665570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd458102a80 msgr2=0x7fd45819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd458102a80 0x7fd45819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.086+0000 7fd457fff640 1 -- 172.21.15.38:0/3168665570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4581a0510 con 0x7fd458108d10 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd457fff640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd450005cc0 tx=0x7fd450003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500317d0 con 0x7fd458108d10 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd450004510 con 0x7fd458108d10 2024-09-21T06:24:21.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4581a07a0 con 0x7fd458108d10 2024-09-21T06:24:21.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45002fda0 con 0x7fd458108d10 2024-09-21T06:24:21.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.087+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4581a6f60 con 0x7fd458108d10 2024-09-21T06:24:21.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.088+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458103d00 con 0x7fd458108d10 2024-09-21T06:24:21.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.089+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd450004040 con 0x7fd458108d10 2024-09-21T06:24:21.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.090+0000 7fd454ff9640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 0x7fd4400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:21.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.090+0000 7fd4577fe640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 0x7fd4400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:21.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.090+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd450108db0 con 0x7fd458108d10 2024-09-21T06:24:21.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.091+0000 7fd4577fe640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 0x7fd4400b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4480058c0 tx=0x7fd44800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:21.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.094+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd450004330 con 0x7fd458108d10 2024-09-21T06:24:21.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:20 smithi044 ceph-mon[34369]: pgmap v459: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:24:21.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.317+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd458102e90 con 0x7fd458108d10 2024-09-21T06:24:21.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.318+0000 7fd454ff9640 1 -- 172.21.15.38:0/3168665570 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11916 (secure 0 0 0) 0x7fd4500cf380 con 0x7fd458108d10 2024-09-21T06:24:21.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:24:21.320 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"btime":"2024-09-21T06:24:10:851801+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:09.931651+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:24:21.321 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-21T06:24:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.321+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 msgr2=0x7fd4400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.321+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 0x7fd4400b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4480058c0 tx=0x7fd44800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.321+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 msgr2=0x7fd45819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.321+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd450005cc0 tx=0x7fd450003f90 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 shutdown_connections 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd4400b6680 0x7fd4400b8b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd458108d10 0x7fd45819fde0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4581083c0 0x7fd45819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 --2- 172.21.15.38:0/3168665570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd458102a80 0x7fd45819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 >> 172.21.15.38:0/3168665570 conn(0x7fd458079740 msgr2=0x7fd4581043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 shutdown_connections 2024-09-21T06:24:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:21.322+0000 7fd45e169640 1 -- 172.21.15.38:0/3168665570 wait complete. 2024-09-21T06:24:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:20 smithi174 ceph-mon[34815]: pgmap v459: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:24:21.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3168665570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:22.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:24:22.351 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:22.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3168665570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:22.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3168665570' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 -- 172.21.15.38:0/2986198792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 msgr2=0x7fe318104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/2986198792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe318104de0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe314009900 tx=0x7fe31402a410 comp rx=0 tx=0).stop 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 -- 172.21.15.38:0/2986198792 shutdown_connections 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/2986198792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe31810de30 0x7fe318110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/2986198792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe318105320 0x7fe31810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/2986198792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe318104de0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 -- 172.21.15.38:0/2986198792 >> 172.21.15.38:0/2986198792 conn(0x7fe318079740 msgr2=0x7fe318079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 -- 172.21.15.38:0/2986198792 shutdown_connections 2024-09-21T06:24:22.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.855+0000 7fe31f4d8640 1 -- 172.21.15.38:0/2986198792 wait complete. 2024-09-21T06:24:22.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 Processor -- start 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 -- start start 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe318105320 0x7fe31819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe31810de30 0x7fe31819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113bd0 con 0x7fe3181049d0 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113a50 con 0x7fe318105320 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31f4d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113d50 con 0x7fe31810de30 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44928/0 (socket says 172.21.15.38:44928) 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 -- 172.21.15.38:0/1247244575 learned_addr learned my addr 172.21.15.38:0/1247244575 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31ca73640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe318105320 0x7fe31819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31da75640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe31810de30 0x7fe31819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 -- 172.21.15.38:0/1247244575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe31810de30 msgr2=0x7fe31819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe31810de30 0x7fe31819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 -- 172.21.15.38:0/1247244575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe318105320 msgr2=0x7fe31819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe318105320 0x7fe31819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.856+0000 7fe31d274640 1 -- 172.21.15.38:0/1247244575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181a05b0 con 0x7fe3181049d0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe31d274640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe314005940 tx=0x7fe3140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe30a7fc640 1 -- 172.21.15.38:0/1247244575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31403f030 con 0x7fe3181049d0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3181a0840 con 0x7fe3181049d0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe30a7fc640 1 -- 172.21.15.38:0/1247244575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe314031910 con 0x7fe3181049d0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe30a7fc640 1 -- 172.21.15.38:0/1247244575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314035070 con 0x7fe3181049d0 2024-09-21T06:24:22.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.857+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3181a7000 con 0x7fe3181049d0 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 Processor -- start 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 -- start start 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3461070 0x55d1f38082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3808d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe30a7fc640 1 -- 172.21.15.38:0/1247244575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe314042030 con 0x7fe3181049d0 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d1f377eea0 con 0x55d1f34381b0 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d1f376e2d0 con 0x55d1f3461070 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe325a4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1f37720e0 con 0x55d1f3440390 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe31d274640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe31d274640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44930/0 (socket says 172.21.15.38:44930) 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe31ca73640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3808d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe31d274640 1 -- 172.21.15.38:0/1501562503 learned_addr learned my addr 172.21.15.38:0/1501562503 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.860+0000 7fe31da75640 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3461070 0x55d1f38082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 -- 172.21.15.38:0/1501562503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3461070 msgr2=0x55d1f38082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3461070 0x55d1f38082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 -- 172.21.15.38:0/1501562503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 msgr2=0x55d1f3808800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 -- 172.21.15.38:0/1501562503 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f34cc650 con 0x55d1f3440390 2024-09-21T06:24:22.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31d274640 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe30a7fc640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 0x7fe3040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31ca73640 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3808d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe31806aaa0 tx=0x7fe30c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3073012edc191d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe31da75640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 0x7fe3040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe30a7fc640 1 -- 172.21.15.38:0/1247244575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe314107ad0 con 0x7fe3181049d0 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe3037fe640 1 -- 172.21.15.38:0/1501562503 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c004030 con 0x55d1f3440390 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe3037fe640 1 -- 172.21.15.38:0/1501562503 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe30c0041d0 con 0x55d1f3440390 2024-09-21T06:24:22.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.861+0000 7fe3037fe640 1 -- 172.21.15.38:0/1501562503 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0116a0 con 0x55d1f3440390 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 -- 172.21.15.38:0/1501562503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 msgr2=0x55d1f3808d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe31da75640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 0x7fe3040b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe310005fd0 tx=0x7fe310009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3808d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe31806aaa0 tx=0x7fe30c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 -- 172.21.15.38:0/1501562503 shutdown_connections 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3808d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f34381b0 0x55d1f3808800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1501562503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3461070 0x55d1f38082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 -- 172.21.15.38:0/1501562503 >> 172.21.15.38:0/1501562503 conn(0x55d1f3455460 msgr2=0x55d1f38061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.862+0000 7fe325a4c740 1 -- 172.21.15.38:0/1501562503 shutdown_connections 2024-09-21T06:24:22.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 -- 172.21.15.38:0/1501562503 wait complete. 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 -- start start 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 Processor -- start 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 0x55d1f3817d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3818260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d1f35cf700 con 0x55d1f3461070 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d1f3709160 con 0x55d1f34381b0 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.863+0000 7fe325a4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1f381ae00 con 0x55d1f3440390 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe325a4c740 10 client.0 _ll_register_callbacks cb 0x55d1f37229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44936/0 (socket says 172.21.15.38:44936) 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 -- 172.21.15.38:0/685567678 learned_addr learned my addr 172.21.15.38:0/685567678 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31ca73640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3818260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31d274640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 0x55d1f3817d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 -- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 msgr2=0x55d1f3818260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3818260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 -- 172.21.15.38:0/685567678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 msgr2=0x55d1f3817d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 0x55d1f3817d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 -- 172.21.15.38:0/685567678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f3736c90 con 0x55d1f3461070 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31d274640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 0x55d1f3817d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe31da75640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe310011d40 tx=0x7fe310004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599ec1ca25100690 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.864+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004d20 con 0x55d1f3461070 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe310005020 con 0x55d1f3461070 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe30c0041d0 con 0x55d1f3461070 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe310005260 con 0x55d1f3461070 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 10 client.16608 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:22.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1f3826b50 con 0x55d1f3461070 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe30c0041d0 con 0x55d1f3461070 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe31000f040 con 0x55d1f3461070 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 10 client.16608 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 10 client.16608 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 20 client.16608 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f341f9f0 0x55d1f382a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 4 client.16608 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.865+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1f3780df0 con 0x55d1f341f9f0 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.866+0000 7fe31d274640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f341f9f0 0x55d1f382a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.866+0000 7fe300ff9640 10 client.16608 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.866+0000 7fe31d274640 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f341f9f0 0x55d1f382a170 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10deab465202e8d6 server_cookie=bfb4a26f5958d490 in_seq=0 out_seq=0 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe300ff9640 1 -- 172.21.15.38:0/685567678 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1f3780df0 con 0x55d1f341f9f0 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe300ff9640 10 client.16608 handle_command_reply: tid=0 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 client.16608 shutdown 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 msgr2=0x55d1f38187c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe310011d40 tx=0x7fe310004a40 comp rx=0 tx=0).stop 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 shutdown_connections 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f341f9f0 0x55d1f382a170 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f38187c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f3440390 0x55d1f3818260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 --2- 172.21.15.38:0/685567678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f34381b0 0x55d1f3817d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 >> 172.21.15.38:0/685567678 conn(0x55d1f3455460 msgr2=0x55d1f3809cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe300ff9640 0 client.16608 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 shutdown_connections 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 1 -- 172.21.15.38:0/685567678 wait complete. 2024-09-21T06:24:22.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.867+0000 7fe325a4c740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T06:24:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.880+0000 7fe325a4c740 1 Processor -- start 2024-09-21T06:24:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.880+0000 7fe325a4c740 1 -- start start 2024-09-21T06:24:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f3814f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f3815450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181afe00 con 0x55d1f3461070 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181ad670 con 0x55d1f3440390 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe325a4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181ab4c0 con 0x55d1f34381b0 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44942/0 (socket says 172.21.15.38:44942) 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 -- 172.21.15.38:0/3625078799 learned_addr learned my addr 172.21.15.38:0/3625078799 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31d274640 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f3814f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31ca73640 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f3815450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 -- 172.21.15.38:0/3625078799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 msgr2=0x55d1f3814f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f3814f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 -- 172.21.15.38:0/3625078799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 msgr2=0x55d1f3815450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f3815450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 -- 172.21.15.38:0/3625078799 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f3809100 con 0x55d1f3461070 2024-09-21T06:24:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.881+0000 7fe31da75640 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe310020b00 tx=0x7fe31001fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717a13c4c5694297 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe302ffd640 1 -- 172.21.15.38:0/3625078799 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310035070 con 0x55d1f3461070 2024-09-21T06:24:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe302ffd640 1 -- 172.21.15.38:0/3625078799 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe310020d80 con 0x55d1f3461070 2024-09-21T06:24:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe302ffd640 1 -- 172.21.15.38:0/3625078799 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310004f50 con 0x55d1f3461070 2024-09-21T06:24:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 -- 172.21.15.38:0/3625078799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 msgr2=0x55d1f382f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe310020b00 tx=0x7fe31001fc10 comp rx=0 tx=0).stop 2024-09-21T06:24:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 -- 172.21.15.38:0/3625078799 shutdown_connections 2024-09-21T06:24:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f382f930 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f3815450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 --2- 172.21.15.38:0/3625078799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f3814f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.882+0000 7fe325a4c740 1 -- 172.21.15.38:0/3625078799 >> 172.21.15.38:0/3625078799 conn(0x55d1f3455460 msgr2=0x55d1f38165a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 -- 172.21.15.38:0/3625078799 shutdown_connections 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 -- 172.21.15.38:0/3625078799 wait complete. 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 -- start start 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 Processor -- start 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f381e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f381e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.883+0000 7fe325a4c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe325a4c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181abb30 con 0x55d1f3461070 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe325a4c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181acfa0 con 0x55d1f3440390 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe325a4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181ac200 con 0x55d1f34381b0 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe325a4c740 10 client.0 _ll_register_callbacks cb 0x7fe310009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44954/0 (socket says 172.21.15.38:44954) 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 -- 172.21.15.38:0/1361425456 learned_addr learned my addr 172.21.15.38:0/1361425456 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31ca73640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f381e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31d274640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f381e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 -- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 msgr2=0x55d1f381e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f381e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 -- 172.21.15.38:0/1361425456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 msgr2=0x55d1f381e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f381e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 -- 172.21.15.38:0/1361425456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f3824060 con 0x55d1f3461070 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31d274640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f381e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe31da75640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe310020a80 tx=0x7fe310020870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbd1ed61f7683ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe300ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310035040 con 0x55d1f3461070 2024-09-21T06:24:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe310004f60 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.884+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe310020d80 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe310005400 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 10 client.16614 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1f3894dd0 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe310020d80 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe31000f070 con 0x55d1f3461070 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 10 client.16614 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 10 client.16614 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 20 client.16614 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f33f4da0 0x55d1f3897420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 4 client.16614 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1f377c8a0 con 0x55d1f33f4da0 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.885+0000 7fe31d274640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f33f4da0 0x55d1f3897420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe300ff9640 10 client.16614 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe31d274640 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f33f4da0 0x55d1f3897420 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cea3a33d77e2067 server_cookie=1eae5ede18f3a8f1 in_seq=0 out_seq=0 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe300ff9640 1 -- 172.21.15.38:0/1361425456 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1f377c8a0 con 0x55d1f33f4da0 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe300ff9640 10 client.16614 handle_command_reply: tid=0 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 client.16614 shutdown 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 msgr2=0x55d1f381ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe310020a80 tx=0x7fe310020870 comp rx=0 tx=0).stop 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 shutdown_connections 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d1f33f4da0 0x55d1f3897420 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d1f3461070 0x55d1f381ed10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1f3440390 0x55d1f381e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 --2- 172.21.15.38:0/1361425456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1f34381b0 0x55d1f381e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 >> 172.21.15.38:0/1361425456 conn(0x55d1f3455460 msgr2=0x55d1f38092f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe300ff9640 0 client.16614 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 shutdown_connections 2024-09-21T06:24:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.886+0000 7fe325a4c740 1 -- 172.21.15.38:0/1361425456 wait complete. 2024-09-21T06:24:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe325a4c740 20 client.16614 trim_cache size 0 max 16384 2024-09-21T06:24:22.893 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 msgr2=0x7fe3040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 0x7fe3040b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe310005fd0 tx=0x7fe310009600 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 msgr2=0x7fe31819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe314005940 tx=0x7fe3140042f0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 shutdown_connections 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe3040b6680 0x7fe3040b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe31810de30 0x7fe31819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe318105320 0x7fe31819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 --2- 172.21.15.38:0/1247244575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3181049d0 0x7fe31819a640 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 >> 172.21.15.38:0/1247244575 conn(0x7fe318079740 msgr2=0x7fe3181007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 shutdown_connections 2024-09-21T06:24:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:22.887+0000 7fe31f4d8640 1 -- 172.21.15.38:0/1247244575 wait complete. 2024-09-21T06:24:23.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:22 smithi038 ceph-mon[31215]: pgmap v460: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T06:24:23.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:22 smithi174 ceph-mon[34815]: pgmap v460: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T06:24:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:22 smithi044 ceph-mon[34369]: pgmap v460: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T06:24:23.716 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:24:23.976 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:24.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 -- 172.21.15.38:0/2064095935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 msgr2=0x7f83a4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/2064095935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a4102e70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8394009900 tx=0x7f839402a410 comp rx=0 tx=0).stop 2024-09-21T06:24:24.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 -- 172.21.15.38:0/2064095935 shutdown_connections 2024-09-21T06:24:24.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/2064095935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 0x7f83a410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/2064095935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 0x7f83a41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/2064095935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a4102e70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 -- 172.21.15.38:0/2064095935 >> 172.21.15.38:0/2064095935 conn(0x7f83a4079730 msgr2=0x7f83a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 -- 172.21.15.38:0/2064095935 shutdown_connections 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.523+0000 7f83a9d2f640 1 -- 172.21.15.38:0/2064095935 wait complete. 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 Processor -- start 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 -- start start 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 0x7f83a41104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 0x7f83a4110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4113ba0 con 0x7f83a4102a60 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4113a20 con 0x7f83a41083a0 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a9d2f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4113d20 con 0x7f83a4108cf0 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44962/0 (socket says 172.21.15.38:44962) 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a37fe640 1 -- 172.21.15.38:0/3737303149 learned_addr learned my addr 172.21.15.38:0/3737303149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 0x7f83a41104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.524+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 0x7f83a4110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 -- 172.21.15.38:0/3737303149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 msgr2=0x7f83a4110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 0x7f83a4110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 -- 172.21.15.38:0/3737303149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 msgr2=0x7f83a41104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 0x7f83a41104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 -- 172.21.15.38:0/3737303149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a41a87d0 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8394005ab0 tx=0x7f83940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a0ff9640 1 -- 172.21.15.38:0/3737303149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839403f030 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a41a8a60 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a0ff9640 1 -- 172.21.15.38:0/3737303149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8394003cd0 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a0ff9640 1 -- 172.21.15.38:0/3737303149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394035070 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.525+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41a8f90 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 Processor -- start 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 -- start start 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83a0ff9640 1 -- 172.21.15.38:0/3737303149 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8394042030 con 0x7f83a4102a60 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562db355eea0 con 0x562db3241070 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562db354e2d0 con 0x562db3220390 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.528+0000 7f83b02a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562db35520e0 con 0x562db32181b0 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44978/0 (socket says 172.21.15.38:44978) 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 -- 172.21.15.38:0/3453548117 learned_addr learned my addr 172.21.15.38:0/3453548117 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 -- 172.21.15.38:0/3453548117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 msgr2=0x562db35e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35e8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 -- 172.21.15.38:0/3453548117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 msgr2=0x562db35e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 -- 172.21.15.38:0/3453548117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db32ac650 con 0x562db3241070 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f839c010370 tx=0x7f839c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314f17dfba14fafb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f83a0ff9640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 0x7f83900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f8399ffb640 1 -- 172.21.15.38:0/3453548117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c016070 con 0x562db3241070 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.529+0000 7f8399ffb640 1 -- 172.21.15.38:0/3453548117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f839c004d20 con 0x562db3241070 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f8399ffb640 1 -- 172.21.15.38:0/3453548117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c005400 con 0x562db3241070 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 0x7f83900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f83a0ff9640 1 -- 172.21.15.38:0/3737303149 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8394107b20 con 0x7f83a4102a60 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f83b02a3740 1 -- 172.21.15.38:0/3453548117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 msgr2=0x562db35e86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f83a37fe640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 0x7f83900b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83941053a0 tx=0x7f839410b670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.530+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f839c010370 tx=0x7f839c010830 comp rx=0 tx=0).stop 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 -- 172.21.15.38:0/3453548117 shutdown_connections 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3453548117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e86a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 -- 172.21.15.38:0/3453548117 >> 172.21.15.38:0/3453548117 conn(0x562db3235460 msgr2=0x562db35e6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 -- 172.21.15.38:0/3453548117 shutdown_connections 2024-09-21T06:24:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 -- 172.21.15.38:0/3453548117 wait complete. 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 -- start start 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.531+0000 7f83b02a3740 1 Processor -- start 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3220390 0x562db35fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3241070 0x562db36088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562db33af700 con 0x562db32181b0 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562db34e9160 con 0x562db3241070 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562db35ff5b0 con 0x562db3220390 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83b02a3740 10 client.0 _ll_register_callbacks cb 0x562db35029e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44990/0 (socket says 172.21.15.38:44990) 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 -- 172.21.15.38:0/1228683105 learned_addr learned my addr 172.21.15.38:0/1228683105 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3220390 0x562db35fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3241070 0x562db36088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 -- 172.21.15.38:0/1228683105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3220390 msgr2=0x562db35fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3220390 0x562db35fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 -- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3241070 msgr2=0x562db36088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3241070 0x562db36088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.532+0000 7f83a3fff640 1 -- 172.21.15.38:0/1228683105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db3516c90 con 0x562db32181b0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83a3fff640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f839c005cc0 tx=0x7f839c004fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882ec595cca2f4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c016070 con 0x562db32181b0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f839c012510 con 0x562db32181b0 2024-09-21T06:24:24.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c004d20 con 0x562db32181b0 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f839c012710 con 0x562db32181b0 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 10 client.16626 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562db360b300 con 0x562db32181b0 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f839c004d20 con 0x562db32181b0 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f839c00f040 con 0x562db32181b0 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 10 client.16626 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 10 client.16626 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 20 client.16626 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31ff9f0 0x562db360e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 4 client.16626 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.533+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562db3560df0 con 0x562db31ff9f0 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.534+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31ff9f0 0x562db360e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.534+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31ff9f0 0x562db360e660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56d153ce366644d8 server_cookie=72a9b04dfa469e68 in_seq=0 out_seq=0 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.534+0000 7f8382ffd640 10 client.16626 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f8382ffd640 1 -- 172.21.15.38:0/1228683105 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562db3560df0 con 0x562db31ff9f0 2024-09-21T06:24:24.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f8382ffd640 10 client.16626 handle_command_reply: tid=0 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 client.16626 shutdown 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 msgr2=0x562db35fc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f839c005cc0 tx=0x7f839c004fe0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 shutdown_connections 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31ff9f0 0x562db360e660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3241070 0x562db36088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3220390 0x562db35fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 --2- 172.21.15.38:0/1228683105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db32181b0 0x562db35fc570 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f8382ffd640 0 client.16626 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 >> 172.21.15.38:0/1228683105 conn(0x562db3235460 msgr2=0x562db35eb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 shutdown_connections 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 1 -- 172.21.15.38:0/1228683105 wait complete. 2024-09-21T06:24:24.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.535+0000 7f83b02a3740 20 client.16626 trim_cache size 0 max 16384 2024-09-21T06:24:24.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 Processor -- start 2024-09-21T06:24:24.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 -- start start 2024-09-21T06:24:24.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35fda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41afd30 con 0x562db3241070 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ad5a0 con 0x562db3220390 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.549+0000 7f83b02a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ab410 con 0x562db32181b0 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44994/0 (socket says 172.21.15.38:44994) 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 -- 172.21.15.38:0/3814973737 learned_addr learned my addr 172.21.15.38:0/3814973737 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 -- 172.21.15.38:0/3814973737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 msgr2=0x562db35fda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35fda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 -- 172.21.15.38:0/3814973737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 msgr2=0x562db35e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 -- 172.21.15.38:0/3814973737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562db35fe940 con 0x562db3241070 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f839c010db0 tx=0x7f839c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74362fb3d214a57b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83997fa640 1 -- 172.21.15.38:0/3814973737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c016030 con 0x562db3241070 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83997fa640 1 -- 172.21.15.38:0/3814973737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f839c01f030 con 0x562db3241070 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.550+0000 7f83997fa640 1 -- 172.21.15.38:0/3814973737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c02c0e0 con 0x562db3241070 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 -- 172.21.15.38:0/3814973737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 msgr2=0x562db35e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f839c010db0 tx=0x7f839c0021f0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 -- 172.21.15.38:0/3814973737 shutdown_connections 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3241070 0x562db35e6100 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db3220390 0x562db35e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3814973737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db32181b0 0x562db35fda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 -- 172.21.15.38:0/3814973737 >> 172.21.15.38:0/3814973737 conn(0x562db3235460 msgr2=0x562db35ec110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 -- 172.21.15.38:0/3814973737 shutdown_connections 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.551+0000 7f83b02a3740 1 -- 172.21.15.38:0/3814973737 wait complete. 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 -- start start 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 Processor -- start 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db32181b0 0x562db3611c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 0x562db360f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41aba60 con 0x562db3220390 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41aced0 con 0x562db32181b0 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ac130 con 0x562db3241070 2024-09-21T06:24:24.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83b02a3740 10 client.0 _ll_register_callbacks cb 0x7f839410b540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45010/0 (socket says 172.21.15.38:45010) 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.552+0000 7f83a2ffd640 1 -- 172.21.15.38:0/3102381564 learned_addr learned my addr 172.21.15.38:0/3102381564 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db32181b0 0x562db3611c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 0x562db360f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 -- 172.21.15.38:0/3102381564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 msgr2=0x562db360f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 0x562db360f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 -- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db32181b0 msgr2=0x562db3611c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db32181b0 0x562db3611c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 -- 172.21.15.38:0/3102381564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562db360fc70 con 0x562db3220390 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 0x562db360f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83a2ffd640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x562db33af7f0 tx=0x7f838c00bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cce786a9b4f0623 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:24.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f8382ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c003df0 con 0x562db3220390 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f838c003f90 con 0x562db3220390 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c01f030 con 0x562db3220390 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f838c01d420 con 0x562db3220390 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83b02a3740 10 client.16632 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:24.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.553+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562db3678bb0 con 0x562db3220390 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f839c01f030 con 0x562db3220390 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f838c024910 con 0x562db3220390 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 10 client.16632 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 10 client.16632 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 20 client.16632 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:24.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31d4da0 0x562db367b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 4 client.16632 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562db355c8a0 con 0x562db31d4da0 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.554+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31d4da0 0x562db367b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f8382ffd640 10 client.16632 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83a3fff640 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31d4da0 0x562db367b330 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d41f5e195e3c6ef server_cookie=847bd7e5ab492c47 in_seq=0 out_seq=0 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f8382ffd640 1 -- 172.21.15.38:0/3102381564 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562db355c8a0 con 0x562db31d4da0 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f8382ffd640 10 client.16632 handle_command_reply: tid=0 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 client.16632 shutdown 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 msgr2=0x562db360f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x562db33af7f0 tx=0x7f838c00bdb0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 shutdown_connections 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562db31d4da0 0x562db367b330 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562db3241070 0x562db360f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f8382ffd640 0 client.16632 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562db3220390 0x562db360f1a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 --2- 172.21.15.38:0/3102381564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562db32181b0 0x562db3611c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 >> 172.21.15.38:0/3102381564 conn(0x562db3235460 msgr2=0x562db35ec110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 shutdown_connections 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.555+0000 7f83b02a3740 1 -- 172.21.15.38:0/3102381564 wait complete. 2024-09-21T06:24:24.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83b02a3740 20 client.16632 trim_cache size 0 max 16384 2024-09-21T06:24:24.567 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:24.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 msgr2=0x7f83900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 0x7f83900b8b90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83941053a0 tx=0x7f839410b670 comp rx=0 tx=0).stop 2024-09-21T06:24:24.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 msgr2=0x7f83a410ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:24.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8394005ab0 tx=0x7f83940042f0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 shutdown_connections 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f83900b6680 0x7f83900b8b90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83a4108cf0 0x7f83a4110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f83a41083a0 0x7f83a41104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 --2- 172.21.15.38:0/3737303149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a4102a60 0x7f83a410ffb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 >> 172.21.15.38:0/3737303149 conn(0x7f83a4079730 msgr2=0x7f83a41013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 shutdown_connections 2024-09-21T06:24:24.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:24.556+0000 7f83a9d2f640 1 -- 172.21.15.38:0/3737303149 wait complete. 2024-09-21T06:24:25.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:24 smithi038 ceph-mon[31215]: pgmap v461: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:25.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:24:25.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:24 smithi174 ceph-mon[34815]: pgmap v461: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:25.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:24 smithi044 ceph-mon[34369]: pgmap v461: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:25.553 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.038+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3515387308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc103b60 msgr2=0x7fa9cc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.038+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3515387308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc103b60 0x7fa9cc103f70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009900 tx=0x7fa9bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3515387308 shutdown_connections 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3515387308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc109df0 0x7fa9cc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3515387308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 0x7fa9cc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3515387308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc103b60 0x7fa9cc103f70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3515387308 >> 172.21.15.38:0/3515387308 conn(0x7fa9cc07b850 msgr2=0x7fa9cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3515387308 shutdown_connections 2024-09-21T06:24:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3515387308 wait complete. 2024-09-21T06:24:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 Processor -- start 2024-09-21T06:24:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.039+0000 7fa9d23bf640 1 -- start start 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc103b60 0x7fa9cc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 0x7fa9cc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc113bd0 con 0x7fa9cc109df0 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc113a50 con 0x7fa9cc1094a0 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d23bf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc113d50 con 0x7fa9cc103b60 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45032/0 (socket says 172.21.15.38:45032) 2024-09-21T06:24:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 -- 172.21.15.38:0/3557355694 learned_addr learned my addr 172.21.15.38:0/3557355694 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc103b60 0x7fa9cc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 0x7fa9cc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 -- 172.21.15.38:0/3557355694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc103b60 msgr2=0x7fa9cc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc103b60 0x7fa9cc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 -- 172.21.15.38:0/3557355694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 msgr2=0x7fa9cc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 0x7fa9cc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.040+0000 7fa9d095c640 1 -- 172.21.15.38:0/3557355694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc1a0550 con 0x7fa9cc109df0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9d095c640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400eaa0 tx=0x7fa9c400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9c97fa640 1 -- 172.21.15.38:0/3557355694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400cdb0 con 0x7fa9cc109df0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9c97fa640 1 -- 172.21.15.38:0/3557355694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9c4005020 con 0x7fa9cc109df0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc1a0840 con 0x7fa9cc109df0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9c97fa640 1 -- 172.21.15.38:0/3557355694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40116d0 con 0x7fa9cc109df0 2024-09-21T06:24:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.041+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1a6fa0 con 0x7fa9cc109df0 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.043+0000 7fa9d8933740 1 Processor -- start 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9c97fa640 1 -- 172.21.15.38:0/3557355694 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa9c40051d0 con 0x7fa9cc109df0 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 -- start start 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e12e0390 0x5586e16a9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586e161eea0 con 0x5586e1301070 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586e160e2d0 con 0x5586e12d81b0 2024-09-21T06:24:26.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9d8933740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586e16120e0 con 0x5586e12e0390 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45040/0 (socket says 172.21.15.38:45040) 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/3575784856 learned_addr learned my addr 172.21.15.38:0/3575784856 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/3575784856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e12e0390 msgr2=0x5586e16a9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.044+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e12e0390 0x5586e16a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/3575784856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 msgr2=0x5586e16a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16a8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/3575784856 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e136c650 con 0x5586e1301070 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9c97fa640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 0x7fa9b40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 0x7fa9b40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000bcd0 tx=0x7fa9c0011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a676e3f4f506fbc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9c97fa640 1 -- 172.21.15.38:0/3557355694 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa9c40e7850 con 0x7fa9cc109df0 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9b27fc640 1 -- 172.21.15.38:0/3575784856 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c001a400 con 0x5586e1301070 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9b27fc640 1 -- 172.21.15.38:0/3575784856 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9c001aa70 con 0x5586e1301070 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.045+0000 7fa9b27fc640 1 -- 172.21.15.38:0/3575784856 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0012a90 con 0x5586e1301070 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- 172.21.15.38:0/3575784856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 msgr2=0x5586e16a86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 0x7fa9b40b8c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009230 tx=0x7fa9bc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000bcd0 tx=0x7fa9c0011750 comp rx=0 tx=0).stop 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- 172.21.15.38:0/3575784856 shutdown_connections 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e12e0390 0x5586e16a9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3575784856 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e1301070 0x5586e16a86a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- 172.21.15.38:0/3575784856 >> 172.21.15.38:0/3575784856 conn(0x5586e12f5460 msgr2=0x5586e16a6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- 172.21.15.38:0/3575784856 shutdown_connections 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- 172.21.15.38:0/3575784856 wait complete. 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.046+0000 7fa9d8933740 1 -- start start 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 Processor -- start 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586e146f700 con 0x5586e12d81b0 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586e15a9160 con 0x5586e12e0390 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586e16b6e80 con 0x5586e1301070 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d8933740 10 client.0 _ll_register_callbacks cb 0x5586e15c29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45054/0 (socket says 172.21.15.38:45054) 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9cbfff640 1 -- 172.21.15.38:0/323704453 learned_addr learned my addr 172.21.15.38:0/323704453 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.047+0000 7fa9d095c640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 -- 172.21.15.38:0/323704453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 msgr2=0x5586e16c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 -- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 msgr2=0x5586e16b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 -- 172.21.15.38:0/323704453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e15d6c90 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9d095c640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc033000 tx=0x7fa9bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda6c2d7e7ec4e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc04c030 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa9bc004310 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c001aa70 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9bc035040 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9d8933740 10 client.16644 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586e16c2b50 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.048+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9c001aa70 con 0x5586e12d81b0 2024-09-21T06:24:26.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa9bc0485d0 con 0x5586e12d81b0 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 10 client.16644 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 20 client.16644 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e12bf9f0 0x5586e16c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 4 client.16644 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586e1620df0 con 0x5586e12bf9f0 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e12bf9f0 0x5586e16c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e12bf9f0 0x5586e16c60c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b993cbcc487cf7 server_cookie=73e835b8d49ef19d in_seq=0 out_seq=0 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.049+0000 7fa9ab7fe640 10 client.16644 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.050+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/323704453 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586e1620df0 con 0x5586e12bf9f0 2024-09-21T06:24:26.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.050+0000 7fa9ab7fe640 10 client.16644 handle_command_reply: tid=0 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.050+0000 7fa9d8933740 1 client.16644 shutdown 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.050+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 msgr2=0x5586e16b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.050+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc033000 tx=0x7fa9bc009260 comp rx=0 tx=0).stop 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 shutdown_connections 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e12bf9f0 0x5586e16c60c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 --2- 172.21.15.38:0/323704453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3d70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 >> 172.21.15.38:0/323704453 conn(0x5586e12f5460 msgr2=0x5586e16ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9ab7fe640 0 client.16644 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 shutdown_connections 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 1 -- 172.21.15.38:0/323704453 wait complete. 2024-09-21T06:24:26.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.051+0000 7fa9d8933740 20 client.16644 trim_cache size 0 max 16384 2024-09-21T06:24:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 Processor -- start 2024-09-21T06:24:26.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 -- start start 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1b2020 con 0x5586e12d81b0 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1af890 con 0x5586e12e0390 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9d8933740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1ad6e0 con 0x5586e1301070 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9cbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45070/0 (socket says 172.21.15.38:45070) 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.064+0000 7fa9cbfff640 1 -- 172.21.15.38:0/3659496930 learned_addr learned my addr 172.21.15.38:0/3659496930 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 -- 172.21.15.38:0/3659496930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 msgr2=0x5586e16a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 -- 172.21.15.38:0/3659496930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 msgr2=0x5586e16b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 -- 172.21.15.38:0/3659496930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586e16b4e10 con 0x5586e12d81b0 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc03c460 tx=0x7fa9bc0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c78c4d8a7a460ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9b1ffb640 1 -- 172.21.15.38:0/3659496930 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc04c040 con 0x5586e12d81b0 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9b1ffb640 1 -- 172.21.15.38:0/3659496930 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9bc0035f0 con 0x5586e12d81b0 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.065+0000 7fa9b1ffb640 1 -- 172.21.15.38:0/3659496930 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc03c690 con 0x5586e12d81b0 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- 172.21.15.38:0/3659496930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 msgr2=0x5586e16b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc03c460 tx=0x7fa9bc0045d0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- 172.21.15.38:0/3659496930 shutdown_connections 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12e0390 0x5586e16b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 --2- 172.21.15.38:0/3659496930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12d81b0 0x5586e16b3b20 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- 172.21.15.38:0/3659496930 >> 172.21.15.38:0/3659496930 conn(0x5586e12f5460 msgr2=0x5586e16b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- 172.21.15.38:0/3659496930 shutdown_connections 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- 172.21.15.38:0/3659496930 wait complete. 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.066+0000 7fa9d8933740 1 -- start start 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 Processor -- start 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1add50 con 0x5586e12e0390 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1af1c0 con 0x5586e12d81b0 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc1ae420 con 0x5586e1301070 2024-09-21T06:24:26.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d8933740 10 client.0 _ll_register_callbacks cb 0x7fa9bc009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45078/0 (socket says 172.21.15.38:45078) 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/2857770365 learned_addr learned my addr 172.21.15.38:0/2857770365 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9d095c640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/2857770365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 msgr2=0x5586e16b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 msgr2=0x5586e16bc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.067+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16bc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9cb7fe640 1 -- 172.21.15.38:0/2857770365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586e16b8850 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9d095c640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9cb7fe640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000bca0 tx=0x7fa9c000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a167857da13e8187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0032060 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa9c0004230 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9bc0035f0 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9c0004430 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9d8933740 10 client.16650 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586e17308b0 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.068+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9bc0035f0 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fa9c00127a0 con 0x5586e12e0390 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 10 client.16650 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:26.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 20 client.16650 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e1294da0 0x5586e1732dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 4 client.16650 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586e161c8a0 con 0x5586e1294da0 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e1294da0 0x5586e1732dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9cbfff640 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e1294da0 0x5586e1732dc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62cddea5e872b9ee server_cookie=d48c80b7567e860e in_seq=0 out_seq=0 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.069+0000 7fa9ab7fe640 10 client.16650 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9ab7fe640 1 -- 172.21.15.38:0/2857770365 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586e161c8a0 con 0x5586e1294da0 2024-09-21T06:24:26.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9ab7fe640 10 client.16650 handle_command_reply: tid=0 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 client.16650 shutdown 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 msgr2=0x5586e16b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000bca0 tx=0x7fa9c000b4b0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 shutdown_connections 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586e1294da0 0x5586e1732dc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586e1301070 0x5586e16b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586e12e0390 0x5586e16b7ca0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9ab7fe640 0 client.16650 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 --2- 172.21.15.38:0/2857770365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586e12d81b0 0x5586e16bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 >> 172.21.15.38:0/2857770365 conn(0x5586e12f5460 msgr2=0x5586e16b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 shutdown_connections 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 1 -- 172.21.15.38:0/2857770365 wait complete. 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.070+0000 7fa9d8933740 20 client.16650 trim_cache size 0 max 16384 2024-09-21T06:24:26.081 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 msgr2=0x7fa9b40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 0x7fa9b40b8c10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009230 tx=0x7fa9bc0058d0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 msgr2=0x7fa9cc19fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400eaa0 tx=0x7fa9c400ef60 comp rx=0 tx=0).stop 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 shutdown_connections 2024-09-21T06:24:26.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9b40b6700 0x7fa9b40b8c10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9cc109df0 0x7fa9cc19fe20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc1094a0 0x7fa9cc19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 --2- 172.21.15.38:0/3557355694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9cc103b60 0x7fa9cc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 >> 172.21.15.38:0/3557355694 conn(0x7fa9cc07b850 msgr2=0x7fa9cc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 shutdown_connections 2024-09-21T06:24:26.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:26.071+0000 7fa9d23bf640 1 -- 172.21.15.38:0/3557355694 wait complete. 2024-09-21T06:24:26.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:26 smithi038 ceph-mon[31215]: pgmap v462: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:27.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:26 smithi174 ceph-mon[34815]: pgmap v462: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:27.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:26 smithi044 ceph-mon[34369]: pgmap v462: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:27.768 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:24:27.768 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:24:28.042 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 -- 172.21.15.38:0/937932629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe701100c0 msgr2=0x7fbe70112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 --2- 172.21.15.38:0/937932629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe701100c0 0x7fbe70112500 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009ca0 tx=0x7fbe6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 -- 172.21.15.38:0/937932629 shutdown_connections 2024-09-21T06:24:28.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 --2- 172.21.15.38:0/937932629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe701100c0 0x7fbe70112500 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 --2- 172.21.15.38:0/937932629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe70076100 0x7fbe7010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 --2- 172.21.15.38:0/937932629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe70075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 -- 172.21.15.38:0/937932629 >> 172.21.15.38:0/937932629 conn(0x7fbe7007b850 msgr2=0x7fbe7007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 -- 172.21.15.38:0/937932629 shutdown_connections 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.641+0000 7fbe77459640 1 -- 172.21.15.38:0/937932629 wait complete. 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 Processor -- start 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 -- start start 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe7019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe701100c0 0x7fbe701a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70115d90 con 0x7fbe70076100 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70115c10 con 0x7fbe701100c0 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.642+0000 7fbe77459640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70115f10 con 0x7fbe700757b0 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45086/0 (socket says 172.21.15.38:45086) 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 -- 172.21.15.38:0/1619857784 learned_addr learned my addr 172.21.15.38:0/1619857784 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe751f5640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe7019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe759f6640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe701100c0 0x7fbe701a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 -- 172.21.15.38:0/1619857784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 msgr2=0x7fbe7019c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe7019c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 -- 172.21.15.38:0/1619857784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe701100c0 msgr2=0x7fbe701a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe701100c0 0x7fbe701a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 -- 172.21.15.38:0/1619857784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe701a2730 con 0x7fbe70076100 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe751f5640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe7019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:28.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe749f4640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000e9c0 tx=0x7fbe6000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe667fc640 1 -- 172.21.15.38:0/1619857784 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000cd80 con 0x7fbe70076100 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe667fc640 1 -- 172.21.15.38:0/1619857784 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe600035f0 con 0x7fbe70076100 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe667fc640 1 -- 172.21.15.38:0/1619857784 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60010690 con 0x7fbe70076100 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe701a2a20 con 0x7fbe70076100 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.643+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe701a9180 con 0x7fbe70076100 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 Processor -- start 2024-09-21T06:24:28.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 -- start start 2024-09-21T06:24:28.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe667fc640 1 -- 172.21.15.38:0/1619857784 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbe600037a0 con 0x7fbe70076100 2024-09-21T06:24:28.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f479350 0x56004f820430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56004f796e60 con 0x56004f458670 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56004f786290 con 0x56004f450490 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.647+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56004f78a0a0 con 0x56004f479350 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe751f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45094/0 (socket says 172.21.15.38:45094) 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe751f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:44296/0 (socket says 172.21.15.38:44296) 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 -- 172.21.15.38:0/2525534981 learned_addr learned my addr 172.21.15.38:0/2525534981 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe759f6640 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f479350 0x56004f820430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 -- 172.21.15.38:0/2525534981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f479350 msgr2=0x56004f820430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f479350 0x56004f820430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 -- 172.21.15.38:0/2525534981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 msgr2=0x56004f820970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 -- 172.21.15.38:0/2525534981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56004f4e4930 con 0x56004f458670 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe751f5640 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbe600e5250 tx=0x7fbe600f0650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56fd39cab9ec67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.648+0000 7fbe667fc640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 0x7fbe5c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.649+0000 7fbe759f6640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 0x7fbe5c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.649+0000 7fbe667fc640 1 -- 172.21.15.38:0/1619857784 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbe600e7b10 con 0x7fbe70076100 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.649+0000 7fbe5b7fe640 1 -- 172.21.15.38:0/2525534981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe600f7020 con 0x56004f458670 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.649+0000 7fbe5b7fe640 1 -- 172.21.15.38:0/2525534981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe600f0e50 con 0x56004f458670 2024-09-21T06:24:28.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.649+0000 7fbe5b7fe640 1 -- 172.21.15.38:0/2525534981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe600ec040 con 0x56004f458670 2024-09-21T06:24:28.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2525534981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 msgr2=0x56004f820eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe759f6640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 0x7fbe5c0b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005e30 tx=0x7fbe68005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbe600e5250 tx=0x7fbe600f0650 comp rx=0 tx=0).stop 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2525534981 shutdown_connections 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f820eb0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f450490 0x56004f820970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2525534981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f479350 0x56004f820430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2525534981 >> 172.21.15.38:0/2525534981 conn(0x56004f46d740 msgr2=0x56004f81e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2525534981 shutdown_connections 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2525534981 wait complete. 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 -- start start 2024-09-21T06:24:28.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.650+0000 7fbe7d9cd740 1 Processor -- start 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 0x56004f82bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 0x56004f82c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f837f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56004f5e7890 con 0x56004f450490 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56004f720d40 con 0x56004f479350 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56004f82ec10 con 0x56004f458670 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe7d9cd740 10 client.0 _ll_register_callbacks cb 0x56004f784c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 0x56004f82c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 0x56004f82c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:57344/0 (socket says 172.21.15.38:57344) 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe749f4640 1 -- 172.21.15.38:0/3649116514 learned_addr learned my addr 172.21.15.38:0/3649116514 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe759f6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f837f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.651+0000 7fbe751f5640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 0x56004f82bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 -- 172.21.15.38:0/3649116514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 msgr2=0x56004f82c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 0x56004f82c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 -- 172.21.15.38:0/3649116514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 msgr2=0x56004f82bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 0x56004f82bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 -- 172.21.15.38:0/3649116514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004f838520 con 0x56004f479350 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe751f5640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 0x56004f82bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe759f6640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f837f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe68006010 tx=0x7fbe6802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7381e31edc5cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68031720 con 0x56004f479350 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe600f0e50 con 0x56004f479350 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbe680318c0 con 0x56004f479350 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.652+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe68004040 con 0x56004f479350 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 10 client.26225 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:28.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56004f83ae30 con 0x56004f479350 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe600f0e50 con 0x56004f479350 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbe68051070 con 0x56004f479350 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 10 client.26225 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 10 client.26225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 20 client.26225 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f437cd0 0x56004f83e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 4 client.26225 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56004f798db0 con 0x56004f437cd0 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.653+0000 7fbe751f5640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f437cd0 0x56004f83e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.654+0000 7fbe751f5640 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f437cd0 0x56004f83e3e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148ca4b5e8f11557 server_cookie=e8f1a634fdeaeb66 in_seq=0 out_seq=0 2024-09-21T06:24:28.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.654+0000 7fbe58ff9640 10 client.26225 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:28.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.654+0000 7fbe58ff9640 1 -- 172.21.15.38:0/3649116514 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56004f798db0 con 0x56004f437cd0 2024-09-21T06:24:28.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.654+0000 7fbe58ff9640 10 client.26225 handle_command_reply: tid=0 2024-09-21T06:24:28.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 client.26225 shutdown 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 msgr2=0x56004f837f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f837f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe68006010 tx=0x7fbe6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 shutdown_connections 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f837f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f437cd0 0x56004f83e3e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f458670 0x56004f82c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/3649116514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f450490 0x56004f82bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 >> 172.21.15.38:0/3649116514 conn(0x56004f46d740 msgr2=0x56004f8235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe58ff9640 0 client.26225 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 shutdown_connections 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/3649116514 wait complete. 2024-09-21T06:24:28.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.655+0000 7fbe7d9cd740 20 client.26225 trim_cache size 0 max 16384 2024-09-21T06:24:28.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 Processor -- start 2024-09-21T06:24:28.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 -- start start 2024-09-21T06:24:28.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f826550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 0x56004f837e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701b41e0 con 0x56004f479350 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701b1a50 con 0x56004f458670 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701af8a0 con 0x56004f450490 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe759f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe759f6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45124/0 (socket says 172.21.15.38:45124) 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe759f6640 1 -- 172.21.15.38:0/426278346 learned_addr learned my addr 172.21.15.38:0/426278346 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe751f5640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f826550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.673+0000 7fbe749f4640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 0x56004f837e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 -- 172.21.15.38:0/426278346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 msgr2=0x56004f826550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f826550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 -- 172.21.15.38:0/426278346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 msgr2=0x56004f837e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 0x56004f837e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 -- 172.21.15.38:0/426278346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56004f822720 con 0x56004f479350 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe749f4640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 0x56004f837e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:28.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe759f6640 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005cc0 tx=0x7fbe68032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b22fda51feffa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe5affd640 1 -- 172.21.15.38:0/426278346 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68060030 con 0x56004f479350 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe5affd640 1 -- 172.21.15.38:0/426278346 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe68036040 con 0x56004f479350 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.674+0000 7fbe5affd640 1 -- 172.21.15.38:0/426278346 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6802f8c0 con 0x56004f479350 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/426278346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 msgr2=0x56004f828fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005cc0 tx=0x7fbe68032f70 comp rx=0 tx=0).stop 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/426278346 shutdown_connections 2024-09-21T06:24:28.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f479350 0x56004f828fe0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f458670 0x56004f837e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/426278346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f826550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/426278346 >> 172.21.15.38:0/426278346 conn(0x56004f46d740 msgr2=0x56004f82a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/426278346 shutdown_connections 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/426278346 wait complete. 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.675+0000 7fbe7d9cd740 1 -- start start 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 Processor -- start 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f8300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f8a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701aff10 con 0x56004f458670 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701b1380 con 0x56004f479350 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701b05e0 con 0x56004f450490 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe7d9cd740 10 client.0 _ll_register_callbacks cb 0x7fbe68009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:28.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe749f4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45132/0 (socket says 172.21.15.38:45132) 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe749f4640 1 -- 172.21.15.38:0/2616688506 learned_addr learned my addr 172.21.15.38:0/2616688506 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe751f5640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f8300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.676+0000 7fbe759f6640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f8a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 -- 172.21.15.38:0/2616688506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 msgr2=0x56004f8300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f8300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 -- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 msgr2=0x56004f8a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f8a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 -- 172.21.15.38:0/2616688506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56004f830df0 con 0x56004f458670 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe751f5640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f8300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe749f4640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbe600e5390 tx=0x7fbe60003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5203e9a335b14cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe600f7070 con 0x56004f458670 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fbe600b6f70 con 0x56004f458670 2024-09-21T06:24:28.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe68036040 con 0x56004f458670 2024-09-21T06:24:28.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbe600ad330 con 0x56004f458670 2024-09-21T06:24:28.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe7d9cd740 10 client.16668 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:28.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.677+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56004f8a9310 con 0x56004f458670 2024-09-21T06:24:28.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe68036040 con 0x56004f458670 2024-09-21T06:24:28.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbe600f2040 con 0x56004f458670 2024-09-21T06:24:28.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 10 client.16668 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 20 client.16668 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f40d080 0x56004f8ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 4 client.16668 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56004f794860 con 0x56004f40d080 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.678+0000 7fbe751f5640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f40d080 0x56004f8ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.679+0000 7fbe58ff9640 10 client.16668 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.679+0000 7fbe751f5640 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f40d080 0x56004f8ab6c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293da683f8085bc2 server_cookie=45a364eebde244e in_seq=0 out_seq=0 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.680+0000 7fbe58ff9640 1 -- 172.21.15.38:0/2616688506 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56004f794860 con 0x56004f40d080 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.680+0000 7fbe58ff9640 10 client.16668 handle_command_reply: tid=0 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.680+0000 7fbe7d9cd740 1 client.16668 shutdown 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 msgr2=0x56004f830600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbe600e5390 tx=0x7fbe60003e90 comp rx=0 tx=0).stop 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 shutdown_connections 2024-09-21T06:24:28.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56004f479350 0x56004f8a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56004f458670 0x56004f830600 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56004f40d080 0x56004f8ab6c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 --2- 172.21.15.38:0/2616688506 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56004f450490 0x56004f8300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 >> 172.21.15.38:0/2616688506 conn(0x56004f46d740 msgr2=0x56004f82d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe58ff9640 0 client.16668 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 shutdown_connections 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.681+0000 7fbe7d9cd740 1 -- 172.21.15.38:0/2616688506 wait complete. 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe7d9cd740 20 client.16668 trim_cache size 0 max 16384 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:24:28.685 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e", 2024-09-21T06:24:28.686 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:24:28.686 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:28.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 msgr2=0x7fbe5c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 0x7fbe5c0b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005e30 tx=0x7fbe68005c30 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 msgr2=0x7fbe7019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000e9c0 tx=0x7fbe6000ee80 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 shutdown_connections 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe5c0b6700 0x7fbe5c0b8c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe701100c0 0x7fbe701a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe70076100 0x7fbe7019cd60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 --2- 172.21.15.38:0/1619857784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe700757b0 0x7fbe7019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 >> 172.21.15.38:0/1619857784 conn(0x7fbe7007b850 msgr2=0x7fbe70108580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 shutdown_connections 2024-09-21T06:24:28.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:28.682+0000 7fbe77459640 1 -- 172.21.15.38:0/1619857784 wait complete. 2024-09-21T06:24:29.200 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:28 smithi038 ceph-mon[31215]: pgmap v463: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:29.206 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:28 smithi044 ceph-mon[34369]: pgmap v463: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:29.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:24:29.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:28 smithi174 ceph-mon[34815]: pgmap v463: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:24:30.029 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:29 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:24:30.030 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:29 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.030 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:29 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:24:30.030 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:29 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3140239990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 msgr2=0x7f9d2810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3140239990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2810f540 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009ca0 tx=0x7f9d2002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3140239990 shutdown_connections 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3140239990 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2810f540 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3140239990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 0x7f9d281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3140239990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 0x7f9d28102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3140239990 >> 172.21.15.38:0/3140239990 conn(0x7f9d28079740 msgr2=0x7f9d28079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3140239990 shutdown_connections 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.123+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3140239990 wait complete. 2024-09-21T06:24:30.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.124+0000 7f9d2e8e5640 1 Processor -- start 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.124+0000 7f9d2e8e5640 1 -- start start 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 0x7f9d2819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 0x7f9d2819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28112ac0 con 0x7f9d28108d10 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28112940 con 0x7f9d281083c0 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2e8e5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28112c40 con 0x7f9d28102a80 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58584/0 (socket says 172.21.15.38:58584) 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3941069316 learned_addr learned my addr 172.21.15.38:0/3941069316 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 0x7f9d2819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 0x7f9d2819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3941069316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 msgr2=0x7f9d2819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 0x7f9d2819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3941069316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 msgr2=0x7f9d2819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 0x7f9d2819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3941069316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d281a6550 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.125+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9d20005e30 tx=0x7f9d20003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.126+0000 7f9d257fa640 1 -- 172.21.15.38:0/3941069316 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20031650 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.126+0000 7f9d257fa640 1 -- 172.21.15.38:0/3941069316 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d200317f0 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.126+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d281a67e0 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.126+0000 7f9d257fa640 1 -- 172.21.15.38:0/3941069316 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2002fb70 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.126+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281a6d20 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.129+0000 7f9d34e59740 1 Processor -- start 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.129+0000 7f9d257fa640 1 -- 172.21.15.38:0/3941069316 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9d2002fd70 con 0x7f9d28108d10 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.129+0000 7f9d34e59740 1 -- start start 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.129+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f2b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.129+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f2c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d34e59740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559f57ea1e50 con 0x559f57b5b1b0 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d34e59740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f57e91280 con 0x559f57b63390 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d34e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559f57e95090 con 0x559f57b84070 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58586/0 (socket says 172.21.15.38:58586) 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 -- 172.21.15.38:0/758718137 learned_addr learned my addr 172.21.15.38:0/758718137 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d277fe640 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f2c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d277fe640 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f2b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 -- 172.21.15.38:0/758718137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 msgr2=0x559f57f2b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f2b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 -- 172.21.15.38:0/758718137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 msgr2=0x559f57f2c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f2c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 -- 172.21.15.38:0/758718137 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f57bef650 con 0x559f57b5b1b0 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d257fa640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 0x7f9d100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d27fff640 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004650 tx=0x7f9d1800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba8fd0698552e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 0x7f9d100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d257fa640 1 -- 172.21.15.38:0/3941069316 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9d20108910 con 0x7f9d28108d10 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.130+0000 7f9d0e7fc640 1 -- 172.21.15.38:0/758718137 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18003bd0 con 0x559f57b5b1b0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d0e7fc640 1 -- 172.21.15.38:0/758718137 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d18015070 con 0x559f57b5b1b0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d0e7fc640 1 -- 172.21.15.38:0/758718137 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18004de0 con 0x559f57b5b1b0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 -- 172.21.15.38:0/758718137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 msgr2=0x559f57f2bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 0x7f9d100b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005d00 tx=0x7f9d1c005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004650 tx=0x7f9d1800bba0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 -- 172.21.15.38:0/758718137 shutdown_connections 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f2c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f2bb90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 --2- 172.21.15.38:0/758718137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f2b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.131+0000 7f9d34e59740 1 -- 172.21.15.38:0/758718137 >> 172.21.15.38:0/758718137 conn(0x559f57b78460 msgr2=0x559f57f29540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.132+0000 7f9d34e59740 1 -- 172.21.15.38:0/758718137 shutdown_connections 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.132+0000 7f9d34e59740 1 -- 172.21.15.38:0/758718137 wait complete. 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.132+0000 7f9d34e59740 1 -- start start 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.132+0000 7f9d34e59740 1 Processor -- start 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559f57cf2700 con 0x559f57b5b1b0 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f57e2c110 con 0x559f57b63390 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559f57f39e30 con 0x559f57b84070 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d34e59740 10 client.0 _ll_register_callbacks cb 0x559f57e45990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58598/0 (socket says 172.21.15.38:58598) 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 -- 172.21.15.38:0/3880604196 learned_addr learned my addr 172.21.15.38:0/3880604196 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 -- 172.21.15.38:0/3880604196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 msgr2=0x559f57f43120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f43120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 -- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 msgr2=0x559f57f37250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f37250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 -- 172.21.15.38:0/3880604196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f57e59c40 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d18004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5481451e93bdb20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.133+0000 7f9d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18028060 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9d18011640 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d18015070 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d18011840 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 10 client.16680 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559f57f45b40 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d18015070 con 0x559f57b5b1b0 2024-09-21T06:24:30.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9d18022070 con 0x559f57b5b1b0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 10 client.16680 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 20 client.16680 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b429f0 0x559f57f48f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 4 client.16680 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.134+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f57ea3da0 con 0x559f57b429f0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.135+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b429f0 0x559f57f48f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.135+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b429f0 0x559f57f48f50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a379dfb19eb532af server_cookie=82b80488738538f0 in_seq=0 out_seq=0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.135+0000 7f9d077fe640 10 client.16680 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d077fe640 1 -- 172.21.15.38:0/3880604196 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f57ea3da0 con 0x559f57b429f0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d077fe640 10 client.16680 handle_command_reply: tid=0 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 client.16680 shutdown 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 msgr2=0x559f57f36d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006010 tx=0x7f9d18004430 comp rx=0 tx=0).stop 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 shutdown_connections 2024-09-21T06:24:30.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b429f0 0x559f57f48f50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b84070 0x559f57f43120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d077fe640 0 client.16680 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b63390 0x559f57f37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3880604196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b5b1b0 0x559f57f36d10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.136+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 >> 172.21.15.38:0/3880604196 conn(0x559f57b78460 msgr2=0x559f57f2e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.137+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 shutdown_connections 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.137+0000 7f9d34e59740 1 -- 172.21.15.38:0/3880604196 wait complete. 2024-09-21T06:24:30.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.137+0000 7f9d34e59740 20 client.16680 trim_cache size 0 max 16384 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.154+0000 7f9d34e59740 1 Processor -- start 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.154+0000 7f9d34e59740 1 -- start start 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b5b1b0 0x559f57f38940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 0x559f57f28b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281b1ef0 con 0x559f57b429f0 2024-09-21T06:24:30.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281af760 con 0x559f57b5b1b0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d34e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281ad5b0 con 0x559f57b63390 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58604/0 (socket says 172.21.15.38:58604) 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 -- 172.21.15.38:0/3737250154 learned_addr learned my addr 172.21.15.38:0/3737250154 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b5b1b0 0x559f57f38940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 0x559f57f28b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 -- 172.21.15.38:0/3737250154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 msgr2=0x559f57f28b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 0x559f57f28b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 -- 172.21.15.38:0/3737250154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b5b1b0 msgr2=0x559f57f38940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b5b1b0 0x559f57f38940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 -- 172.21.15.38:0/3737250154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f57f37db0 con 0x559f57b429f0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 0x559f57f28b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800bbe0 tx=0x7f9d18001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b1c0e431197617 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3737250154 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18028050 con 0x559f57b429f0 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3737250154 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d18015070 con 0x559f57b429f0 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.155+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3737250154 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1802d690 con 0x559f57b429f0 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 -- 172.21.15.38:0/3737250154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 msgr2=0x559f57f35c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800bbe0 tx=0x7f9d18001e50 comp rx=0 tx=0).stop 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 -- 172.21.15.38:0/3737250154 shutdown_connections 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b63390 0x559f57f28b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b5b1b0 0x559f57f38940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3737250154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b429f0 0x559f57f35c00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 -- 172.21.15.38:0/3737250154 >> 172.21.15.38:0/3737250154 conn(0x559f57b78460 msgr2=0x559f57f38230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 -- 172.21.15.38:0/3737250154 shutdown_connections 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.156+0000 7f9d34e59740 1 -- 172.21.15.38:0/3737250154 wait complete. 2024-09-21T06:24:30.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 -- start start 2024-09-21T06:24:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 Processor -- start 2024-09-21T06:24:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b429f0 0x559f57f49ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b5b1b0 0x559f57f4a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281adc20 con 0x559f57b63390 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281af090 con 0x559f57b429f0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d281ae2f0 con 0x559f57b5b1b0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d34e59740 10 client.0 _ll_register_callbacks cb 0x7f9d1c00ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.157+0000 7f9d2ce82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58616/0 (socket says 172.21.15.38:58616) 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3681186963 learned_addr learned my addr 172.21.15.38:0/3681186963 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b429f0 0x559f57f49ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d277fe640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b5b1b0 0x559f57f4a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3681186963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b5b1b0 msgr2=0x559f57f4a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b5b1b0 0x559f57f4a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b429f0 msgr2=0x559f57f49ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b429f0 0x559f57f49ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 -- 172.21.15.38:0/3681186963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f57fb26d0 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d2ce82640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ce4e0 tx=0x7f9d200caf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed4ef17dfe6c637 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d077fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200cdf50 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9d200d7f70 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d18015070 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d200ce2f0 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.158+0000 7f9d34e59740 10 client.16686 fetch_fsmap learned FSMap version 30 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559f57fb38a0 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d18015070 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9d200ca130 con 0x559f57b63390 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 10 client.16686 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:24:30.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 20 client.16686 populate_metadata read hostname 'smithi038' 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b84070 0x559f57fb6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 4 client.16686 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f57e9f850 con 0x559f57b84070 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.159+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b84070 0x559f57fb6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d27fff640 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b84070 0x559f57fb6110 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42842000d6bc993 server_cookie=6387ab4131db7220 in_seq=0 out_seq=0 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d077fe640 10 client.16686 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d077fe640 1 -- 172.21.15.38:0/3681186963 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x559f57e9f850 con 0x559f57b84070 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d077fe640 10 client.16686 handle_command_reply: tid=0 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 client.16686 shutdown 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 msgr2=0x559f57f4a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ce4e0 tx=0x7f9d200caf60 comp rx=0 tx=0).stop 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 shutdown_connections 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559f57b63390 0x559f57f4a970 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559f57b84070 0x559f57fb6110 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559f57b5b1b0 0x559f57f4a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 --2- 172.21.15.38:0/3681186963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f57b429f0 0x559f57f49ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 >> 172.21.15.38:0/3681186963 conn(0x559f57b78460 msgr2=0x559f57f2e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.160+0000 7f9d077fe640 0 client.16686 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 shutdown_connections 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d34e59740 1 -- 172.21.15.38:0/3681186963 wait complete. 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d34e59740 20 client.16686 trim_cache size 0 max 16384 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:24:30.168 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e", 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.169 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.170 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.171 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.172 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:24:30.173 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:24:30.174 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:24:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 msgr2=0x7f9d100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 0x7f9d100b8b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005d00 tx=0x7f9d1c005c90 comp rx=0 tx=0).stop 2024-09-21T06:24:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 msgr2=0x7f9d2819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:24:30.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9d20005e30 tx=0x7f9d20003f90 comp rx=0 tx=0).stop 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 shutdown_connections 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9d100b6680 0x7f9d100b8b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.161+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d28108d10 0x7f9d2819bd10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.162+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d281083c0 0x7f9d2819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.162+0000 7f9d2e8e5640 1 --2- 172.21.15.38:0/3941069316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d28102a80 0x7f9d2819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.162+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 >> 172.21.15.38:0/3941069316 conn(0x7f9d28079740 msgr2=0x7f9d281042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.162+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 shutdown_connections 2024-09-21T06:24:30.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:24:30.162+0000 7f9d2e8e5640 1 -- 172.21.15.38:0/3941069316 wait complete. 2024-09-21T06:24:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:29 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:24:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:29 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:29 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:24:30.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:29 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:29 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:24:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:29 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:29 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:24:30.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:29 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:24:30.988 INFO:tasks.cephfs.filesystem:scrub status for tag:d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e - {'path': '/', 'tag': 'd6ff5cbc-6a97-4b82-bbe5-5043be4cd68e', 'options': 'recursive,force'} 2024-09-21T06:24:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:30 smithi038 ceph-mon[31215]: pgmap v464: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:31.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:30 smithi174 ceph-mon[34815]: pgmap v464: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:31.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:30 smithi044 ceph-mon[34369]: pgmap v464: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:33.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:32 smithi038 ceph-mon[31215]: pgmap v465: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:24:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:32 smithi174 ceph-mon[34815]: pgmap v465: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:24:33.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:32 smithi044 ceph-mon[34369]: pgmap v465: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:24:34.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:33 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:24:34.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:33 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:24:34.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:33 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:24:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:34 smithi038 ceph-mon[31215]: pgmap v466: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:35.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:34 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:35.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:34 smithi174 ceph-mon[34815]: pgmap v466: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:35.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:34 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:34 smithi044 ceph-mon[34369]: pgmap v466: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:24:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:34 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:36 smithi038 ceph-mon[31215]: pgmap v467: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:36 smithi174 ceph-mon[34815]: pgmap v467: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:36 smithi044 ceph-mon[34369]: pgmap v467: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:24:39.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:38 smithi038 ceph-mon[31215]: pgmap v468: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:39.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:38 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:38 smithi174 ceph-mon[34815]: pgmap v468: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:38 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:38 smithi044 ceph-mon[34369]: pgmap v468: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:38 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:41.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:40 smithi038 ceph-mon[31215]: pgmap v469: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:40 smithi174 ceph-mon[34815]: pgmap v469: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:41.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:40 smithi044 ceph-mon[34369]: pgmap v469: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:24:43.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:42 smithi038 ceph-mon[31215]: pgmap v470: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:42 smithi174 ceph-mon[34815]: pgmap v470: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:43.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:42 smithi044 ceph-mon[34369]: pgmap v470: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:24:45.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:44 smithi174 ceph-mon[34815]: pgmap v471: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:24:45.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:44 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:44 smithi044 ceph-mon[34369]: pgmap v471: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:24:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:44 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:44 smithi038 ceph-mon[31215]: pgmap v471: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:24:45.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:44 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:24:47.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:46 smithi174 ceph-mon[34815]: pgmap v472: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:46 smithi044 ceph-mon[34369]: pgmap v472: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:47.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:46 smithi038 ceph-mon[31215]: pgmap v472: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:49.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:49 smithi174 ceph-mon[34815]: pgmap v473: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:49 smithi044 ceph-mon[34369]: pgmap v473: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:49.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:49 smithi038 ceph-mon[31215]: pgmap v473: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:51.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:51 smithi174 ceph-mon[34815]: pgmap v474: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:51.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:51 smithi044 ceph-mon[34369]: pgmap v474: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:51.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:51 smithi038 ceph-mon[31215]: pgmap v474: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:53 smithi174 ceph-mon[34815]: pgmap v475: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:53.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:53 smithi044 ceph-mon[34369]: pgmap v475: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:53 smithi038 ceph-mon[31215]: pgmap v475: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:55 smithi174 ceph-mon[34815]: pgmap v476: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:55.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:55 smithi044 ceph-mon[34369]: pgmap v476: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:55 smithi038 ceph-mon[31215]: pgmap v476: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:24:57.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:57 smithi174 ceph-mon[34815]: pgmap v477: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:57 smithi044 ceph-mon[34369]: pgmap v477: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:57.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:57 smithi038 ceph-mon[31215]: pgmap v477: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:24:58.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:58.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:58.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:58.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:24:58.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:58.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:58.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:58.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:24:58.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:24:58.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:24:58.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:24:58.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:24:59.306 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:24:59 smithi044 ceph-mon[34369]: pgmap v478: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:59.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:24:59 smithi174 ceph-mon[34815]: pgmap v478: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:24:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:24:59 smithi038 ceph-mon[31215]: pgmap v478: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:01.000 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:25:01.277 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:01.287 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:01 smithi038 ceph-mon[31215]: pgmap v479: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:01.288 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:01 smithi038 ceph-mon[31215]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:25:01.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:01 smithi174 ceph-mon[34815]: pgmap v479: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:01.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:01 smithi174 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:25:01.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:01 smithi044 ceph-mon[34369]: pgmap v479: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:01.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:01 smithi044 ceph-mon[34369]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 -- 172.21.15.38:0/2065502624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 msgr2=0x7ff54c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 --2- 172.21.15.38:0/2065502624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c1098b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff540009900 tx=0x7ff54002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 -- 172.21.15.38:0/2065502624 shutdown_connections 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 --2- 172.21.15.38:0/2065502624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c109df0 0x7ff54c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 --2- 172.21.15.38:0/2065502624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c1098b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 --2- 172.21.15.38:0/2065502624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c103b60 0x7ff54c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 -- 172.21.15.38:0/2065502624 >> 172.21.15.38:0/2065502624 conn(0x7ff54c07b850 msgr2=0x7ff54c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 -- 172.21.15.38:0/2065502624 shutdown_connections 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.773+0000 7ff552422640 1 -- 172.21.15.38:0/2065502624 wait complete. 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 Processor -- start 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 -- start start 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c103b60 0x7ff54c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c109df0 0x7ff54c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c113bd0 con 0x7ff54c1094a0 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c113a50 con 0x7ff54c103b60 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff552422640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c113d50 con 0x7ff54c109df0 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35548/0 (socket says 172.21.15.38:35548) 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3563669814 learned_addr learned my addr 172.21.15.38:0/3563669814 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff54bfff640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c103b60 0x7ff54c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.774+0000 7ff5509bf640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c109df0 0x7ff54c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3563669814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c109df0 msgr2=0x7ff54c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c109df0 0x7ff54c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3563669814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c103b60 msgr2=0x7ff54c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c103b60 0x7ff54c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3563669814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c1a88c0 con 0x7ff54c1094a0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff540005940 tx=0x7ff5400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff5497fa640 1 -- 172.21.15.38:0/3563669814 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54003f030 con 0x7ff54c1094a0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c1a8b50 con 0x7ff54c1094a0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff5497fa640 1 -- 172.21.15.38:0/3563669814 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff540031910 con 0x7ff54c1094a0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff5497fa640 1 -- 172.21.15.38:0/3563669814 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540035070 con 0x7ff54c1094a0 2024-09-21T06:25:01.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.775+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c1a9080 con 0x7ff54c1094a0 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 Processor -- start 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 -- start start 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff5497fa640 1 -- 172.21.15.38:0/3563669814 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff540042030 con 0x7ff54c1094a0 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0ccf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0ccf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0c45e50 con 0x55b5c0907390 2024-09-21T06:25:01.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0c35280 con 0x55b5c08ff1b0 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.778+0000 7ff558996740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0c39090 con 0x55b5c0928070 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0ccf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35556/0 (socket says 172.21.15.38:35556) 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54b7fe640 1 -- 172.21.15.38:0/348157076 learned_addr learned my addr 172.21.15.38:0/348157076 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff5509bf640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0ccf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 -- 172.21.15.38:0/348157076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 msgr2=0x55b5c0ccf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0ccf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 -- 172.21.15.38:0/348157076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 msgr2=0x55b5c0ccfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 -- 172.21.15.38:0/348157076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c0993650 con 0x55b5c08ff1b0 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff5509bf640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0ccf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff5497fa640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 0x7ff5340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.779+0000 7ff54bfff640 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0ccf7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00bbc0 tx=0x7ff53c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80925f669123568e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.780+0000 7ff5509bf640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 0x7ff5340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.780+0000 7ff5327fc640 1 -- 172.21.15.38:0/348157076 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c004030 con 0x55b5c08ff1b0 2024-09-21T06:25:01.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.780+0000 7ff5497fa640 1 -- 172.21.15.38:0/3563669814 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff5401077c0 con 0x7ff54c1094a0 2024-09-21T06:25:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.780+0000 7ff5327fc640 1 -- 172.21.15.38:0/348157076 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff53c0041d0 con 0x55b5c08ff1b0 2024-09-21T06:25:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.780+0000 7ff5327fc640 1 -- 172.21.15.38:0/348157076 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0116a0 con 0x55b5c08ff1b0 2024-09-21T06:25:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- 172.21.15.38:0/348157076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 msgr2=0x55b5c0ccf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff5509bf640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 0x7ff5340b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff544005fd0 tx=0x7ff544009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0ccf7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00bbc0 tx=0x7ff53c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- 172.21.15.38:0/348157076 shutdown_connections 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ccfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0ccf7b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 --2- 172.21.15.38:0/348157076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0ccf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- 172.21.15.38:0/348157076 >> 172.21.15.38:0/348157076 conn(0x55b5c091c460 msgr2=0x55b5c0ccd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- 172.21.15.38:0/348157076 shutdown_connections 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- 172.21.15.38:0/348157076 wait complete. 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 -- start start 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.781+0000 7ff558996740 1 Processor -- start 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cda900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0a96700 con 0x55b5c0928070 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0bd0110 con 0x55b5c0907390 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b5c0cdda50 con 0x55b5c08ff1b0 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff558996740 10 client.0 _ll_register_callbacks cb 0x55b5c0be9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35564/0 (socket says 172.21.15.38:35564) 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 -- 172.21.15.38:0/1074781575 learned_addr learned my addr 172.21.15.38:0/1074781575 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff54bfff640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cda900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 -- 172.21.15.38:0/1074781575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c08ff1b0 msgr2=0x55b5c0cda900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cda900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 -- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 msgr2=0x55b5c0cdae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.782+0000 7ff5509bf640 1 -- 172.21.15.38:0/1074781575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c0bfdc40 con 0x55b5c0928070 2024-09-21T06:25:01.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff5509bf640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff544010730 tx=0x7ff544004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33ce2b2f79de5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54402c060 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff54401d850 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff53c0041d0 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff544004b20 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 10 client.16698 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b5c0ce97c0 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff53c0041d0 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff54400f040 con 0x55b5c0928070 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 10 client.16698 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 20 client.16698 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08e69f0 0x55b5c0cecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 4 client.16698 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:01.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.783+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5c0c47da0 con 0x55b5c08e69f0 2024-09-21T06:25:01.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.784+0000 7ff54bfff640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08e69f0 0x55b5c0cecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.784+0000 7ff54bfff640 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08e69f0 0x55b5c0cecd10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea1a5f462a641e80 server_cookie=8d8699044937a3de in_seq=0 out_seq=0 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.784+0000 7ff52b7fe640 10 client.16698 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff52b7fe640 1 -- 172.21.15.38:0/1074781575 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5c0c47da0 con 0x55b5c08e69f0 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff52b7fe640 10 client.16698 handle_command_reply: tid=0 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 client.16698 shutdown 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 msgr2=0x55b5c0ce6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff544010730 tx=0x7ff544004a40 comp rx=0 tx=0).stop 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 shutdown_connections 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0928070 0x55b5c0ce6d70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08e69f0 0x55b5c0cecd10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.785+0000 7ff558996740 1 --2- 172.21.15.38:0/1074781575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cda900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.786+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 >> 172.21.15.38:0/1074781575 conn(0x55b5c091c460 msgr2=0x55b5c0cd2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.786+0000 7ff52b7fe640 0 client.16698 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.786+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 shutdown_connections 2024-09-21T06:25:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.786+0000 7ff558996740 1 -- 172.21.15.38:0/1074781575 wait complete. 2024-09-21T06:25:01.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.786+0000 7ff558996740 20 client.16698 trim_cache size 0 max 16384 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 Processor -- start 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 -- start start 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0cd7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1b41e0 con 0x55b5c0907390 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1b1ab0 con 0x55b5c08ff1b0 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.803+0000 7ff558996740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1af900 con 0x55b5c0928070 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35566/0 (socket says 172.21.15.38:35566) 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3149740830 learned_addr learned my addr 172.21.15.38:0/3149740830 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff5509bf640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0cd7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54bfff640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3149740830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 msgr2=0x55b5c0cd7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0cd7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3149740830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 msgr2=0x55b5c0cdadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 -- 172.21.15.38:0/3149740830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5c0cd8e00 con 0x55b5c0907390 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54bfff640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.804+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff5400314b0 tx=0x7ff54010b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce5fe934bf4db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.805+0000 7ff531ffb640 1 -- 172.21.15.38:0/3149740830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540049040 con 0x55b5c0907390 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.805+0000 7ff531ffb640 1 -- 172.21.15.38:0/3149740830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff5400cd250 con 0x55b5c0907390 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.805+0000 7ff531ffb640 1 -- 172.21.15.38:0/3149740830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400cceb0 con 0x55b5c0907390 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.805+0000 7ff558996740 1 -- 172.21.15.38:0/3149740830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 msgr2=0x55b5c0ce6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.805+0000 7ff558996740 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff5400314b0 tx=0x7ff54010b040 comp rx=0 tx=0).stop 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 -- 172.21.15.38:0/3149740830 shutdown_connections 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0cd7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c0907390 0x55b5c0ce6c70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 --2- 172.21.15.38:0/3149740830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 -- 172.21.15.38:0/3149740830 >> 172.21.15.38:0/3149740830 conn(0x55b5c091c460 msgr2=0x55b5c0cda6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 -- 172.21.15.38:0/3149740830 shutdown_connections 2024-09-21T06:25:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 -- 172.21.15.38:0/3149740830 wait complete. 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 -- start start 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.806+0000 7ff558996740 1 Processor -- start 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0d566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1aff70 con 0x55b5c08ff1b0 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1b13e0 con 0x55b5c0907390 2024-09-21T06:25:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c1b0640 con 0x55b5c0928070 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35570/0 (socket says 172.21.15.38:35570) 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 -- 172.21.15.38:0/2516401446 learned_addr learned my addr 172.21.15.38:0/2516401446 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff558996740 10 client.0 _ll_register_callbacks cb 0x7ff5440105f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff5509bf640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0d566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 -- 172.21.15.38:0/2516401446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 msgr2=0x55b5c0d566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0d566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 -- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 msgr2=0x55b5c0cdf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.807+0000 7ff54bfff640 1 -- 172.21.15.38:0/2516401446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5c0d56c10 con 0x55b5c08ff1b0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff54bfff640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55b5c0ccdef0 tx=0x7ff53c003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac80c337c122e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff52b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0035f0 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff53c003790 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5400cd250 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff53c003990 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff558996740 10 client.16704 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.808+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b5c0d57d70 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff5400cd250 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff53c0115e0 con 0x55b5c08ff1b0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 10 client.16704 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 20 client.16704 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08bbda0 0x55b5c0d5a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 4 client.16704 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b5c0c43850 con 0x55b5c08bbda0 2024-09-21T06:25:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.809+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08bbda0 0x55b5c0d5a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff54b7fe640 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08bbda0 0x55b5c0d5a410 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95f3f3f32e946ba server_cookie=c53549a7461b1a0c in_seq=0 out_seq=0 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff52b7fe640 10 client.16704 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff52b7fe640 1 -- 172.21.15.38:0/2516401446 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55b5c0c43850 con 0x55b5c08bbda0 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff52b7fe640 10 client.16704 handle_command_reply: tid=0 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 client.16704 shutdown 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 msgr2=0x55b5c0cdf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55b5c0ccdef0 tx=0x7ff53c003e80 comp rx=0 tx=0).stop 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 shutdown_connections 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b5c08bbda0 0x55b5c0d5a410 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b5c0928070 0x55b5c0d566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5c0907390 0x55b5c0cdf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 --2- 172.21.15.38:0/2516401446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b5c08ff1b0 0x55b5c0cdf0e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 >> 172.21.15.38:0/2516401446 conn(0x55b5c091c460 msgr2=0x55b5c0cd02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff52b7fe640 0 client.16704 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.810+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 shutdown_connections 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff558996740 1 -- 172.21.15.38:0/2516401446 wait complete. 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff558996740 20 client.16704 trim_cache size 0 max 16384 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:25:01.816 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:25:01.817 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:01.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 msgr2=0x7ff5340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 0x7ff5340b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff544005fd0 tx=0x7ff544009600 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 msgr2=0x7ff54c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff540005940 tx=0x7ff5400042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 shutdown_connections 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff5340b6680 0x7ff5340b8b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff54c109df0 0x7ff54c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff54c1094a0 0x7ff54c075c50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 --2- 172.21.15.38:0/3563669814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff54c103b60 0x7ff54c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.811+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 >> 172.21.15.38:0/3563669814 conn(0x7ff54c07b850 msgr2=0x7ff54c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.812+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 shutdown_connections 2024-09-21T06:25:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:01.812+0000 7ff552422640 1 -- 172.21.15.38:0/3563669814 wait complete. 2024-09-21T06:25:02.549 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:25:02.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:02.824 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:03.212 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:03 smithi038 ceph-mon[31215]: pgmap v480: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:25:03.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:03 smithi174 ceph-mon[34815]: pgmap v480: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:25:03.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:03 smithi044 ceph-mon[34369]: pgmap v480: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 -- 172.21.15.38:0/3430737123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94102a60 msgr2=0x7f1f94102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 --2- 172.21.15.38:0/3430737123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94102a60 0x7f1f94102e70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009900 tx=0x7f1f8402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 -- 172.21.15.38:0/3430737123 shutdown_connections 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 --2- 172.21.15.38:0/3430737123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94108cf0 0x7f1f9410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 --2- 172.21.15.38:0/3430737123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 --2- 172.21.15.38:0/3430737123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94102a60 0x7f1f94102e70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 -- 172.21.15.38:0/3430737123 >> 172.21.15.38:0/3430737123 conn(0x7f1f94079730 msgr2=0x7f1f94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:03.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 -- 172.21.15.38:0/3430737123 shutdown_connections 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.430+0000 7f1f988d3640 1 -- 172.21.15.38:0/3430737123 wait complete. 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 Processor -- start 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 -- start start 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94102a60 0x7f1f9419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f9419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94112a80 con 0x7f1f94108cf0 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94112900 con 0x7f1f94102a60 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.431+0000 7f1f988d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94112c00 con 0x7f1f941083a0 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35586/0 (socket says 172.21.15.38:35586) 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 -- 172.21.15.38:0/4131888193 learned_addr learned my addr 172.21.15.38:0/4131888193 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:03.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f9259c640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94102a60 0x7f1f9419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f91d9b640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f9419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 -- 172.21.15.38:0/4131888193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 msgr2=0x7f1f9419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f9419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 -- 172.21.15.38:0/4131888193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94102a60 msgr2=0x7f1f9419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94102a60 0x7f1f9419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 -- 172.21.15.38:0/4131888193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f941a6550 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f91d9b640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f9419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f92d9d640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00cad0 tx=0x7f1f8c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00ae20 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f8c005020 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f941a6840 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00f6b0 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.432+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f941a6d80 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.433+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f94102e70 con 0x7f1f94108cf0 2024-09-21T06:25:03.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.436+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1f8c0051d0 con 0x7f1f94108cf0 2024-09-21T06:25:03.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.437+0000 7f1f8b7fe640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 0x7f1f800b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:03.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.437+0000 7f1f9259c640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 0x7f1f800b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:03.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.437+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1f8c0e76a0 con 0x7f1f94108cf0 2024-09-21T06:25:03.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.438+0000 7f1f9259c640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 0x7f1f800b8c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1f9406b9c0 tx=0x7f1f840058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:03.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.440+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f8c014030 con 0x7f1f94108cf0 2024-09-21T06:25:03.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.670+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f9406b270 con 0x7f1f94108cf0 2024-09-21T06:25:03.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.671+0000 7f1f8b7fe640 1 -- 172.21.15.38:0/4131888193 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f1f9406b270 con 0x7f1f94108cf0 2024-09-21T06:25:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:25:03.673 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:25:03.673 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:25:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 msgr2=0x7f1f800b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 0x7f1f800b8c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1f9406b9c0 tx=0x7f1f840058d0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 msgr2=0x7f1f9419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00cad0 tx=0x7f1f8c00cf90 comp rx=0 tx=0).stop 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 shutdown_connections 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f800b6730 0x7f1f800b8c40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f94108cf0 0x7f1f9419bdd0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f941083a0 0x7f1f9419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.673+0000 7f1f988d3640 1 --2- 172.21.15.38:0/4131888193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f94102a60 0x7f1f9419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.674+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 >> 172.21.15.38:0/4131888193 conn(0x7f1f94079730 msgr2=0x7f1f94101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.674+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 shutdown_connections 2024-09-21T06:25:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:03.674+0000 7f1f988d3640 1 -- 172.21.15.38:0/4131888193 wait complete. 2024-09-21T06:25:04.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:04 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4131888193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:04.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:25:04.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:04 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4131888193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:04.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:04 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4131888193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:04.565 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:04.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 -- 172.21.15.38:0/2440310032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d681049b0 msgr2=0x7f4d68104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:04.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/2440310032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d681049b0 0x7f4d68104dc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009900 tx=0x7f4d5802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:04.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 -- 172.21.15.38:0/2440310032 shutdown_connections 2024-09-21T06:25:04.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/2440310032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d6810de10 0x7f4d68110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:04.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/2440310032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d68105300 0x7f4d6810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:04.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/2440310032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d681049b0 0x7f4d68104dc0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:04.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 -- 172.21.15.38:0/2440310032 >> 172.21.15.38:0/2440310032 conn(0x7f4d68079730 msgr2=0x7f4d68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:04.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 -- 172.21.15.38:0/2440310032 shutdown_connections 2024-09-21T06:25:04.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.996+0000 7f4d6dd71640 1 -- 172.21.15.38:0/2440310032 wait complete. 2024-09-21T06:25:04.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 Processor -- start 2024-09-21T06:25:05.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 -- start start 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d681049b0 0x7f4d6819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d68105300 0x7f4d6819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d68113bd0 con 0x7f4d6810de10 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d68113a50 con 0x7f4d681049b0 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d6dd71640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d68113d50 con 0x7f4d68105300 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.997+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35608/0 (socket says 172.21.15.38:35608) 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 -- 172.21.15.38:0/873289977 learned_addr learned my addr 172.21.15.38:0/873289977 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d677fe640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d681049b0 0x7f4d6819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d68105300 0x7f4d6819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 -- 172.21.15.38:0/873289977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d68105300 msgr2=0x7f4d6819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d68105300 0x7f4d6819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 -- 172.21.15.38:0/873289977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d681049b0 msgr2=0x7f4d6819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d681049b0 0x7f4d6819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 -- 172.21.15.38:0/873289977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d681a05d0 con 0x7f4d6810de10 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d67fff640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000cad0 tx=0x7f4d6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d64ff9640 1 -- 172.21.15.38:0/873289977 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000ae20 con 0x7f4d6810de10 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d64ff9640 1 -- 172.21.15.38:0/873289977 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d60005020 con 0x7f4d6810de10 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d681a08c0 con 0x7f4d6810de10 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d64ff9640 1 -- 172.21.15.38:0/873289977 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000f6b0 con 0x7f4d6810de10 2024-09-21T06:25:05.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:04.998+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d681a7020 con 0x7f4d6810de10 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 Processor -- start 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d64ff9640 1 -- 172.21.15.38:0/873289977 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d600051d0 con 0x7f4d6810de10 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 -- start start 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae249c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae249cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556ae2412ea0 con 0x556ae20d4390 2024-09-21T06:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ae24022d0 con 0x556ae20cc1b0 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.001+0000 7f4d742e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ae24060e0 con 0x556ae20f5070 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35622/0 (socket says 172.21.15.38:35622) 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2572844297 learned_addr learned my addr 172.21.15.38:0/2572844297 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae249cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae249c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2572844297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 msgr2=0x556ae249c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae249c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2572844297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 msgr2=0x556ae249cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae249cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d64ff9640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 0x7f4d500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2572844297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae2160650 con 0x556ae20d4390 2024-09-21T06:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c019960 tx=0x7f4d5c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d280cb9dc1701e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d67fff640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 0x7f4d500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d64ff9640 1 -- 172.21.15.38:0/873289977 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d600e7580 con 0x7f4d6810de10 2024-09-21T06:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.002+0000 7f4d4dffb640 1 -- 172.21.15.38:0/2572844297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004030 con 0x556ae20d4390 2024-09-21T06:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.003+0000 7f4d4dffb640 1 -- 172.21.15.38:0/2572844297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d5c0054f0 con 0x556ae20d4390 2024-09-21T06:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.003+0000 7f4d4dffb640 1 -- 172.21.15.38:0/2572844297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004a00 con 0x556ae20d4390 2024-09-21T06:25:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.003+0000 7f4d742e5740 1 -- 172.21.15.38:0/2572844297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 msgr2=0x556ae249d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.003+0000 7f4d67fff640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 0x7f4d500b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ad490 tx=0x7f4d600a1d60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.003+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c019960 tx=0x7f4d5c005c90 comp rx=0 tx=0).stop 2024-09-21T06:25:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 -- 172.21.15.38:0/2572844297 shutdown_connections 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20d4390 0x556ae249d120 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae249cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2572844297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae249c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 -- 172.21.15.38:0/2572844297 >> 172.21.15.38:0/2572844297 conn(0x556ae20e9460 msgr2=0x556ae249a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 -- 172.21.15.38:0/2572844297 shutdown_connections 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 -- 172.21.15.38:0/2572844297 wait complete. 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 -- start start 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.004+0000 7f4d742e5740 1 Processor -- start 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20f5070 0x556ae24b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556ae2263700 con 0x556ae20cc1b0 2024-09-21T06:25:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556ae239d160 con 0x556ae20f5070 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ae24aae80 con 0x556ae20d4390 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d742e5740 10 client.0 _ll_register_callbacks cb 0x556ae23b69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35632/0 (socket says 172.21.15.38:35632) 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 -- 172.21.15.38:0/1033214772 learned_addr learned my addr 172.21.15.38:0/1033214772 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d677fe640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20f5070 0x556ae24b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 -- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 msgr2=0x556ae24a8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24a8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 -- 172.21.15.38:0/1033214772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20f5070 msgr2=0x556ae24b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20f5070 0x556ae24b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 -- 172.21.15.38:0/1033214772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae23cac90 con 0x556ae20cc1b0 2024-09-21T06:25:05.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00bea0 tx=0x7f4d5c004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f157b29fa77333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.005+0000 7f4d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c010770 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d5c010910 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d5c0054f0 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4d5c010b30 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 10 client.16722 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ae24b6b30 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d5c0054f0 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4d5c030020 con 0x556ae20cc1b0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 10 client.16722 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 10 client.16722 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 20 client.16722 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae20b39f0 0x556ae24b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 4 client.16722 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.006+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ae2414df0 con 0x556ae20b39f0 2024-09-21T06:25:05.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.007+0000 7f4d677fe640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae20b39f0 0x556ae24b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.007+0000 7f4d46ffd640 10 client.16722 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.007+0000 7f4d677fe640 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae20b39f0 0x556ae24b9e90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4729444eafe339c8 server_cookie=b2240ce2f106a689 in_seq=0 out_seq=0 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d46ffd640 1 -- 172.21.15.38:0/1033214772 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ae2414df0 con 0x556ae20b39f0 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d46ffd640 10 client.16722 handle_command_reply: tid=0 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 client.16722 shutdown 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 msgr2=0x556ae24a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00bea0 tx=0x7f4d5c004500 comp rx=0 tx=0).stop 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 shutdown_connections 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae20b39f0 0x556ae24b9e90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20f5070 0x556ae24b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d46ffd640 0 client.16722 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:05.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 --2- 172.21.15.38:0/1033214772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a7d00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 >> 172.21.15.38:0/1033214772 conn(0x556ae20e9460 msgr2=0x556ae249f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:05.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 shutdown_connections 2024-09-21T06:25:05.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 1 -- 172.21.15.38:0/1033214772 wait complete. 2024-09-21T06:25:05.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.008+0000 7f4d742e5740 20 client.16722 trim_cache size 0 max 16384 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.021+0000 7f4d742e5740 1 Processor -- start 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 -- start start 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20d4390 0x556ae249dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae2499bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681afdf0 con 0x556ae20cc1b0 2024-09-21T06:25:05.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681ad6c0 con 0x556ae20d4390 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d742e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681ab510 con 0x556ae20f5070 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35646/0 (socket says 172.21.15.38:35646) 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2967971119 learned_addr learned my addr 172.21.15.38:0/2967971119 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20d4390 0x556ae249dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2967971119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 msgr2=0x556ae2499bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae2499bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2967971119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20d4390 msgr2=0x556ae249dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20d4390 0x556ae249dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2967971119 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae249e990 con 0x556ae20cc1b0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.022+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00b6b0 tx=0x7f4d5c005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff3438777e1a728 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d4d7fa640 1 -- 172.21.15.38:0/2967971119 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c03b070 con 0x556ae20cc1b0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d4d7fa640 1 -- 172.21.15.38:0/2967971119 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d5c00bbb0 con 0x556ae20cc1b0 2024-09-21T06:25:05.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d4d7fa640 1 -- 172.21.15.38:0/2967971119 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c028020 con 0x556ae20cc1b0 2024-09-21T06:25:05.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 -- 172.21.15.38:0/2967971119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 msgr2=0x556ae24a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00b6b0 tx=0x7f4d5c005580 comp rx=0 tx=0).stop 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 -- 172.21.15.38:0/2967971119 shutdown_connections 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20f5070 0x556ae2499bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20d4390 0x556ae249dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2967971119 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20cc1b0 0x556ae24a9be0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 -- 172.21.15.38:0/2967971119 >> 172.21.15.38:0/2967971119 conn(0x556ae20e9460 msgr2=0x556ae249d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 -- 172.21.15.38:0/2967971119 shutdown_connections 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.023+0000 7f4d742e5740 1 -- 172.21.15.38:0/2967971119 wait complete. 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 -- start start 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 Processor -- start 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae24ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681abb80 con 0x556ae20f5070 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681acff0 con 0x556ae20cc1b0 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d681ac250 con 0x556ae20d4390 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.024+0000 7f4d742e5740 10 client.0 _ll_register_callbacks cb 0x7f4d58009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35650/0 (socket says 172.21.15.38:35650) 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2943625290 learned_addr learned my addr 172.21.15.38:0/2943625290 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae24ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 msgr2=0x556ae24bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2943625290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 msgr2=0x556ae24ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae24ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 -- 172.21.15.38:0/2943625290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae251bca0 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d66ffd640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00be90 tx=0x7f4d5c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce7639ba2dcb2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c028070 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d5c0052d0 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.025+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d5c00bbb0 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4d5c03b040 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 10 client.16728 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ae25241a0 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d5c00bbb0 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4d5c041060 con 0x556ae20f5070 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 10 client.16728 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 10 client.16728 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 20 client.16728 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae2088da0 0x556ae2526850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 4 client.16728 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:05.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ae24108a0 con 0x556ae2088da0 2024-09-21T06:25:05.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.026+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae2088da0 0x556ae2526850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:05.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d46ffd640 10 client.16728 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:05.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d677fe640 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae2088da0 0x556ae2526850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7318e907047704d server_cookie=d8f5cd8f7f414904 in_seq=0 out_seq=0 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d46ffd640 1 -- 172.21.15.38:0/2943625290 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ae24108a0 con 0x556ae2088da0 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d46ffd640 10 client.16728 handle_command_reply: tid=0 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 client.16728 shutdown 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 msgr2=0x556ae251b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00be90 tx=0x7f4d5c019290 comp rx=0 tx=0).stop 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 shutdown_connections 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x556ae2088da0 0x556ae2526850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556ae20f5070 0x556ae251b630 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ae20d4390 0x556ae24bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.027+0000 7f4d742e5740 1 --2- 172.21.15.38:0/2943625290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556ae20cc1b0 0x556ae24ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 >> 172.21.15.38:0/2943625290 conn(0x556ae20e9460 msgr2=0x556ae249dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:05.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d46ffd640 0 client.16728 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:05.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 shutdown_connections 2024-09-21T06:25:05.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d742e5740 1 -- 172.21.15.38:0/2943625290 wait complete. 2024-09-21T06:25:05.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d742e5740 20 client.16728 trim_cache size 0 max 16384 2024-09-21T06:25:05.034 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 msgr2=0x7f4d500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 0x7f4d500b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ad490 tx=0x7f4d600a1d60 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 msgr2=0x7f4d6819fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000cad0 tx=0x7f4d6000cf90 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 shutdown_connections 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d500b6680 0x7f4d500b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d6810de10 0x7f4d6819fea0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d68105300 0x7f4d6819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 --2- 172.21.15.38:0/873289977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d681049b0 0x7f4d6819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.028+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 >> 172.21.15.38:0/873289977 conn(0x7f4d68079730 msgr2=0x7f4d680ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.029+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 shutdown_connections 2024-09-21T06:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:05.029+0000 7f4d6dd71640 1 -- 172.21.15.38:0/873289977 wait complete. 2024-09-21T06:25:05.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:05 smithi038 ceph-mon[31215]: pgmap v481: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:05.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:05 smithi174 ceph-mon[34815]: pgmap v481: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:05.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:05 smithi044 ceph-mon[34369]: pgmap v481: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:05.731 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:25:05.992 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:06.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.404+0000 7f51ffab7640 1 -- 172.21.15.38:0/335105127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 msgr2=0x7f51f81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.404+0000 7f51ffab7640 1 --2- 172.21.15.38:0/335105127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f81098b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009900 tx=0x7f51e802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 -- 172.21.15.38:0/335105127 shutdown_connections 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 --2- 172.21.15.38:0/335105127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8109df0 0x7f51f8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 --2- 172.21.15.38:0/335105127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f81098b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 --2- 172.21.15.38:0/335105127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8103b60 0x7f51f8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 -- 172.21.15.38:0/335105127 >> 172.21.15.38:0/335105127 conn(0x7f51f807b850 msgr2=0x7f51f807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 -- 172.21.15.38:0/335105127 shutdown_connections 2024-09-21T06:25:06.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 -- 172.21.15.38:0/335105127 wait complete. 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 Processor -- start 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.405+0000 7f51ffab7640 1 -- start start 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 0x7f51f819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8109df0 0x7f51f819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8113bd0 con 0x7f51f81094a0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8113a50 con 0x7f51f8109df0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51ffab7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51f8113d50 con 0x7f51f8103b60 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35670/0 (socket says 172.21.15.38:35670) 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 -- 172.21.15.38:0/4128345332 learned_addr learned my addr 172.21.15.38:0/4128345332 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fe054640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8109df0 0x7f51f819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd853640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 0x7f51f819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 -- 172.21.15.38:0/4128345332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 msgr2=0x7f51f819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 0x7f51f819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 -- 172.21.15.38:0/4128345332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8109df0 msgr2=0x7f51f819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8109df0 0x7f51f819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 -- 172.21.15.38:0/4128345332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f81a04b0 con 0x7f51f81094a0 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd853640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 0x7f51f819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51fd052640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005940 tx=0x7f51e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.406+0000 7f51eeffd640 1 -- 172.21.15.38:0/4128345332 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e803f030 con 0x7f51f81094a0 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.407+0000 7f51eeffd640 1 -- 172.21.15.38:0/4128345332 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51e8031910 con 0x7f51f81094a0 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.407+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f81a0740 con 0x7f51f81094a0 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.407+0000 7f51eeffd640 1 -- 172.21.15.38:0/4128345332 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8035070 con 0x7f51f81094a0 2024-09-21T06:25:06.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.407+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81a0c20 con 0x7f51f81094a0 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.409+0000 7f520602b740 1 Processor -- start 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.409+0000 7f520602b740 1 -- start start 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562976859ea0 con 0x56297651b390 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629768492d0 con 0x5629765131b0 2024-09-21T06:25:06.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f520602b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56297684d0e0 con 0x56297653c070 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51eeffd640 1 -- 172.21.15.38:0/4128345332 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f51e8042030 con 0x7f51f81094a0 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:49658/0 (socket says 172.21.15.38:49658) 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 -- 172.21.15.38:0/4272281836 learned_addr learned my addr 172.21.15.38:0/4272281836 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fd853640 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 -- 172.21.15.38:0/4272281836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 msgr2=0x5629768e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 -- 172.21.15.38:0/4272281836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 msgr2=0x5629768e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768e3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fe054640 1 -- 172.21.15.38:0/4272281836 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629765a7650 con 0x56297653c070 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.410+0000 7f51fd052640 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51fe054640 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51f000ac10 tx=0x7f51f000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=914fe9036558861c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51eeffd640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 0x7f51e40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51e3fff640 1 -- 172.21.15.38:0/4272281836 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0005220 con 0x56297653c070 2024-09-21T06:25:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51fd853640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 0x7f51e40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51e3fff640 1 -- 172.21.15.38:0/4272281836 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51f0004c70 con 0x56297653c070 2024-09-21T06:25:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51e3fff640 1 -- 172.21.15.38:0/4272281836 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0018840 con 0x56297653c070 2024-09-21T06:25:06.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.411+0000 7f51eeffd640 1 -- 172.21.15.38:0/4128345332 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51e8107ba0 con 0x7f51f81094a0 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 -- 172.21.15.38:0/4272281836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 msgr2=0x5629768e32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f51fd853640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 0x7f51e40b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5629768e1f40 tx=0x7f51f4009880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51f000ac10 tx=0x7f51f000f790 comp rx=0 tx=0).stop 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 -- 172.21.15.38:0/4272281836 shutdown_connections 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 --2- 172.21.15.38:0/4272281836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768e32c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 -- 172.21.15.38:0/4272281836 >> 172.21.15.38:0/4272281836 conn(0x562976530460 msgr2=0x5629768e11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 -- 172.21.15.38:0/4272281836 shutdown_connections 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.412+0000 7f520602b740 1 -- 172.21.15.38:0/4272281836 wait complete. 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 -- start start 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 Processor -- start 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5629766aa700 con 0x56297651b390 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629767e4160 con 0x5629765131b0 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5629768f1aa0 con 0x56297653c070 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f520602b740 10 client.0 _ll_register_callbacks cb 0x5629767fd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.413+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35694/0 (socket says 172.21.15.38:35694) 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 -- 172.21.15.38:0/4148835641 learned_addr learned my addr 172.21.15.38:0/4148835641 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd853640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fe054640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 -- 172.21.15.38:0/4148835641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 msgr2=0x5629768fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768fadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 -- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 msgr2=0x5629768ee9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768ee9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 -- 172.21.15.38:0/4148835641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562976811c90 con 0x56297651b390 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51fd052640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51e80314b0 tx=0x7f51e8105870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca26ce304ad5a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8049070 con 0x56297651b390 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51e80d7000 con 0x56297651b390 2024-09-21T06:25:06.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.414+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f0004c70 con 0x56297651b390 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51e80c9050 con 0x56297651b390 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 10 client.16740 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5629768fd840 con 0x56297651b390 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51f0004c70 con 0x56297651b390 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f51e80d2080 con 0x56297651b390 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 10 client.16740 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 10 client.16740 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 20 client.16740 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764fa9f0 0x562976900d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 4 client.16740 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56297685bdf0 con 0x5629764fa9f0 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.415+0000 7f51fd853640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764fa9f0 0x562976900d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.416+0000 7f51fd853640 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764fa9f0 0x562976900d60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea6fbb39711e4dbb server_cookie=9db48e617b0f79fe in_seq=0 out_seq=0 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.416+0000 7f51e17fa640 10 client.16740 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f51e17fa640 1 -- 172.21.15.38:0/4148835641 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56297685bdf0 con 0x5629764fa9f0 2024-09-21T06:25:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f51e17fa640 10 client.16740 handle_command_reply: tid=0 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 client.16740 shutdown 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 msgr2=0x5629768eef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51e80314b0 tx=0x7f51e8105870 comp rx=0 tx=0).stop 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 shutdown_connections 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764fa9f0 0x562976900d60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768eef00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 --2- 172.21.15.38:0/4148835641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768ee9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f51e17fa640 0 client.16740 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 >> 172.21.15.38:0/4148835641 conn(0x562976530460 msgr2=0x5629768e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 shutdown_connections 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 1 -- 172.21.15.38:0/4148835641 wait complete. 2024-09-21T06:25:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.417+0000 7f520602b740 20 client.16740 trim_cache size 0 max 16384 2024-09-21T06:25:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 Processor -- start 2024-09-21T06:25:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 -- start start 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297651b390 0x5629768facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 0x5629768e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81b1f50 con 0x5629765131b0 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81af820 con 0x56297653c070 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f520602b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81ad670 con 0x56297651b390 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35696/0 (socket says 172.21.15.38:35696) 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 -- 172.21.15.38:0/2021228172 learned_addr learned my addr 172.21.15.38:0/2021228172 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fe054640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 0x5629768e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd052640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297651b390 0x5629768facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 -- 172.21.15.38:0/2021228172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297651b390 msgr2=0x5629768facc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297651b390 0x5629768facc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.431+0000 7f51fd853640 1 -- 172.21.15.38:0/2021228172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 msgr2=0x5629768e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51fd853640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 0x5629768e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51fd853640 1 -- 172.21.15.38:0/2021228172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629768e95d0 con 0x5629765131b0 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51fe054640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 0x5629768e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51fd853640 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f51f4005fd0 tx=0x7f51f4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b04950ca79b2750 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51e37fe640 1 -- 172.21.15.38:0/2021228172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011e70 con 0x5629765131b0 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51e37fe640 1 -- 172.21.15.38:0/2021228172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51f4032900 con 0x5629765131b0 2024-09-21T06:25:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.432+0000 7f51e37fe640 1 -- 172.21.15.38:0/2021228172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40209b0 con 0x5629765131b0 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- 172.21.15.38:0/2021228172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 msgr2=0x5629768e6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f51f4005fd0 tx=0x7f51f4015040 comp rx=0 tx=0).stop 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- 172.21.15.38:0/2021228172 shutdown_connections 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56297653c070 0x5629768e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297651b390 0x5629768facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 --2- 172.21.15.38:0/2021228172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5629765131b0 0x5629768e6ad0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- 172.21.15.38:0/2021228172 >> 172.21.15.38:0/2021228172 conn(0x562976530460 msgr2=0x5629768e63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- 172.21.15.38:0/2021228172 shutdown_connections 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- 172.21.15.38:0/2021228172 wait complete. 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 -- start start 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.433+0000 7f520602b740 1 Processor -- start 2024-09-21T06:25:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768f3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81adce0 con 0x56297651b390 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81af150 con 0x5629765131b0 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51f81ae3b0 con 0x56297653c070 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f520602b740 10 client.0 _ll_register_callbacks cb 0x7f51e8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35710/0 (socket says 172.21.15.38:35710) 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 -- 172.21.15.38:0/2251457146 learned_addr learned my addr 172.21.15.38:0/2251457146 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd853640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fe054640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 -- 172.21.15.38:0/2251457146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 msgr2=0x5629768f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 -- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 msgr2=0x5629768f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fd052640 1 -- 172.21.15.38:0/2251457146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629768f3910 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.434+0000 7f51fe054640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51fd052640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f51e802a450 tx=0x7f51e803bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b072170d62ccaa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8049040 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51f4032900 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51e80d2180 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51e80cd3c0 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 10 client.16746 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56297696b7a0 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51f4032900 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f51e8105ac0 con 0x56297651b390 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 10 client.16746 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 10 client.16746 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 20 client.16746 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764cfda0 0x56297696ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 4 client.16746 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.435+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629768578a0 con 0x5629764cfda0 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.436+0000 7f51fd853640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764cfda0 0x56297696ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.436+0000 7f51e17fa640 10 client.16746 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.436+0000 7f51fd853640 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764cfda0 0x56297696ddf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eef6d2a46126d84e server_cookie=1f1547825fbed4c2 in_seq=0 out_seq=0 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f51e17fa640 1 -- 172.21.15.38:0/2251457146 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629768578a0 con 0x5629764cfda0 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f51e17fa640 10 client.16746 handle_command_reply: tid=0 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 client.16746 shutdown 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 msgr2=0x5629768f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f51e802a450 tx=0x7f51e803bdb0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 shutdown_connections 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5629764cfda0 0x56297696ddf0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56297653c070 0x5629768f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56297651b390 0x5629768f2b00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 --2- 172.21.15.38:0/2251457146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629765131b0 0x5629768f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f51e17fa640 0 client.16746 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 >> 172.21.15.38:0/2251457146 conn(0x562976530460 msgr2=0x5629768e0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 shutdown_connections 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 1 -- 172.21.15.38:0/2251457146 wait complete. 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.437+0000 7f520602b740 20 client.16746 trim_cache size 0 max 16384 2024-09-21T06:25:06.443 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 msgr2=0x7f51e40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 0x7f51e40b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x5629768e1f40 tx=0x7f51f4009880 comp rx=0 tx=0).stop 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 msgr2=0x7f51f819aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51e8005940 tx=0x7f51e80042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 shutdown_connections 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51e40b66b0 0x7f51e40b8bc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51f8109df0 0x7f51f819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51f81094a0 0x7f51f819aba0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 --2- 172.21.15.38:0/4128345332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51f8103b60 0x7f51f819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 >> 172.21.15.38:0/4128345332 conn(0x7f51f807b850 msgr2=0x7f51f81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 shutdown_connections 2024-09-21T06:25:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:06.438+0000 7f51ffab7640 1 -- 172.21.15.38:0/4128345332 wait complete. 2024-09-21T06:25:07.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:25:07.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:07 smithi174 ceph-mon[34815]: pgmap v482: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:07.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:07 smithi044 ceph-mon[34369]: pgmap v482: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:07.407 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:07.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:07 smithi038 ceph-mon[31215]: pgmap v482: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 -- 172.21.15.38:0/2556748449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880109df0 msgr2=0x7f7880110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 --2- 172.21.15.38:0/2556748449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880109df0 0x7f7880110620 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7878009ca0 tx=0x7f787802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 -- 172.21.15.38:0/2556748449 shutdown_connections 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 --2- 172.21.15.38:0/2556748449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880109df0 0x7f7880110620 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 --2- 172.21.15.38:0/2556748449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f78801098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 --2- 172.21.15.38:0/2556748449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880103b60 0x7f7880103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 -- 172.21.15.38:0/2556748449 >> 172.21.15.38:0/2556748449 conn(0x7f788007b850 msgr2=0x7f788007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 -- 172.21.15.38:0/2556748449 shutdown_connections 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.880+0000 7f7886a5f640 1 -- 172.21.15.38:0/2556748449 wait complete. 2024-09-21T06:25:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 Processor -- start 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 -- start start 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f788019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 0x7f788019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7880113bd0 con 0x7f7880103b60 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7880113a50 con 0x7f78801094a0 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f7886a5f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7880113d50 con 0x7f7880109df0 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f787ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f787ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35724/0 (socket says 172.21.15.38:35724) 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.881+0000 7f787ffff640 1 -- 172.21.15.38:0/524451260 learned_addr learned my addr 172.21.15.38:0/524451260 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7877fff640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f788019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7884ffc640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 0x7f788019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 -- 172.21.15.38:0/524451260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 msgr2=0x7f788019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 0x7f788019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 -- 172.21.15.38:0/524451260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 msgr2=0x7f788019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f788019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 -- 172.21.15.38:0/524451260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78801a0490 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7877fff640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f788019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7884ffc640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 0x7f788019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787ffff640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f787000c890 tx=0x7f787000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787dffb640 1 -- 172.21.15.38:0/524451260 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870004220 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787dffb640 1 -- 172.21.15.38:0/524451260 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78700043c0 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78801a0780 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f787dffb640 1 -- 172.21.15.38:0/524451260 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78700049c0 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.882+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78801a6ee0 con 0x7f7880103b60 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 Processor -- start 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 -- start start 2024-09-21T06:25:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x560418253be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5604181c9ea0 con 0x560417e8b390 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5604181b92d0 con 0x560417e831b0 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f788cfd3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604181bd0e0 con 0x560417eac070 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.885+0000 7f787dffb640 1 -- 172.21.15.38:0/524451260 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7870005140 con 0x7f7880103b60 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35740/0 (socket says 172.21.15.38:35740) 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 -- 172.21.15.38:0/3148154544 learned_addr learned my addr 172.21.15.38:0/3148154544 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f787ffff640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x560418253be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7884ffc640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 -- 172.21.15.38:0/3148154544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 msgr2=0x5604182536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 -- 172.21.15.38:0/3148154544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 msgr2=0x560418253be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x560418253be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 -- 172.21.15.38:0/3148154544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560417f17650 con 0x560417e8b390 2024-09-21T06:25:07.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7884ffc640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:07.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.886+0000 7f7877fff640 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7868009c70 tx=0x7f7868010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93d4e0e8aad5a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f78767fc640 1 -- 172.21.15.38:0/3148154544 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868004030 con 0x560417e8b390 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f78767fc640 1 -- 172.21.15.38:0/3148154544 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78680041d0 con 0x560417e8b390 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f78767fc640 1 -- 172.21.15.38:0/3148154544 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78680126b0 con 0x560417e8b390 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f787dffb640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 0x7f786c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f7884ffc640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 0x7f786c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.887+0000 7f787dffb640 1 -- 172.21.15.38:0/524451260 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f78700e7400 con 0x7f7880103b60 2024-09-21T06:25:07.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- 172.21.15.38:0/3148154544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 msgr2=0x560418254120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f7884ffc640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 0x7f786c0b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f787802f500 tx=0x7f787802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7868009c70 tx=0x7f7868010740 comp rx=0 tx=0).stop 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- 172.21.15.38:0/3148154544 shutdown_connections 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418254120 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x560418253be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 --2- 172.21.15.38:0/3148154544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- 172.21.15.38:0/3148154544 >> 172.21.15.38:0/3148154544 conn(0x560417ea0460 msgr2=0x560418251590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- 172.21.15.38:0/3148154544 shutdown_connections 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- 172.21.15.38:0/3148154544 wait complete. 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.888+0000 7f788cfd3740 1 -- start start 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 Processor -- start 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x5604182630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x560418263b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56041801a700 con 0x560417e8b390 2024-09-21T06:25:07.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560418154160 con 0x560417e831b0 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604182661e0 con 0x560417eac070 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f788cfd3740 10 client.0 _ll_register_callbacks cb 0x56041816d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35744/0 (socket says 172.21.15.38:35744) 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 -- 172.21.15.38:0/4258083604 learned_addr learned my addr 172.21.15.38:0/4258083604 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f787ffff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x5604182630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7884ffc640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x560418263b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 -- 172.21.15.38:0/4258083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 msgr2=0x560418263b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x560418263b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 -- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 msgr2=0x5604182630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x5604182630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.889+0000 7f7877fff640 1 -- 172.21.15.38:0/4258083604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560418181c90 con 0x560417e8b390 2024-09-21T06:25:07.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f7877fff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7868003f60 tx=0x7f78680099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee6ca2468287395 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f785f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786802a060 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7868005050 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78680041d0 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7868004000 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f788cfd3740 10 client.16758 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560418271ea0 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.890+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78680041d0 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f786800f040 con 0x560417e8b390 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 10 client.16758 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:07.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 20 client.16758 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e6a9f0 0x560418275200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 4 client.16758 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604181cbdf0 con 0x560417e6a9f0 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.891+0000 7f787ffff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e6a9f0 0x560418275200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.892+0000 7f787ffff640 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e6a9f0 0x560418275200 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d8516916309d76 server_cookie=f6a1f683abfa9d47 in_seq=0 out_seq=0 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.892+0000 7f785f7fe640 10 client.16758 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.892+0000 7f785f7fe640 1 -- 172.21.15.38:0/4258083604 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604181cbdf0 con 0x560417e6a9f0 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.892+0000 7f785f7fe640 10 client.16758 handle_command_reply: tid=0 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.892+0000 7f788cfd3740 1 client.16758 shutdown 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 msgr2=0x560418263620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7868003f60 tx=0x7f78680099e0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 shutdown_connections 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e6a9f0 0x560418275200 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x560418263b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e8b390 0x560418263620 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 --2- 172.21.15.38:0/4258083604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x5604182630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 >> 172.21.15.38:0/4258083604 conn(0x560417ea0460 msgr2=0x560418255090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f785f7fe640 0 client.16758 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 shutdown_connections 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 1 -- 172.21.15.38:0/4258083604 wait complete. 2024-09-21T06:25:07.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.893+0000 7f788cfd3740 20 client.16758 trim_cache size 0 max 16384 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 Processor -- start 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 -- start start 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e8b390 0x5604182513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78801afd40 con 0x560417e831b0 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78801ad610 con 0x560417e8b390 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.906+0000 7f788cfd3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78801ab460 con 0x560417eac070 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35752/0 (socket says 172.21.15.38:35752) 2024-09-21T06:25:07.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 -- 172.21.15.38:0/2576397225 learned_addr learned my addr 172.21.15.38:0/2576397225 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f7877fff640 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e8b390 0x5604182513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f7884ffc640 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 -- 172.21.15.38:0/2576397225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 msgr2=0x5604182602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 -- 172.21.15.38:0/2576397225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e8b390 msgr2=0x5604182513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e8b390 0x5604182513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 -- 172.21.15.38:0/2576397225 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560418254490 con 0x560417e831b0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f787ffff640 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f78700a98a0 tx=0x7f78700ed0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e050a1c21a39d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f7875ffb640 1 -- 172.21.15.38:0/2576397225 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787001d040 con 0x560417e831b0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f7875ffb640 1 -- 172.21.15.38:0/2576397225 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78700acde0 con 0x560417e831b0 2024-09-21T06:25:07.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.907+0000 7f7875ffb640 1 -- 172.21.15.38:0/2576397225 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870004b60 con 0x560417e831b0 2024-09-21T06:25:07.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 -- 172.21.15.38:0/2576397225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 msgr2=0x560418250eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f78700a98a0 tx=0x7f78700ed0e0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 -- 172.21.15.38:0/2576397225 shutdown_connections 2024-09-21T06:25:07.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417eac070 0x5604182602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e8b390 0x5604182513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2576397225 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417e831b0 0x560418250eb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 -- 172.21.15.38:0/2576397225 >> 172.21.15.38:0/2576397225 conn(0x560417ea0460 msgr2=0x560418261960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 -- 172.21.15.38:0/2576397225 shutdown_connections 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.908+0000 7f788cfd3740 1 -- 172.21.15.38:0/2576397225 wait complete. 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 -- start start 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 Processor -- start 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x56041826be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417e8b390 0x5604182672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78801abad0 con 0x560417eac070 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78801acf40 con 0x560417e831b0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78801ac1a0 con 0x560417e8b390 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f788cfd3740 10 client.0 _ll_register_callbacks cb 0x7f78700eaf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f7884ffc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f7884ffc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35760/0 (socket says 172.21.15.38:35760) 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f7884ffc640 1 -- 172.21.15.38:0/2071107711 learned_addr learned my addr 172.21.15.38:0/2071107711 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.909+0000 7f787ffff640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x56041826be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7877fff640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417e8b390 0x5604182672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 -- 172.21.15.38:0/2071107711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417e8b390 msgr2=0x5604182672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417e8b390 0x5604182672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 -- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 msgr2=0x56041826be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x56041826be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 -- 172.21.15.38:0/2071107711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604182dea00 con 0x560417eac070 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f7884ffc640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7878004980 tx=0x7f78780095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44f2932a0fa8cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:07.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f785f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878056060 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7878030950 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78700acde0 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7878030b50 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.910+0000 7f788cfd3740 10 client.16764 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5604182dfad0 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78700acde0 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7878043040 con 0x560417eac070 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 10 client.16764 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 10 client.16764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 20 client.16764 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e3fda0 0x5604182e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 4 client.16764 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604181c78a0 con 0x560417e3fda0 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.911+0000 7f787ffff640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e3fda0 0x5604182e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f787ffff640 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e3fda0 0x5604182e22f0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c6470cb7ac21248 server_cookie=e7943e094c9c4947 in_seq=0 out_seq=0 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f785f7fe640 10 client.16764 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f785f7fe640 1 -- 172.21.15.38:0/2071107711 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604181c78a0 con 0x560417e3fda0 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f785f7fe640 10 client.16764 handle_command_reply: tid=0 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 client.16764 shutdown 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 msgr2=0x5604182679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7878004980 tx=0x7f78780095c0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 shutdown_connections 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560417eac070 0x5604182679b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560417e3fda0 0x5604182e22f0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560417e8b390 0x5604182672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 --2- 172.21.15.38:0/2071107711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560417e831b0 0x56041826be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 >> 172.21.15.38:0/2071107711 conn(0x560417ea0460 msgr2=0x560418250e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f785f7fe640 0 client.16764 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:07.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 shutdown_connections 2024-09-21T06:25:07.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 1 -- 172.21.15.38:0/2071107711 wait complete. 2024-09-21T06:25:07.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.912+0000 7f788cfd3740 20 client.16764 trim_cache size 0 max 16384 2024-09-21T06:25:07.919 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:07.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 msgr2=0x7f786c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 0x7f786c0b8c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f787802f500 tx=0x7f787802f310 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 msgr2=0x7f788019a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f787000c890 tx=0x7f787000cd50 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 shutdown_connections 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f786c0b6700 0x7f786c0b8c10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880109df0 0x7f788019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78801094a0 0x7f788019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 --2- 172.21.15.38:0/524451260 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7880103b60 0x7f788019a520 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 >> 172.21.15.38:0/524451260 conn(0x7f788007b850 msgr2=0x7f7880107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 shutdown_connections 2024-09-21T06:25:07.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:07.913+0000 7f7886a5f640 1 -- 172.21.15.38:0/524451260 wait complete. 2024-09-21T06:25:09.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:09 smithi174 ceph-mon[34815]: pgmap v483: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:25:09.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:09 smithi044 ceph-mon[34369]: pgmap v483: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:25:09.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:09 smithi038 ceph-mon[31215]: pgmap v483: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:25:09.629 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:25:09.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:25:09.900 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 -- 172.21.15.38:0/2830012929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e01083c0 msgr2=0x7f11e01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 --2- 172.21.15.38:0/2830012929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e01083c0 0x7f11e01087d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009900 tx=0x7f11d002a410 comp rx=0 tx=0).stop 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 -- 172.21.15.38:0/2830012929 shutdown_connections 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 --2- 172.21.15.38:0/2830012929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 --2- 172.21.15.38:0/2830012929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e01083c0 0x7f11e01087d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 --2- 172.21.15.38:0/2830012929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e0102a80 0x7f11e0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 -- 172.21.15.38:0/2830012929 >> 172.21.15.38:0/2830012929 conn(0x7f11e0079740 msgr2=0x7f11e0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 -- 172.21.15.38:0/2830012929 shutdown_connections 2024-09-21T06:25:10.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.331+0000 7f11e8296640 1 -- 172.21.15.38:0/2830012929 wait complete. 2024-09-21T06:25:10.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 Processor -- start 2024-09-21T06:25:10.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 -- start start 2024-09-21T06:25:10.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 0x7f11e019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0112aa0 con 0x7f11e0102a80 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0112920 con 0x7f11e0108d10 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e8296640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0112c20 con 0x7f11e01083c0 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e6032640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e6032640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53130/0 (socket says 172.21.15.38:53130) 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e6032640 1 -- 172.21.15.38:0/2780305707 learned_addr learned my addr 172.21.15.38:0/2780305707 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e5831640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 0x7f11e019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.332+0000 7f11e6833640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 -- 172.21.15.38:0/2780305707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 msgr2=0x7f11e019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 0x7f11e019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 -- 172.21.15.38:0/2780305707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 msgr2=0x7f11e019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e019bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 -- 172.21.15.38:0/2780305707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e01a6600 con 0x7f11e0102a80 2024-09-21T06:25:10.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6833640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e5831640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 0x7f11e019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e6032640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11d77fe640 1 -- 172.21.15.38:0/2780305707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc017070 con 0x7f11e0102a80 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11d77fe640 1 -- 172.21.15.38:0/2780305707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11dc009c30 con 0x7f11e0102a80 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11d77fe640 1 -- 172.21.15.38:0/2780305707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00f6b0 con 0x7f11e0102a80 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e01a68f0 con 0x7f11e0102a80 2024-09-21T06:25:10.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.333+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e01a6e80 con 0x7f11e0102a80 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 Processor -- start 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 -- start start 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11d77fe640 1 -- 172.21.15.38:0/2780305707 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f11dc0109c0 con 0x7f11e0102a80 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da27970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da27eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55901d99de60 con 0x55901d680350 2024-09-21T06:25:10.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55901d98d290 con 0x55901d657490 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11ee80a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55901d9910a0 con 0x55901d65f670 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11e6833640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11e6833640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53144/0 (socket says 172.21.15.38:53144) 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.336+0000 7f11e6833640 1 -- 172.21.15.38:0/1079308964 learned_addr learned my addr 172.21.15.38:0/1079308964 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e5831640 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da27eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6032640 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da27970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 -- 172.21.15.38:0/1079308964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 msgr2=0x55901da27eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da27eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 -- 172.21.15.38:0/1079308964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 msgr2=0x55901da27970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da27970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 -- 172.21.15.38:0/1079308964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901d6eb930 con 0x55901d680350 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6833640 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009ea0 tx=0x7f11d8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d541fdc069f04662 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11d77fe640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 0x7f11cc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11d4d9a640 1 -- 172.21.15.38:0/1079308964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8004d20 con 0x55901d680350 2024-09-21T06:25:10.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11d4d9a640 1 -- 172.21.15.38:0/1079308964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11d80054f0 con 0x55901d680350 2024-09-21T06:25:10.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11d4d9a640 1 -- 172.21.15.38:0/1079308964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8011860 con 0x55901d680350 2024-09-21T06:25:10.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.337+0000 7f11e6032640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 0x7f11cc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11d77fe640 1 -- 172.21.15.38:0/2780305707 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f11dc0e72d0 con 0x7f11e0102a80 2024-09-21T06:25:10.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 -- 172.21.15.38:0/1079308964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 msgr2=0x55901da27430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009ea0 tx=0x7f11d8009f90 comp rx=0 tx=0).stop 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11e6032640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 0x7f11cc0b8c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0e4b50 tx=0x7f11dc005880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 -- 172.21.15.38:0/1079308964 shutdown_connections 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da27eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 --2- 172.21.15.38:0/1079308964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da27430 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 -- 172.21.15.38:0/1079308964 >> 172.21.15.38:0/1079308964 conn(0x55901d674740 msgr2=0x55901da25320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 -- 172.21.15.38:0/1079308964 shutdown_connections 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.338+0000 7f11ee80a740 1 -- 172.21.15.38:0/1079308964 wait complete. 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 -- start start 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 Processor -- start 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da33010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55901d7ee890 con 0x55901d680350 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55901d927d40 con 0x55901d657490 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55901da3a020 con 0x55901d65f670 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11ee80a740 10 client.0 _ll_register_callbacks cb 0x55901d98bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11e6833640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11e6833640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53146/0 (socket says 172.21.15.38:53146) 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.339+0000 7f11e6833640 1 -- 172.21.15.38:0/3582729291 learned_addr learned my addr 172.21.15.38:0/3582729291 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da33010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e5831640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 -- 172.21.15.38:0/3582729291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 msgr2=0x55901da33550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da33550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 -- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 msgr2=0x55901da33010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da33010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 -- 172.21.15.38:0/3582729291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901da438d0 con 0x55901d680350 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11e6833640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005b40 tx=0x7f11d8011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fb4c62b0bdda9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8005340 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f11d80049e0 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11d80054f0 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f11d8004be0 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11ee80a740 10 client.16776 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.340+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55901da46200 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11d80054f0 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f11d80195f0 con 0x55901d680350 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 10 client.16776 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 20 client.16776 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:10.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d63ecd0 0x55901da495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 4 client.16776 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55901d99fdb0 con 0x55901d63ecd0 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.341+0000 7f11e5831640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d63ecd0 0x55901da495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11c9ffb640 10 client.16776 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11e5831640 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d63ecd0 0x55901da495c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ebff9e380b9c6 server_cookie=7cb14962c3cff01 in_seq=0 out_seq=0 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11c9ffb640 1 -- 172.21.15.38:0/3582729291 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55901d99fdb0 con 0x55901d63ecd0 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11c9ffb640 10 client.16776 handle_command_reply: tid=0 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11ee80a740 1 client.16776 shutdown 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 msgr2=0x55901da43310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.342+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005b40 tx=0x7f11d8011440 comp rx=0 tx=0).stop 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 shutdown_connections 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d680350 0x55901da43310 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d63ecd0 0x55901da495c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11c9ffb640 0 client.16776 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3582729291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d657490 0x55901da33010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 >> 172.21.15.38:0/3582729291 conn(0x55901d674740 msgr2=0x55901da2a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 shutdown_connections 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 1 -- 172.21.15.38:0/3582729291 wait complete. 2024-09-21T06:25:10.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.343+0000 7f11ee80a740 20 client.16776 trim_cache size 0 max 16384 2024-09-21T06:25:10.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 Processor -- start 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 -- start start 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d63ecd0 0x55901da43210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da34a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01afe60 con 0x55901d657490 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01ad730 con 0x55901d63ecd0 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11ee80a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01ab580 con 0x55901d65f670 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53160/0 (socket says 172.21.15.38:53160) 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 -- 172.21.15.38:0/3667010307 learned_addr learned my addr 172.21.15.38:0/3667010307 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e6833640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d63ecd0 0x55901da43210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e6833640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da34a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 -- 172.21.15.38:0/3667010307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 msgr2=0x55901da34a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da34a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 -- 172.21.15.38:0/3667010307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d63ecd0 msgr2=0x55901da43210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d63ecd0 0x55901da43210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e5831640 1 -- 172.21.15.38:0/3667010307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901da31310 con 0x55901d657490 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.361+0000 7f11e6833640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da34a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.362+0000 7f11e5831640 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f11e006b6c0 tx=0x7f11d0005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664f604eb13bb361 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.362+0000 7f11cbfff640 1 -- 172.21.15.38:0/3667010307 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0048070 con 0x55901d657490 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.362+0000 7f11cbfff640 1 -- 172.21.15.38:0/3667010307 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11d0005510 con 0x55901d657490 2024-09-21T06:25:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.362+0000 7f11cbfff640 1 -- 172.21.15.38:0/3667010307 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0035040 con 0x55901d657490 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- 172.21.15.38:0/3667010307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 msgr2=0x55901da326a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f11e006b6c0 tx=0x7f11d0005a40 comp rx=0 tx=0).stop 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- 172.21.15.38:0/3667010307 shutdown_connections 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d65f670 0x55901da34a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da326a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 --2- 172.21.15.38:0/3667010307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d63ecd0 0x55901da43210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- 172.21.15.38:0/3667010307 >> 172.21.15.38:0/3667010307 conn(0x55901d674740 msgr2=0x55901da34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- 172.21.15.38:0/3667010307 shutdown_connections 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- 172.21.15.38:0/3667010307 wait complete. 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 -- start start 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.363+0000 7f11ee80a740 1 Processor -- start 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d63ecd0 0x55901da3b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 0x55901dab2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01abbf0 con 0x55901d657490 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01ad060 con 0x55901d65f670 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f11e01ac2c0 con 0x55901d63ecd0 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11ee80a740 10 client.0 _ll_register_callbacks cb 0x7f11d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53172/0 (socket says 172.21.15.38:53172) 2024-09-21T06:25:10.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 -- 172.21.15.38:0/2580382346 learned_addr learned my addr 172.21.15.38:0/2580382346 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e6833640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 0x55901dab2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e6833640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d63ecd0 0x55901da3b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 -- 172.21.15.38:0/2580382346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d63ecd0 msgr2=0x55901da3b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d63ecd0 0x55901da3b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 -- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 msgr2=0x55901dab2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 0x55901dab2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 -- 172.21.15.38:0/2580382346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901dab3360 con 0x55901d657490 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e6833640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 0x55901dab2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11e5831640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f11d00057b0 tx=0x7f11d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5510ebe442748a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.364+0000 7f11c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d0035030 con 0x55901d657490 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f11d0005040 con 0x55901d657490 2024-09-21T06:25:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11d0005510 con 0x55901d657490 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f11d0048070 con 0x55901d657490 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 10 client.16782 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55901dab44a0 con 0x55901d657490 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11d0005510 con 0x55901d657490 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f11d0003a70 con 0x55901d657490 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 10 client.16782 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 20 client.16782 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d680350 0x55901dab6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 4 client.16782 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.365+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55901d99b860 con 0x55901d680350 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.366+0000 7f11e6833640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d680350 0x55901dab6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.366+0000 7f11e6833640 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d680350 0x55901dab6bb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a32adb4418b5944 server_cookie=b214c51d1ae1953d in_seq=0 out_seq=0 2024-09-21T06:25:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.366+0000 7f11c9ffb640 10 client.16782 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11c9ffb640 1 -- 172.21.15.38:0/2580382346 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55901d99b860 con 0x55901d680350 2024-09-21T06:25:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11c9ffb640 10 client.16782 handle_command_reply: tid=0 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 client.16782 shutdown 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 msgr2=0x55901da3bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f11d00057b0 tx=0x7f11d0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 shutdown_connections 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55901d65f670 0x55901dab2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55901d657490 0x55901da3bca0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55901d680350 0x55901dab6bb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 --2- 172.21.15.38:0/2580382346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55901d63ecd0 0x55901da3b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 >> 172.21.15.38:0/2580382346 conn(0x55901d674740 msgr2=0x55901da28460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11c9ffb640 0 client.16782 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 shutdown_connections 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.368+0000 7f11ee80a740 1 -- 172.21.15.38:0/2580382346 wait complete. 2024-09-21T06:25:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11ee80a740 20 client.16782 trim_cache size 0 max 16384 2024-09-21T06:25:10.374 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:25:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "b7c768bc-9171-42b5-acea-7c082800993a", 2024-09-21T06:25:10.374 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:25:10.374 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 msgr2=0x7f11cc0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 0x7f11cc0b8c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0e4b50 tx=0x7f11dc005880 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 msgr2=0x7f11e019b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00d950 tx=0x7f11dc00de10 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 shutdown_connections 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f11cc0b6730 0x7f11cc0b8c40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e0108d10 0x7f11e019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e01083c0 0x7f11e019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 --2- 172.21.15.38:0/2780305707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f11e0102a80 0x7f11e019b370 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 >> 172.21.15.38:0/2780305707 conn(0x7f11e0079740 msgr2=0x7f11e0101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 shutdown_connections 2024-09-21T06:25:10.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:10.369+0000 7f11e8296640 1 -- 172.21.15.38:0/2780305707 wait complete. 2024-09-21T06:25:11.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:25:11.319 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:11.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:11 smithi174 ceph-mon[34815]: pgmap v484: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:11.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:11 smithi044 ceph-mon[34369]: pgmap v484: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:11.441 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:11 smithi038 ceph-mon[31215]: pgmap v484: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:25:11.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.820+0000 7faa36541640 1 -- 172.21.15.38:0/3733544312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 msgr2=0x7faa30110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.820+0000 7faa36541640 1 --2- 172.21.15.38:0/3733544312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa30110620 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7faa28009ca0 tx=0x7faa2802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.820+0000 7faa36541640 1 -- 172.21.15.38:0/3733544312 shutdown_connections 2024-09-21T06:25:11.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.820+0000 7faa36541640 1 --2- 172.21.15.38:0/3733544312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa30110620 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.820+0000 7faa36541640 1 --2- 172.21.15.38:0/3733544312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 0x7faa301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 --2- 172.21.15.38:0/3733544312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 0x7faa30103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 -- 172.21.15.38:0/3733544312 >> 172.21.15.38:0/3733544312 conn(0x7faa3007b850 msgr2=0x7faa3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 -- 172.21.15.38:0/3733544312 shutdown_connections 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 -- 172.21.15.38:0/3733544312 wait complete. 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 Processor -- start 2024-09-21T06:25:11.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.821+0000 7faa36541640 1 -- start start 2024-09-21T06:25:11.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 0x7faa3019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 0x7faa3019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113bf0 con 0x7faa30109df0 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113a70 con 0x7faa30103b60 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa36541640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113d70 con 0x7faa301094a0 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53196/0 (socket says 172.21.15.38:53196) 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 -- 172.21.15.38:0/562332091 learned_addr learned my addr 172.21.15.38:0/562332091 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 0x7faa3019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa2ffff640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 0x7faa3019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 -- 172.21.15.38:0/562332091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 msgr2=0x7faa3019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 0x7faa3019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 -- 172.21.15.38:0/562332091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 msgr2=0x7faa3019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 0x7faa3019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.822+0000 7faa34ade640 1 -- 172.21.15.38:0/562332091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301a04f0 con 0x7faa30109df0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa34ade640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faa28005cc0 tx=0x7faa28003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa2d7fa640 1 -- 172.21.15.38:0/562332091 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280317d0 con 0x7faa30109df0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa2d7fa640 1 -- 172.21.15.38:0/562332091 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa28004510 con 0x7faa30109df0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301a0780 con 0x7faa30109df0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa2d7fa640 1 -- 172.21.15.38:0/562332091 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2802fda0 con 0x7faa30109df0 2024-09-21T06:25:11.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.823+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa301a6f40 con 0x7faa30109df0 2024-09-21T06:25:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 Processor -- start 2024-09-21T06:25:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa2d7fa640 1 -- 172.21.15.38:0/562332091 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7faa280305c0 con 0x7faa30109df0 2024-09-21T06:25:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 -- start start 2024-09-21T06:25:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7ed070 0x5624ddb94270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb94cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5624ddb0ae50 con 0x5624dd7c41b0 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5624ddafa280 con 0x5624dd7ed070 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.826+0000 7faa3cab5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5624ddafe090 con 0x5624dd7cc390 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53202/0 (socket says 172.21.15.38:53202) 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 -- 172.21.15.38:0/1650350774 learned_addr learned my addr 172.21.15.38:0/1650350774 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7ed070 0x5624ddb94270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb94cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 -- 172.21.15.38:0/1650350774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 msgr2=0x5624ddb94cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb94cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 -- 172.21.15.38:0/1650350774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7ed070 msgr2=0x5624ddb94270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7ed070 0x5624ddb94270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2d7fa640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 0x7faa180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 -- 172.21.15.38:0/1650350774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624dd858650 con 0x5624dd7c41b0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa34ade640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 0x7faa180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2ffff640 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faa2000cbf0 tx=0x7faa2000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3458b04703d80284 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa2d7fa640 1 -- 172.21.15.38:0/562332091 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faa28108d70 con 0x7faa30109df0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.827+0000 7faa167fc640 1 -- 172.21.15.38:0/1650350774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20010630 con 0x5624dd7c41b0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa167fc640 1 -- 172.21.15.38:0/1650350774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa20010ca0 con 0x5624dd7c41b0 2024-09-21T06:25:11.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa167fc640 1 -- 172.21.15.38:0/1650350774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2000fc60 con 0x5624dd7c41b0 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 -- 172.21.15.38:0/1650350774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 msgr2=0x5624ddb947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa34ade640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 0x7faa180b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa280cb210 tx=0x7faa2804a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faa2000cbf0 tx=0x7faa2000e720 comp rx=0 tx=0).stop 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 -- 172.21.15.38:0/1650350774 shutdown_connections 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddb947b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 --2- 172.21.15.38:0/1650350774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7ed070 0x5624ddb94270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.828+0000 7faa3cab5740 1 -- 172.21.15.38:0/1650350774 >> 172.21.15.38:0/1650350774 conn(0x5624dd7e1460 msgr2=0x5624ddb92160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 -- 172.21.15.38:0/1650350774 shutdown_connections 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 -- 172.21.15.38:0/1650350774 wait complete. 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 -- start start 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 Processor -- start 2024-09-21T06:25:11.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7c41b0 0x5624ddb9f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddb9feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5624dd95b700 con 0x5624dd7ed070 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.829+0000 7faa3cab5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5624dda95110 con 0x5624dd7cc390 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa3cab5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5624ddba2a50 con 0x5624dd7c41b0 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa3cab5740 10 client.0 _ll_register_callbacks cb 0x5624ddaae990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53208/0 (socket says 172.21.15.38:53208) 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 -- 172.21.15.38:0/2220187168 learned_addr learned my addr 172.21.15.38:0/2220187168 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7c41b0 0x5624ddb9f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2ffff640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddb9feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 -- 172.21.15.38:0/2220187168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7c41b0 msgr2=0x5624ddb9f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7c41b0 0x5624ddb9f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 -- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 msgr2=0x5624ddb9feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddb9feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 -- 172.21.15.38:0/2220187168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ddac2c40 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7faa2400fd60 tx=0x7faa24013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01198d6c64fa97a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2400ee50 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.830+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faa24004020 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa20010ca0 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faa24027050 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 10 client.16794 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5624ddbae7d0 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa20010ca0 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7faa2401f3c0 con 0x5624dd7ed070 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 10 client.16794 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:11.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 20 client.16794 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd7ab9f0 0x5624ddbb1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 4 client.16794 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.831+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624ddb0cda0 con 0x5624dd7ab9f0 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.832+0000 7faa2ffff640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd7ab9f0 0x5624ddbb1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.832+0000 7faa2ffff640 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd7ab9f0 0x5624ddbb1d70 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1222b0a17e6a0770 server_cookie=393362fcd482d21b in_seq=0 out_seq=0 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.832+0000 7faa0f7fe640 10 client.16794 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa0f7fe640 1 -- 172.21.15.38:0/2220187168 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624ddb0cda0 con 0x5624dd7ab9f0 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa0f7fe640 10 client.16794 handle_command_reply: tid=0 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 client.16794 shutdown 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 msgr2=0x5624ddbabd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7faa2400fd60 tx=0x7faa24013040 comp rx=0 tx=0).stop 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 shutdown_connections 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddbabd70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddb9feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd7ab9f0 0x5624ddbb1d70 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 --2- 172.21.15.38:0/2220187168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7c41b0 0x5624ddb9f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 >> 172.21.15.38:0/2220187168 conn(0x5624dd7e1460 msgr2=0x5624ddb97400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa0f7fe640 0 client.16794 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 shutdown_connections 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 1 -- 172.21.15.38:0/2220187168 wait complete. 2024-09-21T06:25:11.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.833+0000 7faa3cab5740 20 client.16794 trim_cache size 0 max 16384 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 Processor -- start 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 -- start start 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7c41b0 0x5624ddb959b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb91710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa301b1f40 con 0x5624dd7ed070 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa301af810 con 0x5624dd7c41b0 2024-09-21T06:25:11.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa3cab5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ad660 con 0x5624dd7cc390 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.851+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53224/0 (socket says 172.21.15.38:53224) 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 -- 172.21.15.38:0/371231249 learned_addr learned my addr 172.21.15.38:0/371231249 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7c41b0 0x5624ddb959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2ffff640 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb91710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 -- 172.21.15.38:0/371231249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 msgr2=0x5624ddb91710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb91710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 -- 172.21.15.38:0/371231249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7c41b0 msgr2=0x5624ddb959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7c41b0 0x5624ddb959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 -- 172.21.15.38:0/371231249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ddb9a5a0 con 0x5624dd7ed070 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faa24005c30 tx=0x7faa24001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20229d1e8068aa94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa15ffb640 1 -- 172.21.15.38:0/371231249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2400ee50 con 0x5624dd7ed070 2024-09-21T06:25:11.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa15ffb640 1 -- 172.21.15.38:0/371231249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa2401fdd0 con 0x5624dd7ed070 2024-09-21T06:25:11.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.852+0000 7faa15ffb640 1 -- 172.21.15.38:0/371231249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24020b80 con 0x5624dd7ed070 2024-09-21T06:25:11.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 -- 172.21.15.38:0/371231249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 msgr2=0x5624ddb91c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7faa24005c30 tx=0x7faa24001e70 comp rx=0 tx=0).stop 2024-09-21T06:25:11.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 -- 172.21.15.38:0/371231249 shutdown_connections 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7ed070 0x5624ddb91c50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7cc390 0x5624ddb91710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 --2- 172.21.15.38:0/371231249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7c41b0 0x5624ddb959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 -- 172.21.15.38:0/371231249 >> 172.21.15.38:0/371231249 conn(0x5624dd7e1460 msgr2=0x5624ddb952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 -- 172.21.15.38:0/371231249 shutdown_connections 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.853+0000 7faa3cab5740 1 -- 172.21.15.38:0/371231249 wait complete. 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 -- start start 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 Processor -- start 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddba3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7ed070 0x5624ddba4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faa301adcd0 con 0x5624dd7c41b0 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa301af140 con 0x5624dd7cc390 2024-09-21T06:25:11.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ae3a0 con 0x5624dd7ed070 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa3cab5740 10 client.0 _ll_register_callbacks cb 0x7faa2400a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53230/0 (socket says 172.21.15.38:53230) 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.854+0000 7faa2f7fe640 1 -- 172.21.15.38:0/3718331425 learned_addr learned my addr 172.21.15.38:0/3718331425 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2ffff640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddba3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7ed070 0x5624ddba4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 -- 172.21.15.38:0/3718331425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7ed070 msgr2=0x5624ddba4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7ed070 0x5624ddba4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 -- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 msgr2=0x5624ddba3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddba3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 -- 172.21.15.38:0/3718331425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ddba4800 con 0x5624dd7c41b0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa2f7fe640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7faa2400fab0 tx=0x7faa2401f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9dde83ce81a63a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:11.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2403d060 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faa24005040 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa2401fdd0 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faa24013040 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa3cab5740 10 client.16800 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.855+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5624ddc1c730 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa2401fdd0 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7faa240424e0 con 0x5624dd7c41b0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 10 client.16800 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 20 client.16800 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd780da0 0x5624ddc1ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 4 client.16800 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624ddb08850 con 0x5624dd780da0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.856+0000 7faa2ffff640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd780da0 0x5624ddc1ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:11.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa2ffff640 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd780da0 0x5624ddc1ed30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42ce1b02c7676158 server_cookie=b1dc303d1657ec43 in_seq=0 out_seq=0 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa0f7fe640 10 client.16800 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa0f7fe640 1 -- 172.21.15.38:0/3718331425 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x5624ddb08850 con 0x5624dd780da0 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa0f7fe640 10 client.16800 handle_command_reply: tid=0 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 client.16800 shutdown 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 msgr2=0x5624ddba8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7faa2400fab0 tx=0x7faa2401f7c0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 shutdown_connections 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5624dd780da0 0x5624ddc1ed30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624dd7ed070 0x5624ddba4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624dd7cc390 0x5624ddba3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 --2- 172.21.15.38:0/3718331425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5624dd7c41b0 0x5624ddba8570 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 >> 172.21.15.38:0/3718331425 conn(0x5624dd7e1460 msgr2=0x5624ddb9feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa0f7fe640 0 client.16800 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 shutdown_connections 2024-09-21T06:25:11.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 1 -- 172.21.15.38:0/3718331425 wait complete. 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.857+0000 7faa3cab5740 20 client.16800 trim_cache size 0 max 16384 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b7c768bc-9171-42b5-acea-7c082800993a", 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:11.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.866 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.867 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.868 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.869 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:11.870 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:11.871 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:11.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:11.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:11.871 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:11.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 msgr2=0x7faa180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 0x7faa180b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa280cb210 tx=0x7faa2804a000 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 msgr2=0x7faa3019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faa28005cc0 tx=0x7faa28003f90 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 shutdown_connections 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faa180b6680 0x7faa180b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa30109df0 0x7faa3019fdc0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa301094a0 0x7faa3019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 --2- 172.21.15.38:0/562332091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa30103b60 0x7faa3019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 >> 172.21.15.38:0/562332091 conn(0x7faa3007b850 msgr2=0x7faa30107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 shutdown_connections 2024-09-21T06:25:11.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:11.858+0000 7faa36541640 1 -- 172.21.15.38:0/562332091 wait complete. 2024-09-21T06:25:12.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:12 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:25:12.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:12 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:12 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:25:12.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:12 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:12 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:25:12.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:12 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:12 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:25:12.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:12 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:12 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:25:12.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:12 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:12 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:25:12.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:12 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:12.545 INFO:tasks.cephfs.filesystem:scrub status for tag:b7c768bc-9171-42b5-acea-7c082800993a - {'path': '/', 'tag': 'b7c768bc-9171-42b5-acea-7c082800993a', 'options': 'recursive,force'} 2024-09-21T06:25:13.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:13 smithi174 ceph-mon[34815]: pgmap v485: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:25:13.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:13 smithi044 ceph-mon[34369]: pgmap v485: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:25:13.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:13 smithi038 ceph-mon[31215]: pgmap v485: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:25:14.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:14 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:25:14.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:14 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:25:14.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:14 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:25:15.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:15 smithi174 ceph-mon[34815]: pgmap v486: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:25:15.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:15 smithi044 ceph-mon[34369]: pgmap v486: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:25:15.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:15 smithi038 ceph-mon[31215]: pgmap v486: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T06:25:17.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:17 smithi174 ceph-mon[34815]: pgmap v487: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:25:17.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:17 smithi044 ceph-mon[34369]: pgmap v487: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:25:17.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:17 smithi038 ceph-mon[31215]: pgmap v487: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:25:19.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:19 smithi174 ceph-mon[34815]: pgmap v488: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:25:19.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:19 smithi044 ceph-mon[34369]: pgmap v488: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:25:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:19 smithi038 ceph-mon[31215]: pgmap v488: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:25:21.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:21 smithi174 ceph-mon[34815]: pgmap v489: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:25:21.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:21 smithi044 ceph-mon[34369]: pgmap v489: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:25:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:21 smithi038 ceph-mon[31215]: pgmap v489: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:25:23.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:23 smithi174 ceph-mon[34815]: pgmap v490: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:25:23.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:23 smithi044 ceph-mon[34369]: pgmap v490: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:25:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:23 smithi038 ceph-mon[31215]: pgmap v490: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:25:25.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:25 smithi174 ceph-mon[34815]: pgmap v491: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:25:25.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:25 smithi044 ceph-mon[34369]: pgmap v491: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:25:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:25 smithi038 ceph-mon[31215]: pgmap v491: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:25:27.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:27 smithi044 ceph-mon[34369]: pgmap v492: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:27 smithi038 ceph-mon[31215]: pgmap v492: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:27.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:27 smithi174 ceph-mon[34815]: pgmap v492: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:29.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:29 smithi044 ceph-mon[34369]: pgmap v493: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:29 smithi038 ceph-mon[31215]: pgmap v493: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:29 smithi174 ceph-mon[34815]: pgmap v493: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:31.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:31 smithi038 ceph-mon[31215]: pgmap v494: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:31.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:31 smithi174 ceph-mon[34815]: pgmap v494: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:31.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:31 smithi044 ceph-mon[34369]: pgmap v494: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:33 smithi038 ceph-mon[31215]: pgmap v495: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:33.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:33 smithi174 ceph-mon[34815]: pgmap v495: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:33.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:33 smithi044 ceph-mon[34369]: pgmap v495: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:35 smithi038 ceph-mon[31215]: pgmap v496: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:35.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:35 smithi174 ceph-mon[34815]: pgmap v496: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:35 smithi044 ceph-mon[34369]: pgmap v496: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:37 smithi038 ceph-mon[31215]: pgmap v497: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:37 smithi174 ceph-mon[34815]: pgmap v497: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:37 smithi044 ceph-mon[34369]: pgmap v497: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:39 smithi038 ceph-mon[31215]: pgmap v498: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:39 smithi174 ceph-mon[34815]: pgmap v498: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:39 smithi044 ceph-mon[34369]: pgmap v498: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:41.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:41 smithi038 ceph-mon[31215]: pgmap v499: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:41.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:41 smithi174 ceph-mon[34815]: pgmap v499: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:41 smithi044 ceph-mon[34369]: pgmap v499: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:42.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:25:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:43.198 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:43 smithi038 ceph-mon[31215]: pgmap v500: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.288+0000 7f78e7539640 1 -- 172.21.15.38:0/3910218817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 msgr2=0x7f78e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.288+0000 7f78e7539640 1 --2- 172.21.15.38:0/3910218817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e010f520 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009ca0 tx=0x7f78d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.288+0000 7f78e7539640 1 -- 172.21.15.38:0/3910218817 shutdown_connections 2024-09-21T06:25:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 --2- 172.21.15.38:0/3910218817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e010f520 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 --2- 172.21.15.38:0/3910218817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 0x7f78e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 --2- 172.21.15.38:0/3910218817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 -- 172.21.15.38:0/3910218817 >> 172.21.15.38:0/3910218817 conn(0x7f78e0079730 msgr2=0x7f78e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 -- 172.21.15.38:0/3910218817 shutdown_connections 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 -- 172.21.15.38:0/3910218817 wait complete. 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.289+0000 7f78e7539640 1 Processor -- start 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 -- start start 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 0x7f78e019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0112aa0 con 0x7f78e0108cf0 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0112920 con 0x7f78e01083a0 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e7539640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0112c20 con 0x7f78e0102a60 2024-09-21T06:25:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e5ad6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e5ad6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50224/0 (socket says 172.21.15.38:50224) 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e5ad6640 1 -- 172.21.15.38:0/4257776144 learned_addr learned my addr 172.21.15.38:0/4257776144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 0x7f78e019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.290+0000 7f78e52d5640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 -- 172.21.15.38:0/4257776144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 msgr2=0x7f78e019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 -- 172.21.15.38:0/4257776144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 msgr2=0x7f78e019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 0x7f78e019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 -- 172.21.15.38:0/4257776144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e01a0450 con 0x7f78e0108cf0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e52d5640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e5ad6640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005e30 tx=0x7f78d8003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78d67fc640 1 -- 172.21.15.38:0/4257776144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8031650 con 0x7f78e0108cf0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e01a06e0 con 0x7f78e0108cf0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78d67fc640 1 -- 172.21.15.38:0/4257776144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78d80317f0 con 0x7f78e0108cf0 2024-09-21T06:25:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78d67fc640 1 -- 172.21.15.38:0/4257776144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d802fac0 con 0x7f78e0108cf0 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.291+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e01a6ea0 con 0x7f78e0108cf0 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.294+0000 7f78edaad740 1 Processor -- start 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78d67fc640 1 -- 172.21.15.38:0/4257776144 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f78d802fc80 con 0x7f78e0108cf0 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 -- start start 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 0x5568d70b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5568d7028e50 con 0x5568d6ce21b0 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568d7018280 con 0x5568d6d0b070 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78edaad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5568d701c090 con 0x5568d6cea390 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78e52d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78e52d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50240/0 (socket says 172.21.15.38:50240) 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78e52d5640 1 -- 172.21.15.38:0/1633810230 learned_addr learned my addr 172.21.15.38:0/1633810230 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 0x5568d70b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.295+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78d67fc640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 0x7f78cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 -- 172.21.15.38:0/1633810230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 msgr2=0x5568d70b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 -- 172.21.15.38:0/1633810230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 msgr2=0x5568d70b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 0x5568d70b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 -- 172.21.15.38:0/1633810230 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d6d76650 con 0x5568d6ce21b0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 0x5568d70b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e5ad6640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 0x7f78cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bd40 tx=0x7f78dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1368e7cb4af078e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78d67fc640 1 -- 172.21.15.38:0/4257776144 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f78d8108ad0 con 0x7f78e0108cf0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78cb7fe640 1 -- 172.21.15.38:0/1633810230 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc015070 con 0x5568d6ce21b0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78cb7fe640 1 -- 172.21.15.38:0/1633810230 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78dc011910 con 0x5568d6ce21b0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.296+0000 7f78cb7fe640 1 -- 172.21.15.38:0/1633810230 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0109c0 con 0x5568d6ce21b0 2024-09-21T06:25:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 -- 172.21.15.38:0/1633810230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 msgr2=0x5568d70b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78e5ad6640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 0x7f78cc0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ce6a0 tx=0x7f78d8092f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bd40 tx=0x7f78dc00f730 comp rx=0 tx=0).stop 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 -- 172.21.15.38:0/1633810230 shutdown_connections 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6ce21b0 0x5568d70b2780 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 --2- 172.21.15.38:0/1633810230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6d0b070 0x5568d70b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 -- 172.21.15.38:0/1633810230 >> 172.21.15.38:0/1633810230 conn(0x5568d6cff460 msgr2=0x5568d70b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 -- 172.21.15.38:0/1633810230 shutdown_connections 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.297+0000 7f78edaad740 1 -- 172.21.15.38:0/1633810230 wait complete. 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.298+0000 7f78edaad740 1 -- start start 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.298+0000 7f78edaad740 1 Processor -- start 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6ce21b0 0x5568d70c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6cea390 0x5568d70c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5568d6e79700 con 0x5568d6d0b070 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568d6fb3110 con 0x5568d6cea390 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5568d70c4d80 con 0x5568d6ce21b0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78edaad740 10 client.0 _ll_register_callbacks cb 0x5568d6fcc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50248/0 (socket says 172.21.15.38:50248) 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 -- 172.21.15.38:0/1002154893 learned_addr learned my addr 172.21.15.38:0/1002154893 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6cea390 0x5568d70c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6ce21b0 0x5568d70c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 -- 172.21.15.38:0/1002154893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6ce21b0 msgr2=0x5568d70c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6ce21b0 0x5568d70c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 -- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6cea390 msgr2=0x5568d70c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6cea390 0x5568d70c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 -- 172.21.15.38:0/1002154893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d6fe0c40 con 0x5568d6d0b070 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5568d70b4c20 tx=0x7f78d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d73aebc55dba9e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.299+0000 7f78c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0004050 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f78d00041f0 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78dc011910 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78d00043f0 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78edaad740 10 client.16812 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.300+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5568d70d0af0 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78dc011910 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f78d00215f0 con 0x5568d6d0b070 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 10 client.16812 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 20 client.16812 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6cc99f0 0x5568d70d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 4 client.16812 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.301+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568d702ada0 con 0x5568d6cc99f0 2024-09-21T06:25:43.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.302+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6cc99f0 0x5568d70d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.302+0000 7f78c8ff9640 10 client.16812 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.302+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6cc99f0 0x5568d70d3fa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c260cc263875ccdb server_cookie=58ebf0427026dc88 in_seq=0 out_seq=0 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78c8ff9640 1 -- 172.21.15.38:0/1002154893 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568d702ada0 con 0x5568d6cc99f0 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78c8ff9640 10 client.16812 handle_command_reply: tid=0 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 client.16812 shutdown 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 msgr2=0x5568d70c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5568d70b4c20 tx=0x7f78d0004730 comp rx=0 tx=0).stop 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 shutdown_connections 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70c2780 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6cea390 0x5568d70c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6cc99f0 0x5568d70d3fa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 --2- 172.21.15.38:0/1002154893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6ce21b0 0x5568d70c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78c8ff9640 0 client.16812 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 >> 172.21.15.38:0/1002154893 conn(0x5568d6cff460 msgr2=0x5568d70ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.303+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 shutdown_connections 2024-09-21T06:25:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.304+0000 7f78edaad740 1 -- 172.21.15.38:0/1002154893 wait complete. 2024-09-21T06:25:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.304+0000 7f78edaad740 20 client.16812 trim_cache size 0 max 16384 2024-09-21T06:25:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.337+0000 7f78edaad740 1 Processor -- start 2024-09-21T06:25:43.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.337+0000 7f78edaad740 1 -- start start 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70d9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01afc50 con 0x5568d6d0b070 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ad520 con 0x5568d6ce21b0 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78edaad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ab370 con 0x5568d6cea390 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e4ad4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e4ad4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70d9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50264/0 (socket says 172.21.15.38:50264) 2024-09-21T06:25:43.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e4ad4640 1 -- 172.21.15.38:0/1031896427 learned_addr learned my addr 172.21.15.38:0/1031896427 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 -- 172.21.15.38:0/1031896427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 msgr2=0x5568d70beeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70beeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 -- 172.21.15.38:0/1031896427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 msgr2=0x5568d70d9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70d9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.338+0000 7f78e52d5640 1 -- 172.21.15.38:0/1031896427 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d70b3030 con 0x5568d6cea390 2024-09-21T06:25:43.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.339+0000 7f78e52d5640 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70bf3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78dc006010 tx=0x7f78dc010660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710db504b1995d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.339+0000 7f78caffd640 1 -- 172.21.15.38:0/1031896427 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc015040 con 0x5568d6cea390 2024-09-21T06:25:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.339+0000 7f78caffd640 1 -- 172.21.15.38:0/1031896427 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78dc0103d0 con 0x5568d6cea390 2024-09-21T06:25:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.339+0000 7f78caffd640 1 -- 172.21.15.38:0/1031896427 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc005550 con 0x5568d6cea390 2024-09-21T06:25:43.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- 172.21.15.38:0/1031896427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 msgr2=0x5568d70bf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70bf3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78dc006010 tx=0x7f78dc010660 comp rx=0 tx=0).stop 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- 172.21.15.38:0/1031896427 shutdown_connections 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6d0b070 0x5568d70d9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6cea390 0x5568d70bf3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 --2- 172.21.15.38:0/1031896427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70beeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- 172.21.15.38:0/1031896427 >> 172.21.15.38:0/1031896427 conn(0x5568d6cff460 msgr2=0x5568d70c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- 172.21.15.38:0/1031896427 shutdown_connections 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- 172.21.15.38:0/1031896427 wait complete. 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 -- start start 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.340+0000 7f78edaad740 1 Processor -- start 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6d0b070 0x5568d70c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ab9e0 con 0x5568d6cea390 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ace50 con 0x5568d6ce21b0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ac0b0 con 0x5568d6d0b070 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78edaad740 10 client.0 _ll_register_callbacks cb 0x7f78d0009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50280/0 (socket says 172.21.15.38:50280) 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 -- 172.21.15.38:0/3568273126 learned_addr learned my addr 172.21.15.38:0/3568273126 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e4ad4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6d0b070 0x5568d70c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 -- 172.21.15.38:0/3568273126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6d0b070 msgr2=0x5568d70c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6d0b070 0x5568d70c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 -- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 msgr2=0x5568d70caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.341+0000 7f78e52d5640 1 -- 172.21.15.38:0/3568273126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d713d970 con 0x5568d6cea390 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78e52d5640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bfd0 tx=0x7f78dc0105f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1b2ac1bcbd0621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:43.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc03b060 con 0x5568d6cea390 2024-09-21T06:25:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78dc0103d0 con 0x5568d6cea390 2024-09-21T06:25:43.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f78dc005350 con 0x5568d6cea390 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78dc015070 con 0x5568d6cea390 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78edaad740 10 client.16818 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5568d713ead0 con 0x5568d6cea390 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.342+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78dc0103d0 con 0x5568d6cea390 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f78dc004b00 con 0x5568d6cea390 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 10 client.16818 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 20 client.16818 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:43.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6c9eda0 0x5568d71410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 4 client.16818 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5568d7026850 con 0x5568d6c9eda0 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6c9eda0 0x5568d71410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78e4ad4640 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6c9eda0 0x5568d71410a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cac87833380bb server_cookie=5994bda7020ca9c2 in_seq=0 out_seq=0 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.343+0000 7f78c8ff9640 10 client.16818 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78c8ff9640 1 -- 172.21.15.38:0/3568273126 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5568d7026850 con 0x5568d6c9eda0 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78c8ff9640 10 client.16818 handle_command_reply: tid=0 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 client.16818 shutdown 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 msgr2=0x5568d70c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bfd0 tx=0x7f78dc0105f0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 shutdown_connections 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5568d6c9eda0 0x5568d71410a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5568d6d0b070 0x5568d70c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5568d6cea390 0x5568d70c7f80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 --2- 172.21.15.38:0/3568273126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568d6ce21b0 0x5568d70caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 >> 172.21.15.38:0/3568273126 conn(0x5568d6cff460 msgr2=0x5568d70ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78c8ff9640 0 client.16818 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 shutdown_connections 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 1 -- 172.21.15.38:0/3568273126 wait complete. 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.344+0000 7f78edaad740 20 client.16818 trim_cache size 0 max 16384 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:25:43.350 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:25:43.351 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.352 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.353 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.354 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:43.356 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 msgr2=0x7f78cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 0x7f78cc0b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ce6a0 tx=0x7f78d8092f90 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 msgr2=0x7f78e019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005e30 tx=0x7f78d8003d80 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 shutdown_connections 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78cc0b6680 0x7f78cc0b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f78e0108cf0 0x7f78e019fd20 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78e01083a0 0x7f78e019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 --2- 172.21.15.38:0/4257776144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78e0102a60 0x7f78e019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 >> 172.21.15.38:0/4257776144 conn(0x7f78e0079730 msgr2=0x7f78e006b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:43.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 shutdown_connections 2024-09-21T06:25:43.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:43.345+0000 7f78e7539640 1 -- 172.21.15.38:0/4257776144 wait complete. 2024-09-21T06:25:43.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:43 smithi174 ceph-mon[34815]: pgmap v500: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:43 smithi044 ceph-mon[34369]: pgmap v500: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:44.136 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:25:44.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:44.403 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:44.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 -- 172.21.15.38:0/4100963392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 msgr2=0x7f8f24102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/4100963392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f24102e70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009900 tx=0x7f8f1402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 -- 172.21.15.38:0/4100963392 shutdown_connections 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/4100963392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 0x7f8f2410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/4100963392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 0x7f8f241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/4100963392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f24102e70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 -- 172.21.15.38:0/4100963392 >> 172.21.15.38:0/4100963392 conn(0x7f8f24079730 msgr2=0x7f8f24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 -- 172.21.15.38:0/4100963392 shutdown_connections 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.868+0000 7f8f2a73c640 1 -- 172.21.15.38:0/4100963392 wait complete. 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 Processor -- start 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 -- start start 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 0x7f8f2419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 0x7f8f2419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24112a80 con 0x7f8f24102a60 2024-09-21T06:25:44.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24112900 con 0x7f8f241083a0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.869+0000 7f8f2a73c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24112c00 con 0x7f8f24108cf0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50298/0 (socket says 172.21.15.38:50298) 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 -- 172.21.15.38:0/1740616684 learned_addr learned my addr 172.21.15.38:0/1740616684 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f237fe640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 0x7f8f2419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f28cd9640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 0x7f8f2419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 -- 172.21.15.38:0/1740616684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 msgr2=0x7f8f2419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 0x7f8f2419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 -- 172.21.15.38:0/1740616684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 msgr2=0x7f8f2419b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 0x7f8f2419b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 -- 172.21.15.38:0/1740616684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f241a64b0 con 0x7f8f24102a60 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f23fff640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006010 tx=0x7f8f14004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1403f070 con 0x7f8f24102a60 2024-09-21T06:25:44.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f241a6740 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f14003ac0 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14035030 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.870+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f241a6c20 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.871+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f24102e70 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.873+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8f14042070 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.874+0000 7f8f217fa640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 0x7f8f0c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.874+0000 7f8f237fe640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 0x7f8f0c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.874+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8f14108350 con 0x7f8f24102a60 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.874+0000 7f8f237fe640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 0x7f8f0c0b8bc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f24100d90 tx=0x7f8f1800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:44.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:44.877+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f140ce8c0 con 0x7f8f24102a60 2024-09-21T06:25:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.101+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f2406b270 con 0x7f8f24102a60 2024-09-21T06:25:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.102+0000 7f8f217fa640 1 -- 172.21.15.38:0/1740616684 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f8f140d2ca0 con 0x7f8f24102a60 2024-09-21T06:25:45.104 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:25:45.104 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:25:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 msgr2=0x7f8f0c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 0x7f8f0c0b8bc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f24100d90 tx=0x7f8f1800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 msgr2=0x7f8f2419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006010 tx=0x7f8f14004430 comp rx=0 tx=0).stop 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 shutdown_connections 2024-09-21T06:25:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8f0c0b66b0 0x7f8f0c0b8bc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f24108cf0 0x7f8f2419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f241083a0 0x7f8f2419b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 --2- 172.21.15.38:0/1740616684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8f24102a60 0x7f8f2419b2b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.104+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 >> 172.21.15.38:0/1740616684 conn(0x7f8f24079730 msgr2=0x7f8f24101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.105+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 shutdown_connections 2024-09-21T06:25:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:45.105+0000 7f8f2a73c640 1 -- 172.21.15.38:0/1740616684 wait complete. 2024-09-21T06:25:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:45 smithi038 ceph-mon[31215]: pgmap v501: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:45.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:45 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1740616684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:45 smithi174 ceph-mon[34815]: pgmap v501: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:45.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:45 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1740616684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:45 smithi044 ceph-mon[34369]: pgmap v501: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:25:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:45 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1740616684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:45.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:25:45.944 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/3798958343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84109df0 msgr2=0x7f0a84110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/3798958343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84109df0 0x7f0a84110620 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009ca0 tx=0x7f0a7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/3798958343 shutdown_connections 2024-09-21T06:25:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/3798958343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84109df0 0x7f0a84110620 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/3798958343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 0x7f0a841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/3798958343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84103b60 0x7f0a84103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/3798958343 >> 172.21.15.38:0/3798958343 conn(0x7f0a8407b850 msgr2=0x7f0a8407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/3798958343 shutdown_connections 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/3798958343 wait complete. 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.444+0000 7f0a8b7b6640 1 Processor -- start 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 -- start start 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 0x7f0a8419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 0x7f0a8419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84113bf0 con 0x7f0a84103b60 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84113a70 con 0x7f0a84109df0 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a8b7b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84113d70 con 0x7f0a841094a0 2024-09-21T06:25:46.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50328/0 (socket says 172.21.15.38:50328) 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 -- 172.21.15.38:0/503354328 learned_addr learned my addr 172.21.15.38:0/503354328 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a88d51640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 0x7f0a8419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89d53640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 0x7f0a8419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 -- 172.21.15.38:0/503354328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 msgr2=0x7f0a8419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 0x7f0a8419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 -- 172.21.15.38:0/503354328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 msgr2=0x7f0a8419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 0x7f0a8419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89552640 1 -- 172.21.15.38:0/503354328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a841a04f0 con 0x7f0a84103b60 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.445+0000 7f0a89d53640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 0x7f0a8419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a89552640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d950 tx=0x7f0a8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a7a7fc640 1 -- 172.21.15.38:0/503354328 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80017070 con 0x7f0a84103b60 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a841a07e0 con 0x7f0a84103b60 2024-09-21T06:25:46.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a7a7fc640 1 -- 172.21.15.38:0/503354328 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a80009c30 con 0x7f0a84103b60 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a7a7fc640 1 -- 172.21.15.38:0/503354328 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000f6b0 con 0x7f0a84103b60 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.446+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841a6f40 con 0x7f0a84103b60 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.448+0000 7f0a91d2a740 1 Processor -- start 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a7a7fc640 1 -- 172.21.15.38:0/503354328 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0a800109c0 con 0x7f0a84103b60 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 -- start start 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5648fddd9ea0 con 0x5648fda931b0 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5648fddc92d0 con 0x5648fda9b390 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5648fddcd0e0 con 0x5648fdabc070 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50340/0 (socket says 172.21.15.38:50340) 2024-09-21T06:25:46.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 -- 172.21.15.38:0/2737375028 learned_addr learned my addr 172.21.15.38:0/2737375028 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a88d51640 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89d53640 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 -- 172.21.15.38:0/2737375028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 msgr2=0x5648fde636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 -- 172.21.15.38:0/2737375028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 msgr2=0x5648fde64120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde64120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.449+0000 7f0a89552640 1 -- 172.21.15.38:0/2737375028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fdb27650 con 0x5648fda931b0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a7a7fc640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 0x7f0a700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a89d53640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 0x7f0a700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a7a7fc640 1 -- 172.21.15.38:0/503354328 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a800e73b0 con 0x7f0a84103b60 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a89552640 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0a800e4af0 tx=0x7f0a800eda30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec32628211baa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a6f7fe640 1 -- 172.21.15.38:0/2737375028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80020030 con 0x5648fda931b0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a6f7fe640 1 -- 172.21.15.38:0/2737375028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a800acd90 con 0x5648fda931b0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.450+0000 7f0a6f7fe640 1 -- 172.21.15.38:0/2737375028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a800a9120 con 0x5648fda931b0 2024-09-21T06:25:46.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- 172.21.15.38:0/2737375028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 msgr2=0x5648fde63be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a89d53640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 0x7f0a700b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c004af0 tx=0x7f0a7c005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0a800e4af0 tx=0x7f0a800eda30 comp rx=0 tx=0).stop 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- 172.21.15.38:0/2737375028 shutdown_connections 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde63be0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/2737375028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- 172.21.15.38:0/2737375028 >> 172.21.15.38:0/2737375028 conn(0x5648fdab0460 msgr2=0x5648fde61590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- 172.21.15.38:0/2737375028 shutdown_connections 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- 172.21.15.38:0/2737375028 wait complete. 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.451+0000 7f0a91d2a740 1 -- start start 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 Processor -- start 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda931b0 0x5648fde6ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde6f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5648fdc2a700 con 0x5648fdabc070 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5648fdd64160 con 0x5648fda9b390 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5648fde71e80 con 0x5648fda931b0 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a91d2a740 10 client.0 _ll_register_callbacks cb 0x5648fdd7d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a89d53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a89d53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50350/0 (socket says 172.21.15.38:50350) 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a89d53640 1 -- 172.21.15.38:0/3626927139 learned_addr learned my addr 172.21.15.38:0/3626927139 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.452+0000 7f0a89552640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda931b0 0x5648fde6ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde6f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 -- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda931b0 msgr2=0x5648fde6ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda931b0 0x5648fde6ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 -- 172.21.15.38:0/3626927139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 msgr2=0x5648fde6f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde6f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 -- 172.21.15.38:0/3626927139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fdd91c90 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c033030 tx=0x7f0a7c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645b75efcfce68c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004250 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a7c0043f0 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a800acd90 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a7c0045f0 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a91d2a740 10 client.16836 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.453+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648fde7dae0 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a800acd90 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a7c050070 con 0x5648fdabc070 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 10 client.16836 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 10 client.16836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 20 client.16836 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:46.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda7a9f0 0x5648fde80fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 4 client.16836 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648fdddbdf0 con 0x5648fda7a9f0 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.454+0000 7f0a89552640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda7a9f0 0x5648fde80fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.455+0000 7f0a89552640 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda7a9f0 0x5648fde80fd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e696cd8cd2ca0ec6 server_cookie=d792377022a605a2 in_seq=0 out_seq=0 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.455+0000 7f0a6cff9640 10 client.16836 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.455+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3626927139 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648fdddbdf0 con 0x5648fda7a9f0 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.455+0000 7f0a6cff9640 10 client.16836 handle_command_reply: tid=0 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 client.16836 shutdown 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 msgr2=0x5648fde6f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c033030 tx=0x7f0a7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 shutdown_connections 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda7a9f0 0x5648fde80fd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fdabc070 0x5648fde6f750 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda9b390 0x5648fde6f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3626927139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda931b0 0x5648fde6ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 >> 172.21.15.38:0/3626927139 conn(0x5648fdab0460 msgr2=0x5648fde66830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a6cff9640 0 client.16836 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:46.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 shutdown_connections 2024-09-21T06:25:46.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3626927139 wait complete. 2024-09-21T06:25:46.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.456+0000 7f0a91d2a740 20 client.16836 trim_cache size 0 max 16384 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 Processor -- start 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 -- start start 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda931b0 0x5648fde615c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b2010 con 0x5648fda9b390 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841af8e0 con 0x5648fda931b0 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841ad730 con 0x5648fdabc070 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50362/0 (socket says 172.21.15.38:50362) 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 -- 172.21.15.38:0/3000383595 learned_addr learned my addr 172.21.15.38:0/3000383595 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a89552640 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda931b0 0x5648fde615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 -- 172.21.15.38:0/3000383595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 msgr2=0x5648fde6c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde6c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 -- 172.21.15.38:0/3000383595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda931b0 msgr2=0x5648fde615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda931b0 0x5648fde615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.470+0000 7f0a88d51640 1 -- 172.21.15.38:0/3000383595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fde6d1d0 con 0x5648fda9b390 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.471+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400bc70 tx=0x7f0a74012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb888c4075414fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.471+0000 7f0a6effd640 1 -- 172.21.15.38:0/3000383595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74020070 con 0x5648fda9b390 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.471+0000 7f0a6effd640 1 -- 172.21.15.38:0/3000383595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a7400bd60 con 0x5648fda9b390 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.471+0000 7f0a6effd640 1 -- 172.21.15.38:0/3000383595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74010850 con 0x5648fda9b390 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3000383595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 msgr2=0x5648fde6bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400bc70 tx=0x7f0a74012820 comp rx=0 tx=0).stop 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3000383595 shutdown_connections 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fdabc070 0x5648fde6c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda9b390 0x5648fde6bec0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3000383595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fda931b0 0x5648fde615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3000383595 >> 172.21.15.38:0/3000383595 conn(0x5648fdab0460 msgr2=0x5648fde60eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3000383595 shutdown_connections 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3000383595 wait complete. 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 -- start start 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.472+0000 7f0a91d2a740 1 Processor -- start 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda9b390 0x5648fde73060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 0x5648fde73770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841adda0 con 0x5648fda931b0 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841af210 con 0x5648fdabc070 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841ae470 con 0x5648fda9b390 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a91d2a740 10 client.0 _ll_register_callbacks cb 0x7f0a7c02f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:46.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50370/0 (socket says 172.21.15.38:50370) 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 -- 172.21.15.38:0/3167613870 learned_addr learned my addr 172.21.15.38:0/3167613870 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 0x5648fde73770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda9b390 0x5648fde73060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 -- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda9b390 msgr2=0x5648fde73060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda9b390 0x5648fde73060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 -- 172.21.15.38:0/3167613870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 msgr2=0x5648fde73770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 0x5648fde73770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89552640 1 -- 172.21.15.38:0/3167613870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fdeea970 con 0x5648fda931b0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.473+0000 7f0a89d53640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 0x5648fde73770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a89552640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000bfd0 tx=0x7f0a8000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936f04beed877efc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8005c070 con 0x5648fda931b0 2024-09-21T06:25:46.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a800b6810 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a7400bd60 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a80020040 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 10 client.16842 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648fdeebb30 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a7400bd60 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a800a8bd0 con 0x5648fda931b0 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 10 client.16842 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 10 client.16842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 20 client.16842 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda4fda0 0x5648fdeede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 4 client.16842 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:46.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.474+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648fddd78a0 con 0x5648fda4fda0 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.475+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda4fda0 0x5648fdeede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.475+0000 7f0a88d51640 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda4fda0 0x5648fdeede20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd0053cc0cfd51cc server_cookie=90157453a0bcb9f9 in_seq=0 out_seq=0 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.475+0000 7f0a6cff9640 10 client.16842 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a6cff9640 1 -- 172.21.15.38:0/3167613870 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648fddd78a0 con 0x5648fda4fda0 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a6cff9640 10 client.16842 handle_command_reply: tid=0 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 client.16842 shutdown 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 msgr2=0x5648fde77b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000bfd0 tx=0x7f0a8000bf60 comp rx=0 tx=0).stop 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 shutdown_connections 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5648fda4fda0 0x5648fdeede20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5648fdabc070 0x5648fde73770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5648fda9b390 0x5648fde73060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 --2- 172.21.15.38:0/3167613870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5648fda931b0 0x5648fde77b30 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 >> 172.21.15.38:0/3167613870 conn(0x5648fdab0460 msgr2=0x5648fde667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a6cff9640 0 client.16842 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:46.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 shutdown_connections 2024-09-21T06:25:46.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 1 -- 172.21.15.38:0/3167613870 wait complete. 2024-09-21T06:25:46.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.476+0000 7f0a91d2a740 20 client.16842 trim_cache size 0 max 16384 2024-09-21T06:25:46.482 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 msgr2=0x7f0a700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 0x7f0a700b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c004af0 tx=0x7f0a7c005d80 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 msgr2=0x7f0a8419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d950 tx=0x7f0a8000de10 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 shutdown_connections 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0a700b6680 0x7f0a700b8b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0a84109df0 0x7f0a8419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a841094a0 0x7f0a8419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 --2- 172.21.15.38:0/503354328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a84103b60 0x7f0a8419a580 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 >> 172.21.15.38:0/503354328 conn(0x7f0a8407b850 msgr2=0x7f0a841054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 shutdown_connections 2024-09-21T06:25:46.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:46.477+0000 7f0a8b7b6640 1 -- 172.21.15.38:0/503354328 wait complete. 2024-09-21T06:25:47.222 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:47 smithi038 ceph-mon[31215]: pgmap v502: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:47.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:25:47.524 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:47.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:47 smithi174 ceph-mon[34815]: pgmap v502: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:47 smithi044 ceph-mon[34369]: pgmap v502: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- 172.21.15.38:0/323114564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed41094a0 msgr2=0x7f4ed41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 --2- 172.21.15.38:0/323114564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed41094a0 0x7f4ed41098b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009900 tx=0x7f4ec402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- 172.21.15.38:0/323114564 shutdown_connections 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 --2- 172.21.15.38:0/323114564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4109df0 0x7f4ed4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 --2- 172.21.15.38:0/323114564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed41094a0 0x7f4ed41098b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 --2- 172.21.15.38:0/323114564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed4103b60 0x7f4ed4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- 172.21.15.38:0/323114564 >> 172.21.15.38:0/323114564 conn(0x7f4ed407b850 msgr2=0x7f4ed407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- 172.21.15.38:0/323114564 shutdown_connections 2024-09-21T06:25:48.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- 172.21.15.38:0/323114564 wait complete. 2024-09-21T06:25:48.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 Processor -- start 2024-09-21T06:25:48.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.003+0000 7f4edbc13640 1 -- start start 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4103b60 0x7f4ed419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed41094a0 0x7f4ed419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4113bd0 con 0x7f4ed4109df0 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4113a50 con 0x7f4ed4103b60 2024-09-21T06:25:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4edbc13640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed4113d50 con 0x7f4ed41094a0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4ed99af640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4103b60 0x7f4ed419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50394/0 (socket says 172.21.15.38:50394) 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 -- 172.21.15.38:0/3706378626 learned_addr learned my addr 172.21.15.38:0/3706378626 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed41094a0 0x7f4ed419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 -- 172.21.15.38:0/3706378626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed41094a0 msgr2=0x7f4ed419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed41094a0 0x7f4ed419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 -- 172.21.15.38:0/3706378626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4103b60 msgr2=0x7f4ed419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4103b60 0x7f4ed419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.004+0000 7f4eda1b0640 1 -- 172.21.15.38:0/3706378626 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed41a04d0 con 0x7f4ed4109df0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4eda1b0640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00eb10 tx=0x7f4ecc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3706378626 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc004b20 con 0x7f4ed4109df0 2024-09-21T06:25:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3706378626 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ecc004cc0 con 0x7f4ed4109df0 2024-09-21T06:25:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed41a07c0 con 0x7f4ed4109df0 2024-09-21T06:25:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3706378626 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc010720 con 0x7f4ed4109df0 2024-09-21T06:25:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.005+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed41a6f20 con 0x7f4ed4109df0 2024-09-21T06:25:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.007+0000 7f4ee2187740 1 Processor -- start 2024-09-21T06:25:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.007+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3706378626 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4ecc005020 con 0x7f4ed4109df0 2024-09-21T06:25:48.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 -- start start 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d62f070 0x55713d9d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55713d94cea0 con 0x55713d60e390 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55713d93c2d0 con 0x55713d6061b0 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ee2187740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55713d9400e0 con 0x55713d62f070 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ed91ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ed91ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50406/0 (socket says 172.21.15.38:50406) 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ed91ae640 1 -- 172.21.15.38:0/1999531493 learned_addr learned my addr 172.21.15.38:0/1999531493 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ed99af640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d62f070 0x55713d9d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.008+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 0x7f4ec00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 -- 172.21.15.38:0/1999531493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d62f070 msgr2=0x55713d9d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d62f070 0x55713d9d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 -- 172.21.15.38:0/1999531493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 msgr2=0x55713d9d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 -- 172.21.15.38:0/1999531493 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713d69a650 con 0x55713d6061b0 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4eda1b0640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 0x7f4ec00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3706378626 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ecc0e7c80 con 0x7f4ed4109df0 2024-09-21T06:25:48.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ed99af640 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9d6800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004630 tx=0x7f4ed000bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ee0d5645a5e963 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ebffff640 1 -- 172.21.15.38:0/1999531493 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0003bd0 con 0x55713d6061b0 2024-09-21T06:25:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4eda1b0640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 0x7f4ec00b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0aa120 tx=0x7f4ecc08a960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ebffff640 1 -- 172.21.15.38:0/1999531493 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ed0015070 con 0x55713d6061b0 2024-09-21T06:25:48.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.009+0000 7f4ebffff640 1 -- 172.21.15.38:0/1999531493 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0004dd0 con 0x55713d6061b0 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 -- 172.21.15.38:0/1999531493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 msgr2=0x55713d9d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9d6800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004630 tx=0x7f4ed000bb20 comp rx=0 tx=0).stop 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 -- 172.21.15.38:0/1999531493 shutdown_connections 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9d6800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 --2- 172.21.15.38:0/1999531493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d62f070 0x55713d9d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 -- 172.21.15.38:0/1999531493 >> 172.21.15.38:0/1999531493 conn(0x55713d623460 msgr2=0x55713d9d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 -- 172.21.15.38:0/1999531493 shutdown_connections 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.010+0000 7f4ee2187740 1 -- 172.21.15.38:0/1999531493 wait complete. 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 -- start start 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 Processor -- start 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9e1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d60e390 0x55713d9e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55713d79d700 con 0x55713d62f070 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55713d8d7160 con 0x55713d6061b0 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55713d9e4aa0 con 0x55713d60e390 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ee2187740 10 client.0 _ll_register_callbacks cb 0x55713d8f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.011+0000 7f4ed91ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50420/0 (socket says 172.21.15.38:50420) 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 -- 172.21.15.38:0/3971416769 learned_addr learned my addr 172.21.15.38:0/3971416769 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d60e390 0x55713d9e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 -- 172.21.15.38:0/3971416769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d60e390 msgr2=0x55713d9e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d60e390 0x55713d9e1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 -- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 msgr2=0x55713d9e1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9e1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 -- 172.21.15.38:0/3971416769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713d904c90 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4004730 tx=0x7f4ec402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42edfef92281656 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ebd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4047040 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ec4004230 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed0015070 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4ec4051050 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ee2187740 10 client.16854 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.012+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55713d9f07a0 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ed0015070 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4ec4004b20 con 0x55713d62f070 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 10 client.16854 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 10 client.16854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:48.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 20 client.16854 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5ed9f0 0x55713d9f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 4 client.16854 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713d94edf0 con 0x55713d5ed9f0 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.013+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5ed9f0 0x55713d9f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.014+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5ed9f0 0x55713d9f3c70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa2f87c4243a9f11 server_cookie=7b37320f5c942d9d in_seq=0 out_seq=0 2024-09-21T06:25:48.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.014+0000 7f4ebd7fa640 10 client.16854 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/3971416769 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55713d94edf0 con 0x55713d5ed9f0 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ebd7fa640 10 client.16854 handle_command_reply: tid=0 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 client.16854 shutdown 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 msgr2=0x55713d9eddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4004730 tx=0x7f4ec402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 shutdown_connections 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5ed9f0 0x55713d9f3c70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d62f070 0x55713d9eddc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d60e390 0x55713d9e1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ebd7fa640 0 client.16854 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3971416769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d6061b0 0x55713d9e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 >> 172.21.15.38:0/3971416769 conn(0x55713d623460 msgr2=0x55713d9d9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 shutdown_connections 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 1 -- 172.21.15.38:0/3971416769 wait complete. 2024-09-21T06:25:48.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.015+0000 7f4ee2187740 20 client.16854 trim_cache size 0 max 16384 2024-09-21T06:25:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 Processor -- start 2024-09-21T06:25:48.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 -- start start 2024-09-21T06:25:48.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9d7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41b1e30 con 0x55713d60e390 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41af700 con 0x55713d62f070 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ee2187740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41ad570 con 0x55713d6061b0 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ed99af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ed99af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50424/0 (socket says 172.21.15.38:50424) 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ed99af640 1 -- 172.21.15.38:0/3768725637 learned_addr learned my addr 172.21.15.38:0/3768725637 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.029+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9d7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 -- 172.21.15.38:0/3768725637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 msgr2=0x55713d9d7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9d7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 -- 172.21.15.38:0/3768725637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 msgr2=0x55713d9d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9d3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 -- 172.21.15.38:0/3768725637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713d9e2260 con 0x55713d60e390 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ed99af640 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004980 tx=0x7f4ed0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec47e5579727d64b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ebf7fe640 1 -- 172.21.15.38:0/3768725637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0004660 con 0x55713d60e390 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ebf7fe640 1 -- 172.21.15.38:0/3768725637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ed0015030 con 0x55713d60e390 2024-09-21T06:25:48.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.030+0000 7f4ebf7fe640 1 -- 172.21.15.38:0/3768725637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed002ed80 con 0x55713d60e390 2024-09-21T06:25:48.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- 172.21.15.38:0/3768725637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 msgr2=0x55713d9d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004980 tx=0x7f4ed0013040 comp rx=0 tx=0).stop 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- 172.21.15.38:0/3768725637 shutdown_connections 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9d3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9d3760 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 --2- 172.21.15.38:0/3768725637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9d7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- 172.21.15.38:0/3768725637 >> 172.21.15.38:0/3768725637 conn(0x55713d623460 msgr2=0x55713d9d72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- 172.21.15.38:0/3768725637 shutdown_connections 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- 172.21.15.38:0/3768725637 wait complete. 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 -- start start 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.031+0000 7f4ee2187740 1 Processor -- start 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9e6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41adbc0 con 0x55713d60e390 2024-09-21T06:25:48.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41af030 con 0x55713d62f070 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed41ae290 con 0x55713d6061b0 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ee2187740 10 client.0 _ll_register_callbacks cb 0x7f4ec4032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50436/0 (socket says 172.21.15.38:50436) 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 -- 172.21.15.38:0/258517695 learned_addr learned my addr 172.21.15.38:0/258517695 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 -- 172.21.15.38:0/258517695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 msgr2=0x55713d9e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 -- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 msgr2=0x55713d9e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed99af640 1 -- 172.21.15.38:0/258517695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713da5d7f0 con 0x55713d60e390 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.032+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:48.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ed99af640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00043f0 tx=0x7f4ed0004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fdf06dbb72de9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0003ea0 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4ed002eb00 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed0015030 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4ed002ed00 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ee2187740 10 client.16860 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55713da5ea30 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ed0015030 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4ed0011b30 con 0x55713d60e390 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ee2187740 10 client.16860 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.033+0000 7f4ee2187740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ee2187740 20 client.16860 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5c2da0 0x55713da60f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ee2187740 4 client.16860 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55713d94a8a0 con 0x55713d5c2da0 2024-09-21T06:25:48.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5c2da0 0x55713da60f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ebd7fa640 10 client.16860 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ed91ae640 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5c2da0 0x55713da60f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f64f3f74c065059c server_cookie=2f65be1b43b1ba5e in_seq=0 out_seq=0 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ebd7fa640 1 -- 172.21.15.38:0/258517695 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55713d94a8a0 con 0x55713d5c2da0 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ebd7fa640 10 client.16860 handle_command_reply: tid=0 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.034+0000 7f4ee2187740 1 client.16860 shutdown 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 msgr2=0x55713d9e6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00043f0 tx=0x7f4ed0004660 comp rx=0 tx=0).stop 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 shutdown_connections 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55713d5c2da0 0x55713da60f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55713d62f070 0x55713d9e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55713d60e390 0x55713d9e6400 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 --2- 172.21.15.38:0/258517695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55713d6061b0 0x55713d9e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ebd7fa640 0 client.16860 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:48.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 >> 172.21.15.38:0/258517695 conn(0x55713d623460 msgr2=0x55713d9d7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 shutdown_connections 2024-09-21T06:25:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 1 -- 172.21.15.38:0/258517695 wait complete. 2024-09-21T06:25:48.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4ee2187740 20 client.16860 trim_cache size 0 max 16384 2024-09-21T06:25:48.041 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 msgr2=0x7f4ec00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 0x7f4ec00b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0aa120 tx=0x7f4ecc08a960 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 msgr2=0x7f4ed419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.035+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00eb10 tx=0x7f4ecc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 shutdown_connections 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4ec00b6680 0x7f4ec00b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ed4109df0 0x7f4ed419fda0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed41094a0 0x7f4ed419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 --2- 172.21.15.38:0/3706378626 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ed4103b60 0x7f4ed419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 >> 172.21.15.38:0/3706378626 conn(0x7f4ed407b850 msgr2=0x7f4ed41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:48.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 shutdown_connections 2024-09-21T06:25:48.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:48.036+0000 7f4edbc13640 1 -- 172.21.15.38:0/3706378626 wait complete. 2024-09-21T06:25:48.686 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:25:48.944 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:49.342 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:49 smithi038 ceph-mon[31215]: pgmap v503: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 -- 172.21.15.38:0/1034505511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b281083a0 msgr2=0x7f6b281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 --2- 172.21.15.38:0/1034505511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b281083a0 0x7f6b281087b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009900 tx=0x7f6b1c02a410 comp rx=0 tx=0).stop 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 -- 172.21.15.38:0/1034505511 shutdown_connections 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 --2- 172.21.15.38:0/1034505511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b28108cf0 0x7f6b2810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 --2- 172.21.15.38:0/1034505511 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b281083a0 0x7f6b281087b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 --2- 172.21.15.38:0/1034505511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28102a60 0x7f6b28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 -- 172.21.15.38:0/1034505511 >> 172.21.15.38:0/1034505511 conn(0x7f6b28079730 msgr2=0x7f6b28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 -- 172.21.15.38:0/1034505511 shutdown_connections 2024-09-21T06:25:49.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.435+0000 7f6b2d751640 1 -- 172.21.15.38:0/1034505511 wait complete. 2024-09-21T06:25:49.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 Processor -- start 2024-09-21T06:25:49.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 -- start start 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 0x7f6b2819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28108cf0 0x7f6b2819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28112a80 con 0x7f6b28102a60 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28112900 con 0x7f6b281083a0 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b2d751640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28112c00 con 0x7f6b28108cf0 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b26ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b26ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49940/0 (socket says 172.21.15.38:49940) 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.436+0000 7f6b26ffd640 1 -- 172.21.15.38:0/167807023 learned_addr learned my addr 172.21.15.38:0/167807023 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b267fc640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 0x7f6b2819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b277fe640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28108cf0 0x7f6b2819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 -- 172.21.15.38:0/167807023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28108cf0 msgr2=0x7f6b2819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28108cf0 0x7f6b2819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 -- 172.21.15.38:0/167807023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 msgr2=0x7f6b2819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 0x7f6b2819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 -- 172.21.15.38:0/167807023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b281a04b0 con 0x7f6b28102a60 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b267fc640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 0x7f6b2819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e9f0 tx=0x7f6b1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b0ffff640 1 -- 172.21.15.38:0/167807023 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1800cd80 con 0x7f6b28102a60 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b0ffff640 1 -- 172.21.15.38:0/167807023 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b180054f0 con 0x7f6b28102a60 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b281a07a0 con 0x7f6b28102a60 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b0ffff640 1 -- 172.21.15.38:0/167807023 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b18010690 con 0x7f6b28102a60 2024-09-21T06:25:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.437+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b281a6f00 con 0x7f6b28102a60 2024-09-21T06:25:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 Processor -- start 2024-09-21T06:25:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 -- start start 2024-09-21T06:25:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b41f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b41f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b41f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5572b416bea0 con 0x5572b3e251b0 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b415b2d0 con 0x5572b3e4e070 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572b415f0e0 con 0x5572b3e2d390 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b0ffff640 1 -- 172.21.15.38:0/167807023 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6b18010830 con 0x7f6b28102a60 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b26ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b41f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b41f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b41f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:36628/0 (socket says 172.21.15.38:36628) 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.440+0000 7f6b267fc640 1 -- 172.21.15.38:0/3876333580 learned_addr learned my addr 172.21.15.38:0/3876333580 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b277fe640 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b41f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3876333580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 msgr2=0x5572b41f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b41f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3876333580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 msgr2=0x5572b41f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b41f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3876333580 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b3eb9650 con 0x5572b3e251b0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b41f5800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6b180e5390 tx=0x7f6b180ebd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bf3c77073916c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b0ffff640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 0x7f6b100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b0d7fa640 1 -- 172.21.15.38:0/3876333580 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180aa0e0 con 0x5572b3e251b0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.441+0000 7f6b277fe640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 0x7f6b100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b0d7fa640 1 -- 172.21.15.38:0/3876333580 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b180056a0 con 0x5572b3e251b0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b0d7fa640 1 -- 172.21.15.38:0/3876333580 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180ad3e0 con 0x5572b3e251b0 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b0ffff640 1 -- 172.21.15.38:0/167807023 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b180e7bc0 con 0x7f6b28102a60 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3876333580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 msgr2=0x5572b41f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b277fe640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 0x7f6b100b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b20005fd0 tx=0x7f6b200097e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.442+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b41f5800 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6b180e5390 tx=0x7f6b180ebd00 comp rx=0 tx=0).stop 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3876333580 shutdown_connections 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b41f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b41f5800 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3876333580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b41f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3876333580 >> 172.21.15.38:0/3876333580 conn(0x5572b3e42460 msgr2=0x5572b41f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3876333580 shutdown_connections 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3876333580 wait complete. 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- start start 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 Processor -- start 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e251b0 0x5572b4200910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b4201390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5572b3fbc700 con 0x5572b3e2d390 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572b40f6160 con 0x5572b3e4e070 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.443+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572b4203aa0 con 0x5572b3e251b0 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b33cc5740 10 client.0 _ll_register_callbacks cb 0x5572b410f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49956/0 (socket says 172.21.15.38:49956) 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 -- 172.21.15.38:0/1206115842 learned_addr learned my addr 172.21.15.38:0/1206115842 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b277fe640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b4201390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e251b0 0x5572b4200910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 -- 172.21.15.38:0/1206115842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e251b0 msgr2=0x5572b4200910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e251b0 0x5572b4200910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 -- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 msgr2=0x5572b4201390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b4201390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 -- 172.21.15.38:0/1206115842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b4123c90 con 0x5572b3e2d390 2024-09-21T06:25:49.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b267fc640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009230 tx=0x7f6b1c031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4603d577b3592975 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c035040 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b180056a0 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.444+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b1c004240 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6b1c004440 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 10 client.16872 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5572b420f740 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b180056a0 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6b1c004b10 con 0x5572b3e2d390 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 10 client.16872 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 20 client.16872 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3e0c9f0 0x5572b4212b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 4 client.16872 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b416ddf0 con 0x5572b3e0c9f0 2024-09-21T06:25:49.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.445+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3e0c9f0 0x5572b4212b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.446+0000 7f6b0aff5640 10 client.16872 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:49.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.446+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3e0c9f0 0x5572b4212b60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d1faad77f995a9 server_cookie=d6016a1895b6a096 in_seq=0 out_seq=0 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b0aff5640 1 -- 172.21.15.38:0/1206115842 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572b416ddf0 con 0x5572b3e0c9f0 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b0aff5640 10 client.16872 handle_command_reply: tid=0 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 client.16872 shutdown 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 msgr2=0x5572b4200e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009230 tx=0x7f6b1c031740 comp rx=0 tx=0).stop 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 shutdown_connections 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b4201390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b4200e50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3e0c9f0 0x5572b4212b60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/1206115842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e251b0 0x5572b4200910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b0aff5640 0 client.16872 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 >> 172.21.15.38:0/1206115842 conn(0x5572b3e42460 msgr2=0x5572b41f84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 shutdown_connections 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 1 -- 172.21.15.38:0/1206115842 wait complete. 2024-09-21T06:25:49.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.447+0000 7f6b33cc5740 20 client.16872 trim_cache size 0 max 16384 2024-09-21T06:25:49.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 Processor -- start 2024-09-21T06:25:49.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 -- start start 2024-09-21T06:25:49.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 0x5572b4202540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e4e070 0x5572b41fe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281b1ec0 con 0x5572b3e2d390 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281af790 con 0x5572b3e251b0 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281ad5e0 con 0x5572b3e4e070 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49966/0 (socket says 172.21.15.38:49966) 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 -- 172.21.15.38:0/3032293557 learned_addr learned my addr 172.21.15.38:0/3032293557 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b277fe640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e4e070 0x5572b41fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 0x5572b4202540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 -- 172.21.15.38:0/3032293557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e4e070 msgr2=0x5572b41fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e4e070 0x5572b41fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 -- 172.21.15.38:0/3032293557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 msgr2=0x5572b4202540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 0x5572b4202540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b267fc640 1 -- 172.21.15.38:0/3032293557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b41fb540 con 0x5572b3e2d390 2024-09-21T06:25:49.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.461+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 0x5572b4202540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:49.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.462+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009900 tx=0x7f6b1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f5d47632c925c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.462+0000 7f6b0cff9640 1 -- 172.21.15.38:0/3032293557 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c035050 con 0x5572b3e2d390 2024-09-21T06:25:49.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.462+0000 7f6b0cff9640 1 -- 172.21.15.38:0/3032293557 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b1c005000 con 0x5572b3e2d390 2024-09-21T06:25:49.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.462+0000 7f6b0cff9640 1 -- 172.21.15.38:0/3032293557 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c003d70 con 0x5572b3e2d390 2024-09-21T06:25:49.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3032293557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 msgr2=0x5572b41fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009900 tx=0x7f6b1c0045e0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3032293557 shutdown_connections 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e4e070 0x5572b41fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e2d390 0x5572b41fdb00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3032293557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e251b0 0x5572b4202540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3032293557 >> 172.21.15.38:0/3032293557 conn(0x5572b3e42460 msgr2=0x5572b4201e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3032293557 shutdown_connections 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3032293557 wait complete. 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 -- start start 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 Processor -- start 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.463+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b4205940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b427c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281adc50 con 0x5572b3e251b0 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281af0c0 con 0x5572b3e4e070 2024-09-21T06:25:49.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b281ae320 con 0x5572b3e2d390 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 10 client.0 _ll_register_callbacks cb 0x7f6b1c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49970/0 (socket says 172.21.15.38:49970) 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3946368633 learned_addr learned my addr 172.21.15.38:0/3946368633 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b4205940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b277fe640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b427c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3946368633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 msgr2=0x5572b4205940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b4205940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 msgr2=0x5572b427c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b427c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 -- 172.21.15.38:0/3946368633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b427caf0 con 0x5572b3e251b0 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b277fe640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b427c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b4205940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:49.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b26ffd640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6b180e5990 tx=0x7f6b1800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c027102d88954b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180eb020 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6b1801fd40 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.464+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b1c005000 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6b180ad5d0 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 10 client.16878 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5572b427dce0 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b1c005000 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6b180e5610 con 0x5572b3e251b0 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 10 client.16878 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 20 client.16878 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3de1da0 0x5572b427ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 4 client.16878 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:49.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572b41698a0 con 0x5572b3de1da0 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.465+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3de1da0 0x5572b427ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b267fc640 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3de1da0 0x5572b427ffd0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1645d8902faf25 server_cookie=e7496b93ed499429 in_seq=0 out_seq=0 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b0aff5640 10 client.16878 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b0aff5640 1 -- 172.21.15.38:0/3946368633 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572b41698a0 con 0x5572b3de1da0 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b0aff5640 10 client.16878 handle_command_reply: tid=0 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 client.16878 shutdown 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 msgr2=0x5572b4205400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6b180e5990 tx=0x7f6b1800c7d0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 shutdown_connections 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572b3e4e070 0x5572b427c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5572b3de1da0 0x5572b427ffd0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572b3e2d390 0x5572b4205940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 --2- 172.21.15.38:0/3946368633 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5572b3e251b0 0x5572b4205400 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 >> 172.21.15.38:0/3946368633 conn(0x5572b3e42460 msgr2=0x5572b420bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.466+0000 7f6b0aff5640 0 client.16878 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 shutdown_connections 2024-09-21T06:25:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b33cc5740 1 -- 172.21.15.38:0/3946368633 wait complete. 2024-09-21T06:25:49.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b33cc5740 20 client.16878 trim_cache size 0 max 16384 2024-09-21T06:25:49.473 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 msgr2=0x7f6b100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 0x7f6b100b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b20005fd0 tx=0x7f6b200097e0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 msgr2=0x7f6b2819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800e9f0 tx=0x7f6b1800edf0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 shutdown_connections 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6b100b6680 0x7f6b100b8b90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b28108cf0 0x7f6b2819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b281083a0 0x7f6b2819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 --2- 172.21.15.38:0/167807023 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b28102a60 0x7f6b2819a540 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 >> 172.21.15.38:0/167807023 conn(0x7f6b28079730 msgr2=0x7f6b281066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:49.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 shutdown_connections 2024-09-21T06:25:49.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:49.467+0000 7f6b2d751640 1 -- 172.21.15.38:0/167807023 wait complete. 2024-09-21T06:25:49.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:49 smithi174 ceph-mon[34815]: pgmap v503: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:49 smithi044 ceph-mon[34369]: pgmap v503: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:51.169 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:25:51.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:25:51.441 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:51.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:51 smithi038 ceph-mon[31215]: pgmap v504: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:25:51.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:51 smithi174 ceph-mon[34815]: pgmap v504: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:25:51.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:51 smithi044 ceph-mon[34369]: pgmap v504: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:25:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 -- 172.21.15.38:0/3181912998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 msgr2=0x7f504c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 --2- 172.21.15.38:0/3181912998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c103f70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5048009900 tx=0x7f504802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:51.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 -- 172.21.15.38:0/3181912998 shutdown_connections 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 --2- 172.21.15.38:0/3181912998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c109df0 0x7f504c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 --2- 172.21.15.38:0/3181912998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c1094a0 0x7f504c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 --2- 172.21.15.38:0/3181912998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c103f70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 -- 172.21.15.38:0/3181912998 >> 172.21.15.38:0/3181912998 conn(0x7f504c07b850 msgr2=0x7f504c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 -- 172.21.15.38:0/3181912998 shutdown_connections 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.912+0000 7f5053488640 1 -- 172.21.15.38:0/3181912998 wait complete. 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 Processor -- start 2024-09-21T06:25:51.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 -- start start 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c1094a0 0x7f504c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c109df0 0x7f504c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f504c113bf0 con 0x7f504c103b60 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f504c113a70 con 0x7f504c109df0 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5053488640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f504c113d70 con 0x7f504c1094a0 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5051224640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5051224640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49992/0 (socket says 172.21.15.38:49992) 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.913+0000 7f5051224640 1 -- 172.21.15.38:0/2216270596 learned_addr learned my addr 172.21.15.38:0/2216270596 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:51.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051a25640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c109df0 0x7f504c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5050a23640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c1094a0 0x7f504c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 -- 172.21.15.38:0/2216270596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c1094a0 msgr2=0x7f504c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c1094a0 0x7f504c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 -- 172.21.15.38:0/2216270596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c109df0 msgr2=0x7f504c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c109df0 0x7f504c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 -- 172.21.15.38:0/2216270596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c1a0570 con 0x7f504c103b60 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5051224640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5048005ab0 tx=0x7f50480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f50427fc640 1 -- 172.21.15.38:0/2216270596 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504803f030 con 0x7f504c103b60 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f50427fc640 1 -- 172.21.15.38:0/2216270596 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5048003cd0 con 0x7f504c103b60 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f50427fc640 1 -- 172.21.15.38:0/2216270596 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048035070 con 0x7f504c103b60 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504c1a0800 con 0x7f504c103b60 2024-09-21T06:25:51.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.914+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504c0755f0 con 0x7f504c103b60 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.917+0000 7f50427fc640 1 -- 172.21.15.38:0/2216270596 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5048042030 con 0x7f504c103b60 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.917+0000 7f50599fc740 1 Processor -- start 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.917+0000 7f50599fc740 1 -- start start 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.917+0000 7f50599fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50599fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50599fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2ff670 0x564d9a6c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50599fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564d9a63de60 con 0x564d9a320350 2024-09-21T06:25:51.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50599fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564d9a62d290 con 0x564d9a2ff670 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50599fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564d9a6310a0 con 0x564d9a2f7490 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49998/0 (socket says 172.21.15.38:49998) 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 -- 172.21.15.38:0/1018690823 learned_addr learned my addr 172.21.15.38:0/1018690823 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5050a23640 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2ff670 0x564d9a6c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051224640 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50427fc640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 0x7f50380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 -- 172.21.15.38:0/1018690823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 msgr2=0x564d9a6c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 -- 172.21.15.38:0/1018690823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2ff670 msgr2=0x564d9a6c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2ff670 0x564d9a6c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f5051a25640 1 -- 172.21.15.38:0/1018690823 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9a38b930 con 0x564d9a320350 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.918+0000 7f50427fc640 1 -- 172.21.15.38:0/2216270596 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5048107c20 con 0x7f504c103b60 2024-09-21T06:25:51.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.919+0000 7f5051a25640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 0x7f50380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.919+0000 7f5051a25640 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5044009e60 tx=0x7f5044010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f782e0d404e5494d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.919+0000 7f50377fe640 1 -- 172.21.15.38:0/1018690823 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044021070 con 0x564d9a320350 2024-09-21T06:25:51.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.919+0000 7f50377fe640 1 -- 172.21.15.38:0/1018690823 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f50440113e0 con 0x564d9a320350 2024-09-21T06:25:51.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.919+0000 7f50377fe640 1 -- 172.21.15.38:0/1018690823 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016070 con 0x564d9a320350 2024-09-21T06:25:51.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- 172.21.15.38:0/1018690823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 msgr2=0x564d9a6c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5044009e60 tx=0x7f5044010740 comp rx=0 tx=0).stop 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f5051a25640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 0x7f50380b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5044011010 tx=0x7f5044021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- 172.21.15.38:0/1018690823 shutdown_connections 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2ff670 0x564d9a6c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 --2- 172.21.15.38:0/1018690823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6c7430 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- 172.21.15.38:0/1018690823 >> 172.21.15.38:0/1018690823 conn(0x564d9a314740 msgr2=0x564d9a6c5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- 172.21.15.38:0/1018690823 shutdown_connections 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- 172.21.15.38:0/1018690823 wait complete. 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 -- start start 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.920+0000 7f50599fc740 1 Processor -- start 2024-09-21T06:25:51.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2f7490 0x564d9a6d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564d9a48e890 con 0x564d9a320350 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564d9a5c7d40 con 0x564d9a2f7490 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564d9a6d5c10 con 0x564d9a2ff670 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f50599fc740 10 client.0 _ll_register_callbacks cb 0x564d9a62bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50004/0 (socket says 172.21.15.38:50004) 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 -- 172.21.15.38:0/2177702644 learned_addr learned my addr 172.21.15.38:0/2177702644 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051224640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2f7490 0x564d9a6d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5050a23640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 -- 172.21.15.38:0/2177702644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 msgr2=0x564d9a6d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 -- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2f7490 msgr2=0x564d9a6d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2f7490 0x564d9a6d2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5051a25640 1 -- 172.21.15.38:0/2177702644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9a6df490 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.921+0000 7f5050a23640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5051a25640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5044006010 tx=0x7f5044012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5703c34994066f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5034ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044016040 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f50440049e0 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50440113e0 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f50440119a0 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f50599fc740 10 client.16890 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d9a6e1dc0 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.922+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f50440113e0 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f504400f040 con 0x564d9a320350 2024-09-21T06:25:51.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 10 client.16890 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 20 client.16890 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2decd0 0x564d9a6e5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 4 client.16890 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d9a63fdb0 con 0x564d9a2decd0 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f5051224640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2decd0 0x564d9a6e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.923+0000 7f5051224640 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2decd0 0x564d9a6e5180 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bcf0afbdc7a7bcc server_cookie=b04cb1c2352570c in_seq=0 out_seq=0 2024-09-21T06:25:51.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.924+0000 7f5034ff9640 10 client.16890 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.924+0000 7f5034ff9640 1 -- 172.21.15.38:0/2177702644 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d9a63fdb0 con 0x564d9a2decd0 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.924+0000 7f5034ff9640 10 client.16890 handle_command_reply: tid=0 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.924+0000 7f50599fc740 1 client.16890 shutdown 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 msgr2=0x564d9a6def00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5044006010 tx=0x7f5044012a00 comp rx=0 tx=0).stop 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 shutdown_connections 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a320350 0x564d9a6def00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2decd0 0x564d9a6e5180 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 --2- 172.21.15.38:0/2177702644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a2f7490 0x564d9a6d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 >> 172.21.15.38:0/2177702644 conn(0x564d9a314740 msgr2=0x564d9a6ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f5034ff9640 0 client.16890 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 shutdown_connections 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 1 -- 172.21.15.38:0/2177702644 wait complete. 2024-09-21T06:25:51.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.925+0000 7f50599fc740 20 client.16890 trim_cache size 0 max 16384 2024-09-21T06:25:51.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 Processor -- start 2024-09-21T06:25:51.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 -- start start 2024-09-21T06:25:51.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b4180 con 0x564d9a2f7490 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b1a50 con 0x564d9a320350 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f50599fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1af8a0 con 0x564d9a2ff670 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50020/0 (socket says 172.21.15.38:50020) 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 -- 172.21.15.38:0/3121120745 learned_addr learned my addr 172.21.15.38:0/3121120745 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5050a23640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051a25640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 -- 172.21.15.38:0/3121120745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 msgr2=0x564d9a6d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 -- 172.21.15.38:0/3121120745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 msgr2=0x564d9a6c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5051224640 1 -- 172.21.15.38:0/3121120745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d9a6d4070 con 0x564d9a2f7490 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.943+0000 7f5050a23640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f5051224640 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5048006010 tx=0x7f504810b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb7f1aea3d8c7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f5036ffd640 1 -- 172.21.15.38:0/3121120745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50480d2070 con 0x564d9a2f7490 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f5036ffd640 1 -- 172.21.15.38:0/3121120745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f50480cd600 con 0x564d9a2f7490 2024-09-21T06:25:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f5036ffd640 1 -- 172.21.15.38:0/3121120745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048049040 con 0x564d9a2f7490 2024-09-21T06:25:51.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f50599fc740 1 -- 172.21.15.38:0/3121120745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 msgr2=0x564d9a6dee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.944+0000 7f50599fc740 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5048006010 tx=0x7f504810b770 comp rx=0 tx=0).stop 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 -- 172.21.15.38:0/3121120745 shutdown_connections 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2ff670 0x564d9a6d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 --2- 172.21.15.38:0/3121120745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2f7490 0x564d9a6dee70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 -- 172.21.15.38:0/3121120745 >> 172.21.15.38:0/3121120745 conn(0x564d9a314740 msgr2=0x564d9a6d4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 -- 172.21.15.38:0/3121120745 shutdown_connections 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 -- 172.21.15.38:0/3121120745 wait complete. 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 -- start start 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.945+0000 7f50599fc740 1 Processor -- start 2024-09-21T06:25:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1aff10 con 0x564d9a2ff670 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b1380 con 0x564d9a320350 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1b05e0 con 0x564d9a2f7490 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f50599fc740 10 client.0 _ll_register_callbacks cb 0x7f504401f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50030/0 (socket says 172.21.15.38:50030) 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 -- 172.21.15.38:0/1195831920 learned_addr learned my addr 172.21.15.38:0/1195831920 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5051a25640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5051224640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 -- 172.21.15.38:0/1195831920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 msgr2=0x564d9a6e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6e6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 -- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 msgr2=0x564d9a6e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 -- 172.21.15.38:0/1195831920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d9a74eab0 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5050a23640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f503c009de0 tx=0x7f503c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907826253e7e98d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5034ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.946+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c021060 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f503c0117d0 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50480cd600 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f503c0119d0 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 10 client.16896 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d9a74fdd0 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f50480cd600 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f503c00f040 con 0x564d9a2ff670 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 10 client.16896 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 20 client.16896 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2b4080 0x564d9a7525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:51.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 4 client.16896 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:25:51.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.947+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564d9a63b860 con 0x564d9a2b4080 2024-09-21T06:25:51.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.948+0000 7f5051224640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2b4080 0x564d9a7525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:51.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.948+0000 7f5051224640 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2b4080 0x564d9a7525c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb4036f3dcbd059 server_cookie=393a3937d61cf030 in_seq=0 out_seq=0 2024-09-21T06:25:51.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.948+0000 7f5034ff9640 10 client.16896 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f5034ff9640 1 -- 172.21.15.38:0/1195831920 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564d9a63b860 con 0x564d9a2b4080 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f5034ff9640 10 client.16896 handle_command_reply: tid=0 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 client.16896 shutdown 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 msgr2=0x564d9a6e6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f503c009de0 tx=0x7f503c013830 comp rx=0 tx=0).stop 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 shutdown_connections 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d9a320350 0x564d9a6e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d9a2ff670 0x564d9a6e6890 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d9a2b4080 0x564d9a7525c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 --2- 172.21.15.38:0/1195831920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d9a2f7490 0x564d9a6e6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 >> 172.21.15.38:0/1195831920 conn(0x564d9a314740 msgr2=0x564d9a6c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f5034ff9640 0 client.16896 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 shutdown_connections 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 1 -- 172.21.15.38:0/1195831920 wait complete. 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.950+0000 7f50599fc740 20 client.16896 trim_cache size 0 max 16384 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a2da322f-d1ba-4e07-98ba-07e91d47351e", 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:25:51.956 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 msgr2=0x7f50380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 0x7f50380b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5044011010 tx=0x7f5044021000 comp rx=0 tx=0).stop 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 msgr2=0x7f504c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5048005ab0 tx=0x7f50480042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 shutdown_connections 2024-09-21T06:25:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f50380b6700 0x7f50380b8c10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f504c109df0 0x7f504c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f504c1094a0 0x7f504c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 --2- 172.21.15.38:0/2216270596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f504c103b60 0x7f504c19a600 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 >> 172.21.15.38:0/2216270596 conn(0x7f504c07b850 msgr2=0x7f504c1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 shutdown_connections 2024-09-21T06:25:51.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:51.951+0000 7f5053488640 1 -- 172.21.15.38:0/2216270596 wait complete. 2024-09-21T06:25:52.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:25:52.927 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: pgmap v505: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:53 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:25:53.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 -- 172.21.15.38:0/2645407218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 msgr2=0x7f9204102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2645407218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 0x7f9204102e90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009900 tx=0x7f91f402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:53.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 -- 172.21.15.38:0/2645407218 shutdown_connections 2024-09-21T06:25:53.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2645407218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204108d10 0x7f920410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2645407218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92041083c0 0x7f92041087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2645407218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9204102a80 0x7f9204102e90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 -- 172.21.15.38:0/2645407218 >> 172.21.15.38:0/2645407218 conn(0x7f9204079740 msgr2=0x7f9204079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.443+0000 7f9208cf0640 1 -- 172.21.15.38:0/2645407218 shutdown_connections 2024-09-21T06:25:53.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.444+0000 7f9208cf0640 1 -- 172.21.15.38:0/2645407218 wait complete. 2024-09-21T06:25:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.444+0000 7f9208cf0640 1 Processor -- start 2024-09-21T06:25:53.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.444+0000 7f9208cf0640 1 -- start start 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204102a80 0x7f920419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204108d10 0x7f920419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113bc0 con 0x7f92041083c0 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113a40 con 0x7f9204108d10 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9208cf0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9204113d40 con 0x7f9204102a80 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50046/0 (socket says 172.21.15.38:50046) 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 -- 172.21.15.38:0/2205767519 learned_addr learned my addr 172.21.15.38:0/2205767519 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f9202d9d640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204108d10 0x7f920419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f920259c640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204102a80 0x7f920419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 -- 172.21.15.38:0/2205767519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204102a80 msgr2=0x7f920419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204102a80 0x7f920419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 -- 172.21.15.38:0/2205767519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204108d10 msgr2=0x7f920419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204108d10 0x7f920419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 -- 172.21.15.38:0/2205767519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92041a04a0 con 0x7f92041083c0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.445+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c970 tx=0x7f91ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.446+0000 7f91fb7fe640 1 -- 172.21.15.38:0/2205767519 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec007bb0 con 0x7f92041083c0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.446+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041a0790 con 0x7f92041083c0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.446+0000 7f91fb7fe640 1 -- 172.21.15.38:0/2205767519 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91ec007d50 con 0x7f92041083c0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.446+0000 7f91fb7fe640 1 -- 172.21.15.38:0/2205767519 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00f450 con 0x7f92041083c0 2024-09-21T06:25:53.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.446+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041a6ef0 con 0x7f92041083c0 2024-09-21T06:25:53.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.448+0000 7f920f264740 1 Processor -- start 2024-09-21T06:25:53.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 -- start start 2024-09-21T06:25:53.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f91fb7fe640 1 -- 172.21.15.38:0/2205767519 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f91ec004f60 con 0x7f92041083c0 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581b9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57df1390 0x559a581ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559a5812fe50 con 0x559a57de91b0 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559a5811f280 con 0x559a57df1390 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920f264740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559a58123090 con 0x559a57e12070 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50060/0 (socket says 172.21.15.38:50060) 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f920259c640 1 -- 172.21.15.38:0/1251653299 learned_addr learned my addr 172.21.15.38:0/1251653299 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.449+0000 7f9202d9d640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f91fbfff640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57df1390 0x559a581ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 -- 172.21.15.38:0/1251653299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 msgr2=0x559a581b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 -- 172.21.15.38:0/1251653299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57df1390 msgr2=0x559a581ba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57df1390 0x559a581ba0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 -- 172.21.15.38:0/1251653299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a57e7d650 con 0x559a57de91b0 2024-09-21T06:25:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f9202d9d640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:53.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f920259c640 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009900 tx=0x7f91f4031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb91d62d58c505d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f91f8ff9640 1 -- 172.21.15.38:0/1251653299 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4040070 con 0x559a57de91b0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f91fb7fe640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f91f8ff9640 1 -- 172.21.15.38:0/1251653299 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91f4031710 con 0x559a57de91b0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f91f8ff9640 1 -- 172.21.15.38:0/1251653299 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4035040 con 0x559a57de91b0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.450+0000 7f9202d9d640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f91fb7fe640 1 -- 172.21.15.38:0/2205767519 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f91ec0e7280 con 0x7f92041083c0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 -- 172.21.15.38:0/1251653299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 msgr2=0x559a581b9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f9202d9d640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91fc005fd0 tx=0x7f91fc009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009900 tx=0x7f91f4031c70 comp rx=0 tx=0).stop 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 -- 172.21.15.38:0/1251653299 shutdown_connections 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57df1390 0x559a581ba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57de91b0 0x559a581b9b90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 --2- 172.21.15.38:0/1251653299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 -- 172.21.15.38:0/1251653299 >> 172.21.15.38:0/1251653299 conn(0x559a57e06460 msgr2=0x559a581b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 -- 172.21.15.38:0/1251653299 shutdown_connections 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.451+0000 7f920f264740 1 -- 172.21.15.38:0/1251653299 wait complete. 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 -- start start 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 Processor -- start 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57de91b0 0x559a581c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 0x559a581d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559a57f80700 con 0x559a57df1390 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559a580ba110 con 0x559a57e12070 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559a581c7dd0 con 0x559a57de91b0 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f920f264740 10 client.0 _ll_register_callbacks cb 0x559a580d3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50066/0 (socket says 172.21.15.38:50066) 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f91fbfff640 1 -- 172.21.15.38:0/2100526786 learned_addr learned my addr 172.21.15.38:0/2100526786 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.452+0000 7f9202d9d640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 0x559a581d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f920259c640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57de91b0 0x559a581c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 -- 172.21.15.38:0/2100526786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57de91b0 msgr2=0x559a581c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57de91b0 0x559a581c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 -- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 msgr2=0x559a581d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 0x559a581d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 -- 172.21.15.38:0/2100526786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a580e7c40 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f9202d9d640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 0x559a581d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91fbfff640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c940 tx=0x7f91ec00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2681e1b79a4afc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec01d040 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f91ec0a8d50 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91f4031710 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91ec0acb50 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f920f264740 10 client.16908 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.453+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559a581d3b40 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91f4031710 con 0x559a57df1390 2024-09-21T06:25:53.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91ec0eaac0 con 0x559a57df1390 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 10 client.16908 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 20 client.16908 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57dd09f0 0x559a581d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 4 client.16908 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a58131da0 con 0x559a57dd09f0 2024-09-21T06:25:53.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.454+0000 7f920259c640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57dd09f0 0x559a581d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.455+0000 7f920259c640 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57dd09f0 0x559a581d7010 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a1740f6b10e7c6 server_cookie=64def6aac0ae3c7f in_seq=0 out_seq=0 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.455+0000 7f91e9ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f91e9ffb640 1 -- 172.21.15.38:0/2100526786 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a58131da0 con 0x559a57dd09f0 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f91e9ffb640 10 client.16908 handle_command_reply: tid=0 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 client.16908 shutdown 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 msgr2=0x559a581c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c940 tx=0x7f91ec00a570 comp rx=0 tx=0).stop 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 shutdown_connections 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57e12070 0x559a581d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c52d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57dd09f0 0x559a581d7010 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 --2- 172.21.15.38:0/2100526786 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57de91b0 0x559a581c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 >> 172.21.15.38:0/2100526786 conn(0x559a57e06460 msgr2=0x559a581bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f91e9ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 shutdown_connections 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 1 -- 172.21.15.38:0/2100526786 wait complete. 2024-09-21T06:25:53.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.456+0000 7f920f264740 20 client.16908 trim_cache size 0 max 16384 2024-09-21T06:25:53.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.473+0000 7f920f264740 1 Processor -- start 2024-09-21T06:25:53.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.473+0000 7f920f264740 1 -- start start 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581b7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581bc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f92041b1ed0 con 0x559a57df1390 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92041af7a0 con 0x559a57de91b0 2024-09-21T06:25:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920f264740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f92041ad5f0 con 0x559a57e12070 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50076/0 (socket says 172.21.15.38:50076) 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 -- 172.21.15.38:0/3631135751 learned_addr learned my addr 172.21.15.38:0/3631135751 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f920259c640 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f9202d9d640 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 -- 172.21.15.38:0/3631135751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 msgr2=0x559a581bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581bc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 -- 172.21.15.38:0/3631135751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 msgr2=0x559a581b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 -- 172.21.15.38:0/3631135751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a581bc4b0 con 0x559a57df1390 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.474+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0a97d0 tx=0x7f91ec0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec06aa51a355bca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f91ebfff640 1 -- 172.21.15.38:0/3631135751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec01d070 con 0x559a57df1390 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f91ebfff640 1 -- 172.21.15.38:0/3631135751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91ec0055f0 con 0x559a57df1390 2024-09-21T06:25:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f91ebfff640 1 -- 172.21.15.38:0/3631135751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0ac970 con 0x559a57df1390 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 -- 172.21.15.38:0/3631135751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 msgr2=0x559a581d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0a97d0 tx=0x7f91ec0076c0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 -- 172.21.15.38:0/3631135751 shutdown_connections 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581d0ff0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 --2- 172.21.15.38:0/3631135751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 -- 172.21.15.38:0/3631135751 >> 172.21.15.38:0/3631135751 conn(0x559a57e06460 msgr2=0x559a581b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 -- 172.21.15.38:0/3631135751 shutdown_connections 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.475+0000 7f920f264740 1 -- 172.21.15.38:0/3631135751 wait complete. 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 -- start start 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 Processor -- start 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f92041adc60 con 0x559a57df1390 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92041af0d0 con 0x559a57de91b0 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f92041ae330 con 0x559a57e12070 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f920f264740 10 client.0 _ll_register_callbacks cb 0x7f91ec0058a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f91fbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50082/0 (socket says 172.21.15.38:50082) 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.476+0000 7f91fbfff640 1 -- 172.21.15.38:0/3820420003 learned_addr learned my addr 172.21.15.38:0/3820420003 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f9202d9d640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f920259c640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 -- 172.21.15.38:0/3820420003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 msgr2=0x559a581c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 -- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 msgr2=0x559a581cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 -- 172.21.15.38:0/3820420003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a581c9ad0 con 0x559a57df1390 2024-09-21T06:25:53.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f920259c640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91fbfff640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0a8d80 tx=0x7f91ec007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2af5fede520af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec01d070 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f91ec0d0ad0 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a5812d850 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91ec0ac970 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f920f264740 10 client.16914 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.477+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559a581c9ad0 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x559a5812d850 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91ec058a40 con 0x559a57df1390 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 10 client.16914 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 20 client.16914 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57da5da0 0x559a58243c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:53.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 4 client.16914 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:25:53.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a5812ac80 con 0x559a57da5da0 2024-09-21T06:25:53.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.478+0000 7f920259c640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57da5da0 0x559a58243c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920259c640 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57da5da0 0x559a58243c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b333be9747921bb server_cookie=109e4ca1cef95f87 in_seq=0 out_seq=0 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f91e9ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f91e9ffb640 1 -- 172.21.15.38:0/3820420003 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x559a5812ac80 con 0x559a57da5da0 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f91e9ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 client.16914 shutdown 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 msgr2=0x559a581c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0a8d80 tx=0x7f91ec007730 comp rx=0 tx=0).stop 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 shutdown_connections 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559a57da5da0 0x559a58243c80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559a57e12070 0x559a581c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559a57df1390 0x559a581c8dc0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 --2- 172.21.15.38:0/3820420003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559a57de91b0 0x559a581cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 >> 172.21.15.38:0/3820420003 conn(0x559a57e06460 msgr2=0x559a581bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f91e9ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 shutdown_connections 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 1 -- 172.21.15.38:0/3820420003 wait complete. 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.479+0000 7f920f264740 20 client.16914 trim_cache size 0 max 16384 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:25:53.485 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.486 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.487 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.488 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:25:53.489 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.490 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.491 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:25:53.492 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 msgr2=0x7f91f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f91fc005fd0 tx=0x7f91fc009600 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 msgr2=0x7f920419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c970 tx=0x7f91ec00ce30 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 shutdown_connections 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91f00b6680 0x7f91f00b8b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9204108d10 0x7f920419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92041083c0 0x7f920419aad0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 --2- 172.21.15.38:0/2205767519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9204102a80 0x7f920419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 >> 172.21.15.38:0/2205767519 conn(0x7f9204079740 msgr2=0x7f9204101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 shutdown_connections 2024-09-21T06:25:53.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:53.480+0000 7f9208cf0640 1 -- 172.21.15.38:0/2205767519 wait complete. 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: pgmap v505: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:53 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: pgmap v505: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:25:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:53 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:25:54.191 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:25:54.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:25:54.451 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 -- 172.21.15.38:0/2419035985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a81049f0 msgr2=0x7f41a8104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2419035985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a81049f0 0x7f41a8104e00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009900 tx=0x7f41a402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 -- 172.21.15.38:0/2419035985 shutdown_connections 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2419035985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a810de50 0x7f41a8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2419035985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 0x7f41a810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.941+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2419035985 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a81049f0 0x7f41a8104e00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.942+0000 7f41af9e1640 1 -- 172.21.15.38:0/2419035985 >> 172.21.15.38:0/2419035985 conn(0x7f41a8079750 msgr2=0x7f41a8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.942+0000 7f41af9e1640 1 -- 172.21.15.38:0/2419035985 shutdown_connections 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.942+0000 7f41af9e1640 1 -- 172.21.15.38:0/2419035985 wait complete. 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.942+0000 7f41af9e1640 1 Processor -- start 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.942+0000 7f41af9e1640 1 -- start start 2024-09-21T06:25:54.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a81049f0 0x7f41a819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 0x7f41a819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8113bf0 con 0x7f41a810de50 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8113a70 con 0x7f41a8105340 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41af9e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8113d70 con 0x7f41a81049f0 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50102/0 (socket says 172.21.15.38:50102) 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 -- 172.21.15.38:0/2869239861 learned_addr learned my addr 172.21.15.38:0/2869239861 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41acf7c640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 0x7f41a819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41ad77d640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a81049f0 0x7f41a819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 -- 172.21.15.38:0/2869239861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a81049f0 msgr2=0x7f41a819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a81049f0 0x7f41a819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 -- 172.21.15.38:0/2869239861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 msgr2=0x7f41a819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:54.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 0x7f41a819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 -- 172.21.15.38:0/2869239861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a81a04f0 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f41adf7e640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009fd0 tx=0x7f41a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.943+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0017070 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.944+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f41a0003e40 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.944+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81a07e0 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.944+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0004820 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.944+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81a6f40 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.945+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a8104e00 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.946+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f41a0003970 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.947+0000 7f419e7fc640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 0x7f41940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.947+0000 7f41ad77d640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 0x7f41940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.947+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f41a00e74c0 con 0x7f41a810de50 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.947+0000 7f41ad77d640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 0x7f41940b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41a40096c0 tx=0x7f41a4009630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:54.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:54.951+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41a0003c60 con 0x7f41a810de50 2024-09-21T06:25:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.179+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a81a71a0 con 0x7f41a810de50 2024-09-21T06:25:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.180+0000 7f419e7fc640 1 -- 172.21.15.38:0/2869239861 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f41a00ada90 con 0x7f41a810de50 2024-09-21T06:25:55.182 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:25:55.182 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:25:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 msgr2=0x7f41940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 0x7f41940b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f41a40096c0 tx=0x7f41a4009630 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 msgr2=0x7f41a819fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009fd0 tx=0x7f41a000b260 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 shutdown_connections 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41940b6680 0x7f41940b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41a810de50 0x7f41a819fdc0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41a8105340 0x7f41a819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 --2- 172.21.15.38:0/2869239861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41a81049f0 0x7f41a819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 >> 172.21.15.38:0/2869239861 conn(0x7f41a8079750 msgr2=0x7f41a80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 shutdown_connections 2024-09-21T06:25:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:55.183+0000 7f41af9e1640 1 -- 172.21.15.38:0/2869239861 wait complete. 2024-09-21T06:25:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:55 smithi038 ceph-mon[31215]: pgmap v506: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2869239861' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:55 smithi174 ceph-mon[34815]: pgmap v506: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:55.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2869239861' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:55 smithi044 ceph-mon[34369]: pgmap v506: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:25:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2869239861' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:25:55.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:25:56.089 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 -- 172.21.15.38:0/3167521590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a41094b0 msgr2=0x7f79a41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 --2- 172.21.15.38:0/3167521590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a41094b0 0x7f79a41098c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f798c009900 tx=0x7f798c02a410 comp rx=0 tx=0).stop 2024-09-21T06:25:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 -- 172.21.15.38:0/3167521590 shutdown_connections 2024-09-21T06:25:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 --2- 172.21.15.38:0/3167521590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 --2- 172.21.15.38:0/3167521590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a41094b0 0x7f79a41098c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 --2- 172.21.15.38:0/3167521590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4103b70 0x7f79a4103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 -- 172.21.15.38:0/3167521590 >> 172.21.15.38:0/3167521590 conn(0x7f79a40ff5e0 msgr2=0x7f79a4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 -- 172.21.15.38:0/3167521590 shutdown_connections 2024-09-21T06:25:56.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.604+0000 7f79a934d640 1 -- 172.21.15.38:0/3167521590 wait complete. 2024-09-21T06:25:56.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 Processor -- start 2024-09-21T06:25:56.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 -- start start 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 0x7f79a4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4113be0 con 0x7f79a4103b70 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4113a60 con 0x7f79a41094b0 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.605+0000 7f79a934d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4113d60 con 0x7f79a4109e00 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50128/0 (socket says 172.21.15.38:50128) 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 -- 172.21.15.38:0/378584078 learned_addr learned my addr 172.21.15.38:0/378584078 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a37fe640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a27fc640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 0x7f79a4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 -- 172.21.15.38:0/378584078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 msgr2=0x7f79a4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 -- 172.21.15.38:0/378584078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 msgr2=0x7f79a4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 0x7f79a4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 -- 172.21.15.38:0/378584078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a41a8850 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a37fe640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a27fc640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 0x7f79a4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f799400eab0 tx=0x7f799400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f799bfff640 1 -- 172.21.15.38:0/378584078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799400ce40 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f799bfff640 1 -- 172.21.15.38:0/378584078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7994011940 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.606+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a41a8b40 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.607+0000 7f799bfff640 1 -- 172.21.15.38:0/378584078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994010aa0 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.607+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a41a9050 con 0x7f79a4103b70 2024-09-21T06:25:56.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.609+0000 7f79af8c1740 1 Processor -- start 2024-09-21T06:25:56.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.609+0000 7f79af8c1740 1 -- start start 2024-09-21T06:25:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b66800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b66d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e853adcea0 con 0x55e8537bf070 2024-09-21T06:25:56.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e853acc2d0 con 0x55e85379e390 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79af8c1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e853ad00e0 con 0x55e8537961b0 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f799bfff640 1 -- 172.21.15.38:0/378584078 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7994010c40 con 0x7f79a4103b70 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50136/0 (socket says 172.21.15.38:50136) 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 -- 172.21.15.38:0/1982144890 learned_addr learned my addr 172.21.15.38:0/1982144890 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b66d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b66800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 -- 172.21.15.38:0/1982144890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 msgr2=0x55e853b66800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b66800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 -- 172.21.15.38:0/1982144890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 msgr2=0x55e853b66d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b66d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a37fe640 1 -- 172.21.15.38:0/1982144890 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e85382a650 con 0x55e8537bf070 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.610+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b66d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f799c00cc30 tx=0x7f799c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acf2036bd5cd8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f79997fa640 1 -- 172.21.15.38:0/1982144890 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c014070 con 0x55e8537bf070 2024-09-21T06:25:56.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f79997fa640 1 -- 172.21.15.38:0/1982144890 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f799c004220 con 0x55e8537bf070 2024-09-21T06:25:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f79997fa640 1 -- 172.21.15.38:0/1982144890 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c010720 con 0x55e8537bf070 2024-09-21T06:25:56.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f799bfff640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 0x7f79900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 0x7f79900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.611+0000 7f799bfff640 1 -- 172.21.15.38:0/378584078 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f79940e7db0 con 0x7f79a4103b70 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- 172.21.15.38:0/1982144890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 msgr2=0x55e853b662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79a2ffd640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 0x7f79900b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79940e5630 tx=0x7f7994095040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f799c00cc30 tx=0x7f799c00e720 comp rx=0 tx=0).stop 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- 172.21.15.38:0/1982144890 shutdown_connections 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b66d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b66800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1982144890 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b662c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- 172.21.15.38:0/1982144890 >> 172.21.15.38:0/1982144890 conn(0x55e8537b3460 msgr2=0x55e853b641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- 172.21.15.38:0/1982144890 shutdown_connections 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- 172.21.15.38:0/1982144890 wait complete. 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.612+0000 7f79af8c1740 1 -- start start 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 Processor -- start 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b71930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b71e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e85392d700 con 0x55e8537bf070 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e853a67160 con 0x55e85379e390 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e853b74aa0 con 0x55e8537961b0 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79af8c1740 10 client.0 _ll_register_callbacks cb 0x55e853a809e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50142/0 (socket says 172.21.15.38:50142) 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 -- 172.21.15.38:0/1001967305 learned_addr learned my addr 172.21.15.38:0/1001967305 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b71930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b71e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 -- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 msgr2=0x55e853b71930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b71930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 -- 172.21.15.38:0/1001967305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 msgr2=0x55e853b71e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b71e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.613+0000 7f79a37fe640 1 -- 172.21.15.38:0/1001967305 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e853a94c90 con 0x55e8537bf070 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f799c005d10 tx=0x7f799c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5328188d8e291f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f798a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c014070 con 0x55e8537bf070 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f799c005230 con 0x55e8537bf070 2024-09-21T06:25:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f799c004220 con 0x55e8537bf070 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f799c005430 con 0x55e8537bf070 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f79af8c1740 10 client.16932 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e853b80770 con 0x55e8537bf070 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.614+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f799c004220 con 0x55e8537bf070 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f799c0106d0 con 0x55e8537bf070 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 10 client.16932 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 10 client.16932 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 20 client.16932 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e85377d9f0 0x55e853b83ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 4 client.16932 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e853adedf0 con 0x55e85377d9f0 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e85377d9f0 0x55e853b83ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e85377d9f0 0x55e853b83ad0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=73fb27028b914d6f server_cookie=369ea3e2f7bb513 in_seq=0 out_seq=0 2024-09-21T06:25:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.615+0000 7f798a7fc640 10 client.16932 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f798a7fc640 1 -- 172.21.15.38:0/1001967305 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e853adedf0 con 0x55e85377d9f0 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f798a7fc640 10 client.16932 handle_command_reply: tid=0 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 client.16932 shutdown 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 msgr2=0x55e853b7dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f799c005d10 tx=0x7f799c003f60 comp rx=0 tx=0).stop 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 shutdown_connections 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e85377d9f0 0x55e853b83ad0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537bf070 0x55e853b7dd90 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e85379e390 0x55e853b71e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1001967305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537961b0 0x55e853b71930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 >> 172.21.15.38:0/1001967305 conn(0x55e8537b3460 msgr2=0x55e853b694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.616+0000 7f798a7fc640 0 client.16932 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.617+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 shutdown_connections 2024-09-21T06:25:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.617+0000 7f79af8c1740 1 -- 172.21.15.38:0/1001967305 wait complete. 2024-09-21T06:25:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.617+0000 7f79af8c1740 20 client.16932 trim_cache size 0 max 16384 2024-09-21T06:25:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.630+0000 7f79af8c1740 1 Processor -- start 2024-09-21T06:25:56.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.630+0000 7f79af8c1740 1 -- start start 2024-09-21T06:25:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e85379e390 0x55e853b7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537bf070 0x55e853b6eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41b4130 con 0x55e8537961b0 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41b1a00 con 0x55e8537bf070 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79af8c1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41af850 con 0x55e85379e390 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50154/0 (socket says 172.21.15.38:50154) 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 -- 172.21.15.38:0/1696044356 learned_addr learned my addr 172.21.15.38:0/1696044356 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e85379e390 0x55e853b7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537bf070 0x55e853b6eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 -- 172.21.15.38:0/1696044356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e85379e390 msgr2=0x55e853b7dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e85379e390 0x55e853b7dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 -- 172.21.15.38:0/1696044356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537bf070 msgr2=0x55e853b6eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537bf070 0x55e853b6eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 -- 172.21.15.38:0/1696044356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e853b72880 con 0x55e8537961b0 2024-09-21T06:25:56.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.631+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f799c005ce0 tx=0x7f799c005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d309768510076 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.632+0000 7f7998ff9640 1 -- 172.21.15.38:0/1696044356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c03b070 con 0x55e8537961b0 2024-09-21T06:25:56.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.632+0000 7f7998ff9640 1 -- 172.21.15.38:0/1696044356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f799c0039a0 con 0x55e8537961b0 2024-09-21T06:25:56.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.632+0000 7f7998ff9640 1 -- 172.21.15.38:0/1696044356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c014040 con 0x55e8537961b0 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.632+0000 7f79af8c1740 1 -- 172.21.15.38:0/1696044356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 msgr2=0x55e853b71df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.632+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f799c005ce0 tx=0x7f799c005a10 comp rx=0 tx=0).stop 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- 172.21.15.38:0/1696044356 shutdown_connections 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537bf070 0x55e853b6eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e85379e390 0x55e853b7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1696044356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e8537961b0 0x55e853b71df0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- 172.21.15.38:0/1696044356 >> 172.21.15.38:0/1696044356 conn(0x55e8537b3460 msgr2=0x55e853b716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- 172.21.15.38:0/1696044356 shutdown_connections 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- 172.21.15.38:0/1696044356 wait complete. 2024-09-21T06:25:56.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- start start 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 Processor -- start 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 0x55e853b84590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537bf070 0x55e853be5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41afec0 con 0x55e85379e390 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41b1330 con 0x55e8537961b0 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.633+0000 7f79af8c1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79a41b0590 con 0x55e8537bf070 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79af8c1740 10 client.0 _ll_register_callbacks cb 0x7f799c00cab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50158/0 (socket says 172.21.15.38:50158) 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 -- 172.21.15.38:0/1108948570 learned_addr learned my addr 172.21.15.38:0/1108948570 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537bf070 0x55e853be5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 0x55e853b84590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 -- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537bf070 msgr2=0x55e853be5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537bf070 0x55e853be5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 -- 172.21.15.38:0/1108948570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 msgr2=0x55e853b84590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 0x55e853b84590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 -- 172.21.15.38:0/1108948570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e853be5870 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 0x55e853b84590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79a27fc640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f798c02a450 tx=0x7f798c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7832c153379b602d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f798a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c035070 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f798c005040 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.634+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f799c0039a0 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f798c005240 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 10 client.16938 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e853beddb0 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f799c0039a0 con 0x55e85379e390 2024-09-21T06:25:56.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f798c003680 con 0x55e85379e390 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 10 client.16938 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 10 client.16938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 20 client.16938 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e853752da0 0x55e853bf0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 4 client.16938 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e853ada8a0 con 0x55e853752da0 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.635+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e853752da0 0x55e853bf0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f79a37fe640 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e853752da0 0x55e853bf0550 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6092dcad1161fc50 server_cookie=f36b62aad08bd241 in_seq=0 out_seq=0 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f798a7fc640 10 client.16938 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f798a7fc640 1 -- 172.21.15.38:0/1108948570 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e853ada8a0 con 0x55e853752da0 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f798a7fc640 10 client.16938 handle_command_reply: tid=0 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f79af8c1740 1 client.16938 shutdown 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 msgr2=0x55e853b84b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.636+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f798c02a450 tx=0x7f798c004040 comp rx=0 tx=0).stop 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 shutdown_connections 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e853752da0 0x55e853bf0550 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e8537bf070 0x55e853be5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e85379e390 0x55e853b84b30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 --2- 172.21.15.38:0/1108948570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8537961b0 0x55e853b84590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 >> 172.21.15.38:0/1108948570 conn(0x55e8537b3460 msgr2=0x55e853b67220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f798a7fc640 0 client.16938 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 shutdown_connections 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 1 -- 172.21.15.38:0/1108948570 wait complete. 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79af8c1740 20 client.16938 trim_cache size 0 max 16384 2024-09-21T06:25:56.643 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 msgr2=0x7f79900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 0x7f79900b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f79940e5630 tx=0x7f7994095040 comp rx=0 tx=0).stop 2024-09-21T06:25:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 msgr2=0x7f79a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f799400eab0 tx=0x7f799400ef70 comp rx=0 tx=0).stop 2024-09-21T06:25:56.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 shutdown_connections 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f79900b6680 0x7f79900b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79a4109e00 0x7f79a4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a41094b0 0x7f79a4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 --2- 172.21.15.38:0/378584078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79a4103b70 0x7f79a4075710 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.637+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 >> 172.21.15.38:0/378584078 conn(0x7f79a40ff5e0 msgr2=0x7f79a4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.638+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 shutdown_connections 2024-09-21T06:25:56.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:56.638+0000 7f79a934d640 1 -- 172.21.15.38:0/378584078 wait complete. 2024-09-21T06:25:57.397 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:25:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:57 smithi174 ceph-mon[34815]: pgmap v507: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:25:57.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:57 smithi044 ceph-mon[34369]: pgmap v507: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:25:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:57.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:57 smithi038 ceph-mon[31215]: pgmap v507: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:25:58.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- 172.21.15.38:0/1108721442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 msgr2=0x7f96c8106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 --2- 172.21.15.38:0/1108721442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8106720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009900 tx=0x7f96b802a410 comp rx=0 tx=0).stop 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- 172.21.15.38:0/1108721442 shutdown_connections 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 --2- 172.21.15.38:0/1108721442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8106c60 0x7f96c81106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 --2- 172.21.15.38:0/1108721442 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8106720 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 --2- 172.21.15.38:0/1108721442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8102120 0x7f96c8102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- 172.21.15.38:0/1108721442 >> 172.21.15.38:0/1108721442 conn(0x7f96c8079ea0 msgr2=0x7f96c807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- 172.21.15.38:0/1108721442 shutdown_connections 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- 172.21.15.38:0/1108721442 wait complete. 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 Processor -- start 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.179+0000 7f96cf75e640 1 -- start start 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8102120 0x7f96c81030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8106c60 0x7f96c8103b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113c80 con 0x7f96c8106310 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113b00 con 0x7f96c8102120 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cf75e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8113e00 con 0x7f96c8106c60 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50168/0 (socket says 172.21.15.38:50168) 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 -- 172.21.15.38:0/300939512 learned_addr learned my addr 172.21.15.38:0/300939512 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8102120 0x7f96c81030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8106c60 0x7f96c8103b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 -- 172.21.15.38:0/300939512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8106c60 msgr2=0x7f96c8103b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8106c60 0x7f96c8103b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 -- 172.21.15.38:0/300939512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8102120 msgr2=0x7f96c81030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8102120 0x7f96c81030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 -- 172.21.15.38:0/300939512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c81a8910 con 0x7f96c8106310 2024-09-21T06:25:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.180+0000 7f96cccf9640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005940 tx=0x7f96b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.181+0000 7f96be7fc640 1 -- 172.21.15.38:0/300939512 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b803f030 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.181+0000 7f96be7fc640 1 -- 172.21.15.38:0/300939512 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b80318f0 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.181+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c81a8ba0 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.181+0000 7f96be7fc640 1 -- 172.21.15.38:0/300939512 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8035070 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.181+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a9080 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.183+0000 7f96d5cd2740 1 Processor -- start 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.183+0000 7f96d5cd2740 1 -- start start 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96be7fc640 1 -- 172.21.15.38:0/300939512 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f96b8042030 con 0x7f96c8106310 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 0x562b2ed81be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562b2ecf7ea0 con 0x562b2e9b9390 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ece72d0 con 0x562b2e9da070 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562b2eceb0e0 con 0x562b2e9b11b0 2024-09-21T06:25:58.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cd4fa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 0x562b2ed81be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50182/0 (socket says 172.21.15.38:50182) 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 -- 172.21.15.38:0/2445843884 learned_addr learned my addr 172.21.15.38:0/2445843884 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 -- 172.21.15.38:0/2445843884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 msgr2=0x562b2ed81be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 0x562b2ed81be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 -- 172.21.15.38:0/2445843884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 msgr2=0x562b2ed816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 -- 172.21.15.38:0/2445843884 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2ea45650 con 0x562b2e9b9390 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 0x562b2ed81be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.184+0000 7f96cccf9640 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f96b8104e20 tx=0x7f96b810dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355f8c3d5262bc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96b37fe640 1 -- 172.21.15.38:0/2445843884 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8107da0 con 0x562b2e9b9390 2024-09-21T06:25:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96be7fc640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 0x7f96b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96b37fe640 1 -- 172.21.15.38:0/2445843884 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b8117020 con 0x562b2e9b9390 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96b37fe640 1 -- 172.21.15.38:0/2445843884 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8111a40 con 0x562b2e9b9390 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 0x7f96b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.185+0000 7f96be7fc640 1 -- 172.21.15.38:0/300939512 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96b81076e0 con 0x7f96c8106310 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- 172.21.15.38:0/2445843884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 msgr2=0x562b2ed82120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f96b8104e20 tx=0x7f96b810dcd0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 0x7f96b40b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96c0005fd0 tx=0x7f96c00096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- 172.21.15.38:0/2445843884 shutdown_connections 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed82120 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b11b0 0x562b2ed81be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/2445843884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- 172.21.15.38:0/2445843884 >> 172.21.15.38:0/2445843884 conn(0x562b2e9ce460 msgr2=0x562b2ed7f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- 172.21.15.38:0/2445843884 shutdown_connections 2024-09-21T06:25:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- 172.21.15.38:0/2445843884 wait complete. 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 -- start start 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.186+0000 7f96d5cd2740 1 Processor -- start 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b9390 0x562b2ed8d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed98ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562b2eb48700 con 0x562b2e9b11b0 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ec82160 con 0x562b2e9da070 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562b2ed8fc40 con 0x562b2e9b9390 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96d5cd2740 10 client.0 _ll_register_callbacks cb 0x562b2ec9b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50192/0 (socket says 172.21.15.38:50192) 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 -- 172.21.15.38:0/3119259203 learned_addr learned my addr 172.21.15.38:0/3119259203 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed98ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cccf9640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b9390 0x562b2ed8d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 -- 172.21.15.38:0/3119259203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b9390 msgr2=0x562b2ed8d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b9390 0x562b2ed8d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 -- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 msgr2=0x562b2ed98ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed98ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 -- 172.21.15.38:0/3119259203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2ecafc90 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.187+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f96c4012720 tx=0x7f96c4012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d3a76555da6980 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4004050 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96c40041f0 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b8117020 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f96c40043f0 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 10 client.16950 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562b2ed9b8e0 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b8117020 con 0x562b2e9b11b0 2024-09-21T06:25:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f96c4003c10 con 0x562b2e9b11b0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 10 client.16950 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 10 client.16950 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 20 client.16950 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e9989f0 0x562b2ed9ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 4 client.16950 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.188+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b2ecf9df0 con 0x562b2e9989f0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.189+0000 7f96cccf9640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e9989f0 0x562b2ed9ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.189+0000 7f96b0ff9640 10 client.16950 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.189+0000 7f96cccf9640 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e9989f0 0x562b2ed9ed70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=235b61647b413c1e server_cookie=83291e307457dd9a in_seq=0 out_seq=0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96b0ff9640 1 -- 172.21.15.38:0/3119259203 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b2ecf9df0 con 0x562b2e9989f0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96b0ff9640 10 client.16950 handle_command_reply: tid=0 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 client.16950 shutdown 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 msgr2=0x562b2ed8cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f96c4012720 tx=0x7f96c4012be0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 shutdown_connections 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e9989f0 0x562b2ed9ed70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9da070 0x562b2ed98ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9b9390 0x562b2ed8d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96b0ff9640 0 client.16950 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/3119259203 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed8cd40 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 >> 172.21.15.38:0/3119259203 conn(0x562b2e9ce460 msgr2=0x562b2ed84830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 shutdown_connections 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 1 -- 172.21.15.38:0/3119259203 wait complete. 2024-09-21T06:25:58.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.190+0000 7f96d5cd2740 20 client.16950 trim_cache size 0 max 16384 2024-09-21T06:25:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 Processor -- start 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 -- start start 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b11b0 0x562b2ed82de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed7f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81b4110 con 0x562b2e9b9390 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81b19e0 con 0x562b2e9b11b0 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81af830 con 0x562b2e9da070 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96cccf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50204/0 (socket says 172.21.15.38:50204) 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96cccf9640 1 -- 172.21.15.38:0/1152306086 learned_addr learned my addr 172.21.15.38:0/1152306086 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b11b0 0x562b2ed82de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.204+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed7f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 -- 172.21.15.38:0/1152306086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 msgr2=0x562b2ed7f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed7f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 -- 172.21.15.38:0/1152306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b11b0 msgr2=0x562b2ed82de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b11b0 0x562b2ed82de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 -- 172.21.15.38:0/1152306086 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2ed879d0 con 0x562b2e9b9390 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f96b8104f60 tx=0x7f96b8111500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be35de168c4ec89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96b2ffd640 1 -- 172.21.15.38:0/1152306086 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8116070 con 0x562b2e9b9390 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96b2ffd640 1 -- 172.21.15.38:0/1152306086 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96b810d320 con 0x562b2e9b9390 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.205+0000 7f96b2ffd640 1 -- 172.21.15.38:0/1152306086 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8049040 con 0x562b2e9b9390 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1152306086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 msgr2=0x562b2ed7ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f96b8104f60 tx=0x7f96b8111500 comp rx=0 tx=0).stop 2024-09-21T06:25:58.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1152306086 shutdown_connections 2024-09-21T06:25:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed7f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b9390 0x562b2ed7ebc0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1152306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b11b0 0x562b2ed82de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1152306086 >> 172.21.15.38:0/1152306086 conn(0x562b2e9ce460 msgr2=0x562b2ed826d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1152306086 shutdown_connections 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1152306086 wait complete. 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.206+0000 7f96d5cd2740 1 -- start start 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.207+0000 7f96d5cd2740 1 Processor -- start 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.207+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.207+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 0x562b2ed91470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96d5cd2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81afea0 con 0x562b2e9b11b0 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81b1310 con 0x562b2e9b9390 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96d5cd2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81b0570 con 0x562b2e9da070 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96d5cd2740 10 client.0 _ll_register_callbacks cb 0x7f96c4009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50212/0 (socket says 172.21.15.38:50212) 2024-09-21T06:25:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 -- 172.21.15.38:0/1816117769 learned_addr learned my addr 172.21.15.38:0/1816117769 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 0x562b2ed91470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cdcfb640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 -- 172.21.15.38:0/1816117769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 msgr2=0x562b2ed919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 -- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 msgr2=0x562b2ed91470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 0x562b2ed91470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 -- 172.21.15.38:0/1816117769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2ee088d0 con 0x562b2e9b11b0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 0x562b2ed91470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96cd4fa640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000c00 tx=0x7f96c4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f69ba962f0d6211 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.208+0000 7f96b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4026640 con 0x562b2e9b11b0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f96c40267e0 con 0x562b2e9b11b0 2024-09-21T06:25:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96b810d320 con 0x562b2e9b11b0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f96c4026ac0 con 0x562b2e9b11b0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 10 client.16956 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562b2ee09b60 con 0x562b2e9b11b0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f96c400fd70 con 0x562b2e9b11b0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f96c4005310 con 0x562b2e9b11b0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 10 client.16956 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 10 client.16956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.209+0000 7f96d5cd2740 20 client.16956 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e96dda0 0x562b2ee0c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96d5cd2740 4 client.16956 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f96b810d320 con 0x562b2e96dda0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e96dda0 0x562b2ee0c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96b0ff9640 10 client.16956 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.210+0000 7f96cccf9640 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e96dda0 0x562b2ee0c3a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1108bcfc653c299d server_cookie=886c969e0078bb27 in_seq=0 out_seq=0 2024-09-21T06:25:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96b0ff9640 1 -- 172.21.15.38:0/1816117769 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f96b810d320 con 0x562b2e96dda0 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96b0ff9640 10 client.16956 handle_command_reply: tid=0 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 client.16956 shutdown 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 msgr2=0x562b2ed90f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000c00 tx=0x7f96c4009ee0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 shutdown_connections 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562b2e96dda0 0x562b2ee0c3a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2e9da070 0x562b2ed919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2e9b9390 0x562b2ed91470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96b0ff9640 0 client.16956 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 --2- 172.21.15.38:0/1816117769 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562b2e9b11b0 0x562b2ed90f30 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 >> 172.21.15.38:0/1816117769 conn(0x562b2e9ce460 msgr2=0x562b2ed8e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 shutdown_connections 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 1 -- 172.21.15.38:0/1816117769 wait complete. 2024-09-21T06:25:58.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.211+0000 7f96d5cd2740 20 client.16956 trim_cache size 0 max 16384 2024-09-21T06:25:58.222 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 msgr2=0x7f96b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 0x7f96b40b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96c0005fd0 tx=0x7f96c00096a0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 msgr2=0x7f96c8103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005940 tx=0x7f96b80042f0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 shutdown_connections 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96b40b6680 0x7f96b40b8b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96c8106c60 0x7f96c8103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96c8106310 0x7f96c8103600 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 --2- 172.21.15.38:0/300939512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c8102120 0x7f96c81030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 >> 172.21.15.38:0/300939512 conn(0x7f96c8079ea0 msgr2=0x7f96c81081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 shutdown_connections 2024-09-21T06:25:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:58.212+0000 7f96cf75e640 1 -- 172.21.15.38:0/300939512 wait complete. 2024-09-21T06:25:58.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:58.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:58.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:25:58.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:25:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:25:59.556 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:59 smithi044 ceph-mon[34369]: pgmap v508: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:25:59.556 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.556 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:59.557 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:25:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:25:59.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:59 smithi038 ceph-mon[31215]: pgmap v508: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:25:59.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:59.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:25:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:25:59.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:59 smithi174 ceph-mon[34815]: pgmap v508: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:25:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:25:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:25:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/646660817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd41094a0 msgr2=0x7f3cd41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/646660817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd41094a0 0x7f3cd41098b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009900 tx=0x7f3cc402a410 comp rx=0 tx=0).stop 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/646660817 shutdown_connections 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/646660817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd4109df0 0x7f3cd4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/646660817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd41094a0 0x7f3cd41098b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/646660817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd4103b60 0x7f3cd4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/646660817 >> 172.21.15.38:0/646660817 conn(0x7f3cd407b850 msgr2=0x7f3cd407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/646660817 shutdown_connections 2024-09-21T06:25:59.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.687+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/646660817 wait complete. 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 Processor -- start 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 -- start start 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 0x7f3cd4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd4109df0 0x7f3cd4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4113bd0 con 0x7f3cd4103b60 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4113a50 con 0x7f3cd4109df0 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cdb8a2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4113d50 con 0x7f3cd41094a0 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48332/0 (socket says 172.21.15.38:48332) 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 -- 172.21.15.38:0/1483806329 learned_addr learned my addr 172.21.15.38:0/1483806329 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 0x7f3cd4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 -- 172.21.15.38:0/1483806329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 msgr2=0x7f3cd4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 0x7f3cd4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 -- 172.21.15.38:0/1483806329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd4109df0 msgr2=0x7f3cd4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd4109df0 0x7f3cd4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd963e640 1 -- 172.21.15.38:0/1483806329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd41a8820 con 0x7f3cd4103b60 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.688+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 0x7f3cd4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:25:59.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cd963e640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000d950 tx=0x7f3cd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cca7fc640 1 -- 172.21.15.38:0/1483806329 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0017030 con 0x7f3cd4103b60 2024-09-21T06:25:59.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd41a8b10 con 0x7f3cd4103b60 2024-09-21T06:25:59.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cca7fc640 1 -- 172.21.15.38:0/1483806329 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cd0004020 con 0x7f3cd4103b60 2024-09-21T06:25:59.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cca7fc640 1 -- 172.21.15.38:0/1483806329 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00047a0 con 0x7f3cd4103b60 2024-09-21T06:25:59.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.689+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd41a9070 con 0x7f3cd4103b60 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 Processor -- start 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 -- start start 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc60f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc60fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637fc585ea0 con 0x5637fc247390 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637fc5752d0 con 0x5637fc23f1b0 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5637fc5790e0 con 0x5637fc268070 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cca7fc640 1 -- 172.21.15.38:0/1483806329 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3cd00041d0 con 0x7f3cd4103b60 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cd8e3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cd8e3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48348/0 (socket says 172.21.15.38:48348) 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/14740308 learned_addr learned my addr 172.21.15.38:0/14740308 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc60f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.692+0000 7f3cd963e640 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc60fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/14740308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 msgr2=0x5637fc60f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc60f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/14740308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 msgr2=0x5637fc60fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc60fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/14740308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fc2d3650 con 0x5637fc247390 2024-09-21T06:25:59.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3cd406c9f0 tx=0x7f3cc4032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1f9915a0794562 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cbf7fe640 1 -- 172.21.15.38:0/14740308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc403f070 con 0x5637fc247390 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cbf7fe640 1 -- 172.21.15.38:0/14740308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cc4031710 con 0x5637fc247390 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cbf7fe640 1 -- 172.21.15.38:0/14740308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4035070 con 0x5637fc247390 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cca7fc640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 0x7f3cc00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 0x7f3cc00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.693+0000 7f3cca7fc640 1 -- 172.21.15.38:0/1483806329 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3cd00e7240 con 0x7f3cd4103b60 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- 172.21.15.38:0/14740308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 msgr2=0x5637fc610120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 0x7f3cc00b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc005c40 tx=0x7f3ccc009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3cd406c9f0 tx=0x7f3cc4032c80 comp rx=0 tx=0).stop 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- 172.21.15.38:0/14740308 shutdown_connections 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc610120 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc60fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/14740308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc60f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- 172.21.15.38:0/14740308 >> 172.21.15.38:0/14740308 conn(0x5637fc25c460 msgr2=0x5637fc60d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- 172.21.15.38:0/14740308 shutdown_connections 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- 172.21.15.38:0/14740308 wait complete. 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.694+0000 7f3ce1e16740 1 -- start start 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 Processor -- start 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5637fc3d6700 con 0x5637fc23f1b0 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5637fc510160 con 0x5637fc247390 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5637fc61de20 con 0x5637fc268070 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3ce1e16740 10 client.0 _ll_register_callbacks cb 0x5637fc5299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3cd963e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3cd963e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48356/0 (socket says 172.21.15.38:48356) 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3cd963e640 1 -- 172.21.15.38:0/3526086750 learned_addr learned my addr 172.21.15.38:0/3526086750 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.695+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 -- 172.21.15.38:0/3526086750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 msgr2=0x5637fc627140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 -- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 msgr2=0x5637fc61b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 -- 172.21.15.38:0/3526086750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fc53dc90 con 0x5637fc23f1b0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cd963e640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009610 tx=0x7f3cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504eca10082df199 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00a9700 con 0x5637fc23f1b0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3cd00a8a00 con 0x5637fc23f1b0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cc4031710 con 0x5637fc23f1b0 2024-09-21T06:25:59.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3cd00ac820 con 0x5637fc23f1b0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3ce1e16740 10 client.16968 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5637fc629bf0 con 0x5637fc23f1b0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.696+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cc4031710 con 0x5637fc23f1b0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3cd00a8c00 con 0x5637fc23f1b0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 10 client.16968 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 20 client.16968 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc2269f0 0x5637fc62d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 4 client.16968 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637fc587df0 con 0x5637fc2269f0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc2269f0 0x5637fc62d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc2269f0 0x5637fc62d110 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6206105e702281f6 server_cookie=f720212060410485 in_seq=0 out_seq=0 2024-09-21T06:25:59.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.697+0000 7f3cbcff9640 10 client.16968 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3cbcff9640 1 -- 172.21.15.38:0/3526086750 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637fc587df0 con 0x5637fc2269f0 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3cbcff9640 10 client.16968 handle_command_reply: tid=0 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 client.16968 shutdown 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 msgr2=0x5637fc61ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009610 tx=0x7f3cd00046c0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 shutdown_connections 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc2269f0 0x5637fc62d110 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3526086750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc23f1b0 0x5637fc61ad80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.698+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 >> 172.21.15.38:0/3526086750 conn(0x5637fc25c460 msgr2=0x5637fc612830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.699+0000 7f3cbcff9640 0 client.16968 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.699+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 shutdown_connections 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.699+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3526086750 wait complete. 2024-09-21T06:25:59.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.699+0000 7f3ce1e16740 20 client.16968 trim_cache size 0 max 16384 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 Processor -- start 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 -- start start 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc61b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41b40d0 con 0x5637fc247390 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41b19a0 con 0x5637fc23f1b0 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41af7f0 con 0x5637fc268070 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3cd8e3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.712+0000 7f3cd8e3d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48366/0 (socket says 172.21.15.38:48366) 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/3290267778 learned_addr learned my addr 172.21.15.38:0/3290267778 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd963e640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc61b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/3290267778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 msgr2=0x5637fc627580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/3290267778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 msgr2=0x5637fc61b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc61b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 -- 172.21.15.38:0/3290267778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fc226c20 con 0x5637fc247390 2024-09-21T06:25:59.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd963e640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc61b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:25:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005f70 tx=0x7f3cc4032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44688bcb45c29672 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cbeffd640 1 -- 172.21.15.38:0/3290267778 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc403f040 con 0x5637fc247390 2024-09-21T06:25:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cbeffd640 1 -- 172.21.15.38:0/3290267778 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cc404f070 con 0x5637fc247390 2024-09-21T06:25:59.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.713+0000 7f3cbeffd640 1 -- 172.21.15.38:0/3290267778 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4035040 con 0x5637fc247390 2024-09-21T06:25:59.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3290267778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 msgr2=0x5637fc627040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4005f70 tx=0x7f3cc4032d70 comp rx=0 tx=0).stop 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3290267778 shutdown_connections 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc268070 0x5637fc627580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc247390 0x5637fc627040 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/3290267778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc23f1b0 0x5637fc61b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3290267778 >> 172.21.15.38:0/3290267778 conn(0x5637fc25c460 msgr2=0x5637fc61ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3290267778 shutdown_connections 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- 172.21.15.38:0/3290267778 wait complete. 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.714+0000 7f3ce1e16740 1 -- start start 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 Processor -- start 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc23f1b0 0x5637fc6237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41afe60 con 0x5637fc268070 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41b12d0 con 0x5637fc247390 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd41b0530 con 0x5637fc23f1b0 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3ce1e16740 10 client.0 _ll_register_callbacks cb 0x7f3cd00ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3cd9e3f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3cd9e3f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48378/0 (socket says 172.21.15.38:48378) 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3cd9e3f640 1 -- 172.21.15.38:0/944523298 learned_addr learned my addr 172.21.15.38:0/944523298 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3cd8e3d640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.715+0000 7f3cd963e640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc23f1b0 0x5637fc6237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 -- 172.21.15.38:0/944523298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc23f1b0 msgr2=0x5637fc6237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc23f1b0 0x5637fc6237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 -- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 msgr2=0x5637fc61ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:25:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 -- 172.21.15.38:0/944523298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fc61f910 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cd9e3f640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc012980 tx=0x7f3ccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c393da01b14f2209 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc021d50 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f3ccc004b20 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cc404f070 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3ccc004d20 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3ce1e16740 10 client.16974 fetch_fsmap learned FSMap version 34 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.716+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5637fc697880 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3cc404f070 con 0x5637fc268070 2024-09-21T06:25:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3ccc028070 con 0x5637fc268070 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 10 client.16974 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 20 client.16974 populate_metadata read hostname 'smithi038' 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc1fbda0 0x5637fc69a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 4 client.16974 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637fc5838a0 con 0x5637fc1fbda0 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3cd963e640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc1fbda0 0x5637fc69a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3cbcff9640 10 client.16974 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.717+0000 7f3cd963e640 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc1fbda0 0x5637fc69a060 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3219b5e5a383bb87 server_cookie=bd6657b39e794580 in_seq=0 out_seq=0 2024-09-21T06:25:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3cbcff9640 1 -- 172.21.15.38:0/944523298 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637fc5838a0 con 0x5637fc1fbda0 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3cbcff9640 10 client.16974 handle_command_reply: tid=0 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 client.16974 shutdown 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 msgr2=0x5637fc61f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc012980 tx=0x7f3ccc004a40 comp rx=0 tx=0).stop 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 shutdown_connections 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5637fc268070 0x5637fc61f250 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5637fc247390 0x5637fc61ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5637fc1fbda0 0x5637fc69a060 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 --2- 172.21.15.38:0/944523298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5637fc23f1b0 0x5637fc6237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3cbcff9640 0 client.16974 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 >> 172.21.15.38:0/944523298 conn(0x5637fc25c460 msgr2=0x5637fc610640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 shutdown_connections 2024-09-21T06:25:59.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 1 -- 172.21.15.38:0/944523298 wait complete. 2024-09-21T06:25:59.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.718+0000 7f3ce1e16740 20 client.16974 trim_cache size 0 max 16384 2024-09-21T06:25:59.726 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:25:59.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 msgr2=0x7f3cc00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 0x7f3cc00b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc005c40 tx=0x7f3ccc009560 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 msgr2=0x7f3cd4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000d950 tx=0x7f3cd000de10 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 shutdown_connections 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3cc00b6680 0x7f3cc00b8b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cd4109df0 0x7f3cd4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3cd41094a0 0x7f3cd4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 --2- 172.21.15.38:0/1483806329 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cd4103b60 0x7f3cd4075710 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 >> 172.21.15.38:0/1483806329 conn(0x7f3cd407b850 msgr2=0x7f3cd41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 shutdown_connections 2024-09-21T06:25:59.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:25:59.719+0000 7f3cdb8a2640 1 -- 172.21.15.38:0/1483806329 wait complete. 2024-09-21T06:26:01.420 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:01.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:01.638 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:01 smithi038 ceph-mon[31215]: pgmap v509: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:01 smithi174 ceph-mon[34815]: pgmap v509: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:01 smithi044 ceph-mon[34369]: pgmap v509: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:02.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 -- 172.21.15.38:0/3885399752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c108400 msgr2=0x7f172c108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 --2- 172.21.15.38:0/3885399752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c108400 0x7f172c108810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f171c009ca0 tx=0x7f171c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 -- 172.21.15.38:0/3885399752 shutdown_connections 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 --2- 172.21.15.38:0/3885399752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108d50 0x7f172c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 --2- 172.21.15.38:0/3885399752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c108400 0x7f172c108810 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 --2- 172.21.15.38:0/3885399752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c1031d0 0x7f172c1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 -- 172.21.15.38:0/3885399752 >> 172.21.15.38:0/3885399752 conn(0x7f172c079f90 msgr2=0x7f172c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 -- 172.21.15.38:0/3885399752 shutdown_connections 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.141+0000 7f1730936640 1 -- 172.21.15.38:0/3885399752 wait complete. 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.142+0000 7f1730936640 1 Processor -- start 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.142+0000 7f1730936640 1 -- start start 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 0x7f172c0ff330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 0x7f172c0ff870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f172c112b30 con 0x7f172c1031d0 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1129b0 con 0x7f172c108400 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1730936640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f172c112cb0 con 0x7f172c108d50 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48394/0 (socket says 172.21.15.38:48394) 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 -- 172.21.15.38:0/1906939041 learned_addr learned my addr 172.21.15.38:0/1906939041 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1729d9b640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 0x7f172c0ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172ad9d640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 0x7f172c0ff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 -- 172.21.15.38:0/1906939041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 msgr2=0x7f172c0ff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 0x7f172c0ff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 -- 172.21.15.38:0/1906939041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 msgr2=0x7f172c0ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 0x7f172c0ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 -- 172.21.15.38:0/1906939041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c1a8870 con 0x7f172c1031d0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172ad9d640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 0x7f172c0ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f1729d9b640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 0x7f172c0ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.143+0000 7f172a59c640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f171400d950 tx=0x7f171400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.144+0000 7f17237fe640 1 -- 172.21.15.38:0/1906939041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714017070 con 0x7f172c1031d0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.144+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c1a8b60 con 0x7f172c1031d0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.144+0000 7f17237fe640 1 -- 172.21.15.38:0/1906939041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1714009c30 con 0x7f172c1031d0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.144+0000 7f17237fe640 1 -- 172.21.15.38:0/1906939041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171400f6b0 con 0x7f172c1031d0 2024-09-21T06:26:02.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.144+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c1a90c0 con 0x7f172c1031d0 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 Processor -- start 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 -- start start 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b8097430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b8097970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f17237fe640 1 -- 172.21.15.38:0/1906939041 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1714010460 con 0x7f172c1031d0 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5628b800de60 con 0x5628b7ccf670 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628b7ffd290 con 0x5628b7cf0350 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1736eaa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5628b80010a0 con 0x5628b7cc7490 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1729d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1729d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48400/0 (socket says 172.21.15.38:48400) 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.147+0000 7f1729d9b640 1 -- 172.21.15.38:0/3863091545 learned_addr learned my addr 172.21.15.38:0/3863091545 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f172a59c640 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b8097970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b8097430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 -- 172.21.15.38:0/3863091545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 msgr2=0x5628b8097970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b8097970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 -- 172.21.15.38:0/3863091545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 msgr2=0x5628b8097430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b8097430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 -- 172.21.15.38:0/3863091545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b7d5b930 con 0x5628b7ccf670 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f171c009ca0 tx=0x7f171c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b506adf6c25ede server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.148+0000 7f17237fe640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 0x7f17180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.149+0000 7f172ad9d640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 0x7f17180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.149+0000 7f17237fe640 1 -- 172.21.15.38:0/1906939041 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17140e73b0 con 0x7f172c1031d0 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.149+0000 7f1720ff9640 1 -- 172.21.15.38:0/3863091545 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c003970 con 0x5628b7ccf670 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.149+0000 7f1720ff9640 1 -- 172.21.15.38:0/3863091545 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f171c036040 con 0x5628b7ccf670 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.149+0000 7f1720ff9640 1 -- 172.21.15.38:0/3863091545 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0043c0 con 0x5628b7ccf670 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 -- 172.21.15.38:0/3863091545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 msgr2=0x5628b8097eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f171c009ca0 tx=0x7f171c009a20 comp rx=0 tx=0).stop 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f172ad9d640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 0x7f17180b8c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f172400bbf0 tx=0x7f172400b340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 -- 172.21.15.38:0/3863091545 shutdown_connections 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b8097eb0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b8097970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3863091545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b8097430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 -- 172.21.15.38:0/3863091545 >> 172.21.15.38:0/3863091545 conn(0x5628b7ce4740 msgr2=0x5628b8095320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.150+0000 7f1736eaa740 1 -- 172.21.15.38:0/3863091545 shutdown_connections 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 -- 172.21.15.38:0/3863091545 wait complete. 2024-09-21T06:26:02.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 -- start start 2024-09-21T06:26:02.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 Processor -- start 2024-09-21T06:26:02.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7ccf670 0x5628b80a3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b80aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.151+0000 7f1736eaa740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5628b7e5e890 con 0x5628b7cc7490 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1736eaa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5628b7f97d40 con 0x5628b7cf0350 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1736eaa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5628b80a5bb0 con 0x5628b7ccf670 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48416/0 (socket says 172.21.15.38:48416) 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 -- 172.21.15.38:0/3234566527 learned_addr learned my addr 172.21.15.38:0/3234566527 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1736eaa740 10 client.0 _ll_register_callbacks cb 0x5628b7ffbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7ccf670 0x5628b80a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b80aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 -- 172.21.15.38:0/3234566527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7ccf670 msgr2=0x5628b80a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7ccf670 0x5628b80a3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 -- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 msgr2=0x5628b80aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b80aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 -- 172.21.15.38:0/3234566527 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b80af510 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f172a59c640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f17140aa490 tx=0x7f17140ea910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f144982fd7bfc75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714020070 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f17140a8b70 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.152+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171c036040 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17140acff0 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 10 client.16986 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5628b80b1e20 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f171c036040 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f17140a8d70 con 0x5628b7cc7490 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 10 client.16986 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:02.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 20 client.16986 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7caecd0 0x5628b80b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 4 client.16986 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628b800fdb0 con 0x5628b7caecd0 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.153+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7caecd0 0x5628b80b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.154+0000 7f1711ffb640 10 client.16986 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:02.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.154+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7caecd0 0x5628b80b52d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df06707f4371389d server_cookie=d25484d08c687e01 in_seq=0 out_seq=0 2024-09-21T06:26:02.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1711ffb640 1 -- 172.21.15.38:0/3234566527 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628b800fdb0 con 0x5628b7caecd0 2024-09-21T06:26:02.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1711ffb640 10 client.16986 handle_command_reply: tid=0 2024-09-21T06:26:02.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 client.16986 shutdown 2024-09-21T06:26:02.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 msgr2=0x5628b80a3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f17140aa490 tx=0x7f17140ea910 comp rx=0 tx=0).stop 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 shutdown_connections 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cf0350 0x5628b80aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7caecd0 0x5628b80b52d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7ccf670 0x5628b80a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1711ffb640 0 client.16986 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3234566527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7cc7490 0x5628b80a3070 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 >> 172.21.15.38:0/3234566527 conn(0x5628b7ce4740 msgr2=0x5628b809a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 shutdown_connections 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 1 -- 172.21.15.38:0/3234566527 wait complete. 2024-09-21T06:26:02.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.155+0000 7f1736eaa740 20 client.16986 trim_cache size 0 max 16384 2024-09-21T06:26:02.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 Processor -- start 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 -- start start 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7caecd0 0x5628b809cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 0x5628b80a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b40a0 con 0x5628b7ccf670 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b1970 con 0x5628b7cc7490 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.173+0000 7f1736eaa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1af7c0 con 0x5628b7caecd0 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f172ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f172ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48426/0 (socket says 172.21.15.38:48426) 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 0x5628b80a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f172ad9d640 1 -- 172.21.15.38:0/466783384 learned_addr learned my addr 172.21.15.38:0/466783384 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:02.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f172a59c640 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7caecd0 0x5628b809cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 -- 172.21.15.38:0/466783384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7caecd0 msgr2=0x5628b809cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7caecd0 0x5628b809cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 -- 172.21.15.38:0/466783384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 msgr2=0x5628b80a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 -- 172.21.15.38:0/466783384 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b8099720 con 0x5628b7cc7490 2024-09-21T06:26:02.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1729d9b640 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 0x5628b80a0060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f171c0094b0 tx=0x7f171c031a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac9169f84b57bea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.174+0000 7f1713fff640 1 -- 172.21.15.38:0/466783384 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c054070 con 0x5628b7cc7490 2024-09-21T06:26:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1713fff640 1 -- 172.21.15.38:0/466783384 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f171c036070 con 0x5628b7cc7490 2024-09-21T06:26:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1713fff640 1 -- 172.21.15.38:0/466783384 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c04a040 con 0x5628b7cc7490 2024-09-21T06:26:02.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1736eaa740 1 -- 172.21.15.38:0/466783384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 msgr2=0x5628b80a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1736eaa740 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 0x5628b80a0060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f171c0094b0 tx=0x7f171c031a30 comp rx=0 tx=0).stop 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1736eaa740 1 -- 172.21.15.38:0/466783384 shutdown_connections 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.175+0000 7f1736eaa740 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7cc7490 0x5628b80a0060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 --2- 172.21.15.38:0/466783384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7caecd0 0x5628b809cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 -- 172.21.15.38:0/466783384 >> 172.21.15.38:0/466783384 conn(0x5628b7ce4740 msgr2=0x5628b809c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 -- 172.21.15.38:0/466783384 shutdown_connections 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 -- 172.21.15.38:0/466783384 wait complete. 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 -- start start 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.176+0000 7f1736eaa740 1 Processor -- start 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b80a7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1afe30 con 0x5628b7ccf670 2024-09-21T06:26:02.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b12a0 con 0x5628b7caecd0 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1b0500 con 0x5628b7cc7490 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1736eaa740 10 client.0 _ll_register_callbacks cb 0x7f17140b6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:57136/0 (socket says 172.21.15.38:57136) 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172a59c640 1 -- 172.21.15.38:0/3236263434 learned_addr learned my addr 172.21.15.38:0/3236263434 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f1729d9b640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b80a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 -- 172.21.15.38:0/3236263434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 msgr2=0x5628b80a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b80a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 -- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 msgr2=0x5628b80ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.177+0000 7f172ad9d640 1 -- 172.21.15.38:0/3236263434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b80a8520 con 0x5628b7ccf670 2024-09-21T06:26:02.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f172a59c640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f172ad9d640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a7eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f172400b9d0 tx=0x7f17240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56a102576ef46bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:02.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172401de50 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171c036070 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f172401b5b0 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f172401b7b0 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1736eaa740 10 client.16992 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.178+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5628b8120ae0 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f171c036070 con 0x5628b7ccf670 2024-09-21T06:26:02.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1724031c40 con 0x5628b7ccf670 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 10 client.16992 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 20 client.16992 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7cf0350 0x5628b8123350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 4 client.16992 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5628b800b860 con 0x5628b7cf0350 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.179+0000 7f172a59c640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7cf0350 0x5628b8123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.180+0000 7f172a59c640 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7cf0350 0x5628b8123350 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81dacc9bfff549d6 server_cookie=b66fbf716b4733a2 in_seq=0 out_seq=0 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.180+0000 7f1711ffb640 10 client.16992 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.181+0000 7f1711ffb640 1 -- 172.21.15.38:0/3236263434 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628b800b860 con 0x5628b7cf0350 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.181+0000 7f1711ffb640 10 client.16992 handle_command_reply: tid=0 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.181+0000 7f1736eaa740 1 client.16992 shutdown 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 msgr2=0x5628b80a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a7eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f172400b9d0 tx=0x7f17240046c0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 shutdown_connections 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5628b7ccf670 0x5628b80a7eb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5628b7cf0350 0x5628b8123350 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5628b7cc7490 0x5628b80a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 --2- 172.21.15.38:0/3236263434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5628b7caecd0 0x5628b80ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1711ffb640 0 client.16992 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 >> 172.21.15.38:0/3236263434 conn(0x5628b7ce4740 msgr2=0x5628b8098460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 shutdown_connections 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 1 -- 172.21.15.38:0/3236263434 wait complete. 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.182+0000 7f1736eaa740 20 client.16992 trim_cache size 0 max 16384 2024-09-21T06:26:02.186 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "23dae03e-9c5a-40a1-8db9-220615a22fa9", 2024-09-21T06:26:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:02.187 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 msgr2=0x7f17180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 0x7f17180b8c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f172400bbf0 tx=0x7f172400b340 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 msgr2=0x7f172c0fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f171400d950 tx=0x7f171400de10 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 shutdown_connections 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f17180b6700 0x7f17180b8c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f172c108d50 0x7f172c0ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f172c108400 0x7f172c0ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 --2- 172.21.15.38:0/1906939041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f172c1031d0 0x7f172c0fedf0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 >> 172.21.15.38:0/1906939041 conn(0x7f172c079f90 msgr2=0x7f172c101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 shutdown_connections 2024-09-21T06:26:02.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:02.183+0000 7f1730936640 1 -- 172.21.15.38:0/1906939041 wait complete. 2024-09-21T06:26:02.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:02 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:02.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:02 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:02 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:02.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:02 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:02 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:02.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:02 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:02 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:02.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:02 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:02 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:02 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:02 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:02.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:02 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:02.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:03.032 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:03.406 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:03 smithi038 ceph-mon[31215]: pgmap v510: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:26:03.406 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:03 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 -- 172.21.15.38:0/1211152935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c10de40 msgr2=0x7f404c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 --2- 172.21.15.38:0/1211152935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c10de40 0x7f404c110330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4044009ca0 tx=0x7f404402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 -- 172.21.15.38:0/1211152935 shutdown_connections 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 --2- 172.21.15.38:0/1211152935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c10de40 0x7f404c110330 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 --2- 172.21.15.38:0/1211152935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c105330 0x7f404c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 --2- 172.21.15.38:0/1211152935 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 0x7f404c104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 -- 172.21.15.38:0/1211152935 >> 172.21.15.38:0/1211152935 conn(0x7f404c079750 msgr2=0x7f404c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 -- 172.21.15.38:0/1211152935 shutdown_connections 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.495+0000 7f4051b66640 1 -- 172.21.15.38:0/1211152935 wait complete. 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 Processor -- start 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 -- start start 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 0x7f404c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c10de40 0x7f404c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f404c113c00 con 0x7f404c105330 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f404c113a80 con 0x7f404c1049e0 2024-09-21T06:26:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f4051b66640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f404c113d80 con 0x7f404c10de40 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f404affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f404affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48448/0 (socket says 172.21.15.38:48448) 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.496+0000 7f404affd640 1 -- 172.21.15.38:0/2572805858 learned_addr learned my addr 172.21.15.38:0/2572805858 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 0x7f404c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404bfff640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c10de40 0x7f404c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 -- 172.21.15.38:0/2572805858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c10de40 msgr2=0x7f404c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c10de40 0x7f404c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 -- 172.21.15.38:0/2572805858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 msgr2=0x7f404c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 0x7f404c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 -- 172.21.15.38:0/2572805858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c1a0480 con 0x7f404c105330 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f404affd640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f404000c970 tx=0x7f404000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f4048ff9640 1 -- 172.21.15.38:0/2572805858 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040004220 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f4048ff9640 1 -- 172.21.15.38:0/2572805858 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40400043c0 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404c1a0770 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f4048ff9640 1 -- 172.21.15.38:0/2572805858 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4040004a00 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.497+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c1a6ed0 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f4048ff9640 1 -- 172.21.15.38:0/2572805858 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f40400050b0 con 0x7f404c105330 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 Processor -- start 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 -- start start 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b01b0 0x56449b680b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b6810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56449b5f6e50 con 0x56449b2d9070 2024-09-21T06:26:03.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56449b5e6280 con 0x56449b2b01b0 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.500+0000 7f40580da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56449b5ea090 con 0x56449b2b8390 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48460/0 (socket says 172.21.15.38:48460) 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 -- 172.21.15.38:0/828927708 learned_addr learned my addr 172.21.15.38:0/828927708 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f4048ff9640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 0x7f40340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404affd640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b6810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404b7fe640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b01b0 0x56449b680b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 -- 172.21.15.38:0/828927708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 msgr2=0x56449b6810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b6810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 -- 172.21.15.38:0/828927708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b01b0 msgr2=0x56449b680b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b01b0 0x56449b680b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 -- 172.21.15.38:0/828927708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449b344650 con 0x56449b2d9070 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404affd640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b6810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 0x7f40340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f4048ff9640 1 -- 172.21.15.38:0/2572805858 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f40400e7300 con 0x7f404c105330 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.501+0000 7f404bfff640 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f40440099e0 tx=0x7f4044009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787a3bb5dfe5286f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f4031ffb640 1 -- 172.21.15.38:0/828927708 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044031610 con 0x56449b2d9070 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f4031ffb640 1 -- 172.21.15.38:0/828927708 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4044036040 con 0x56449b2d9070 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f4031ffb640 1 -- 172.21.15.38:0/828927708 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404402f8a0 con 0x56449b2d9070 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f40580da740 1 -- 172.21.15.38:0/828927708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 msgr2=0x56449b680650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f40580da740 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f40440099e0 tx=0x7f4044009a10 comp rx=0 tx=0).stop 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f404bfff640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 0x7f40340b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f404404c000 tx=0x7f4044049000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f40580da740 1 -- 172.21.15.38:0/828927708 shutdown_connections 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f40580da740 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b6810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.502+0000 7f40580da740 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b01b0 0x56449b680b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 --2- 172.21.15.38:0/828927708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2d9070 0x56449b680650 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 -- 172.21.15.38:0/828927708 >> 172.21.15.38:0/828927708 conn(0x56449b2cd460 msgr2=0x56449b67e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 -- 172.21.15.38:0/828927708 shutdown_connections 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 -- 172.21.15.38:0/828927708 wait complete. 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 -- start start 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 Processor -- start 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.503+0000 7f40580da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b68c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2d9070 0x56449b68c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56449b447700 con 0x56449b2b01b0 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56449b581110 con 0x56449b2d9070 2024-09-21T06:26:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56449b68ecb0 con 0x56449b2b8390 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 10 client.0 _ll_register_callbacks cb 0x56449b59a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48464/0 (socket says 172.21.15.38:48464) 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 -- 172.21.15.38:0/2018692205 learned_addr learned my addr 172.21.15.38:0/2018692205 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404bfff640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2d9070 0x56449b68c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404affd640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b68c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 -- 172.21.15.38:0/2018692205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 msgr2=0x56449b68c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b68c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 -- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2d9070 msgr2=0x56449b68c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2d9070 0x56449b68c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 -- 172.21.15.38:0/2018692205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449b5aec40 con 0x56449b2b01b0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f403c00ba00 tx=0x7f403c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad7465f4b3e47d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f402affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c003ea0 con 0x56449b2b01b0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f403c011640 con 0x56449b2b01b0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.504+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044036040 con 0x56449b2b01b0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f403c011840 con 0x56449b2b01b0 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 10 client.17004 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:03.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56449b69a9e0 con 0x56449b2b01b0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4044036040 con 0x56449b2b01b0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f403c010cb0 con 0x56449b2b01b0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 10 client.17004 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 10 client.17004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 20 client.17004 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2979f0 0x56449b69df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 4 client.17004 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.505+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56449b5f8da0 con 0x56449b2979f0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.506+0000 7f404affd640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2979f0 0x56449b69df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.506+0000 7f404affd640 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2979f0 0x56449b69df20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619f8ebc5e2b22b9 server_cookie=30345650b74cd983 in_seq=0 out_seq=0 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.506+0000 7f402affd640 10 client.17004 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f402affd640 1 -- 172.21.15.38:0/2018692205 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56449b5f8da0 con 0x56449b2979f0 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f402affd640 10 client.17004 handle_command_reply: tid=0 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 client.17004 shutdown 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 msgr2=0x56449b68bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f403c00ba00 tx=0x7f403c00bec0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 shutdown_connections 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2d9070 0x56449b68c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2979f0 0x56449b69df20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f402affd640 0 client.17004 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:03.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b8390 0x56449b68c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 --2- 172.21.15.38:0/2018692205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b01b0 0x56449b68bcc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 >> 172.21.15.38:0/2018692205 conn(0x56449b2cd460 msgr2=0x56449b683830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 shutdown_connections 2024-09-21T06:26:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 1 -- 172.21.15.38:0/2018692205 wait complete. 2024-09-21T06:26:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.507+0000 7f40580da740 20 client.17004 trim_cache size 0 max 16384 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 Processor -- start 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 -- start start 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 0x56449b682040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b68d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1b1ea0 con 0x56449b2b8390 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1af770 con 0x56449b2979f0 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f40580da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ad5c0 con 0x56449b2b01b0 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f404bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f404bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48474/0 (socket says 172.21.15.38:48474) 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.525+0000 7f404bfff640 1 -- 172.21.15.38:0/3088071033 learned_addr learned my addr 172.21.15.38:0/3088071033 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404affd640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b68d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404b7fe640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 0x56449b682040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 -- 172.21.15.38:0/3088071033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 msgr2=0x56449b68d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b68d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 -- 172.21.15.38:0/3088071033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 msgr2=0x56449b682040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 0x56449b682040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 -- 172.21.15.38:0/3088071033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449b68c540 con 0x56449b2b8390 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404affd640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b68d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404b7fe640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 0x56449b682040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f404bfff640 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4044009970 tx=0x7f40440047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f949754926445597 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f40317fa640 1 -- 172.21.15.38:0/3088071033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044004840 con 0x56449b2b8390 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f40317fa640 1 -- 172.21.15.38:0/3088071033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4044036070 con 0x56449b2b8390 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.526+0000 7f40317fa640 1 -- 172.21.15.38:0/3088071033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044004040 con 0x56449b2b8390 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- 172.21.15.38:0/3088071033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 msgr2=0x56449b67db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4044009970 tx=0x7f40440047d0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- 172.21.15.38:0/3088071033 shutdown_connections 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2b8390 0x56449b67db70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b68d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 --2- 172.21.15.38:0/3088071033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2979f0 0x56449b682040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- 172.21.15.38:0/3088071033 >> 172.21.15.38:0/3088071033 conn(0x56449b2cd460 msgr2=0x56449b68d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- 172.21.15.38:0/3088071033 shutdown_connections 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- 172.21.15.38:0/3088071033 wait complete. 2024-09-21T06:26:03.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.527+0000 7f40580da740 1 -- start start 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 Processor -- start 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b690750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 0x56449b707920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1adc30 con 0x56449b2979f0 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1af0a0 con 0x56449b2b8390 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ae300 con 0x56449b2b01b0 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f40580da740 10 client.0 _ll_register_callbacks cb 0x7f403c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f404b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48482/0 (socket says 172.21.15.38:48482) 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f404bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 0x56449b707920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f404b7fe640 1 -- 172.21.15.38:0/2401786896 learned_addr learned my addr 172.21.15.38:0/2401786896 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.528+0000 7f404affd640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b690750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 -- 172.21.15.38:0/2401786896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 msgr2=0x56449b690750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b690750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 -- 172.21.15.38:0/2401786896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 msgr2=0x56449b690210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 -- 172.21.15.38:0/2401786896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56449b690ff0 con 0x56449b2b8390 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f404bfff640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 0x56449b707920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f404402ade0 tx=0x7f404402fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee89715548bfda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f402affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:26:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044004840 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f404404e050 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044036070 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4044031820 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f40580da740 10 client.26519 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.529+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56449b708e30 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4044036070 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f40440309e0 con 0x56449b2b8390 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 10 client.26519 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 10 client.26519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 20 client.26519 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2d9070 0x56449b70b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 4 client.26519 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56449b687870 con 0x56449b2d9070 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.530+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2d9070 0x56449b70b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f402affd640 10 client.26519 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f404b7fe640 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2d9070 0x56449b70b280 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cc6af2f7d145166 server_cookie=2f0ad9bd268f5b2f in_seq=0 out_seq=0 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f402affd640 1 -- 172.21.15.38:0/2401786896 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x56449b687870 con 0x56449b2d9070 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f402affd640 10 client.26519 handle_command_reply: tid=0 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 client.26519 shutdown 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 msgr2=0x56449b707920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 0x56449b707920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f404402ade0 tx=0x7f404402fe70 comp rx=0 tx=0).stop 2024-09-21T06:26:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 shutdown_connections 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56449b2b8390 0x56449b707920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56449b2d9070 0x56449b70b280 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56449b2b01b0 0x56449b690750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 --2- 172.21.15.38:0/2401786896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56449b2979f0 0x56449b690210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f402affd640 0 client.26519 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 >> 172.21.15.38:0/2401786896 conn(0x56449b2cd460 msgr2=0x56449b681e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.531+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 shutdown_connections 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f40580da740 1 -- 172.21.15.38:0/2401786896 wait complete. 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f40580da740 20 client.26519 trim_cache size 0 max 16384 2024-09-21T06:26:03.543 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:03.553 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:03.553 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 msgr2=0x7f40340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 0x7f40340b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f404404c000 tx=0x7f4044049000 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 msgr2=0x7f404c19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f404000c970 tx=0x7f404000ce30 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 shutdown_connections 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f40340b6680 0x7f40340b8b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f404c10de40 0x7f404c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f404c105330 0x7f404c19aab0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 --2- 172.21.15.38:0/2572805858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404c1049e0 0x7f404c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 >> 172.21.15.38:0/2572805858 conn(0x7f404c079750 msgr2=0x7f404c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 shutdown_connections 2024-09-21T06:26:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:03.532+0000 7f4051b66640 1 -- 172.21.15.38:0/2572805858 wait complete. 2024-09-21T06:26:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:03 smithi174 ceph-mon[34815]: pgmap v510: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:26:03.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:03 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:03 smithi044 ceph-mon[34369]: pgmap v510: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:26:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:03 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:04.169 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:04.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:04.429 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:04.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 -- 172.21.15.38:0/2338115505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c103b90 msgr2=0x7fc17c103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:04.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 --2- 172.21.15.38:0/2338115505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c103b90 0x7fc17c103fa0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009900 tx=0x7fc16c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 -- 172.21.15.38:0/2338115505 shutdown_connections 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 --2- 172.21.15.38:0/2338115505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c109e20 0x7fc17c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 --2- 172.21.15.38:0/2338115505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 --2- 172.21.15.38:0/2338115505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c103b90 0x7fc17c103fa0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 -- 172.21.15.38:0/2338115505 >> 172.21.15.38:0/2338115505 conn(0x7fc17c0ff5e0 msgr2=0x7fc17c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 -- 172.21.15.38:0/2338115505 shutdown_connections 2024-09-21T06:26:04.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.858+0000 7fc1817cf640 1 -- 172.21.15.38:0/2338115505 wait complete. 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.859+0000 7fc1817cf640 1 Processor -- start 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.859+0000 7fc1817cf640 1 -- start start 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c103b90 0x7fc17c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c113c00 con 0x7fc17c109e20 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c113a80 con 0x7fc17c1094d0 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc1817cf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c113d80 con 0x7fc17c103b90 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc173fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48504/0 (socket says 172.21.15.38:48504) 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 -- 172.21.15.38:0/4238095871 learned_addr learned my addr 172.21.15.38:0/4238095871 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:04.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17affd640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c103b90 0x7fc17c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 -- 172.21.15.38:0/4238095871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c103b90 msgr2=0x7fc17c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c103b90 0x7fc17c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 -- 172.21.15.38:0/4238095871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 msgr2=0x7fc17c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 -- 172.21.15.38:0/4238095871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c1a0520 con 0x7fc17c109e20 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc173fff640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.860+0000 7fc17b7fe640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc174009fd0 tx=0x7fc17400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.861+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174017070 con 0x7fc17c109e20 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.861+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c1a0810 con 0x7fc17c109e20 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.861+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc174003e40 con 0x7fc17c109e20 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.861+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174004820 con 0x7fc17c109e20 2024-09-21T06:26:04.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.861+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a6f70 con 0x7fc17c109e20 2024-09-21T06:26:04.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.862+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c103fa0 con 0x7fc17c109e20 2024-09-21T06:26:04.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.864+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc174003970 con 0x7fc17c109e20 2024-09-21T06:26:04.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.864+0000 7fc178ff9640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 0x7fc1680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:04.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.865+0000 7fc17affd640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 0x7fc1680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:04.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.865+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc1740e7400 con 0x7fc17c109e20 2024-09-21T06:26:04.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.865+0000 7fc17affd640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 0x7fc1680b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009230 tx=0x7fc16c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:04.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:04.868+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc174003c60 con 0x7fc17c109e20 2024-09-21T06:26:05.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.092+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc17c19b6e0 con 0x7fc17c109e20 2024-09-21T06:26:05.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.092+0000 7fc178ff9640 1 -- 172.21.15.38:0/4238095871 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fc17c19b6e0 con 0x7fc17c109e20 2024-09-21T06:26:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:05.095 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:05.095 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 msgr2=0x7fc1680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 0x7fc1680b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009230 tx=0x7fc16c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 msgr2=0x7fc17c19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc174009fd0 tx=0x7fc17400b260 comp rx=0 tx=0).stop 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 shutdown_connections 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc1680b6680 0x7fc1680b8b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc17c109e20 0x7fc17c19fdf0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc17c1094d0 0x7fc17c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:05.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 --2- 172.21.15.38:0/4238095871 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc17c103b90 0x7fc17c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:05.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 >> 172.21.15.38:0/4238095871 conn(0x7fc17c0ff5e0 msgr2=0x7fc17c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:05.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 shutdown_connections 2024-09-21T06:26:05.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:05.095+0000 7fc1817cf640 1 -- 172.21.15.38:0/4238095871 wait complete. 2024-09-21T06:26:05.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:05 smithi038 ceph-mon[31215]: pgmap v511: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:26:05.389 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:05 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/4238095871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:05.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:05 smithi174 ceph-mon[34815]: pgmap v511: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:26:05.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:05 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/4238095871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:05 smithi044 ceph-mon[34369]: pgmap v511: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:26:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:05 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/4238095871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:05.692 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:05.949 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 -- 172.21.15.38:0/4251516733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2401083d0 msgr2=0x7fd2401087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 --2- 172.21.15.38:0/4251516733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2401083d0 0x7fd2401087e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd234009900 tx=0x7fd23402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 -- 172.21.15.38:0/4251516733 shutdown_connections 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 --2- 172.21.15.38:0/4251516733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240108d20 0x7fd24010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 --2- 172.21.15.38:0/4251516733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2401083d0 0x7fd2401087e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 --2- 172.21.15.38:0/4251516733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd240102ae0 0x7fd240102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 -- 172.21.15.38:0/4251516733 >> 172.21.15.38:0/4251516733 conn(0x7fd240079760 msgr2=0x7fd240079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 -- 172.21.15.38:0/4251516733 shutdown_connections 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.411+0000 7fd245446640 1 -- 172.21.15.38:0/4251516733 wait complete. 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 Processor -- start 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 -- start start 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 0x7fd24019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2401083d0 0x7fd24019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd240112ab0 con 0x7fd240108d20 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd240112930 con 0x7fd240102ae0 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd245446640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd240112c30 con 0x7fd2401083d0 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd23f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd23f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48512/0 (socket says 172.21.15.38:48512) 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.412+0000 7fd23f7fe640 1 -- 172.21.15.38:0/1645734621 learned_addr learned my addr 172.21.15.38:0/1645734621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2401083d0 0x7fd24019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23effd640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 0x7fd24019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 -- 172.21.15.38:0/1645734621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2401083d0 msgr2=0x7fd24019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2401083d0 0x7fd24019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 -- 172.21.15.38:0/1645734621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 msgr2=0x7fd24019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 0x7fd24019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 -- 172.21.15.38:0/1645734621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2401a04e0 con 0x7fd240108d20 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23effd640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 0x7fd24019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd23f7fe640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd238009fd0 tx=0x7fd23800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd227fff640 1 -- 172.21.15.38:0/1645734621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238017070 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd227fff640 1 -- 172.21.15.38:0/1645734621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd238003e40 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2401a07d0 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd227fff640 1 -- 172.21.15.38:0/1645734621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238004820 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.413+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2401a6f30 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.416+0000 7fd24b9ba740 1 Processor -- start 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd227fff640 1 -- 172.21.15.38:0/1645734621 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd238003970 con 0x7fd240108d20 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 -- start start 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f573be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f574120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f84f4e9ea0 con 0x55f84f1cc070 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f84f4d92d0 con 0x55f84f1ab390 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f84f4dd0e0 con 0x55f84f1a31b0 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48528/0 (socket says 172.21.15.38:48528) 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd23e7fc640 1 -- 172.21.15.38:0/431691568 learned_addr learned my addr 172.21.15.38:0/431691568 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd23effd640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f573be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.417+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f574120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 -- 172.21.15.38:0/431691568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 msgr2=0x55f84f573be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd227fff640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 0x7fd2280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f573be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 -- 172.21.15.38:0/431691568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 msgr2=0x55f84f574120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f574120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 -- 172.21.15.38:0/431691568 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84f237650 con 0x55f84f1cc070 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23effd640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f573be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23f7fe640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 0x7fd2280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd24006b680 tx=0x7fd234000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a0f41bd3713ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd227fff640 1 -- 172.21.15.38:0/1645734621 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd2380e74c0 con 0x7fd240108d20 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd2257fa640 1 -- 172.21.15.38:0/431691568 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234044020 con 0x55f84f1cc070 2024-09-21T06:26:06.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd2257fa640 1 -- 172.21.15.38:0/431691568 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd234031790 con 0x55f84f1cc070 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.418+0000 7fd2257fa640 1 -- 172.21.15.38:0/431691568 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234035040 con 0x55f84f1cc070 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- 172.21.15.38:0/431691568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 msgr2=0x55f84f5736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd23f7fe640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 0x7fd2280b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2380e5290 tx=0x7fd23807a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd24006b680 tx=0x7fd234000bc0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- 172.21.15.38:0/431691568 shutdown_connections 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f574120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f573be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/431691568 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5736a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- 172.21.15.38:0/431691568 >> 172.21.15.38:0/431691568 conn(0x55f84f1c0460 msgr2=0x55f84f571590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- 172.21.15.38:0/431691568 shutdown_connections 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- 172.21.15.38:0/431691568 wait complete. 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.419+0000 7fd24b9ba740 1 -- start start 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 Processor -- start 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f5836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1cc070 0x55f84f58f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f84f33a700 con 0x55f84f1a31b0 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f84f474160 con 0x55f84f1cc070 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f84f586180 con 0x55f84f1ab390 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd24b9ba740 10 client.0 _ll_register_callbacks cb 0x55f84f48d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48534/0 (socket says 172.21.15.38:48534) 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 -- 172.21.15.38:0/1656710359 learned_addr learned my addr 172.21.15.38:0/1656710359 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23effd640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f5836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 -- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 msgr2=0x55f84f5836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f5836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 -- 172.21.15.38:0/1656710359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1cc070 msgr2=0x55f84f58f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1cc070 0x55f84f58f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.420+0000 7fd23e7fc640 1 -- 172.21.15.38:0/1656710359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84f4a1c90 con 0x55f84f1a31b0 2024-09-21T06:26:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd234004620 tx=0x7fd2340319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec6c2561ae8deea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd222ff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23404c020 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd234004980 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd234031790 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd234057050 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd24b9ba740 10 client.17028 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f84f591ee0 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.421+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd234031790 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd2340488e0 con 0x55f84f1a31b0 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 10 client.17028 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 10 client.17028 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 20 client.17028 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f18a9f0 0x55f84f595240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 4 client.17028 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f84f4ebdf0 con 0x55f84f18a9f0 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd23effd640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f18a9f0 0x55f84f595240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd222ff5640 10 client.17028 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.422+0000 7fd23effd640 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f18a9f0 0x55f84f595240 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=713806cde5af1ded server_cookie=b06e93d915a189e4 in_seq=0 out_seq=0 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd222ff5640 1 -- 172.21.15.38:0/1656710359 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f84f4ebdf0 con 0x55f84f18a9f0 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd222ff5640 10 client.17028 handle_command_reply: tid=0 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 client.17028 shutdown 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 msgr2=0x55f84f583180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd234004620 tx=0x7fd2340319d0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 shutdown_connections 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f18a9f0 0x55f84f595240 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1cc070 0x55f84f58f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f5836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd222ff5640 0 client.17028 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/1656710359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1a31b0 0x55f84f583180 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.423+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 >> 172.21.15.38:0/1656710359 conn(0x55f84f1c0460 msgr2=0x55f84f575090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.424+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 shutdown_connections 2024-09-21T06:26:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.424+0000 7fd24b9ba740 1 -- 172.21.15.38:0/1656710359 wait complete. 2024-09-21T06:26:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.424+0000 7fd24b9ba740 20 client.17028 trim_cache size 0 max 16384 2024-09-21T06:26:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 Processor -- start 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 -- start start 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1a31b0 0x55f84f585060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f58f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401afb90 con 0x55f84f1cc070 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401ad460 con 0x55f84f1a31b0 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401ab2d0 con 0x55f84f1ab390 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48544/0 (socket says 172.21.15.38:48544) 2024-09-21T06:26:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd23e7fc640 1 -- 172.21.15.38:0/2758197126 learned_addr learned my addr 172.21.15.38:0/2758197126 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.437+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1a31b0 0x55f84f585060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23effd640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f58f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 -- 172.21.15.38:0/2758197126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 msgr2=0x55f84f58f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f58f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 -- 172.21.15.38:0/2758197126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1a31b0 msgr2=0x55f84f585060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1a31b0 0x55f84f585060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 -- 172.21.15.38:0/2758197126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84f576460 con 0x55f84f1cc070 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23effd640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f58f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd234001eb0 tx=0x7fd234032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efc9616d5d1db25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd224ff9640 1 -- 172.21.15.38:0/2758197126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23404c070 con 0x55f84f1cc070 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd224ff9640 1 -- 172.21.15.38:0/2758197126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd234031790 con 0x55f84f1cc070 2024-09-21T06:26:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.438+0000 7fd224ff9640 1 -- 172.21.15.38:0/2758197126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234035040 con 0x55f84f1cc070 2024-09-21T06:26:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- 172.21.15.38:0/2758197126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 msgr2=0x55f84f574de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd234001eb0 tx=0x7fd234032fc0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- 172.21.15.38:0/2758197126 shutdown_connections 2024-09-21T06:26:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f574de0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1ab390 0x55f84f58f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/2758197126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1a31b0 0x55f84f585060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- 172.21.15.38:0/2758197126 >> 172.21.15.38:0/2758197126 conn(0x55f84f1c0460 msgr2=0x55f84f5746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- 172.21.15.38:0/2758197126 shutdown_connections 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- 172.21.15.38:0/2758197126 wait complete. 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 -- start start 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.439+0000 7fd24b9ba740 1 Processor -- start 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f5982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f5988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401ab920 con 0x55f84f1cc070 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401acd90 con 0x55f84f1ab390 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401abff0 con 0x55f84f1a31b0 2024-09-21T06:26:06.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd24b9ba740 10 client.0 _ll_register_callbacks cb 0x7fd234031de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48554/0 (socket says 172.21.15.38:48554) 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 -- 172.21.15.38:0/3821248316 learned_addr learned my addr 172.21.15.38:0/3821248316 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23effd640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f5988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f5982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 -- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 msgr2=0x55f84f5982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f5982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 -- 172.21.15.38:0/3821248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 msgr2=0x55f84f5988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f5988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23e7fc640 1 -- 172.21.15.38:0/3821248316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84f5f86c0 con 0x55f84f1cc070 2024-09-21T06:26:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.440+0000 7fd23effd640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f5988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd23e7fc640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd234005910 tx=0x7fd234005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33418c365bb32321 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23404c070 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd234031790 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd234031590 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd234044040 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 10 client.17034 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f84f5ffa00 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd234031790 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd23403a960 con 0x55f84f1cc070 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 10 client.17034 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 10 client.17034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 20 client.17034 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f15fda0 0x55f84f602020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 4 client.17034 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.441+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f84f4e78a0 con 0x55f84f15fda0 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd23effd640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f15fda0 0x55f84f602020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd222ff5640 10 client.17034 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd23effd640 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f15fda0 0x55f84f602020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41a9d8d4650e733b server_cookie=f15eed8b5902d68c in_seq=0 out_seq=0 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd222ff5640 1 -- 172.21.15.38:0/3821248316 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f84f4e78a0 con 0x55f84f15fda0 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd222ff5640 10 client.17034 handle_command_reply: tid=0 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.442+0000 7fd24b9ba740 1 client.17034 shutdown 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 msgr2=0x55f84f5f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd234005910 tx=0x7fd234005c90 comp rx=0 tx=0).stop 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 shutdown_connections 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55f84f15fda0 0x55f84f602020 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f84f1cc070 0x55f84f5f8050 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f84f1ab390 0x55f84f5988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 --2- 172.21.15.38:0/3821248316 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f84f1a31b0 0x55f84f5982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 >> 172.21.15.38:0/3821248316 conn(0x55f84f1c0460 msgr2=0x55f84f584ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd222ff5640 0 client.17034 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:06.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 shutdown_connections 2024-09-21T06:26:06.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 1 -- 172.21.15.38:0/3821248316 wait complete. 2024-09-21T06:26:06.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd24b9ba740 20 client.17034 trim_cache size 0 max 16384 2024-09-21T06:26:06.450 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 msgr2=0x7fd2280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 0x7fd2280b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2380e5290 tx=0x7fd23807a040 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 msgr2=0x7fd24019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd238009fd0 tx=0x7fd23800b260 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 shutdown_connections 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd2280b6680 0x7fd2280b8b90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.443+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd240108d20 0x7fd24019fdb0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.444+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2401083d0 0x7fd24019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.444+0000 7fd245446640 1 --2- 172.21.15.38:0/1645734621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd240102ae0 0x7fd24019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.444+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 >> 172.21.15.38:0/1645734621 conn(0x7fd240079760 msgr2=0x7fd240101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.444+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 shutdown_connections 2024-09-21T06:26:06.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:06.444+0000 7fd245446640 1 -- 172.21.15.38:0/1645734621 wait complete. 2024-09-21T06:26:07.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:07.409 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:07.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:07 smithi038 ceph-mon[31215]: pgmap v512: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:26:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:07 smithi174 ceph-mon[34815]: pgmap v512: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:26:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:07 smithi044 ceph-mon[34369]: pgmap v512: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 -- 172.21.15.38:0/2394784130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c104840 msgr2=0x7fa18c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 --2- 172.21.15.38:0/2394784130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c104840 0x7fa18c104c50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009900 tx=0x7fa17c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 -- 172.21.15.38:0/2394784130 shutdown_connections 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 --2- 172.21.15.38:0/2394784130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c10ddf0 0x7fa18c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 --2- 172.21.15.38:0/2394784130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c105270 0x7fa18c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 --2- 172.21.15.38:0/2394784130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c104840 0x7fa18c104c50 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 -- 172.21.15.38:0/2394784130 >> 172.21.15.38:0/2394784130 conn(0x7fa18c079730 msgr2=0x7fa18c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 -- 172.21.15.38:0/2394784130 shutdown_connections 2024-09-21T06:26:07.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.851+0000 7fa192482640 1 -- 172.21.15.38:0/2394784130 wait complete. 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.852+0000 7fa192482640 1 Processor -- start 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.852+0000 7fa192482640 1 -- start start 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c104840 0x7fa18c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 0x7fa18c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c113bd0 con 0x7fa18c105270 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c113a50 con 0x7fa18c10ddf0 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa192482640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c113d50 con 0x7fa18c104840 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48562/0 (socket says 172.21.15.38:48562) 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 -- 172.21.15.38:0/3393344400 learned_addr learned my addr 172.21.15.38:0/3393344400 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa18bfff640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c104840 0x7fa18c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa190a1f640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 0x7fa18c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 -- 172.21.15.38:0/3393344400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c104840 msgr2=0x7fa18c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c104840 0x7fa18c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 -- 172.21.15.38:0/3393344400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 msgr2=0x7fa18c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 0x7fa18c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa183fff640 1 -- 172.21.15.38:0/3393344400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c1a04d0 con 0x7fa18c105270 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.853+0000 7fa190a1f640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 0x7fa18c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa183fff640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa17400d740 tx=0x7fa17400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa189ffb640 1 -- 172.21.15.38:0/3393344400 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174017070 con 0x7fa18c105270 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c1a07c0 con 0x7fa18c105270 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa189ffb640 1 -- 172.21.15.38:0/3393344400 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa17400de50 con 0x7fa18c105270 2024-09-21T06:26:07.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa189ffb640 1 -- 172.21.15.38:0/3393344400 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17400f620 con 0x7fa18c105270 2024-09-21T06:26:07.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.854+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c1a6f20 con 0x7fa18c105270 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.856+0000 7fa1989f6740 1 Processor -- start 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.856+0000 7fa1989f6740 1 -- start start 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0edb070 0x5622b12822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eb21b0 0x5622b1282800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa189ffb640 1 -- 172.21.15.38:0/3393344400 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa17401a070 con 0x7fa18c105270 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5622b11f8ea0 con 0x5622b0eba390 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5622b11e82d0 con 0x5622b0edb070 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa1989f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622b11ec0e0 con 0x5622b0eb21b0 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48578/0 (socket says 172.21.15.38:48578) 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 -- 172.21.15.38:0/1016357740 learned_addr learned my addr 172.21.15.38:0/1016357740 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0edb070 0x5622b12822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eb21b0 0x5622b1282800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 -- 172.21.15.38:0/1016357740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eb21b0 msgr2=0x5622b1282800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eb21b0 0x5622b1282800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 -- 172.21.15.38:0/1016357740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0edb070 msgr2=0x5622b12822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0edb070 0x5622b12822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.857+0000 7fa183fff640 1 -- 172.21.15.38:0/1016357740 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b0f46650 con 0x5622b0eba390 2024-09-21T06:26:07.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa183fff640 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa1740e47d0 tx=0x7fa1740ef780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ee06d0864b614f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa1827fc640 1 -- 172.21.15.38:0/1016357740 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740fa070 con 0x5622b0eba390 2024-09-21T06:26:07.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa1827fc640 1 -- 172.21.15.38:0/1016357740 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1740e7a10 con 0x5622b0eba390 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa1827fc640 1 -- 172.21.15.38:0/1016357740 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740f5a50 con 0x5622b0eba390 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa189ffb640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 0x7fa1780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa190a1f640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 0x7fa1780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.858+0000 7fa189ffb640 1 -- 172.21.15.38:0/3393344400 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa1740e7090 con 0x7fa18c105270 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- 172.21.15.38:0/1016357740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 msgr2=0x5622b1282d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa190a1f640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 0x7fa1780b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa184005fd0 tx=0x7fa184009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa1740e47d0 tx=0x7fa1740ef780 comp rx=0 tx=0).stop 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- 172.21.15.38:0/1016357740 shutdown_connections 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eba390 0x5622b1282d40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eb21b0 0x5622b1282800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1016357740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0edb070 0x5622b12822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- 172.21.15.38:0/1016357740 >> 172.21.15.38:0/1016357740 conn(0x5622b0ecf460 msgr2=0x5622b12801b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- 172.21.15.38:0/1016357740 shutdown_connections 2024-09-21T06:26:07.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- 172.21.15.38:0/1016357740 wait complete. 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.859+0000 7fa1989f6740 1 -- start start 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 Processor -- start 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b128da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b128df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5622b1049700 con 0x5622b0edb070 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5622b1183160 con 0x5622b0eb21b0 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622b1290aa0 con 0x5622b0eba390 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa1989f6740 10 client.0 _ll_register_callbacks cb 0x5622b119c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa190a1f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa190a1f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48586/0 (socket says 172.21.15.38:48586) 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa190a1f640 1 -- 172.21.15.38:0/1077684919 learned_addr learned my addr 172.21.15.38:0/1077684919 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b128da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.860+0000 7fa183fff640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b128df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 -- 172.21.15.38:0/1077684919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 msgr2=0x5622b128df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b128df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 -- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 msgr2=0x5622b128da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b128da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 -- 172.21.15.38:0/1077684919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b11b0c90 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa184011cc0 tx=0x7fa184004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c5cb512a3ae9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa16b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18401ecb0 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa18401f410 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1740e7a10 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa18401ee50 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa1989f6740 10 client.17046 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.861+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622b129c890 con 0x5622b0edb070 2024-09-21T06:26:07.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1740e7a10 con 0x5622b0edb070 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa18400f040 con 0x5622b0edb070 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 10 client.17046 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 10 client.17046 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 20 client.17046 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e999f0 0x5622b129fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 4 client.17046 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622b11fadf0 con 0x5622b0e999f0 2024-09-21T06:26:07.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.862+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e999f0 0x5622b129fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.863+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e999f0 0x5622b129fcf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94e3ac508aff6509 server_cookie=bdc7e55226245135 in_seq=0 out_seq=0 2024-09-21T06:26:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.863+0000 7fa16b7fe640 10 client.17046 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.863+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1077684919 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622b11fadf0 con 0x5622b0e999f0 2024-09-21T06:26:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.863+0000 7fa16b7fe640 10 client.17046 handle_command_reply: tid=0 2024-09-21T06:26:07.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.863+0000 7fa1989f6740 1 client.17046 shutdown 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 msgr2=0x5622b1299d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa184011cc0 tx=0x7fa184004a40 comp rx=0 tx=0).stop 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 shutdown_connections 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e999f0 0x5622b129fcf0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1299d90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b128df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1077684919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b128da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 >> 172.21.15.38:0/1077684919 conn(0x5622b0ecf460 msgr2=0x5622b12832f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa16b7fe640 0 client.17046 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 shutdown_connections 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 1 -- 172.21.15.38:0/1077684919 wait complete. 2024-09-21T06:26:07.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.864+0000 7fa1989f6740 20 client.17046 trim_cache size 0 max 16384 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 Processor -- start 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 -- start start 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eba390 0x5622b1280220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0edb070 0x5622b1299c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b1f30 con 0x5622b0eb21b0 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1af800 con 0x5622b0eba390 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa1989f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1ad650 con 0x5622b0edb070 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.877+0000 7fa18bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48590/0 (socket says 172.21.15.38:48590) 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 -- 172.21.15.38:0/4154334268 learned_addr learned my addr 172.21.15.38:0/4154334268 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa190a1f640 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0edb070 0x5622b1299c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 -- 172.21.15.38:0/4154334268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0edb070 msgr2=0x5622b1299c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa183fff640 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eba390 0x5622b1280220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0edb070 0x5622b1299c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 -- 172.21.15.38:0/4154334268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eba390 msgr2=0x5622b1280220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eba390 0x5622b1280220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 -- 172.21.15.38:0/4154334268 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b12845b0 con 0x5622b0eb21b0 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa18bfff640 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0314b0 tx=0x7fa17c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2b52116d8571a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa181ffb640 1 -- 172.21.15.38:0/4154334268 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c04a020 con 0x5622b0eb21b0 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa181ffb640 1 -- 172.21.15.38:0/4154334268 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa17c005040 con 0x5622b0eb21b0 2024-09-21T06:26:07.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.878+0000 7fa181ffb640 1 -- 172.21.15.38:0/4154334268 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c035040 con 0x5622b0eb21b0 2024-09-21T06:26:07.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- 172.21.15.38:0/4154334268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 msgr2=0x5622b1283960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0314b0 tx=0x7fa17c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- 172.21.15.38:0/4154334268 shutdown_connections 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0edb070 0x5622b1299c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eba390 0x5622b1280220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 --2- 172.21.15.38:0/4154334268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0eb21b0 0x5622b1283960 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- 172.21.15.38:0/4154334268 >> 172.21.15.38:0/4154334268 conn(0x5622b0ecf460 msgr2=0x5622b127fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- 172.21.15.38:0/4154334268 shutdown_connections 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- 172.21.15.38:0/4154334268 wait complete. 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.879+0000 7fa1989f6740 1 -- start start 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 Processor -- start 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b1296420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b12918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1adcc0 con 0x5622b0edb070 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1af130 con 0x5622b0eb21b0 2024-09-21T06:26:07.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1ae390 con 0x5622b0eba390 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa1989f6740 10 client.0 _ll_register_callbacks cb 0x7fa184009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa190a1f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa190a1f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48592/0 (socket says 172.21.15.38:48592) 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa190a1f640 1 -- 172.21.15.38:0/1169037666 learned_addr learned my addr 172.21.15.38:0/1169037666 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b1296420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.880+0000 7fa183fff640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b12918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 -- 172.21.15.38:0/1169037666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 msgr2=0x5622b12918d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b12918d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 -- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 msgr2=0x5622b1296420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b1296420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 -- 172.21.15.38:0/1169037666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b1292500 con 0x5622b0edb070 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa190a1f640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa184018040 tx=0x7fa18402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b64728a91a7c259 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa16b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18401ee50 con 0x5622b0edb070 2024-09-21T06:26:07.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa184004cc0 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17c005040 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa18402aa40 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa1989f6740 10 client.17052 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622b130a540 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.881+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa17c005040 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa1840057b0 con 0x5622b0edb070 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 10 client.17052 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 10 client.17052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 20 client.17052 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e6eda0 0x5622b130cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 4 client.17052 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622b11f68a0 con 0x5622b0e6eda0 2024-09-21T06:26:07.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e6eda0 0x5622b130cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:07.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa16b7fe640 10 client.17052 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.882+0000 7fa18bfff640 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e6eda0 0x5622b130cd80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7dffbb64c8d2a3af server_cookie=dcc3445dbc71501c in_seq=0 out_seq=0 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa16b7fe640 1 -- 172.21.15.38:0/1169037666 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622b11f68a0 con 0x5622b0e6eda0 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa16b7fe640 10 client.17052 handle_command_reply: tid=0 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 client.17052 shutdown 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 msgr2=0x5622b1291e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa184018040 tx=0x7fa18402a730 comp rx=0 tx=0).stop 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 shutdown_connections 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5622b0e6eda0 0x5622b130cd80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5622b0edb070 0x5622b1291e10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622b0eba390 0x5622b12918d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 --2- 172.21.15.38:0/1169037666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622b0eb21b0 0x5622b1296420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa16b7fe640 0 client.17052 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 >> 172.21.15.38:0/1169037666 conn(0x5622b0ecf460 msgr2=0x5622b128d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 shutdown_connections 2024-09-21T06:26:07.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 1 -- 172.21.15.38:0/1169037666 wait complete. 2024-09-21T06:26:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.883+0000 7fa1989f6740 20 client.17052 trim_cache size 0 max 16384 2024-09-21T06:26:07.889 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 msgr2=0x7fa1780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 0x7fa1780b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa184005fd0 tx=0x7fa184009800 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 msgr2=0x7fa18c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa17400d740 tx=0x7fa17400dc00 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 shutdown_connections 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa1780b6680 0x7fa1780b8b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa18c10ddf0 0x7fa18c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa18c105270 0x7fa18c19ab00 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 --2- 172.21.15.38:0/3393344400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa18c104840 0x7fa18c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 >> 172.21.15.38:0/3393344400 conn(0x7fa18c079730 msgr2=0x7fa18c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 shutdown_connections 2024-09-21T06:26:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:07.884+0000 7fa192482640 1 -- 172.21.15.38:0/3393344400 wait complete. 2024-09-21T06:26:08.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:26:09.159 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:09.544 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:09 smithi038 ceph-mon[31215]: pgmap v513: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:26:09.544 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:09 smithi038 ceph-mon[31215]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:26:09.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 -- 172.21.15.38:0/896797212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3174103bc0 msgr2=0x7f3174103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 --2- 172.21.15.38:0/896797212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3174103bc0 0x7f3174103fd0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3164009ca0 tx=0x7f316402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 -- 172.21.15.38:0/896797212 shutdown_connections 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 --2- 172.21.15.38:0/896797212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174109e00 0x7f3174110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 --2- 172.21.15.38:0/896797212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f31741094b0 0x7f31741098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 --2- 172.21.15.38:0/896797212 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3174103bc0 0x7f3174103fd0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 -- 172.21.15.38:0/896797212 >> 172.21.15.38:0/896797212 conn(0x7f317407b910 msgr2=0x7f317407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 -- 172.21.15.38:0/896797212 shutdown_connections 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.635+0000 7f3179fa3640 1 -- 172.21.15.38:0/896797212 wait complete. 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 Processor -- start 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 -- start start 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 0x7f317419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 0x7f317419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113be0 con 0x7f31741094b0 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113a60 con 0x7f3174109e00 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3179fa3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113d60 con 0x7f3174103bc0 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32950/0 (socket says 172.21.15.38:32950) 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.636+0000 7f3172ffd640 1 -- 172.21.15.38:0/1633836275 learned_addr learned my addr 172.21.15.38:0/1633836275 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3173fff640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 0x7f317419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f31737fe640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 0x7f317419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 -- 172.21.15.38:0/1633836275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 msgr2=0x7f317419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 0x7f317419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 -- 172.21.15.38:0/1633836275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 msgr2=0x7f317419fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 0x7f317419fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 -- 172.21.15.38:0/1633836275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a0460 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f31737fe640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 0x7f317419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3173fff640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 0x7f317419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3172ffd640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f316800c8c0 tx=0x7f316800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3170ff9640 1 -- 172.21.15.38:0/1633836275 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168007bb0 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a0750 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3170ff9640 1 -- 172.21.15.38:0/1633836275 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3168007d50 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3170ff9640 1 -- 172.21.15.38:0/1633836275 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31680188c0 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.637+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a6f70 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 Processor -- start 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 -- start start 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3170ff9640 1 -- 172.21.15.38:0/1633836275 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f316800fb60 con 0x7f31741094b0 2024-09-21T06:26:09.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55626562bea0 con 0x5562652e51b0 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55626561b2d0 con 0x55626530e070 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3180517740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55626561f0e0 con 0x5562652ed390 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32954/0 (socket says 172.21.15.38:32954) 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 -- 172.21.15.38:0/3299335539 learned_addr learned my addr 172.21.15.38:0/3299335539 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3173fff640 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f3172ffd640 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 -- 172.21.15.38:0/3299335539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 msgr2=0x5562656b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 -- 172.21.15.38:0/3299335539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 msgr2=0x5562656b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.640+0000 7f31737fe640 1 -- 172.21.15.38:0/3299335539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556265379650 con 0x5562652e51b0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f31737fe640 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3164009880 tx=0x7f31640098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa69164408c7f7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3170ff9640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 0x7f315c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3159ffb640 1 -- 172.21.15.38:0/3299335539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164031dc0 con 0x5562652e51b0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3173fff640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 0x7f315c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3159ffb640 1 -- 172.21.15.38:0/3299335539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3164036070 con 0x5562652e51b0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3159ffb640 1 -- 172.21.15.38:0/3299335539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164004330 con 0x5562652e51b0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.641+0000 7f3170ff9640 1 -- 172.21.15.38:0/1633836275 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f31680e7880 con 0x7f31741094b0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- 172.21.15.38:0/3299335539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 msgr2=0x5562656b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3173fff640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 0x7f315c0b8bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3164009880 tx=0x7f31640098b0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- 172.21.15.38:0/3299335539 shutdown_connections 2024-09-21T06:26:09.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656b5800 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 --2- 172.21.15.38:0/3299335539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- 172.21.15.38:0/3299335539 >> 172.21.15.38:0/3299335539 conn(0x556265302460 msgr2=0x5562656b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- 172.21.15.38:0/3299335539 shutdown_connections 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- 172.21.15.38:0/3299335539 wait complete. 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.642+0000 7f3180517740 1 -- start start 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 Processor -- start 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55626547c700 con 0x5562652e51b0 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5562655b6160 con 0x55626530e070 2024-09-21T06:26:09.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5562656c3a40 con 0x5562652ed390 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3180517740 10 client.0 _ll_register_callbacks cb 0x5562655cf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f31737fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f31737fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32968/0 (socket says 172.21.15.38:32968) 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.643+0000 7f31737fe640 1 -- 172.21.15.38:0/3669625759 learned_addr learned my addr 172.21.15.38:0/3669625759 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3173fff640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 -- 172.21.15.38:0/3669625759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 msgr2=0x5562656c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 -- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 msgr2=0x5562656ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 -- 172.21.15.38:0/3669625759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562655e3c90 con 0x5562652e51b0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f31737fe640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3164031ae0 tx=0x7f316402b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea12d54b4c9acaea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164052020 con 0x5562652e51b0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f3164031450 con 0x5562652e51b0 2024-09-21T06:26:09.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3164036070 con 0x5562652e51b0 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.644+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f316405d050 con 0x5562652e51b0 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 10 client.17064 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5562656d3b30 con 0x5562652e51b0 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3164036070 con 0x5562652e51b0 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3164004450 con 0x5562652e51b0 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 10 client.17064 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 20 client.17064 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562652cc9f0 0x5562656d6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 4 client.17064 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:09.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626562ddf0 con 0x5562652cc9f0 2024-09-21T06:26:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:09 smithi044 ceph-mon[34369]: pgmap v513: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:26:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:09 smithi044 ceph-mon[34369]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:26:09.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:09 smithi174 ceph-mon[34815]: pgmap v513: 97 pgs: 97 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:26:09.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:09 smithi174 ceph-mon[34815]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:26:09.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.645+0000 7f3172ffd640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562652cc9f0 0x5562656d6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.646+0000 7f3172ffd640 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562652cc9f0 0x5562656d6e90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de2a8624faf32a12 server_cookie=f4dbde5eca5cb1c3 in_seq=0 out_seq=0 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.646+0000 7f3152ffd640 10 client.17064 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3152ffd640 1 -- 172.21.15.38:0/3669625759 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55626562ddf0 con 0x5562652cc9f0 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3152ffd640 10 client.17064 handle_command_reply: tid=0 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 client.17064 shutdown 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 msgr2=0x5562656c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3164031ae0 tx=0x7f316402b050 comp rx=0 tx=0).stop 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 shutdown_connections 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55626530e070 0x5562656ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5562652cc9f0 0x5562656d6e90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3152ffd640 0 client.17064 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 --2- 172.21.15.38:0/3669625759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656c0980 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 >> 172.21.15.38:0/3669625759 conn(0x556265302460 msgr2=0x5562656b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 shutdown_connections 2024-09-21T06:26:09.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 1 -- 172.21.15.38:0/3669625759 wait complete. 2024-09-21T06:26:09.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.647+0000 7f3180517740 20 client.17064 trim_cache size 0 max 16384 2024-09-21T06:26:09.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.660+0000 7f3180517740 1 Processor -- start 2024-09-21T06:26:09.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.660+0000 7f3180517740 1 -- start start 2024-09-21T06:26:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652cc9f0 0x5562656c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f31741afe70 con 0x5562652e51b0 2024-09-21T06:26:09.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ad740 con 0x5562652cc9f0 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3180517740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ab5b0 con 0x5562652ed390 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32982/0 (socket says 172.21.15.38:32982) 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f31737fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652cc9f0 0x5562656c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 -- 172.21.15.38:0/2976227322 learned_addr learned my addr 172.21.15.38:0/2976227322 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3173fff640 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656bdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 -- 172.21.15.38:0/2976227322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 msgr2=0x5562656bdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656bdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 -- 172.21.15.38:0/2976227322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652cc9f0 msgr2=0x5562656c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652cc9f0 0x5562656c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 -- 172.21.15.38:0/2976227322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562656b75b0 con 0x5562652e51b0 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f3172ffd640 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f31680e55f0 tx=0x7f3168000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3519c7e20abd2718 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f31597fa640 1 -- 172.21.15.38:0/2976227322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31680b21d0 con 0x5562652e51b0 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f31597fa640 1 -- 172.21.15.38:0/2976227322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f31680b7110 con 0x5562652e51b0 2024-09-21T06:26:09.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.661+0000 7f31597fa640 1 -- 172.21.15.38:0/2976227322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31680a9040 con 0x5562652e51b0 2024-09-21T06:26:09.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 -- 172.21.15.38:0/2976227322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 msgr2=0x5562656cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f31680e55f0 tx=0x7f3168000bc0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 -- 172.21.15.38:0/2976227322 shutdown_connections 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652ed390 0x5562656bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652e51b0 0x5562656cccd0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 --2- 172.21.15.38:0/2976227322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652cc9f0 0x5562656c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 -- 172.21.15.38:0/2976227322 >> 172.21.15.38:0/2976227322 conn(0x556265302460 msgr2=0x5562656c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 -- 172.21.15.38:0/2976227322 shutdown_connections 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.662+0000 7f3180517740 1 -- 172.21.15.38:0/2976227322 wait complete. 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 -- start start 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 Processor -- start 2024-09-21T06:26:09.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652cc9f0 0x5562656d8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652e51b0 0x5562656d8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f31741abc00 con 0x5562652ed390 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ad070 con 0x5562652e51b0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ac2d0 con 0x5562652cc9f0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3180517740 10 client.0 _ll_register_callbacks cb 0x7f3164031a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3173fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3173fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32998/0 (socket says 172.21.15.38:32998) 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.663+0000 7f3173fff640 1 -- 172.21.15.38:0/842069147 learned_addr learned my addr 172.21.15.38:0/842069147 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f31737fe640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652cc9f0 0x5562656d8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3172ffd640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652e51b0 0x5562656d8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 -- 172.21.15.38:0/842069147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652cc9f0 msgr2=0x5562656d8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652cc9f0 0x5562656d8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 -- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652e51b0 msgr2=0x5562656d8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652e51b0 0x5562656d8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 -- 172.21.15.38:0/842069147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556265740860 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3173fff640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f316c0128e0 tx=0x7f316c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7968e01742fe9213 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c02e060 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f316c020b40 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31680b7110 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f316c020d40 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3180517740 10 client.17070 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.664+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556265741b40 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f31680b7110 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f316c01e3b0 con 0x5562652ed390 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 10 client.17070 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:09.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 20 client.17070 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55626530e070 0x556265744360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 4 client.17070 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5562656298a0 con 0x55626530e070 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.665+0000 7f31737fe640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55626530e070 0x556265744360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3152ffd640 10 client.17070 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f31737fe640 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55626530e070 0x556265744360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d82790e4babd6cd server_cookie=aaa6ccf6af1c1efd in_seq=0 out_seq=0 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3152ffd640 1 -- 172.21.15.38:0/842069147 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5562656298a0 con 0x55626530e070 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3152ffd640 10 client.17070 handle_command_reply: tid=0 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 client.17070 shutdown 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 msgr2=0x5562656d8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f316c0128e0 tx=0x7f316c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 shutdown_connections 2024-09-21T06:26:09.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5562652ed390 0x5562656d8c10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5562652e51b0 0x5562656d8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55626530e070 0x556265744360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3152ffd640 0 client.17070 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 --2- 172.21.15.38:0/842069147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5562652cc9f0 0x5562656d8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 >> 172.21.15.38:0/842069147 conn(0x556265302460 msgr2=0x5562656b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 shutdown_connections 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 1 -- 172.21.15.38:0/842069147 wait complete. 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.666+0000 7f3180517740 20 client.17070 trim_cache size 0 max 16384 2024-09-21T06:26:09.673 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 msgr2=0x7f315c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 0x7f315c0b8bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b5f0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 msgr2=0x7f317419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f316800c8c0 tx=0x7f316800cd80 comp rx=0 tx=0).stop 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 shutdown_connections 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f315c0b66b0 0x7f315c0b8bc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3174109e00 0x7f317419fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31741094b0 0x7f317419ab50 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 --2- 172.21.15.38:0/1633836275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3174103bc0 0x7f317419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:09.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 >> 172.21.15.38:0/1633836275 conn(0x7f317407b910 msgr2=0x7f3174107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:09.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 shutdown_connections 2024-09-21T06:26:09.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:09.667+0000 7f3179fa3640 1 -- 172.21.15.38:0/1633836275 wait complete. 2024-09-21T06:26:11.480 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:11.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:11 smithi174 ceph-mon[34815]: pgmap v515: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:26:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:11 smithi044 ceph-mon[34369]: pgmap v515: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:26:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:11 smithi038 ceph-mon[31215]: pgmap v515: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:26:11.752 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1097674512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 msgr2=0x7fdbc010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1097674512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc010fbb0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009900 tx=0x7fdbb002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1097674512 shutdown_connections 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1097674512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc01100f0 0x7fdbc0112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1097674512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc010fbb0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1097674512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc00757b0 0x7fdbc0075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1097674512 >> 172.21.15.38:0/1097674512 conn(0x7fdbc00ff620 msgr2=0x7fdbc0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1097674512 shutdown_connections 2024-09-21T06:26:12.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.492+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1097674512 wait complete. 2024-09-21T06:26:12.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 Processor -- start 2024-09-21T06:26:12.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 -- start start 2024-09-21T06:26:12.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00757b0 0x7fdbc019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc01100f0 0x7fdbc01a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0115dc0 con 0x7fdbc0076100 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0115c40 con 0x7fdbc01100f0 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.493+0000 7fdbc7dbb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc0115f40 con 0x7fdbc00757b0 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33016/0 (socket says 172.21.15.38:33016) 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 -- 172.21.15.38:0/1179893111 learned_addr learned my addr 172.21.15.38:0/1179893111 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc6358640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc01100f0 0x7fdbc01a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00757b0 0x7fdbc019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 -- 172.21.15.38:0/1179893111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00757b0 msgr2=0x7fdbc019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00757b0 0x7fdbc019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 -- 172.21.15.38:0/1179893111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc01100f0 msgr2=0x7fdbc01a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc01100f0 0x7fdbc01a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.497 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 -- 172.21.15.38:0/1179893111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc01a26e0 con 0x7fdbc0076100 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.494+0000 7fdbc5356640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005940 tx=0x7fdbb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.495+0000 7fdbb6ffd640 1 -- 172.21.15.38:0/1179893111 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb003f030 con 0x7fdbc0076100 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.495+0000 7fdbb6ffd640 1 -- 172.21.15.38:0/1179893111 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbb0031910 con 0x7fdbc0076100 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.495+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc01a2970 con 0x7fdbc0076100 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.495+0000 7fdbb6ffd640 1 -- 172.21.15.38:0/1179893111 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0035070 con 0x7fdbc0076100 2024-09-21T06:26:12.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.495+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc01a9130 con 0x7fdbc0076100 2024-09-21T06:26:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.497+0000 7fdbce32f740 1 Processor -- start 2024-09-21T06:26:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 -- start start 2024-09-21T06:26:12.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbb6ffd640 1 -- 172.21.15.38:0/1179893111 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdbb0042030 con 0x7fdbc0076100 2024-09-21T06:26:12.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e976430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5ae670 0x560f2e976eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560f2e8ece60 con 0x560f2e5a6490 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560f2e8dc290 con 0x560f2e5cf350 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbce32f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560f2e8e00a0 con 0x560f2e5ae670 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbc5b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbc5b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33024/0 (socket says 172.21.15.38:33024) 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2856635822 learned_addr learned my addr 172.21.15.38:0/2856635822 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.498+0000 7fdbc6358640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e976430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5356640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5ae670 0x560f2e976eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2856635822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5ae670 msgr2=0x560f2e976eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5ae670 0x560f2e976eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2856635822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 msgr2=0x560f2e976430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e976430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2856635822 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2e63a930 con 0x560f2e5a6490 2024-09-21T06:26:12.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc6358640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e976430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:12.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00bd10 tx=0x7fdbbc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240f59b84759bf79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbb6ffd640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 0x7fdbac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbc6358640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 0x7fdbac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbabfff640 1 -- 172.21.15.38:0/2856635822 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004030 con 0x560f2e5a6490 2024-09-21T06:26:12.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.499+0000 7fdbb6ffd640 1 -- 172.21.15.38:0/1179893111 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fdbb0107830 con 0x7fdbc0076100 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.500+0000 7fdbabfff640 1 -- 172.21.15.38:0/2856635822 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbbc0041d0 con 0x560f2e5a6490 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.500+0000 7fdbabfff640 1 -- 172.21.15.38:0/2856635822 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0118b0 con 0x560f2e5a6490 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.500+0000 7fdbce32f740 1 -- 172.21.15.38:0/2856635822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 msgr2=0x560f2e976970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.500+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00bd10 tx=0x7fdbbc0107a0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.500+0000 7fdbc6358640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 0x7fdbac0b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8005fd0 tx=0x7fdbb8009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 -- 172.21.15.38:0/2856635822 shutdown_connections 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5ae670 0x560f2e976eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e976970 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2856635822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e976430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 -- 172.21.15.38:0/2856635822 >> 172.21.15.38:0/2856635822 conn(0x560f2e5c3740 msgr2=0x560f2e974320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 -- 172.21.15.38:0/2856635822 shutdown_connections 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 -- 172.21.15.38:0/2856635822 wait complete. 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 -- start start 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.501+0000 7fdbce32f740 1 Processor -- start 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 0x560f2e982600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e98df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560f2e73d890 con 0x560f2e5a6490 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560f2e876d40 con 0x560f2e5ae670 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560f2e984c10 con 0x560f2e5cf350 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbce32f740 10 client.0 _ll_register_callbacks cb 0x560f2e8dac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33028/0 (socket says 172.21.15.38:33028) 2024-09-21T06:26:12.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2882145876 learned_addr learned my addr 172.21.15.38:0/2882145876 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc6358640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e98df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5356640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 0x560f2e982600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2882145876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 msgr2=0x560f2e98df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e98df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 msgr2=0x560f2e982600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 0x560f2e982600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.502+0000 7fdbc5b57640 1 -- 172.21.15.38:0/2882145876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2e98e540 con 0x560f2e5a6490 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdbc5356640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 0x560f2e982600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc000c00 tx=0x7fdbbc004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca0ec7c1f8b844a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdba97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc029060 con 0x560f2e5a6490 2024-09-21T06:26:12.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fdbbc0037f0 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbbc0041d0 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbbc0039f0 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdbce32f740 10 client.17082 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.503+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560f2e990e70 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbbc0041d0 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdbbc023030 con 0x560f2e5a6490 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 10 client.17082 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 20 client.17082 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e58dcd0 0x560f2e994280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 4 client.17082 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f2e8eedb0 con 0x560f2e58dcd0 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.504+0000 7fdbc5356640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e58dcd0 0x560f2e994280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.505+0000 7fdbc5356640 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e58dcd0 0x560f2e994280 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1350bc70e5c4a121 server_cookie=311f88fc5637842d in_seq=0 out_seq=0 2024-09-21T06:26:12.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.505+0000 7fdba97fa640 10 client.17082 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:12.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdba97fa640 1 -- 172.21.15.38:0/2882145876 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f2e8eedb0 con 0x560f2e58dcd0 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdba97fa640 10 client.17082 handle_command_reply: tid=0 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 client.17082 shutdown 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 msgr2=0x560f2e982080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc000c00 tx=0x7fdbbc004000 comp rx=0 tx=0).stop 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 shutdown_connections 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e58dcd0 0x560f2e994280 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e98df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5ae670 0x560f2e982600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 --2- 172.21.15.38:0/2882145876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5a6490 0x560f2e982080 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdba97fa640 0 client.17082 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 >> 172.21.15.38:0/2882145876 conn(0x560f2e5c3740 msgr2=0x560f2e9795c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 shutdown_connections 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 1 -- 172.21.15.38:0/2882145876 wait complete. 2024-09-21T06:26:12.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.506+0000 7fdbce32f740 20 client.17082 trim_cache size 0 max 16384 2024-09-21T06:26:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 Processor -- start 2024-09-21T06:26:12.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 -- start start 2024-09-21T06:26:12.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 0x560f2e97b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e979530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b4280 con 0x560f2e5ae670 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b1b50 con 0x560f2e5a6490 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbce32f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01af9c0 con 0x560f2e5cf350 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33036/0 (socket says 172.21.15.38:33036) 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 -- 172.21.15.38:0/4158403970 learned_addr learned my addr 172.21.15.38:0/4158403970 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 0x560f2e97b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc6358640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e979530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 -- 172.21.15.38:0/4158403970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 msgr2=0x560f2e979530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e979530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 -- 172.21.15.38:0/4158403970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 msgr2=0x560f2e97b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 0x560f2e97b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5356640 1 -- 172.21.15.38:0/4158403970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2e974c10 con 0x560f2e5ae670 2024-09-21T06:26:12.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.524+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 0x560f2e97b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:12.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.525+0000 7fdbc5356640 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00c9f10 tx=0x7fdbb003b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306f91b017cde1db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.525+0000 7fdbab7fe640 1 -- 172.21.15.38:0/4158403970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0049040 con 0x560f2e5ae670 2024-09-21T06:26:12.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.525+0000 7fdbab7fe640 1 -- 172.21.15.38:0/4158403970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbb00c7e50 con 0x560f2e5ae670 2024-09-21T06:26:12.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.525+0000 7fdbab7fe640 1 -- 172.21.15.38:0/4158403970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00d6c30 con 0x560f2e5ae670 2024-09-21T06:26:12.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- 172.21.15.38:0/4158403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 msgr2=0x560f2e97bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00c9f10 tx=0x7fdbb003b6b0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- 172.21.15.38:0/4158403970 shutdown_connections 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5cf350 0x560f2e979530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e97bbd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 --2- 172.21.15.38:0/4158403970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5a6490 0x560f2e97b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- 172.21.15.38:0/4158403970 >> 172.21.15.38:0/4158403970 conn(0x560f2e5c3740 msgr2=0x560f2e980700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- 172.21.15.38:0/4158403970 shutdown_connections 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- 172.21.15.38:0/4158403970 wait complete. 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 -- start start 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.526+0000 7fdbce32f740 1 Processor -- start 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5a6490 0x560f2e995dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e9f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b0010 con 0x560f2e5ae670 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b1480 con 0x560f2e5cf350 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc01b06e0 con 0x560f2e5a6490 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbce32f740 10 client.0 _ll_register_callbacks cb 0x7fdbb8009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33046/0 (socket says 172.21.15.38:33046) 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 -- 172.21.15.38:0/3471238140 learned_addr learned my addr 172.21.15.38:0/3471238140 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc6358640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e9f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5a6490 0x560f2e995dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 -- 172.21.15.38:0/3471238140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5a6490 msgr2=0x560f2e995dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5a6490 0x560f2e995dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 -- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 msgr2=0x560f2e9f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:12.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e9f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 -- 172.21.15.38:0/3471238140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2e9f70a0 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc6358640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e9f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdbc5356640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0105050 tx=0x7fdbb00d7130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fb8c25db70b089 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.527+0000 7fdba97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0049030 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fdbb00d6c30 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb00c7e50 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbb00d6e30 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 10 client.17088 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560f2e9ff530 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdbb00c7e50 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdbb0107ce0 con 0x560f2e5ae670 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 10 client.17088 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:12.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 20 client.17088 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e563080 0x560f2ea01a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 4 client.17088 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.528+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f2e8ea860 con 0x560f2e563080 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.529+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e563080 0x560f2ea01a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.529+0000 7fdba97fa640 10 client.17088 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:12.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.529+0000 7fdbc5b57640 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e563080 0x560f2ea01a10 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a974525381da146 server_cookie=361a1509fc4eedaf in_seq=0 out_seq=0 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdba97fa640 1 -- 172.21.15.38:0/3471238140 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f2e8ea860 con 0x560f2e563080 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdba97fa640 10 client.17088 handle_command_reply: tid=0 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 client.17088 shutdown 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 msgr2=0x560f2e996360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0105050 tx=0x7fdbb00d7130 comp rx=0 tx=0).stop 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 shutdown_connections 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560f2e5cf350 0x560f2e9f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560f2e5ae670 0x560f2e996360 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x560f2e563080 0x560f2ea01a10 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 --2- 172.21.15.38:0/3471238140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560f2e5a6490 0x560f2e995dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdba97fa640 0 client.17088 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 >> 172.21.15.38:0/3471238140 conn(0x560f2e5c3740 msgr2=0x560f2e979530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.531+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 shutdown_connections 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbce32f740 1 -- 172.21.15.38:0/3471238140 wait complete. 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbce32f740 20 client.17088 trim_cache size 0 max 16384 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "402d740f-2038-4de8-aa8d-8566296d8cd3", 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:12.536 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 msgr2=0x7fdbac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 0x7fdbac0b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8005fd0 tx=0x7fdbb8009600 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 msgr2=0x7fdbc019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0005940 tx=0x7fdbb00042f0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 shutdown_connections 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdbac0b6680 0x7fdbac0b8b90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc01100f0 0x7fdbc01a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdbc0076100 0x7fdbc019cd10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 --2- 172.21.15.38:0/1179893111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbc00757b0 0x7fdbc019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 >> 172.21.15.38:0/1179893111 conn(0x7fdbc00ff620 msgr2=0x7fdbc0109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 shutdown_connections 2024-09-21T06:26:12.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:12.532+0000 7fdbc7dbb640 1 -- 172.21.15.38:0/1179893111 wait complete. 2024-09-21T06:26:13.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: pgmap v516: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:13 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: pgmap v516: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:13 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:13.669 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: pgmap v516: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 169 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:26:13.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:13.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:13.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:13.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:13 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/3377272690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d41083a0 msgr2=0x7ff3d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/3377272690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d41083a0 0x7ff3d41087b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009900 tx=0x7ff3c802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/3377272690 shutdown_connections 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/3377272690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/3377272690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d41083a0 0x7ff3d41087b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/3377272690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d4102a60 0x7ff3d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/3377272690 >> 172.21.15.38:0/3377272690 conn(0x7ff3d4079730 msgr2=0x7ff3d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/3377272690 shutdown_connections 2024-09-21T06:26:14.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.097+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/3377272690 wait complete. 2024-09-21T06:26:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 Processor -- start 2024-09-21T06:26:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 -- start start 2024-09-21T06:26:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 0x7ff3d419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d41a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4113ba0 con 0x7ff3d4102a60 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4113a20 con 0x7ff3d41083a0 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d9a9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4113d20 con 0x7ff3d4108cf0 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33076/0 (socket says 172.21.15.38:33076) 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.098+0000 7ff3d37fe640 1 -- 172.21.15.38:0/1195559835 learned_addr learned my addr 172.21.15.38:0/1195559835 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 0x7ff3d419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d41a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 -- 172.21.15.38:0/1195559835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 msgr2=0x7ff3d41a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d41a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 -- 172.21.15.38:0/1195559835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 msgr2=0x7ff3d419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 0x7ff3d419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 -- 172.21.15.38:0/1195559835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d41a27c0 con 0x7ff3d4102a60 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d41a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:14.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 0x7ff3d419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d950 tx=0x7ff3c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d0ff9640 1 -- 172.21.15.38:0/1195559835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4017070 con 0x7ff3d4102a60 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d0ff9640 1 -- 172.21.15.38:0/1195559835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3c4009c30 con 0x7ff3d4102a60 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d41a2ab0 con 0x7ff3d4102a60 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.099+0000 7ff3d0ff9640 1 -- 172.21.15.38:0/1195559835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400f6b0 con 0x7ff3d4102a60 2024-09-21T06:26:14.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.100+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a9210 con 0x7ff3d4102a60 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 Processor -- start 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 -- start start 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f4098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3d0ff9640 1 -- 172.21.15.38:0/1195559835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff3c40109c0 con 0x7ff3d4102a60 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cd0390 0x55d9f40990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d9f400ee50 con 0x55d9f3cf1070 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d9f3ffe280 con 0x55d9f3cc81b0 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.102+0000 7ff3e0011740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4002090 con 0x55d9f3cd0390 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33080/0 (socket says 172.21.15.38:33080) 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 -- 172.21.15.38:0/1716414037 learned_addr learned my addr 172.21.15.38:0/1716414037 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cd0390 0x55d9f40990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f4098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 -- 172.21.15.38:0/1716414037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cd0390 msgr2=0x55d9f40990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cd0390 0x55d9f40990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 -- 172.21.15.38:0/1716414037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 msgr2=0x55d9f4098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f4098b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 -- 172.21.15.38:0/1716414037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f3d5c650 con 0x55d9f3cf1070 2024-09-21T06:26:14.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.103+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009e40 tx=0x7ff3cc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103253916f4feed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3b9ffb640 1 -- 172.21.15.38:0/1716414037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004d20 con 0x55d9f3cf1070 2024-09-21T06:26:14.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3b9ffb640 1 -- 172.21.15.38:0/1716414037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3cc0054f0 con 0x55d9f3cf1070 2024-09-21T06:26:14.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3b9ffb640 1 -- 172.21.15.38:0/1716414037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc011800 con 0x55d9f3cf1070 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3d0ff9640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 0x7ff3bc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 0x7ff3bc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.104+0000 7ff3d0ff9640 1 -- 172.21.15.38:0/1195559835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff3c40e73e0 con 0x7ff3d4102a60 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- 172.21.15.38:0/1716414037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 msgr2=0x55d9f4098650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009e40 tx=0x7ff3cc00f730 comp rx=0 tx=0).stop 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3d37fe640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 0x7ff3bc0b8c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40e4c00 tx=0x7ff3c4010d60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- 172.21.15.38:0/1716414037 shutdown_connections 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cd0390 0x55d9f40990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f4098b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 --2- 172.21.15.38:0/1716414037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f4098650 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- 172.21.15.38:0/1716414037 >> 172.21.15.38:0/1716414037 conn(0x55d9f3ce5460 msgr2=0x55d9f4096540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- 172.21.15.38:0/1716414037 shutdown_connections 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- 172.21.15.38:0/1716414037 wait complete. 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.105+0000 7ff3e0011740 1 -- start start 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 Processor -- start 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d9f3e5f700 con 0x55d9f3cd0390 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d9f3f99110 con 0x55d9f3cc81b0 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d9f40a6e30 con 0x55d9f3cf1070 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3e0011740 10 client.0 _ll_register_callbacks cb 0x55d9f3fb2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33082/0 (socket says 172.21.15.38:33082) 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/4109920253 learned_addr learned my addr 172.21.15.38:0/4109920253 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.106+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/4109920253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 msgr2=0x55d9f40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 msgr2=0x55d9f40a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/4109920253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f3fc6c40 con 0x55d9f3cd0390 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406aaa0 tx=0x7ff3c8031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf02ed5e566c3d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8035070 con 0x55d9f3cd0390 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff3c8004040 con 0x55d9f3cd0390 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3cc0054f0 con 0x55d9f3cd0390 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff3c8004240 con 0x55d9f3cd0390 2024-09-21T06:26:14.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3e0011740 10 client.17100 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.107+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d9f40b2b10 con 0x55d9f3cd0390 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3cc0054f0 con 0x55d9f3cd0390 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff3c8004b50 con 0x55d9f3cd0390 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 10 client.17100 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 20 client.17100 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3caf9f0 0x55d9f40b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 4 client.17100 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9f4010da0 con 0x55d9f3caf9f0 2024-09-21T06:26:14.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.108+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3caf9f0 0x55d9f40b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.109+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3caf9f0 0x55d9f40b6040 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51a42daa9d0dfcc server_cookie=b5fd6c6ec9c0ecf4 in_seq=0 out_seq=0 2024-09-21T06:26:14.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.109+0000 7ff3b2ffd640 10 client.17100 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:14.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.109+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/4109920253 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9f4010da0 con 0x55d9f3caf9f0 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.109+0000 7ff3b2ffd640 10 client.17100 handle_command_reply: tid=0 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 client.17100 shutdown 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 msgr2=0x55d9f40a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406aaa0 tx=0x7ff3c8031740 comp rx=0 tx=0).stop 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 shutdown_connections 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3caf9f0 0x55d9f40b6040 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cd0390 0x55d9f40a4250 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 --2- 172.21.15.38:0/4109920253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 >> 172.21.15.38:0/4109920253 conn(0x55d9f3ce5460 msgr2=0x55d9f409b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3b2ffd640 0 client.17100 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 shutdown_connections 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 1 -- 172.21.15.38:0/4109920253 wait complete. 2024-09-21T06:26:14.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.110+0000 7ff3e0011740 20 client.17100 trim_cache size 0 max 16384 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 Processor -- start 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 -- start start 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41b4290 con 0x55d9f3cc81b0 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41b1b60 con 0x55d9f3cd0390 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.128+0000 7ff3e0011740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41af9d0 con 0x55d9f3cf1070 2024-09-21T06:26:14.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33092/0 (socket says 172.21.15.38:33092) 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 -- 172.21.15.38:0/3500135598 learned_addr learned my addr 172.21.15.38:0/3500135598 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 -- 172.21.15.38:0/3500135598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 msgr2=0x55d9f40a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 -- 172.21.15.38:0/3500135598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 msgr2=0x55d9f40b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 -- 172.21.15.38:0/3500135598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f40a2210 con 0x55d9f3cc81b0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0092f0 tx=0x7ff3cc009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce1026e7d4babe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.129+0000 7ff3b97fa640 1 -- 172.21.15.38:0/3500135598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc022040 con 0x55d9f3cc81b0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3b97fa640 1 -- 172.21.15.38:0/3500135598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3cc011570 con 0x55d9f3cc81b0 2024-09-21T06:26:14.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3b97fa640 1 -- 172.21.15.38:0/3500135598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0059d0 con 0x55d9f3cc81b0 2024-09-21T06:26:14.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 -- 172.21.15.38:0/3500135598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 msgr2=0x55d9f4099d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0092f0 tx=0x7ff3cc009740 comp rx=0 tx=0).stop 2024-09-21T06:26:14.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 -- 172.21.15.38:0/3500135598 shutdown_connections 2024-09-21T06:26:14.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cf1070 0x55d9f40a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 --2- 172.21.15.38:0/3500135598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cc81b0 0x55d9f4099d90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.130+0000 7ff3e0011740 1 -- 172.21.15.38:0/3500135598 >> 172.21.15.38:0/3500135598 conn(0x55d9f3ce5460 msgr2=0x55d9f4099680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.131+0000 7ff3e0011740 1 -- 172.21.15.38:0/3500135598 shutdown_connections 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.131+0000 7ff3e0011740 1 -- 172.21.15.38:0/3500135598 wait complete. 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.131+0000 7ff3e0011740 1 -- start start 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.131+0000 7ff3e0011740 1 Processor -- start 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f40a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41b0020 con 0x55d9f3cf1070 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41b1490 con 0x55d9f3cd0390 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41b06f0 con 0x55d9f3cc81b0 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3e0011740 10 client.0 _ll_register_callbacks cb 0x7ff3c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:14.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:37190/0 (socket says 172.21.15.38:37190) 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/2546553616 learned_addr learned my addr 172.21.15.38:0/2546553616 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f40a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/2546553616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cc81b0 msgr2=0x55d9f40a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/2546553616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 msgr2=0x55d9f40a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f40a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 -- 172.21.15.38:0/2546553616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f411fa30 con 0x55d9f3cd0390 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f40a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3d2ffd640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009850 tx=0x7ff3c8003770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50fe5c0f12a3a303 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.132+0000 7ff3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8051040 con 0x55d9f3cd0390 2024-09-21T06:26:14.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3cc011570 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff3c8003b80 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff3c8035040 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3e0011740 10 client.26597 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d9f4120ca0 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.133+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3cc011570 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff3c80052a0 con 0x55d9f3cd0390 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 10 client.26597 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 10 client.26597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 20 client.26597 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3c84da0 0x55d9f4123430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 4 client.26597 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d9f400c850 con 0x55d9f3c84da0 2024-09-21T06:26:14.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3c84da0 0x55d9f4123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3b2ffd640 10 client.26597 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.134+0000 7ff3d3fff640 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3c84da0 0x55d9f4123430 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e49c47060edf33 server_cookie=f86668dcb54737d1 in_seq=0 out_seq=0 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3b2ffd640 1 -- 172.21.15.38:0/2546553616 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55d9f400c850 con 0x55d9f3c84da0 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3b2ffd640 10 client.26597 handle_command_reply: tid=0 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 client.26597 shutdown 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 msgr2=0x55d9f40a85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009850 tx=0x7ff3c8003770 comp rx=0 tx=0).stop 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 shutdown_connections 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d9f3cf1070 0x55d9f40a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d9f3cd0390 0x55d9f40a85b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d9f3c84da0 0x55d9f4123430 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 --2- 172.21.15.38:0/2546553616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9f3cc81b0 0x55d9f40a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3b2ffd640 0 client.26597 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 >> 172.21.15.38:0/2546553616 conn(0x55d9f3ce5460 msgr2=0x55d9f40a5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 shutdown_connections 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 1 -- 172.21.15.38:0/2546553616 wait complete. 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.135+0000 7ff3e0011740 20 client.26597 trim_cache size 0 max 16384 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.143 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.144 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.145 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.146 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:14.147 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:14.148 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 msgr2=0x7ff3bc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 0x7ff3bc0b8c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40e4c00 tx=0x7ff3c4010d60 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 msgr2=0x7ff3d419c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d950 tx=0x7ff3c400de10 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 shutdown_connections 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff3bc0b6700 0x7ff3bc0b8c10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3d4108cf0 0x7ff3d41a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d41083a0 0x7ff3d419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 --2- 172.21.15.38:0/1195559835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d4102a60 0x7ff3d419c850 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 >> 172.21.15.38:0/1195559835 conn(0x7ff3d4079730 msgr2=0x7ff3d4104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 shutdown_connections 2024-09-21T06:26:14.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:14.136+0000 7ff3d9a9d640 1 -- 172.21.15.38:0/1195559835 wait complete. 2024-09-21T06:26:14.957 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:14.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:15.624 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:15 smithi038 ceph-mon[31215]: pgmap v517: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:15.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:15 smithi174 ceph-mon[34815]: pgmap v517: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:15 smithi044 ceph-mon[34369]: pgmap v517: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 -- 172.21.15.38:0/1684777368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 msgr2=0x7fccc8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 --2- 172.21.15.38:0/1684777368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc8103f70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009900 tx=0x7fccb802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 -- 172.21.15.38:0/1684777368 shutdown_connections 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 --2- 172.21.15.38:0/1684777368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc8109df0 0x7fccc8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 --2- 172.21.15.38:0/1684777368 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc81094a0 0x7fccc81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 --2- 172.21.15.38:0/1684777368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc8103f70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 -- 172.21.15.38:0/1684777368 >> 172.21.15.38:0/1684777368 conn(0x7fccc807b850 msgr2=0x7fccc807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 -- 172.21.15.38:0/1684777368 shutdown_connections 2024-09-21T06:26:15.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.716+0000 7fccce67b640 1 -- 172.21.15.38:0/1684777368 wait complete. 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 Processor -- start 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 -- start start 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc81094a0 0x7fccc819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc8109df0 0x7fccc819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8113bf0 con 0x7fccc8103b60 2024-09-21T06:26:15.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8113a70 con 0x7fccc8109df0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccce67b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8113d70 con 0x7fccc81094a0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccc7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33116/0 (socket says 172.21.15.38:33116) 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccc7fff640 1 -- 172.21.15.38:0/1519825931 learned_addr learned my addr 172.21.15.38:0/1519825931 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccc77fe640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc81094a0 0x7fccc819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.717+0000 7fccccc18640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc8109df0 0x7fccc819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 -- 172.21.15.38:0/1519825931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc81094a0 msgr2=0x7fccc819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc81094a0 0x7fccc819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 -- 172.21.15.38:0/1519825931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc8109df0 msgr2=0x7fccc819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc8109df0 0x7fccc819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 -- 172.21.15.38:0/1519825931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc81a04f0 con 0x7fccc8103b60 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc7fff640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fccb8005ab0 tx=0x7fccb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb803f030 con 0x7fccc8103b60 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fccb8003cd0 con 0x7fccc8103b60 2024-09-21T06:26:15.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc81a0780 con 0x7fccc8103b60 2024-09-21T06:26:15.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8035070 con 0x7fccc8103b60 2024-09-21T06:26:15.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.718+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc81a6f40 con 0x7fccc8103b60 2024-09-21T06:26:15.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.719+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc8103f70 con 0x7fccc8103b60 2024-09-21T06:26:15.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.721+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fccb8042030 con 0x7fccc8103b60 2024-09-21T06:26:15.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.722+0000 7fccc57fa640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 0x7fccb00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:15.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.722+0000 7fccc77fe640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 0x7fccb00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:15.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.722+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fccb8107f70 con 0x7fccc8103b60 2024-09-21T06:26:15.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.722+0000 7fccc77fe640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 0x7fccb00b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fccc8109040 tx=0x7fccbc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:15.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.725+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccb80ce480 con 0x7fccc8103b60 2024-09-21T06:26:15.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.953+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccc810bbf0 con 0x7fccc8103b60 2024-09-21T06:26:15.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.953+0000 7fccc57fa640 1 -- 172.21.15.38:0/1519825931 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fccb80d2860 con 0x7fccc8103b60 2024-09-21T06:26:15.955 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:15.955 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:15.956 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:15.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 msgr2=0x7fccb00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 0x7fccb00b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fccc8109040 tx=0x7fccbc00b390 comp rx=0 tx=0).stop 2024-09-21T06:26:15.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 msgr2=0x7fccc819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:15.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fccb8005ab0 tx=0x7fccb80042f0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 shutdown_connections 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fccb00b6680 0x7fccb00b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc8109df0 0x7fccc819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccc81094a0 0x7fccc819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 --2- 172.21.15.38:0/1519825931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc8103b60 0x7fccc819a580 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 >> 172.21.15.38:0/1519825931 conn(0x7fccc807b850 msgr2=0x7fccc81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 shutdown_connections 2024-09-21T06:26:15.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:15.956+0000 7fccce67b640 1 -- 172.21.15.38:0/1519825931 wait complete. 2024-09-21T06:26:16.628 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:16 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1519825931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:16.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:16 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1519825931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:16.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:16 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1519825931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:16.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 -- 172.21.15.38:0/2623198359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 msgr2=0x7f3954103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 --2- 172.21.15.38:0/2623198359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f3954103f70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3944009ca0 tx=0x7f394402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 -- 172.21.15.38:0/2623198359 shutdown_connections 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 --2- 172.21.15.38:0/2623198359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3954109df0 0x7f3954110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 --2- 172.21.15.38:0/2623198359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39541094a0 0x7f39541098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 --2- 172.21.15.38:0/2623198359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f3954103f70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 -- 172.21.15.38:0/2623198359 >> 172.21.15.38:0/2623198359 conn(0x7f395407b850 msgr2=0x7f395407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 -- 172.21.15.38:0/2623198359 shutdown_connections 2024-09-21T06:26:17.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.474+0000 7f395c78f640 1 -- 172.21.15.38:0/2623198359 wait complete. 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 Processor -- start 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 -- start start 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39541094a0 0x7f395419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3954109df0 0x7f395419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3954113bf0 con 0x7f3954103b60 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3954113a70 con 0x7f39541094a0 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395c78f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3954113d70 con 0x7f3954109df0 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.475+0000 7f395a52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33136/0 (socket says 172.21.15.38:33136) 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 -- 172.21.15.38:0/1551485643 learned_addr learned my addr 172.21.15.38:0/1551485643 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:17.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395ad2c640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3954109df0 0x7f395419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f3959d2a640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39541094a0 0x7f395419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 -- 172.21.15.38:0/1551485643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3954109df0 msgr2=0x7f395419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3954109df0 0x7f395419fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 -- 172.21.15.38:0/1551485643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39541094a0 msgr2=0x7f395419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39541094a0 0x7f395419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 -- 172.21.15.38:0/1551485643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39541a05b0 con 0x7f3954103b60 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395a52b640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3944006010 tx=0x7f3944003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f39537fe640 1 -- 172.21.15.38:0/1551485643 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440316d0 con 0x7f3954103b60 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f39537fe640 1 -- 172.21.15.38:0/1551485643 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3944031870 con 0x7f3954103b60 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39541a0840 con 0x7f3954103b60 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.476+0000 7f39537fe640 1 -- 172.21.15.38:0/1551485643 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394402fc90 con 0x7f3954103b60 2024-09-21T06:26:17.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.477+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39541a7000 con 0x7f3954103b60 2024-09-21T06:26:17.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.479+0000 7f3962d03740 1 Processor -- start 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.479+0000 7f3962d03740 1 -- start start 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f39537fe640 1 -- 172.21.15.38:0/1551485643 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f39440305c0 con 0x7f3954103b60 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c659390 0x558c5ca21d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558c5c997ea0 con 0x558c5c6511b0 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c5c9872d0 con 0x558c5c659390 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3962d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c5c98b0e0 con 0x558c5c67a070 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33146/0 (socket says 172.21.15.38:33146) 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 -- 172.21.15.38:0/2481933622 learned_addr learned my addr 172.21.15.38:0/2481933622 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:17.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395ad2c640 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f3959d2a640 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c659390 0x558c5ca21d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 -- 172.21.15.38:0/2481933622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 msgr2=0x558c5ca212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 -- 172.21.15.38:0/2481933622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c659390 msgr2=0x558c5ca21d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c659390 0x558c5ca21d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 -- 172.21.15.38:0/2481933622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5c6e5650 con 0x558c5c6511b0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.480+0000 7f395a52b640 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f39441060b0 tx=0x7f394410eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0725d56c6e85d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f39537fe640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 0x7f393c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f3950ff9640 1 -- 172.21.15.38:0/2481933622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440cdf80 con 0x558c5c6511b0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f395ad2c640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 0x7f393c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f3950ff9640 1 -- 172.21.15.38:0/2481933622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3944118020 con 0x558c5c6511b0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f3950ff9640 1 -- 172.21.15.38:0/2481933622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440ce160 con 0x558c5c6511b0 2024-09-21T06:26:17.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.481+0000 7f39537fe640 1 -- 172.21.15.38:0/1551485643 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f3944108970 con 0x7f3954103b60 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- 172.21.15.38:0/2481933622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 msgr2=0x558c5ca21800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f395ad2c640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 0x7f393c0b8c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f394c00b6c0 tx=0x7f394c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f39441060b0 tx=0x7f394410eb40 comp rx=0 tx=0).stop 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- 172.21.15.38:0/2481933622 shutdown_connections 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c659390 0x558c5ca21d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c6511b0 0x558c5ca21800 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 --2- 172.21.15.38:0/2481933622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- 172.21.15.38:0/2481933622 >> 172.21.15.38:0/2481933622 conn(0x558c5c66e460 msgr2=0x558c5ca1f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- 172.21.15.38:0/2481933622 shutdown_connections 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- 172.21.15.38:0/2481933622 wait complete. 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.482+0000 7f3962d03740 1 -- start start 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 Processor -- start 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca30d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c659390 0x558c5ca31260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558c5c7e8700 con 0x558c5c67a070 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558c5c922160 con 0x558c5c6511b0 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c5c997ea0 con 0x558c5c659390 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3962d03740 10 client.0 _ll_register_callbacks cb 0x558c5c93b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395a52b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca30d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33150/0 (socket says 172.21.15.38:33150) 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 -- 172.21.15.38:0/360314663 learned_addr learned my addr 172.21.15.38:0/360314663 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f3959d2a640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c659390 0x558c5ca31260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 -- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c659390 msgr2=0x558c5ca31260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c659390 0x558c5ca31260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 -- 172.21.15.38:0/360314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 msgr2=0x558c5ca30d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca30d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.483+0000 7f395ad2c640 1 -- 172.21.15.38:0/360314663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5c94fc90 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f395ad2c640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f394c003bf0 tx=0x7f394c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359249a9d7fc0364 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c02c060 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f394c017030 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3944118020 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f394c01fd40 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3962d03740 10 client.17124 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558c5ca3f730 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3944118020 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.484+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f394c0275f0 con 0x558c5c67a070 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 10 client.17124 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 10 client.17124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 20 client.17124 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:17.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c6389f0 0x558c5ca42c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 4 client.17124 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c5c999df0 con 0x558c5c6389f0 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f395a52b640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c6389f0 0x558c5ca42c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f3939ffb640 10 client.17124 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.485+0000 7f395a52b640 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c6389f0 0x558c5ca42c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89b9c39cdece3b33 server_cookie=a1d59bef168fa3d in_seq=0 out_seq=0 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3939ffb640 1 -- 172.21.15.38:0/360314663 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c5c999df0 con 0x558c5c6389f0 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3939ffb640 10 client.17124 handle_command_reply: tid=0 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 client.17124 shutdown 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 msgr2=0x558c5ca317c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f394c003bf0 tx=0x7f394c004730 comp rx=0 tx=0).stop 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 shutdown_connections 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c6389f0 0x558c5ca42c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c67a070 0x558c5ca317c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c659390 0x558c5ca31260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 --2- 172.21.15.38:0/360314663 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca30d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 >> 172.21.15.38:0/360314663 conn(0x558c5c66e460 msgr2=0x558c5ca22cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.486+0000 7f3939ffb640 0 client.17124 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.487+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 shutdown_connections 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.487+0000 7f3962d03740 1 -- 172.21.15.38:0/360314663 wait complete. 2024-09-21T06:26:17.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.487+0000 7f3962d03740 20 client.17124 trim_cache size 0 max 16384 2024-09-21T06:26:17.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 Processor -- start 2024-09-21T06:26:17.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 -- start start 2024-09-21T06:26:17.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca32c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca2df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f39541afe10 con 0x558c5c659390 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39541ad6e0 con 0x558c5c6511b0 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3962d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39541ab550 con 0x558c5c67a070 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3959d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.500+0000 7f3959d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33164/0 (socket says 172.21.15.38:33164) 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 -- 172.21.15.38:0/3465792421 learned_addr learned my addr 172.21.15.38:0/3465792421 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f395ad2c640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca2df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f395a52b640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca32c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 -- 172.21.15.38:0/3465792421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 msgr2=0x558c5ca2df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca2df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 -- 172.21.15.38:0/3465792421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 msgr2=0x558c5ca32c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca32c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 -- 172.21.15.38:0/3465792421 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5ca1a5a0 con 0x558c5c659390 2024-09-21T06:26:17.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f395a52b640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca32c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:17.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f3959d2a640 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f394800b7a0 tx=0x7f394800bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af2a503549e05c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f393bfff640 1 -- 172.21.15.38:0/3465792421 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948003cd0 con 0x558c5c659390 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f393bfff640 1 -- 172.21.15.38:0/3465792421 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3948003e70 con 0x558c5c659390 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.501+0000 7f393bfff640 1 -- 172.21.15.38:0/3465792421 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948011440 con 0x558c5c659390 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 -- 172.21.15.38:0/3465792421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 msgr2=0x558c5ca22a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f394800b7a0 tx=0x7f394800bc60 comp rx=0 tx=0).stop 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 -- 172.21.15.38:0/3465792421 shutdown_connections 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5ca2df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca22a00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 --2- 172.21.15.38:0/3465792421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca32c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 -- 172.21.15.38:0/3465792421 >> 172.21.15.38:0/3465792421 conn(0x558c5c66e460 msgr2=0x558c5ca222f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 -- 172.21.15.38:0/3465792421 shutdown_connections 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.502+0000 7f3962d03740 1 -- 172.21.15.38:0/3465792421 wait complete. 2024-09-21T06:26:17.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 -- start start 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 Processor -- start 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca37680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5caa6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f39541abba0 con 0x558c5c659390 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39541ad010 con 0x558c5c6511b0 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39541ac270 con 0x558c5c67a070 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3959d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3962d03740 10 client.0 _ll_register_callbacks cb 0x7f394c0043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3959d2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33176/0 (socket says 172.21.15.38:33176) 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f3959d2a640 1 -- 172.21.15.38:0/852931787 learned_addr learned my addr 172.21.15.38:0/852931787 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.503+0000 7f395a52b640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca37680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f395ad2c640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5caa6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 -- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 msgr2=0x558c5caa6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5caa6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 -- 172.21.15.38:0/852931787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 msgr2=0x558c5ca37680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca37680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 -- 172.21.15.38:0/852931787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5caa6d80 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3959d2a640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f3948003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1be39bef88cd5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394802a020 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3948003e70 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f3948004e10 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3948035050 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3962d03740 10 client.17130 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.504+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558c5caae0c0 con 0x558c5c659390 2024-09-21T06:26:17.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3948003e70 con 0x558c5c659390 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f394801a070 con 0x558c5c659390 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 10 client.17130 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 20 client.17130 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c60dda0 0x558c5cab0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 4 client.17130 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c5c9958a0 con 0x558c5c60dda0 2024-09-21T06:26:17.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.505+0000 7f395a52b640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c60dda0 0x558c5cab0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3939ffb640 10 client.17130 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f395a52b640 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c60dda0 0x558c5cab0820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ba28549873077ed server_cookie=cab6c43b9f428c1f in_seq=0 out_seq=0 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3939ffb640 1 -- 172.21.15.38:0/852931787 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c5c9958a0 con 0x558c5c60dda0 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3939ffb640 10 client.17130 handle_command_reply: tid=0 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 client.17130 shutdown 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 msgr2=0x558c5ca37c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f3948003d80 comp rx=0 tx=0).stop 2024-09-21T06:26:17.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 shutdown_connections 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x558c5c60dda0 0x558c5cab0820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c5c67a070 0x558c5caa6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558c5c659390 0x558c5ca37c20 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3939ffb640 0 client.17130 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 --2- 172.21.15.38:0/852931787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558c5c6511b0 0x558c5ca37680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 >> 172.21.15.38:0/852931787 conn(0x558c5c66e460 msgr2=0x558c5ca3c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 shutdown_connections 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 1 -- 172.21.15.38:0/852931787 wait complete. 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.506+0000 7f3962d03740 20 client.17130 trim_cache size 0 max 16384 2024-09-21T06:26:17.512 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 msgr2=0x7f393c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 0x7f393c0b8c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f394c00b6c0 tx=0x7f394c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 msgr2=0x7f395419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3944006010 tx=0x7f3944003f10 comp rx=0 tx=0).stop 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 shutdown_connections 2024-09-21T06:26:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f393c0b6700 0x7f393c0b8c10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3954109df0 0x7f395419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39541094a0 0x7f395419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 --2- 172.21.15.38:0/1551485643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3954103b60 0x7f395419a640 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 >> 172.21.15.38:0/1551485643 conn(0x7f395407b850 msgr2=0x7f3954107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 shutdown_connections 2024-09-21T06:26:17.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:17.507+0000 7f395c78f640 1 -- 172.21.15.38:0/1551485643 wait complete. 2024-09-21T06:26:17.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:17 smithi174 ceph-mon[34815]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:17.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:17 smithi174 ceph-mon[34815]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:26:17.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:17 smithi044 ceph-mon[34369]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:17 smithi044 ceph-mon[34369]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:26:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:17 smithi038 ceph-mon[31215]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:17 smithi038 ceph-mon[31215]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:26:18.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:18.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 -- 172.21.15.38:0/1671786179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40108d10 msgr2=0x7fae4010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 --2- 172.21.15.38:0/1671786179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40108d10 0x7fae4010f540 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fae38009ca0 tx=0x7fae3802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 -- 172.21.15.38:0/1671786179 shutdown_connections 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 --2- 172.21.15.38:0/1671786179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40108d10 0x7fae4010f540 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 --2- 172.21.15.38:0/1671786179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae401083c0 0x7fae401087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 --2- 172.21.15.38:0/1671786179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae40102a80 0x7fae40102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 -- 172.21.15.38:0/1671786179 >> 172.21.15.38:0/1671786179 conn(0x7fae40079740 msgr2=0x7fae40079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 -- 172.21.15.38:0/1671786179 shutdown_connections 2024-09-21T06:26:18.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 -- 172.21.15.38:0/1671786179 wait complete. 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.909+0000 7fae46009640 1 Processor -- start 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 -- start start 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 0x7fae401998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 0x7fae40199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112ba0 con 0x7fae40102a80 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112a20 con 0x7fae401083c0 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae46009640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112d20 con 0x7fae40108d10 2024-09-21T06:26:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33192/0 (socket says 172.21.15.38:33192) 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 -- 172.21.15.38:0/2389805596 learned_addr learned my addr 172.21.15.38:0/2389805596 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3effd640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 0x7fae401998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3ffff640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 0x7fae40199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 -- 172.21.15.38:0/2389805596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 msgr2=0x7fae40199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 0x7fae40199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 -- 172.21.15.38:0/2389805596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 msgr2=0x7fae401998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 0x7fae401998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3f7fe640 1 -- 172.21.15.38:0/2389805596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae401a8a50 con 0x7fae40102a80 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3effd640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 0x7fae401998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.910+0000 7fae3ffff640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 0x7fae40199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fae3000b4a0 tx=0x7fae3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae3cff9640 1 -- 172.21.15.38:0/2389805596 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30014070 con 0x7fae40102a80 2024-09-21T06:26:18.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae401a8d40 con 0x7fae40102a80 2024-09-21T06:26:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae3cff9640 1 -- 172.21.15.38:0/2389805596 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae30010ae0 con 0x7fae40102a80 2024-09-21T06:26:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae3cff9640 1 -- 172.21.15.38:0/2389805596 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30017ce0 con 0x7fae40102a80 2024-09-21T06:26:18.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.911+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae401a9220 con 0x7fae40102a80 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.913+0000 7fae4c57d740 1 Processor -- start 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 -- start start 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3cff9640 1 -- 172.21.15.38:0/2389805596 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fae30017070 con 0x7fae40102a80 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa8b070 0x556cafe326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa6a390 0x556cafe33120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556cafda8ea0 con 0x556cafa621b0 2024-09-21T06:26:18.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cafd982d0 con 0x556cafa8b070 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae4c57d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556cafd9c0e0 con 0x556cafa6a390 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33202/0 (socket says 172.21.15.38:33202) 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3174775660 learned_addr learned my addr 172.21.15.38:0/3174775660 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3ffff640 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa8b070 0x556cafe326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3effd640 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa6a390 0x556cafe33120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3174775660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa6a390 msgr2=0x556cafe33120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa6a390 0x556cafe33120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3174775660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa8b070 msgr2=0x556cafe326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa8b070 0x556cafe326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.914+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3174775660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cafaf6650 con 0x556cafa621b0 2024-09-21T06:26:18.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fae300e4480 tx=0x7fae300ed520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b312e3ec6e1aacbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae25ffb640 1 -- 172.21.15.38:0/3174775660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300ed0d0 con 0x556cafa621b0 2024-09-21T06:26:18.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae25ffb640 1 -- 172.21.15.38:0/3174775660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae300ed270 con 0x556cafa621b0 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae25ffb640 1 -- 172.21.15.38:0/3174775660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300f76d0 con 0x556cafa621b0 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae3cff9640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 0x7fae280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae3ffff640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 0x7fae280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.915+0000 7fae3cff9640 1 -- 172.21.15.38:0/2389805596 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fae300e6d70 con 0x7fae40102a80 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- 172.21.15.38:0/3174775660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 msgr2=0x556cafe32be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae3ffff640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 0x7fae280b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fae380094e0 tx=0x7fae38009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fae300e4480 tx=0x7fae300ed520 comp rx=0 tx=0).stop 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- 172.21.15.38:0/3174775660 shutdown_connections 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa6a390 0x556cafe33120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe32be0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3174775660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa8b070 0x556cafe326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- 172.21.15.38:0/3174775660 >> 172.21.15.38:0/3174775660 conn(0x556cafa7f460 msgr2=0x556cafe30590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- 172.21.15.38:0/3174775660 shutdown_connections 2024-09-21T06:26:18.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- 172.21.15.38:0/3174775660 wait complete. 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.916+0000 7fae4c57d740 1 -- start start 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 Processor -- start 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe3dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa8b070 0x556cafe4a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x556cafbf9700 con 0x556cafa6a390 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cafd33160 con 0x556cafa621b0 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556cafe40e80 con 0x556cafa8b070 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae4c57d740 10 client.0 _ll_register_callbacks cb 0x556cafd4c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae3effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae3effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33210/0 (socket says 172.21.15.38:33210) 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae3effd640 1 -- 172.21.15.38:0/390867818 learned_addr learned my addr 172.21.15.38:0/390867818 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe3dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.917+0000 7fae3ffff640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa8b070 0x556cafe4a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 -- 172.21.15.38:0/390867818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa8b070 msgr2=0x556cafe4a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa8b070 0x556cafe4a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 -- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 msgr2=0x556cafe3dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe3dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 -- 172.21.15.38:0/390867818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cafd60c90 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae3effd640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fae3400e2d0 tx=0x7fae3400e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af854679ef998e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae1effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34018020 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fae34013660 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae300ed270 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae34023050 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae4c57d740 10 client.17142 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.918+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556cafe4cbd0 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae300ed270 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fae34014a20 con 0x556cafa6a390 2024-09-21T06:26:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 10 client.17142 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 10 client.17142 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 20 client.17142 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa499f0 0x556cafe50150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 4 client.17142 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cafdaadf0 con 0x556cafa499f0 2024-09-21T06:26:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.919+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa499f0 0x556cafe50150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.920+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa499f0 0x556cafe50150 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24636ea3e65c4e62 server_cookie=3d0bb87d24cc4eb2 in_seq=0 out_seq=0 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.920+0000 7fae1effd640 10 client.17142 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.920+0000 7fae1effd640 1 -- 172.21.15.38:0/390867818 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556cafdaadf0 con 0x556cafa499f0 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.920+0000 7fae1effd640 10 client.17142 handle_command_reply: tid=0 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.920+0000 7fae4c57d740 1 client.17142 shutdown 2024-09-21T06:26:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 msgr2=0x556cafe3e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fae3400e2d0 tx=0x7fae3400e790 comp rx=0 tx=0).stop 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 shutdown_connections 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa499f0 0x556cafe50150 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa8b070 0x556cafe4a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa6a390 0x556cafe3e2e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae1effd640 0 client.17142 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 --2- 172.21.15.38:0/390867818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe3dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 >> 172.21.15.38:0/390867818 conn(0x556cafa7f460 msgr2=0x556cafe35880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 shutdown_connections 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 1 -- 172.21.15.38:0/390867818 wait complete. 2024-09-21T06:26:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.921+0000 7fae4c57d740 20 client.17142 trim_cache size 0 max 16384 2024-09-21T06:26:18.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 Processor -- start 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 -- start start 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa499f0 0x556cafe357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe35ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fae401b43a0 con 0x556cafa7f460 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae401b1c70 con 0x556cafa621b0 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae4c57d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae401afae0 con 0x556cafa499f0 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae3f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33214/0 (socket says 172.21.15.38:33214) 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.934+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3769073694 learned_addr learned my addr 172.21.15.38:0/3769073694 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3effd640 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa499f0 0x556cafe357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3ffff640 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe35ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3769073694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa499f0 msgr2=0x556cafe357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa499f0 0x556cafe357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3769073694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 msgr2=0x556cafe35ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe35ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 -- 172.21.15.38:0/3769073694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cafe3c2a0 con 0x556cafa7f460 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fae300e45c0 tx=0x7fae300edf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b93891e37dcca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae257fa640 1 -- 172.21.15.38:0/3769073694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3001e070 con 0x556cafa7f460 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae257fa640 1 -- 172.21.15.38:0/3769073694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae300ac720 con 0x556cafa7f460 2024-09-21T06:26:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.935+0000 7fae257fa640 1 -- 172.21.15.38:0/3769073694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300a8380 con 0x556cafa7f460 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- 172.21.15.38:0/3769073694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 msgr2=0x556cafe3e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fae300e45c0 tx=0x7fae300edf30 comp rx=0 tx=0).stop 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- 172.21.15.38:0/3769073694 shutdown_connections 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa621b0 0x556cafe35ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa499f0 0x556cafe357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 --2- 172.21.15.38:0/3769073694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa7f460 0x556cafe3e260 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- 172.21.15.38:0/3769073694 >> 172.21.15.38:0/3769073694 conn(0x556cafe4a5f0 msgr2=0x556cafe3db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- 172.21.15.38:0/3769073694 shutdown_connections 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- 172.21.15.38:0/3769073694 wait complete. 2024-09-21T06:26:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.936+0000 7fae4c57d740 1 -- start start 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 Processor -- start 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa499f0 0x556cafe422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 0x556cafe42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fae401b0130 con 0x556cafa621b0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae401b15a0 con 0x556cafa499f0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae401b0800 con 0x556cafa7f460 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae4c57d740 10 client.0 _ll_register_callbacks cb 0x7fae3400c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33228/0 (socket says 172.21.15.38:33228) 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 -- 172.21.15.38:0/696335074 learned_addr learned my addr 172.21.15.38:0/696335074 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa499f0 0x556cafe422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3ffff640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 0x556cafe42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 -- 172.21.15.38:0/696335074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 msgr2=0x556cafe42db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 0x556cafe42db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 -- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa499f0 msgr2=0x556cafe422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa499f0 0x556cafe422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3effd640 1 -- 172.21.15.38:0/696335074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cafeb9d60 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.937+0000 7fae3ffff640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 0x556cafe42db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae3effd640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fae34014e40 tx=0x7fae34014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af93fc7ffaff3e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3402b020 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fae34013660 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae300ac720 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae34036050 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae4c57d740 10 client.17148 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556cafebb040 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae300ac720 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.938+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fae340275c0 con 0x556cafa621b0 2024-09-21T06:26:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 10 client.17148 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 10 client.17148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 20 client.17148 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa6a390 0x556cafebd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 4 client.17148 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556cafda68a0 con 0x556cafa6a390 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa6a390 0x556cafebd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae3f7fe640 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa6a390 0x556cafebd8b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f686e11dc8333baf server_cookie=1f7244c9903ba24d in_seq=0 out_seq=0 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.939+0000 7fae1effd640 10 client.17148 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae1effd640 1 -- 172.21.15.38:0/696335074 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556cafda68a0 con 0x556cafa6a390 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae1effd640 10 client.17148 handle_command_reply: tid=0 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 client.17148 shutdown 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 msgr2=0x556cafe42830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fae34014e40 tx=0x7fae34014710 comp rx=0 tx=0).stop 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 shutdown_connections 2024-09-21T06:26:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x556cafa6a390 0x556cafebd8b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556cafa7f460 0x556cafe42db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556cafa621b0 0x556cafe42830 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 --2- 172.21.15.38:0/696335074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cafa499f0 0x556cafe422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 >> 172.21.15.38:0/696335074 conn(0x556cafe4a5f0 msgr2=0x556cafe357a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae1effd640 0 client.17148 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 shutdown_connections 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 1 -- 172.21.15.38:0/696335074 wait complete. 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.940+0000 7fae4c57d740 20 client.17148 trim_cache size 0 max 16384 2024-09-21T06:26:18.946 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 msgr2=0x7fae280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 0x7fae280b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fae380094e0 tx=0x7fae38009360 comp rx=0 tx=0).stop 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 msgr2=0x7fae401993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fae3000b4a0 tx=0x7fae3000b960 comp rx=0 tx=0).stop 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 shutdown_connections 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fae280b6680 0x7fae280b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae40108d10 0x7fae40199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae401083c0 0x7fae401998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 --2- 172.21.15.38:0/2389805596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fae40102a80 0x7fae401993a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:18.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 >> 172.21.15.38:0/2389805596 conn(0x7fae40079740 msgr2=0x7fae40105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:18.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 shutdown_connections 2024-09-21T06:26:18.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:18.941+0000 7fae46009640 1 -- 172.21.15.38:0/2389805596 wait complete. 2024-09-21T06:26:19.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:19 smithi174 ceph-mon[34815]: pgmap v520: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 214 B/s wr, 7 op/s 2024-09-21T06:26:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:19 smithi044 ceph-mon[34369]: pgmap v520: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 214 B/s wr, 7 op/s 2024-09-21T06:26:19.730 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:19 smithi038 ceph-mon[31215]: pgmap v520: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 214 B/s wr, 7 op/s 2024-09-21T06:26:19.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:26:20.019 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 -- 172.21.15.38:0/3750330959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 msgr2=0x7f5890103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 --2- 172.21.15.38:0/3750330959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f5890103fd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5888009900 tx=0x7f588802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 -- 172.21.15.38:0/3750330959 shutdown_connections 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 --2- 172.21.15.38:0/3750330959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5890109e00 0x7f5890110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 --2- 172.21.15.38:0/3750330959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58901094b0 0x7f58901098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 --2- 172.21.15.38:0/3750330959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f5890103fd0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 -- 172.21.15.38:0/3750330959 >> 172.21.15.38:0/3750330959 conn(0x7f589007b910 msgr2=0x7f589007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 -- 172.21.15.38:0/3750330959 shutdown_connections 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.445+0000 7f5898261640 1 -- 172.21.15.38:0/3750330959 wait complete. 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.446+0000 7f5898261640 1 Processor -- start 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.446+0000 7f5898261640 1 -- start start 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 0x7f589019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890109e00 0x7f589019ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5890113cc0 con 0x7f5890103bc0 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5890113b40 con 0x7f58901094b0 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5898261640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5890113e40 con 0x7f5890109e00 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33580/0 (socket says 172.21.15.38:33580) 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 -- 172.21.15.38:0/3319878908 learned_addr learned my addr 172.21.15.38:0/3319878908 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:20.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f58957fc640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 0x7f589019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f58967fe640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890109e00 0x7f589019ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 -- 172.21.15.38:0/3319878908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890109e00 msgr2=0x7f589019ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890109e00 0x7f589019ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 -- 172.21.15.38:0/3319878908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 msgr2=0x7f589019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 0x7f589019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 -- 172.21.15.38:0/3319878908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58901a06c0 con 0x7f5890103bc0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f58957fc640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 0x7f589019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5888006010 tx=0x7f5888004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f588effd640 1 -- 172.21.15.38:0/3319878908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588803f070 con 0x7f5890103bc0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.447+0000 7f588effd640 1 -- 172.21.15.38:0/3319878908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5888031e10 con 0x7f5890103bc0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.448+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58901a0950 con 0x7f5890103bc0 2024-09-21T06:26:20.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.448+0000 7f588effd640 1 -- 172.21.15.38:0/3319878908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888035030 con 0x7f5890103bc0 2024-09-21T06:26:20.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.448+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901a7110 con 0x7f5890103bc0 2024-09-21T06:26:20.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.450+0000 7f589e7d5740 1 Processor -- start 2024-09-21T06:26:20.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 -- start start 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f588effd640 1 -- 172.21.15.38:0/3319878908 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5888042070 con 0x7f5890103bc0 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3a966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3a96be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563ad3a0cea0 con 0x563ad36ce390 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563ad39fc2d0 con 0x563ad36ef070 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f589e7d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563ad3a000e0 con 0x563ad36c61b0 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33582/0 (socket says 172.21.15.38:33582) 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f58957fc640 1 -- 172.21.15.38:0/3092036946 learned_addr learned my addr 172.21.15.38:0/3092036946 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:20.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.451+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3a96be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58967fe640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3a966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 -- 172.21.15.38:0/3092036946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 msgr2=0x563ad3a96be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3a96be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 -- 172.21.15.38:0/3092036946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 msgr2=0x563ad3a966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3a966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 -- 172.21.15.38:0/3092036946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad375a650 con 0x563ad36ce390 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58967fe640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3a966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58957fc640 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f58840077a0 tx=0x7f5884007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8a3fb3be914e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f588effd640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 0x7f58780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f5877fff640 1 -- 172.21.15.38:0/3092036946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588400d950 con 0x563ad36ce390 2024-09-21T06:26:20.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f58967fe640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 0x7f58780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f5877fff640 1 -- 172.21.15.38:0/3092036946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5884018070 con 0x563ad36ce390 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f5877fff640 1 -- 172.21.15.38:0/3092036946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58840123e0 con 0x563ad36ce390 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.452+0000 7f588effd640 1 -- 172.21.15.38:0/3319878908 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f58881080c0 con 0x7f5890103bc0 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 -- 172.21.15.38:0/3092036946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 msgr2=0x563ad3a97120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f58967fe640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 0x7f58780b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f588000e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f58840077a0 tx=0x7f5884007c60 comp rx=0 tx=0).stop 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 -- 172.21.15.38:0/3092036946 shutdown_connections 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97120 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3a96be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3092036946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3a966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.453+0000 7f589e7d5740 1 -- 172.21.15.38:0/3092036946 >> 172.21.15.38:0/3092036946 conn(0x563ad36e3460 msgr2=0x563ad3a94590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.454+0000 7f589e7d5740 1 -- 172.21.15.38:0/3092036946 shutdown_connections 2024-09-21T06:26:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.454+0000 7f589e7d5740 1 -- 172.21.15.38:0/3092036946 wait complete. 2024-09-21T06:26:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.454+0000 7f589e7d5740 1 -- start start 2024-09-21T06:26:20.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.454+0000 7f589e7d5740 1 Processor -- start 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ce390 0x563ad3aa2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563ad385d700 con 0x563ad36ef070 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563ad3997160 con 0x563ad36c61b0 2024-09-21T06:26:20.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563ad3aa4e80 con 0x563ad36ce390 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f589e7d5740 10 client.0 _ll_register_callbacks cb 0x563ad39b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33590/0 (socket says 172.21.15.38:33590) 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 -- 172.21.15.38:0/3766713571 learned_addr learned my addr 172.21.15.38:0/3766713571 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58957fc640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ce390 0x563ad3aa2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 -- 172.21.15.38:0/3766713571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ce390 msgr2=0x563ad3aa2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ce390 0x563ad3aa2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 -- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 msgr2=0x563ad3aa1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 -- 172.21.15.38:0/3766713571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad39c4c90 con 0x563ad36ef070 2024-09-21T06:26:20.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58967fe640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f588000bfd0 tx=0x7f5880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dafe86498d2506 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.455+0000 7f58757fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880028060 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f5880018cb0 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5884018070 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f588002d460 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 10 client.17160 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563ad3ab0bf0 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5884018070 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5880016070 con 0x563ad36ef070 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 10 client.17160 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 20 client.17160 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:20.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad36ad9f0 0x563ad3ab4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 4 client.17160 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.456+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ad3a0edf0 con 0x563ad36ad9f0 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.457+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad36ad9f0 0x563ad3ab4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.457+0000 7f58757fa640 10 client.17160 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.457+0000 7f5895ffd640 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad36ad9f0 0x563ad3ab4190 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa02aee084585f1 server_cookie=2e1d682660ccc2f in_seq=0 out_seq=0 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f58757fa640 1 -- 172.21.15.38:0/3766713571 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ad3a0edf0 con 0x563ad36ad9f0 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f58757fa640 10 client.17160 handle_command_reply: tid=0 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 client.17160 shutdown 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 msgr2=0x563ad3aae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f588000bfd0 tx=0x7f5880004a40 comp rx=0 tx=0).stop 2024-09-21T06:26:20.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 shutdown_connections 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ef070 0x563ad3aae170 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad36ad9f0 0x563ad3ab4190 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ce390 0x563ad3aa2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 --2- 172.21.15.38:0/3766713571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f58757fa640 0 client.17160 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 >> 172.21.15.38:0/3766713571 conn(0x563ad36e3460 msgr2=0x563ad3a99880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 shutdown_connections 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.458+0000 7f589e7d5740 1 -- 172.21.15.38:0/3766713571 wait complete. 2024-09-21T06:26:20.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.459+0000 7f589e7d5740 20 client.17160 trim_cache size 0 max 16384 2024-09-21T06:26:20.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 Processor -- start 2024-09-21T06:26:20.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 -- start start 2024-09-21T06:26:20.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3aa3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3aae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f58901b2050 con 0x563ad36ce390 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58901af920 con 0x563ad36ef070 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f589e7d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f58901ad790 con 0x563ad36c61b0 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33606/0 (socket says 172.21.15.38:33606) 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 -- 172.21.15.38:0/2501911221 learned_addr learned my addr 172.21.15.38:0/2501911221 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58967fe640 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3aae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f5895ffd640 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3aa3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 -- 172.21.15.38:0/2501911221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 msgr2=0x563ad3aa3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3aa3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 -- 172.21.15.38:0/2501911221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 msgr2=0x563ad3aae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3aae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.472+0000 7f58957fc640 1 -- 172.21.15.38:0/2501911221 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad3a9c9d0 con 0x563ad36ce390 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f58957fc640 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f588400d530 tx=0x7f5884013ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b62d8113f38adb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f58777fe640 1 -- 172.21.15.38:0/2501911221 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884013680 con 0x563ad36ce390 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f58777fe640 1 -- 172.21.15.38:0/2501911221 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5884018040 con 0x563ad36ce390 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f58777fe640 1 -- 172.21.15.38:0/2501911221 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884028af0 con 0x563ad36ce390 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f589e7d5740 1 -- 172.21.15.38:0/2501911221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 msgr2=0x563ad3a97de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.473+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f588400d530 tx=0x7f5884013ab0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 -- 172.21.15.38:0/2501911221 shutdown_connections 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36ef070 0x563ad3aae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3a97de0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2501911221 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36c61b0 0x563ad3aa3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 -- 172.21.15.38:0/2501911221 >> 172.21.15.38:0/2501911221 conn(0x563ad36e3460 msgr2=0x563ad3a976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 -- 172.21.15.38:0/2501911221 shutdown_connections 2024-09-21T06:26:20.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 -- 172.21.15.38:0/2501911221 wait complete. 2024-09-21T06:26:20.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 -- start start 2024-09-21T06:26:20.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.474+0000 7f589e7d5740 1 Processor -- start 2024-09-21T06:26:20.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ef070 0x563ad3b1db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f58901adde0 con 0x563ad36ce390 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58901af250 con 0x563ad36c61b0 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f58901ae4b0 con 0x563ad36ef070 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f589e7d5740 10 client.0 _ll_register_callbacks cb 0x7f5880009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33610/0 (socket says 172.21.15.38:33610) 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 -- 172.21.15.38:0/2105088063 learned_addr learned my addr 172.21.15.38:0/2105088063 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f5895ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58967fe640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ef070 0x563ad3b1db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 -- 172.21.15.38:0/2105088063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ef070 msgr2=0x563ad3b1db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ef070 0x563ad3b1db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 -- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 msgr2=0x563ad3aa6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 -- 172.21.15.38:0/2105088063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad3b1e090 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58957fc640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5884004810 tx=0x7f5884007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22151c53a79990e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58757fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.475+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588400db50 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f588400dcf0 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5884018040 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f58840138d0 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 10 client.17166 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563ad3b1f2a0 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5884018040 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5884032030 con 0x563ad36ce390 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 10 client.17166 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:20.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 20 client.17166 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad3682da0 0x563ad3b216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 4 client.17166 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.476+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ad3a0a8a0 con 0x563ad3682da0 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f5895ffd640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad3682da0 0x563ad3b216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f5895ffd640 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad3682da0 0x563ad3b216e0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c62f586984a52e server_cookie=b705863fbb4e576d in_seq=0 out_seq=0 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f58757fa640 10 client.17166 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f58757fa640 1 -- 172.21.15.38:0/2105088063 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ad3a0a8a0 con 0x563ad3682da0 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f58757fa640 10 client.17166 handle_command_reply: tid=0 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f589e7d5740 1 client.17166 shutdown 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 msgr2=0x563ad3aa6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.477+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5884004810 tx=0x7f5884007710 comp rx=0 tx=0).stop 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 shutdown_connections 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563ad3682da0 0x563ad3b216e0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563ad36ef070 0x563ad3b1db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563ad36ce390 0x563ad3aa6cc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 --2- 172.21.15.38:0/2105088063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ad36c61b0 0x563ad3aa6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f58757fa640 0 client.17166 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 >> 172.21.15.38:0/2105088063 conn(0x563ad36e3460 msgr2=0x563ad3aa3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 shutdown_connections 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 1 -- 172.21.15.38:0/2105088063 wait complete. 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f589e7d5740 20 client.17166 trim_cache size 0 max 16384 2024-09-21T06:26:20.485 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 msgr2=0x7f58780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 0x7f58780b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5880009fd0 tx=0x7f588000e040 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 msgr2=0x7f589019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5888006010 tx=0x7f5888004430 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 shutdown_connections 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f58780b6680 0x7f58780b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5890109e00 0x7f589019ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58901094b0 0x7f589019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 --2- 172.21.15.38:0/3319878908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5890103bc0 0x7f589019a750 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:20.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.478+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 >> 172.21.15.38:0/3319878908 conn(0x7f589007b910 msgr2=0x7f5890107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.479+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 shutdown_connections 2024-09-21T06:26:20.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:20.479+0000 7f5898261640 1 -- 172.21.15.38:0/3319878908 wait complete. 2024-09-21T06:26:21.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:21 smithi038 ceph-mon[31215]: pgmap v521: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:21.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:21 smithi174 ceph-mon[34815]: pgmap v521: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:21 smithi044 ceph-mon[34369]: pgmap v521: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:26:22.119 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:22.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:22.391 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 -- 172.21.15.38:0/2566998440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c1083a0 msgr2=0x7fb07c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 --2- 172.21.15.38:0/2566998440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c1083a0 0x7fb07c1087b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009900 tx=0x7fb06c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 -- 172.21.15.38:0/2566998440 shutdown_connections 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 --2- 172.21.15.38:0/2566998440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c108cf0 0x7fb07c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 --2- 172.21.15.38:0/2566998440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c1083a0 0x7fb07c1087b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 --2- 172.21.15.38:0/2566998440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 0x7fb07c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 -- 172.21.15.38:0/2566998440 >> 172.21.15.38:0/2566998440 conn(0x7fb07c079730 msgr2=0x7fb07c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 -- 172.21.15.38:0/2566998440 shutdown_connections 2024-09-21T06:26:22.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.877+0000 7fb083ce7640 1 -- 172.21.15.38:0/2566998440 wait complete. 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 Processor -- start 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 -- start start 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 0x7fb07c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c1083a0 0x7fb07c1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c112a80 con 0x7fb07c108cf0 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c112900 con 0x7fb07c102a60 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb083ce7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c112c00 con 0x7fb07c1083a0 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb082284640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb082284640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33614/0 (socket says 172.21.15.38:33614) 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb082284640 1 -- 172.21.15.38:0/4286952543 learned_addr learned my addr 172.21.15.38:0/4286952543 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb081a83640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 0x7fb07c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.878+0000 7fb081282640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c1083a0 0x7fb07c1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 -- 172.21.15.38:0/4286952543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c1083a0 msgr2=0x7fb07c1999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c1083a0 0x7fb07c1999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 -- 172.21.15.38:0/4286952543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 msgr2=0x7fb07c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 0x7fb07c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 -- 172.21.15.38:0/4286952543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c19f3a0 con 0x7fb07c108cf0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb082284640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb074007850 tx=0x7fb074007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb072ffd640 1 -- 172.21.15.38:0/4286952543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074019020 con 0x7fb07c108cf0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c19f690 con 0x7fb07c108cf0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb072ffd640 1 -- 172.21.15.38:0/4286952543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0740054f0 con 0x7fb07c108cf0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb072ffd640 1 -- 172.21.15.38:0/4286952543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07400e890 con 0x7fb07c108cf0 2024-09-21T06:26:22.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.879+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c06ae60 con 0x7fb07c108cf0 2024-09-21T06:26:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.882+0000 7fb08a25b740 1 Processor -- start 2024-09-21T06:26:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.882+0000 7fb072ffd640 1 -- 172.21.15.38:0/4286952543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb0740046c0 con 0x7fb07c108cf0 2024-09-21T06:26:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.882+0000 7fb08a25b740 1 -- start start 2024-09-21T06:26:22.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951542d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x55951542deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5595153a3e60 con 0x559515086350 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559515393290 con 0x559515065670 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb08a25b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5595153970a0 con 0x55951505d490 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33624/0 (socket says 172.21.15.38:33624) 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 -- 172.21.15.38:0/1896105933 learned_addr learned my addr 172.21.15.38:0/1896105933 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x55951542deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081a83640 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951542d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 -- 172.21.15.38:0/1896105933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 msgr2=0x55951542d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951542d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 -- 172.21.15.38:0/1896105933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 msgr2=0x55951542deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x55951542deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb072ffd640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 0x7fb0680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 -- 172.21.15.38:0/1896105933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595150f1930 con 0x559515086350 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb082284640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 0x7fb0680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.883+0000 7fb081282640 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06aaa0 tx=0x7fb06c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adbb1ccef7e0bee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.884+0000 7fb072ffd640 1 -- 172.21.15.38:0/4286952543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb0740e8b60 con 0x7fb07c108cf0 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.884+0000 7fb067fff640 1 -- 172.21.15.38:0/1896105933 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c044070 con 0x559515086350 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.884+0000 7fb067fff640 1 -- 172.21.15.38:0/1896105933 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb06c005020 con 0x559515086350 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.884+0000 7fb067fff640 1 -- 172.21.15.38:0/1896105933 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c035040 con 0x559515086350 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- 172.21.15.38:0/1896105933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 msgr2=0x55951542d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb082284640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 0x7fb0680b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb0740e6900 tx=0x7fb0740d2040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06aaa0 tx=0x7fb06c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- 172.21.15.38:0/1896105933 shutdown_connections 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x55951542deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951542d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 --2- 172.21.15.38:0/1896105933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x55951542d430 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- 172.21.15.38:0/1896105933 >> 172.21.15.38:0/1896105933 conn(0x55951507a740 msgr2=0x55951542b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- 172.21.15.38:0/1896105933 shutdown_connections 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- 172.21.15.38:0/1896105933 wait complete. 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 -- start start 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.885+0000 7fb08a25b740 1 Processor -- start 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x5595154390b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x559515439650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5595151f4890 con 0x559515086350 2024-09-21T06:26:22.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55951532dd40 con 0x559515065670 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55951543bbb0 con 0x55951505d490 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb08a25b740 10 client.0 _ll_register_callbacks cb 0x559515391c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb081282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb081282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33630/0 (socket says 172.21.15.38:33630) 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb081282640 1 -- 172.21.15.38:0/185326235 learned_addr learned my addr 172.21.15.38:0/185326235 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb081a83640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x559515439650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.886+0000 7fb081282640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x5595154390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 -- 172.21.15.38:0/185326235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 msgr2=0x5595154390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x5595154390b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 -- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 msgr2=0x559515439650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x559515439650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 -- 172.21.15.38:0/185326235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559515445510 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081a83640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x559515439650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb081282640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb06c004650 tx=0x7fb06c031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4875957c9d7d3c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb0657fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c04c070 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb06c004aa0 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb06c005020 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb06c059050 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb08a25b740 10 client.17178 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.887+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559515447e40 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb06c005020 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb06c048ca0 con 0x559515086350 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 10 client.17178 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:22.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 20 client.17178 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:22.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559515044cd0 0x55951544b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 4 client.17178 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:22.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595153a5db0 con 0x559515044cd0 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.888+0000 7fb081a83640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559515044cd0 0x55951544b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb081a83640 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559515044cd0 0x55951544b4d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5345470685603764 server_cookie=9ecb455eeb4418e3 in_seq=0 out_seq=0 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb0657fa640 10 client.17178 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb0657fa640 1 -- 172.21.15.38:0/185326235 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595153a5db0 con 0x559515044cd0 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb0657fa640 10 client.17178 handle_command_reply: tid=0 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb08a25b740 1 client.17178 shutdown 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 msgr2=0x559515444ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.889+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb06c004650 tx=0x7fb06c031a00 comp rx=0 tx=0).stop 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 shutdown_connections 2024-09-21T06:26:22.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515086350 0x559515444ed0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515065670 0x559515439650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559515044cd0 0x55951544b4d0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 --2- 172.21.15.38:0/185326235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x5595154390b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 >> 172.21.15.38:0/185326235 conn(0x55951507a740 msgr2=0x559515430610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb0657fa640 0 client.17178 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 shutdown_connections 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 1 -- 172.21.15.38:0/185326235 wait complete. 2024-09-21T06:26:22.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.890+0000 7fb08a25b740 20 client.17178 trim_cache size 0 max 16384 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 Processor -- start 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 -- start start 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951505d490 0x559515430c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559515086350 0x559515432a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1afca0 con 0x559515065670 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ad570 con 0x55951505d490 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb08a25b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ab3e0 con 0x559515086350 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33644/0 (socket says 172.21.15.38:33644) 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 -- 172.21.15.38:0/4288861579 learned_addr learned my addr 172.21.15.38:0/4288861579 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081282640 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951505d490 0x559515430c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 -- 172.21.15.38:0/4288861579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559515086350 msgr2=0x559515432a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559515086350 0x559515432a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 -- 172.21.15.38:0/4288861579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951505d490 msgr2=0x559515430c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951505d490 0x559515430c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 -- 172.21.15.38:0/4288861579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951542b860 con 0x559515065670 2024-09-21T06:26:22.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.908+0000 7fb081a83640 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x55951543b7e0 tx=0x7fb078012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770b58bdb7b2a347 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb0677fe640 1 -- 172.21.15.38:0/4288861579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078020040 con 0x559515065670 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb0677fe640 1 -- 172.21.15.38:0/4288861579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb078004d20 con 0x559515065670 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb0677fe640 1 -- 172.21.15.38:0/4288861579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078005020 con 0x559515065670 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 -- 172.21.15.38:0/4288861579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 msgr2=0x559515432510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x55951543b7e0 tx=0x7fb078012e40 comp rx=0 tx=0).stop 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 -- 172.21.15.38:0/4288861579 shutdown_connections 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559515086350 0x559515432a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x559515432510 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 --2- 172.21.15.38:0/4288861579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951505d490 0x559515430c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.909+0000 7fb08a25b740 1 -- 172.21.15.38:0/4288861579 >> 172.21.15.38:0/4288861579 conn(0x55951507a740 msgr2=0x559515430530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.910+0000 7fb08a25b740 1 -- 172.21.15.38:0/4288861579 shutdown_connections 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.910+0000 7fb08a25b740 1 -- 172.21.15.38:0/4288861579 wait complete. 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.910+0000 7fb08a25b740 1 -- start start 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.910+0000 7fb08a25b740 1 Processor -- start 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951543d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515086350 0x55951543dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1aba30 con 0x559515065670 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1acea0 con 0x559515086350 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1ac100 con 0x55951505d490 2024-09-21T06:26:22.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb08a25b740 10 client.0 _ll_register_callbacks cb 0x7fb06c031510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33656/0 (socket says 172.21.15.38:33656) 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 -- 172.21.15.38:0/392839370 learned_addr learned my addr 172.21.15.38:0/392839370 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081282640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515086350 0x55951543dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081282640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951543d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 -- 172.21.15.38:0/392839370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 msgr2=0x55951543d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951543d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 -- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515086350 msgr2=0x55951543dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515086350 0x55951543dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 -- 172.21.15.38:0/392839370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595154b4f10 con 0x559515065670 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb081a83640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb078005e90 tx=0x7fb07801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7051ec8663f3e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.911+0000 7fb0657fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078020040 con 0x559515065670 2024-09-21T06:26:22.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb07800fa70 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb078004d20 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb07800fc70 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 10 client.17184 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595154b61d0 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb078004d20 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb078025480 con 0x559515065670 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 10 client.17184 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 20 client.17184 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951501a080 0x5595154b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 4 client.17184 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.912+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5595153a1860 con 0x55951501a080 2024-09-21T06:26:22.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.913+0000 7fb081282640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951501a080 0x5595154b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:22.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.913+0000 7fb0657fa640 10 client.17184 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.913+0000 7fb081282640 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951501a080 0x5595154b8830 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3144ee7883f54e2b server_cookie=2e51cf93c0df2df2 in_seq=0 out_seq=0 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.915+0000 7fb0657fa640 1 -- 172.21.15.38:0/392839370 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5595153a1860 con 0x55951501a080 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.915+0000 7fb0657fa640 10 client.17184 handle_command_reply: tid=0 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.915+0000 7fb08a25b740 1 client.17184 shutdown 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.915+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 msgr2=0x55951543d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.915+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb078005e90 tx=0x7fb07801ebf0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 shutdown_connections 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559515086350 0x55951543dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559515065670 0x55951543d560 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951501a080 0x5595154b8830 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 --2- 172.21.15.38:0/392839370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951505d490 0x55951543d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb0657fa640 0 client.17184 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 >> 172.21.15.38:0/392839370 conn(0x55951507a740 msgr2=0x55951543a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 shutdown_connections 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 1 -- 172.21.15.38:0/392839370 wait complete. 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb08a25b740 20 client.17184 trim_cache size 0 max 16384 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a30f7bb4-b898-470a-8e19-29d90dda54d9", 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:22.921 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 msgr2=0x7fb0680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 0x7fb0680b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb0740e6900 tx=0x7fb0740d2040 comp rx=0 tx=0).stop 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 msgr2=0x7fb07c19ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb074007850 tx=0x7fb074007d10 comp rx=0 tx=0).stop 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 shutdown_connections 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0680b6680 0x7fb0680b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb07c108cf0 0x7fb07c19ec70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07c1083a0 0x7fb07c1999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 --2- 172.21.15.38:0/4286952543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb07c102a60 0x7fb07c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.916+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 >> 172.21.15.38:0/4286952543 conn(0x7fb07c079730 msgr2=0x7fb07c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.917+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 shutdown_connections 2024-09-21T06:26:22.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:22.917+0000 7fb083ce7640 1 -- 172.21.15.38:0/4286952543 wait complete. 2024-09-21T06:26:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:23 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:23.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:23.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:23.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:23 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:23 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:23.900 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:24.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 -- 172.21.15.38:0/2379106553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49701083c0 msgr2=0x7f49701087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 --2- 172.21.15.38:0/2379106553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49701083c0 0x7f49701087d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4960009900 tx=0x7f496002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 -- 172.21.15.38:0/2379106553 shutdown_connections 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 --2- 172.21.15.38:0/2379106553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4970108d10 0x7f497010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 --2- 172.21.15.38:0/2379106553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49701083c0 0x7f49701087d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 --2- 172.21.15.38:0/2379106553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 0x7f4970102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 -- 172.21.15.38:0/2379106553 >> 172.21.15.38:0/2379106553 conn(0x7f4970079740 msgr2=0x7f4970079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 -- 172.21.15.38:0/2379106553 shutdown_connections 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.344+0000 7f4976b19640 1 -- 172.21.15.38:0/2379106553 wait complete. 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 Processor -- start 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 -- start start 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 0x7f4970199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49701083c0 0x7f49701999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4970112aa0 con 0x7f4970108d10 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4970112920 con 0x7f4970102a80 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f4976b19640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4970112c20 con 0x7f49701083c0 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f49750b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f49750b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33668/0 (socket says 172.21.15.38:33668) 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.345+0000 7f49750b6640 1 -- 172.21.15.38:0/2109361450 learned_addr learned my addr 172.21.15.38:0/2109361450 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49748b5640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 0x7f4970199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f496ffff640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49701083c0 0x7f49701999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 -- 172.21.15.38:0/2109361450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49701083c0 msgr2=0x7f49701999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49701083c0 0x7f49701999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 -- 172.21.15.38:0/2109361450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 msgr2=0x7f4970199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 0x7f4970199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 -- 172.21.15.38:0/2109361450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497019f2e0 con 0x7f4970108d10 2024-09-21T06:26:24.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f49750b6640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f496800eaa0 tx=0x7f496800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f496dffb640 1 -- 172.21.15.38:0/2109361450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968004d20 con 0x7f4970108d10 2024-09-21T06:26:24.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f496dffb640 1 -- 172.21.15.38:0/2109361450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4968005020 con 0x7f4970108d10 2024-09-21T06:26:24.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497019f5d0 con 0x7f4970108d10 2024-09-21T06:26:24.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.346+0000 7f496dffb640 1 -- 172.21.15.38:0/2109361450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680116d0 con 0x7f4970108d10 2024-09-21T06:26:24.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.347+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49701a5df0 con 0x7f4970108d10 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.349+0000 7f496dffb640 1 -- 172.21.15.38:0/2109361450 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f49680051d0 con 0x7f4970108d10 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.349+0000 7f497d08d740 1 Processor -- start 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.349+0000 7f497d08d740 1 -- start start 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.349+0000 7f497d08d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d32070 0x557a930d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.349+0000 7f497d08d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f497d08d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f497d08d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557a9304fe50 con 0x557a92d11390 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f497d08d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557a9303f280 con 0x557a92d091b0 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f497d08d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557a93043090 con 0x557a92d32070 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33672/0 (socket says 172.21.15.38:33672) 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 -- 172.21.15.38:0/955448794 learned_addr learned my addr 172.21.15.38:0/955448794 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d32070 0x557a930d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f49748b5640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 -- 172.21.15.38:0/955448794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d32070 msgr2=0x557a930d9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d32070 0x557a930d9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496dffb640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 0x7f495c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 -- 172.21.15.38:0/955448794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 msgr2=0x557a930d9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 -- 172.21.15.38:0/955448794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a92d9d650 con 0x557a92d11390 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f49748b5640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f49750b6640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 0x7f495c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.350+0000 7f496ffff640 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f497006b6c0 tx=0x7f49600056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c89fcb8fc37700e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.351+0000 7f496dffb640 1 -- 172.21.15.38:0/2109361450 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f49680e78d0 con 0x7f4970108d10 2024-09-21T06:26:24.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.351+0000 7f4966ffd640 1 -- 172.21.15.38:0/955448794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960035040 con 0x557a92d11390 2024-09-21T06:26:24.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.351+0000 7f4966ffd640 1 -- 172.21.15.38:0/955448794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49600035f0 con 0x557a92d11390 2024-09-21T06:26:24.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.351+0000 7f4966ffd640 1 -- 172.21.15.38:0/955448794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496003d6e0 con 0x557a92d11390 2024-09-21T06:26:24.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- 172.21.15.38:0/955448794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 msgr2=0x557a930da0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f49750b6640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 0x7f495c0b8bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49680e5670 tx=0x7f4968000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f497006b6c0 tx=0x7f49600056d0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- 172.21.15.38:0/955448794 shutdown_connections 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d11390 0x557a930da0d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 --2- 172.21.15.38:0/955448794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d32070 0x557a930d9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- 172.21.15.38:0/955448794 >> 172.21.15.38:0/955448794 conn(0x557a92d26460 msgr2=0x557a930d7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- 172.21.15.38:0/955448794 shutdown_connections 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- 172.21.15.38:0/955448794 wait complete. 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 -- start start 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.352+0000 7f497d08d740 1 Processor -- start 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d32070 0x557a930f3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557a92ea0700 con 0x557a92d091b0 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557a92fda110 con 0x557a92d32070 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557a930e9f80 con 0x557a92d11390 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f497d08d740 10 client.0 _ll_register_callbacks cb 0x557a92ff3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33676/0 (socket says 172.21.15.38:33676) 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 -- 172.21.15.38:0/542779553 learned_addr learned my addr 172.21.15.38:0/542779553 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f49748b5640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d32070 0x557a930f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 -- 172.21.15.38:0/542779553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 msgr2=0x557a930e52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930e52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 -- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d32070 msgr2=0x557a930f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d32070 0x557a930f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 -- 172.21.15.38:0/542779553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a93007c40 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.353+0000 7f496ffff640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4960001eb0 tx=0x7f4960003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3854fc7bc5f7f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960051060 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49600035f0 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f49600039a0 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4960035070 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 10 client.17196 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557a930f5cd0 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49600035f0 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f496003a040 con 0x557a92d091b0 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 10 client.17196 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 20 client.17196 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:24.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cf09f0 0x557a930f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 4 client.17196 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.354+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a93051da0 con 0x557a92cf09f0 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.355+0000 7f49748b5640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cf09f0 0x557a930f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.355+0000 7f49748b5640 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cf09f0 0x557a930f9030 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d82fdf24fea639 server_cookie=c70884e2e479ef44 in_seq=0 out_seq=0 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.355+0000 7f494ffff640 10 client.17196 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f494ffff640 1 -- 172.21.15.38:0/542779553 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a93051da0 con 0x557a92cf09f0 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f494ffff640 10 client.17196 handle_command_reply: tid=0 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 client.17196 shutdown 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 msgr2=0x557a930e4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4960001eb0 tx=0x7f4960003ed0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 shutdown_connections 2024-09-21T06:26:24.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d32070 0x557a930f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cf09f0 0x557a930f9030 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f494ffff640 0 client.17196 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 --2- 172.21.15.38:0/542779553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d091b0 0x557a930e4d80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 >> 172.21.15.38:0/542779553 conn(0x557a92d26460 msgr2=0x557a930dc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 shutdown_connections 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 1 -- 172.21.15.38:0/542779553 wait complete. 2024-09-21T06:26:24.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.356+0000 7f497d08d740 20 client.17196 trim_cache size 0 max 16384 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 Processor -- start 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 -- start start 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f49701afd30 con 0x557a92d32070 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49701ad600 con 0x557a92d091b0 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f497d08d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f49701ab470 con 0x557a92d11390 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33678/0 (socket says 172.21.15.38:33678) 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f496ffff640 1 -- 172.21.15.38:0/3107337121 learned_addr learned my addr 172.21.15.38:0/3107337121 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.374+0000 7f496ffff640 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f49748b5640 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 -- 172.21.15.38:0/3107337121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 msgr2=0x557a930f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 -- 172.21.15.38:0/3107337121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 msgr2=0x557a930d7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 -- 172.21.15.38:0/3107337121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a930dfa00 con 0x557a92d32070 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f496ffff640 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f496003dc30 tx=0x7f49600056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c78f6e9a1517c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f49667fc640 1 -- 172.21.15.38:0/3107337121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960051070 con 0x557a92d32070 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f49667fc640 1 -- 172.21.15.38:0/3107337121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4960031730 con 0x557a92d32070 2024-09-21T06:26:24.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.375+0000 7f49667fc640 1 -- 172.21.15.38:0/3107337121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960004410 con 0x557a92d32070 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- 172.21.15.38:0/3107337121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 msgr2=0x557a930dc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f496003dc30 tx=0x7f49600056d0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- 172.21.15.38:0/3107337121 shutdown_connections 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930dc750 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d11390 0x557a930f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 --2- 172.21.15.38:0/3107337121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d091b0 0x557a930d7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- 172.21.15.38:0/3107337121 >> 172.21.15.38:0/3107337121 conn(0x557a92d26460 msgr2=0x557a930d6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- 172.21.15.38:0/3107337121 shutdown_connections 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- 172.21.15.38:0/3107337121 wait complete. 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 -- start start 2024-09-21T06:26:24.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.376+0000 7f497d08d740 1 Processor -- start 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d091b0 0x557a930fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d11390 0x557a930f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f49701abac0 con 0x557a92d32070 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49701acf30 con 0x557a92d11390 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f49701ac190 con 0x557a92d091b0 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f497d08d740 10 client.0 _ll_register_callbacks cb 0x7f4960032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33688/0 (socket says 172.21.15.38:33688) 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 -- 172.21.15.38:0/461657416 learned_addr learned my addr 172.21.15.38:0/461657416 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f49748b5640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d11390 0x557a930f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d091b0 0x557a930fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 -- 172.21.15.38:0/461657416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d091b0 msgr2=0x557a930fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d091b0 0x557a930fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 -- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d11390 msgr2=0x557a930f9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d11390 0x557a930f9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.377+0000 7f496ffff640 1 -- 172.21.15.38:0/461657416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a930fa9a0 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f496ffff640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x557a930c89a0 tx=0x7f496003db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367f948c09e54fab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960068060 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4960031730 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f49600040d0 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4960051070 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 10 client.17202 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557a931636e0 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4960031730 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4960032040 con 0x557a92d32070 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 10 client.17202 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:24.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 20 client.17202 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.378+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cc5da0 0x557a93165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.379+0000 7f497d08d740 4 client.17202 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.379+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a930e0930 con 0x557a92cc5da0 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.379+0000 7f49748b5640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cc5da0 0x557a93165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.379+0000 7f494ffff640 10 client.17202 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.379+0000 7f49748b5640 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cc5da0 0x557a93165c20 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ce141155da2f69 server_cookie=7c08749c2e20159 in_seq=0 out_seq=0 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f494ffff640 1 -- 172.21.15.38:0/461657416 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x557a930e0930 con 0x557a92cc5da0 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f494ffff640 10 client.17202 handle_command_reply: tid=0 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 client.17202 shutdown 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 msgr2=0x557a930fa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x557a930c89a0 tx=0x7f496003db90 comp rx=0 tx=0).stop 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 shutdown_connections 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557a92d32070 0x557a930fa230 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a92d11390 0x557a930f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557a92cc5da0 0x557a93165c20 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 --2- 172.21.15.38:0/461657416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557a92d091b0 0x557a930fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f494ffff640 0 client.17202 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 >> 172.21.15.38:0/461657416 conn(0x557a92d26460 msgr2=0x557a930dc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 shutdown_connections 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 1 -- 172.21.15.38:0/461657416 wait complete. 2024-09-21T06:26:24.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.380+0000 7f497d08d740 20 client.17202 trim_cache size 0 max 16384 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.388 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.389 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.390 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.391 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:24.392 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:26:24.393 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:24.396 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 msgr2=0x7f495c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 0x7f495c0b8bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49680e5670 tx=0x7f4968000f40 comp rx=0 tx=0).stop 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 msgr2=0x7f497019ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f496800eaa0 tx=0x7f496800eea0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 shutdown_connections 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f495c0b66b0 0x7f495c0b8bc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4970108d10 0x7f497019ec70 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f49701083c0 0x7f49701999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 --2- 172.21.15.38:0/2109361450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4970102a80 0x7f4970199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:24.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 >> 172.21.15.38:0/2109361450 conn(0x7f4970079740 msgr2=0x7f4970104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:24.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 shutdown_connections 2024-09-21T06:26:24.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:24.381+0000 7f4976b19640 1 -- 172.21.15.38:0/2109361450 wait complete. 2024-09-21T06:26:25.050 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:25.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:25.594 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:25 smithi038 ceph-mon[31215]: pgmap v523: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:25 smithi174 ceph-mon[34815]: pgmap v523: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:25.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:25 smithi044 ceph-mon[34369]: pgmap v523: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 -- 172.21.15.38:0/3191010652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e8103b60 msgr2=0x7fd9e8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/3191010652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e8103b60 0x7fd9e8103f70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009900 tx=0x7fd9e402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:25.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 -- 172.21.15.38:0/3191010652 shutdown_connections 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/3191010652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8109df0 0x7fd9e8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/3191010652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e81094a0 0x7fd9e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/3191010652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e8103b60 0x7fd9e8103f70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.799+0000 7fd9efbbf640 1 -- 172.21.15.38:0/3191010652 >> 172.21.15.38:0/3191010652 conn(0x7fd9e807b850 msgr2=0x7fd9e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.800+0000 7fd9efbbf640 1 -- 172.21.15.38:0/3191010652 shutdown_connections 2024-09-21T06:26:25.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.800+0000 7fd9efbbf640 1 -- 172.21.15.38:0/3191010652 wait complete. 2024-09-21T06:26:25.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.800+0000 7fd9efbbf640 1 Processor -- start 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.800+0000 7fd9efbbf640 1 -- start start 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8103b60 0x7fd9e819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e8109df0 0x7fd9e819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8113bf0 con 0x7fd9e81094a0 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8113a70 con 0x7fd9e8103b60 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9efbbf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8113d70 con 0x7fd9e8109df0 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33712/0 (socket says 172.21.15.38:33712) 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 -- 172.21.15.38:0/1642780296 learned_addr learned my addr 172.21.15.38:0/1642780296 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed95b640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8103b60 0x7fd9e819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ee15c640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e8109df0 0x7fd9e819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 -- 172.21.15.38:0/1642780296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e8109df0 msgr2=0x7fd9e819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e8109df0 0x7fd9e819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 -- 172.21.15.38:0/1642780296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8103b60 msgr2=0x7fd9e819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8103b60 0x7fd9e819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 -- 172.21.15.38:0/1642780296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e81a0550 con 0x7fd9e81094a0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.801+0000 7fd9ed15a640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d750 tx=0x7fd9d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.802+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8017070 con 0x7fd9e81094a0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.802+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd9d80054f0 con 0x7fd9e81094a0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.802+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e81a0840 con 0x7fd9e81094a0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.802+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8004d90 con 0x7fd9e81094a0 2024-09-21T06:26:25.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.802+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a6fa0 con 0x7fd9e81094a0 2024-09-21T06:26:25.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.803+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e8104de0 con 0x7fd9e81094a0 2024-09-21T06:26:25.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.804+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd9d8004f30 con 0x7fd9e81094a0 2024-09-21T06:26:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.805+0000 7fd9deffd640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 0x7fd9d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.805+0000 7fd9ed95b640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 0x7fd9d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.805+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd9d80e7520 con 0x7fd9e81094a0 2024-09-21T06:26:25.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.806+0000 7fd9ed95b640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 0x7fd9d40b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009230 tx=0x7fd9e40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:25.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:25.808+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9d80adac0 con 0x7fd9e81094a0 2024-09-21T06:26:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.034+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9e810bbc0 con 0x7fd9e81094a0 2024-09-21T06:26:26.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.035+0000 7fd9deffd640 1 -- 172.21.15.38:0/1642780296 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fd9d80b1ea0 con 0x7fd9e81094a0 2024-09-21T06:26:26.038 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:26.038 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 msgr2=0x7fd9d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 0x7fd9d40b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009230 tx=0x7fd9e40058d0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 msgr2=0x7fd9e819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800d750 tx=0x7fd9d800dc10 comp rx=0 tx=0).stop 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 shutdown_connections 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd9d40b6680 0x7fd9d40b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9e8109df0 0x7fd9e819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd9e81094a0 0x7fd9e819ab80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 --2- 172.21.15.38:0/1642780296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8103b60 0x7fd9e819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.037+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 >> 172.21.15.38:0/1642780296 conn(0x7fd9e807b850 msgr2=0x7fd9e8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.038+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 shutdown_connections 2024-09-21T06:26:26.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:26.038+0000 7fd9efbbf640 1 -- 172.21.15.38:0/1642780296 wait complete. 2024-09-21T06:26:26.614 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:26 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1642780296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:26.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:26.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:26 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1642780296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:26.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:26 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1642780296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:26.903 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 -- 172.21.15.38:0/3278528739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6390076100 msgr2=0x7f639010fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 --2- 172.21.15.38:0/3278528739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6390076100 0x7f639010fba0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6384009900 tx=0x7f638402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 -- 172.21.15.38:0/3278528739 shutdown_connections 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 --2- 172.21.15.38:0/3278528739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63901100e0 0x7f6390112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 --2- 172.21.15.38:0/3278528739 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6390076100 0x7f639010fba0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 --2- 172.21.15.38:0/3278528739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63900757b0 0x7f6390075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 -- 172.21.15.38:0/3278528739 >> 172.21.15.38:0/3278528739 conn(0x7f63900ff610 msgr2=0x7f6390101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 -- 172.21.15.38:0/3278528739 shutdown_connections 2024-09-21T06:26:27.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.336+0000 7f6398110640 1 -- 172.21.15.38:0/3278528739 wait complete. 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 Processor -- start 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 -- start start 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6390076100 0x7f639019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 0x7f63901a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6390115db0 con 0x7f63900757b0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6390115c30 con 0x7f6390076100 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6398110640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6390115f30 con 0x7f63901100e0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6395eac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6395eac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33720/0 (socket says 172.21.15.38:33720) 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.337+0000 7f6395eac640 1 -- 172.21.15.38:0/3439662736 learned_addr learned my addr 172.21.15.38:0/3439662736 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f63956ab640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6390076100 0x7f639019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f63966ad640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 0x7f63901a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 -- 172.21.15.38:0/3439662736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 msgr2=0x7f63901a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 0x7f63901a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 -- 172.21.15.38:0/3439662736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6390076100 msgr2=0x7f639019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6390076100 0x7f639019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 -- 172.21.15.38:0/3439662736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63901a2610 con 0x7f63900757b0 2024-09-21T06:26:27.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f63966ad640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 0x7f63901a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6395eac640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f638000cce0 tx=0x7f638000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f638effd640 1 -- 172.21.15.38:0/3439662736 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638000f650 con 0x7f63900757b0 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f638effd640 1 -- 172.21.15.38:0/3439662736 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f638000fcc0 con 0x7f63900757b0 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63901a2900 con 0x7f63900757b0 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f638effd640 1 -- 172.21.15.38:0/3439662736 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380018c40 con 0x7f63900757b0 2024-09-21T06:26:27.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.338+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63901a9120 con 0x7f63900757b0 2024-09-21T06:26:27.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.341+0000 7f639e684740 1 Processor -- start 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 -- start start 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f638effd640 1 -- 172.21.15.38:0/3439662736 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f638000f7f0 con 0x7f63900757b0 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede9390 0x55a88f1b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a88f127ea0 con 0x55a88ede11b0 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a88f1172d0 con 0x55a88ee0a070 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f639e684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a88f11b0e0 con 0x55a88ede9390 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f6395eac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f6395eac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33732/0 (socket says 172.21.15.38:33732) 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f6395eac640 1 -- 172.21.15.38:0/2503666432 learned_addr learned my addr 172.21.15.38:0/2503666432 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f63966ad640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.342+0000 7f63956ab640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede9390 0x55a88f1b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 -- 172.21.15.38:0/2503666432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede9390 msgr2=0x55a88f1b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede9390 0x55a88f1b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 -- 172.21.15.38:0/2503666432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 msgr2=0x55a88f1b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 -- 172.21.15.38:0/2503666432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88ee75650 con 0x55a88ee0a070 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f6395eac640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f63966ad640 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1b12c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6388005fd0 tx=0x7f638800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1eb1c645d80b84e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f6377fff640 1 -- 172.21.15.38:0/2503666432 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388015070 con 0x55a88ee0a070 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f638effd640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 0x7f63780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f6377fff640 1 -- 172.21.15.38:0/2503666432 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f63880035f0 con 0x55a88ee0a070 2024-09-21T06:26:27.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f6377fff640 1 -- 172.21.15.38:0/2503666432 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880116a0 con 0x55a88ee0a070 2024-09-21T06:26:27.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f638effd640 1 -- 172.21.15.38:0/3439662736 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f63800e7b80 con 0x7f63900757b0 2024-09-21T06:26:27.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.343+0000 7f6395eac640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 0x7f63780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 -- 172.21.15.38:0/2503666432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 msgr2=0x55a88f1b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f6395eac640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 0x7f63780b8bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f63800e5380 tx=0x7f63800eb6d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1b12c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6388005fd0 tx=0x7f638800f730 comp rx=0 tx=0).stop 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 -- 172.21.15.38:0/2503666432 shutdown_connections 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede9390 0x55a88f1b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 --2- 172.21.15.38:0/2503666432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1b12c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 -- 172.21.15.38:0/2503666432 >> 172.21.15.38:0/2503666432 conn(0x55a88edfe460 msgr2=0x55a88f1af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 -- 172.21.15.38:0/2503666432 shutdown_connections 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.344+0000 7f639e684740 1 -- 172.21.15.38:0/2503666432 wait complete. 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.345+0000 7f639e684740 1 -- start start 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.345+0000 7f639e684740 1 Processor -- start 2024-09-21T06:26:27.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede11b0 0x55a88f1bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a88ef78700 con 0x55a88ede9390 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a88f0b2160 con 0x55a88ee0a070 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a88f1bfaa0 con 0x55a88ede11b0 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f639e684740 10 client.0 _ll_register_callbacks cb 0x55a88f0cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33738/0 (socket says 172.21.15.38:33738) 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 -- 172.21.15.38:0/671492696 learned_addr learned my addr 172.21.15.38:0/671492696 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63966ad640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63966ad640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede11b0 0x55a88f1bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 -- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede11b0 msgr2=0x55a88f1bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede11b0 0x55a88f1bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 -- 172.21.15.38:0/671492696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 msgr2=0x55a88f1c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 -- 172.21.15.38:0/671492696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88f0dfc90 con 0x55a88ede9390 2024-09-21T06:26:27.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63966ad640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:27.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63956ab640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6384009230 tx=0x7f6384031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44476ca2c93ddb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.346+0000 7f63757fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384035040 con 0x55a88ede9390 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f6384004250 con 0x55a88ede9390 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63880035f0 con 0x55a88ede9390 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6384004450 con 0x55a88ede9390 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 10 client.17220 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:27.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a88f1cb7d0 con 0x55a88ede9390 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f63880035f0 con 0x55a88ede9390 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6384004c70 con 0x55a88ede9390 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 10 client.17220 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 10 client.17220 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 20 client.17220 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88edc89f0 0x55a88f1cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 4 client.17220 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.354+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a88f129df0 con 0x55a88edc89f0 2024-09-21T06:26:27.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.355+0000 7f63966ad640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88edc89f0 0x55a88f1cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.355+0000 7f63966ad640 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88edc89f0 0x55a88f1cec90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3c0dfe78857eb2c server_cookie=f40f26e04d49eae0 in_seq=0 out_seq=0 2024-09-21T06:26:27.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.355+0000 7f63757fa640 10 client.17220 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:27.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f63757fa640 1 -- 172.21.15.38:0/671492696 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a88f129df0 con 0x55a88edc89f0 2024-09-21T06:26:27.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f63757fa640 10 client.17220 handle_command_reply: tid=0 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 client.17220 shutdown 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 msgr2=0x55a88f1bcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6384009230 tx=0x7f6384031510 comp rx=0 tx=0).stop 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 shutdown_connections 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88edc89f0 0x55a88f1cec90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ee0a070 0x55a88f1c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1bcee0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f63757fa640 0 client.17220 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 --2- 172.21.15.38:0/671492696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ede11b0 0x55a88f1bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 >> 172.21.15.38:0/671492696 conn(0x55a88edfe460 msgr2=0x55a88f1b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 shutdown_connections 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.356+0000 7f639e684740 1 -- 172.21.15.38:0/671492696 wait complete. 2024-09-21T06:26:27.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.357+0000 7f639e684740 20 client.17220 trim_cache size 0 max 16384 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 Processor -- start 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 -- start start 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 0x55a88f1be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b4030 con 0x55a88ede9390 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b1900 con 0x55a88ede11b0 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f639e684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63901af770 con 0x55a88ee0a070 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33746/0 (socket says 172.21.15.38:33746) 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 -- 172.21.15.38:0/289190655 learned_addr learned my addr 172.21.15.38:0/289190655 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:27.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63966ad640 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 0x55a88f1be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 -- 172.21.15.38:0/289190655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 msgr2=0x55a88f1b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 -- 172.21.15.38:0/289190655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 msgr2=0x55a88f1be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 0x55a88f1be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63956ab640 1 -- 172.21.15.38:0/289190655 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88f1b4120 con 0x55a88ede9390 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.370+0000 7f63966ad640 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 0x55a88f1be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.371+0000 7f63956ab640 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6384000c00 tx=0x7f638402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831f3d51636a7e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.371+0000 7f63777fe640 1 -- 172.21.15.38:0/289190655 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384035070 con 0x55a88ede9390 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.371+0000 7f63777fe640 1 -- 172.21.15.38:0/289190655 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6384041070 con 0x55a88ede9390 2024-09-21T06:26:27.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.371+0000 7f63777fe640 1 -- 172.21.15.38:0/289190655 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63840054f0 con 0x55a88ede9390 2024-09-21T06:26:27.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- 172.21.15.38:0/289190655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 msgr2=0x55a88f1c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6384000c00 tx=0x7f638402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- 172.21.15.38:0/289190655 shutdown_connections 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede9390 0x55a88f1c8cf0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 --2- 172.21.15.38:0/289190655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede11b0 0x55a88f1be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- 172.21.15.38:0/289190655 >> 172.21.15.38:0/289190655 conn(0x55a88edfe460 msgr2=0x55a88f1bdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- 172.21.15.38:0/289190655 shutdown_connections 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- 172.21.15.38:0/289190655 wait complete. 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 -- start start 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.372+0000 7f639e684740 1 Processor -- start 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede9390 0x55a88f1c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f63901afdc0 con 0x55a88ede11b0 2024-09-21T06:26:27.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b1230 con 0x55a88ede9390 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63901b0490 con 0x55a88ee0a070 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f639e684740 10 client.0 _ll_register_callbacks cb 0x7f6384005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33760/0 (socket says 172.21.15.38:33760) 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 -- 172.21.15.38:0/529611987 learned_addr learned my addr 172.21.15.38:0/529611987 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63956ab640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede9390 0x55a88f1c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 -- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 msgr2=0x55a88f1c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 -- 172.21.15.38:0/529611987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede9390 msgr2=0x55a88f1c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede9390 0x55a88f1c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 -- 172.21.15.38:0/529611987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88f2387b0 con 0x55a88ede11b0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63966ad640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f638800bb60 tx=0x7f6388003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dba16df31a4bb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:27.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.373+0000 7f63757fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388015040 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f6388003fa0 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6384041070 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6388022040 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 10 client.17226 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a88f239980 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6384041070 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6388032940 con 0x55a88ede11b0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 10 client.17226 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 10 client.17226 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 20 client.17226 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88ed9dda0 0x55a88f23bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 4 client.17226 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.374+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a88f1258a0 con 0x55a88ed9dda0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f63956ab640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88ed9dda0 0x55a88f23bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:27.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f63757fa640 10 client.17226 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f63956ab640 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88ed9dda0 0x55a88f23bf60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9552b9feff19a56c server_cookie=508d0326f161377f in_seq=0 out_seq=0 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f63757fa640 1 -- 172.21.15.38:0/529611987 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a88f1258a0 con 0x55a88ed9dda0 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f63757fa640 10 client.17226 handle_command_reply: tid=0 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f639e684740 1 client.17226 shutdown 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 msgr2=0x55a88f1c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.375+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f638800bb60 tx=0x7f6388003e90 comp rx=0 tx=0).stop 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 shutdown_connections 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55a88ed9dda0 0x55a88f23bf60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a88ee0a070 0x55a88f1c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a88ede9390 0x55a88f1c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 --2- 172.21.15.38:0/529611987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a88ede11b0 0x55a88f1c0ec0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 >> 172.21.15.38:0/529611987 conn(0x55a88edfe460 msgr2=0x55a88f1bde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f63757fa640 0 client.17226 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:27.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 shutdown_connections 2024-09-21T06:26:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 1 -- 172.21.15.38:0/529611987 wait complete. 2024-09-21T06:26:27.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f639e684740 20 client.17226 trim_cache size 0 max 16384 2024-09-21T06:26:27.383 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 msgr2=0x7f63780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 0x7f63780b8bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f63800e5380 tx=0x7f63800eb6d0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 msgr2=0x7f639019c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f638000cce0 tx=0x7f638000a620 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 shutdown_connections 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63780b66b0 0x7f63780b8bc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63901100e0 0x7f63901a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6390076100 0x7f639019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 --2- 172.21.15.38:0/3439662736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63900757b0 0x7f639019c760 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 >> 172.21.15.38:0/3439662736 conn(0x7f63900ff610 msgr2=0x7f6390109c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.376+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 shutdown_connections 2024-09-21T06:26:27.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:27.377+0000 7f6398110640 1 -- 172.21.15.38:0/3439662736 wait complete. 2024-09-21T06:26:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:27 smithi174 ceph-mon[34815]: pgmap v524: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:27 smithi044 ceph-mon[34369]: pgmap v524: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:27.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:27 smithi038 ceph-mon[31215]: pgmap v524: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:26:28.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:28.311 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 -- 172.21.15.38:0/3189471395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 msgr2=0x7f105c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 --2- 172.21.15.38:0/3189471395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c10d8c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1050009900 tx=0x7f105002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 -- 172.21.15.38:0/3189471395 shutdown_connections 2024-09-21T06:26:28.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 --2- 172.21.15.38:0/3189471395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c10de00 0x7f105c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 --2- 172.21.15.38:0/3189471395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c10d8c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 --2- 172.21.15.38:0/3189471395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c104850 0x7f105c104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 -- 172.21.15.38:0/3189471395 >> 172.21.15.38:0/3189471395 conn(0x7f105c079710 msgr2=0x7f105c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 -- 172.21.15.38:0/3189471395 shutdown_connections 2024-09-21T06:26:28.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.741+0000 7f1062099640 1 -- 172.21.15.38:0/3189471395 wait complete. 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.742+0000 7f1062099640 1 Processor -- start 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.742+0000 7f1062099640 1 -- start start 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c104850 0x7f105c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 0x7f105c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f105c113ba0 con 0x7f105c105280 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f105c113a20 con 0x7f105c104850 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f1062099640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f105c113d20 con 0x7f105c10de00 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33778/0 (socket says 172.21.15.38:33778) 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 -- 172.21.15.38:0/2064015117 learned_addr learned my addr 172.21.15.38:0/2064015117 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c104850 0x7f105c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105bfff640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 0x7f105c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 -- 172.21.15.38:0/2064015117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 msgr2=0x7f105c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 0x7f105c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 -- 172.21.15.38:0/2064015117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c104850 msgr2=0x7f105c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c104850 0x7f105c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 -- 172.21.15.38:0/2064015117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c1a0560 con 0x7f105c105280 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105bfff640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 0x7f105c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.743+0000 7f105affd640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1050005940 tx=0x7f10500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.744+0000 7f1058ff9640 1 -- 172.21.15.38:0/2064015117 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105003f030 con 0x7f105c105280 2024-09-21T06:26:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.744+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c1a07f0 con 0x7f105c105280 2024-09-21T06:26:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.744+0000 7f1058ff9640 1 -- 172.21.15.38:0/2064015117 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1050031910 con 0x7f105c105280 2024-09-21T06:26:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.744+0000 7f1058ff9640 1 -- 172.21.15.38:0/2064015117 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050035070 con 0x7f105c105280 2024-09-21T06:26:28.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.744+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c1a6fb0 con 0x7f105c105280 2024-09-21T06:26:28.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f106860d740 1 Processor -- start 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f106860d740 1 -- start start 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f1058ff9640 1 -- 172.21.15.38:0/2064015117 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1050042030 con 0x7f105c105280 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f106860d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f106860d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.746+0000 7f106860d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e09390 0x55f7021d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f106860d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f702147ea0 con 0x55f701e011b0 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f106860d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7021372d0 con 0x55f701e2a070 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f106860d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f70213b0e0 con 0x55f701e09390 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33784/0 (socket says 172.21.15.38:33784) 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 -- 172.21.15.38:0/1020561653 learned_addr learned my addr 172.21.15.38:0/1020561653 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105bfff640 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105affd640 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e09390 0x55f7021d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 -- 172.21.15.38:0/1020561653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e09390 msgr2=0x55f7021d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e09390 0x55f7021d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 -- 172.21.15.38:0/1020561653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 msgr2=0x55f7021d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 -- 172.21.15.38:0/1020561653 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f701e95650 con 0x55f701e011b0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f1058ff9640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 0x7f10440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.747+0000 7f105b7fe640 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f104c00bcb0 tx=0x7f104c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5883c624847d5571 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.748+0000 7f105bfff640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 0x7f10440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.748+0000 7f1041ffb640 1 -- 172.21.15.38:0/1020561653 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c015070 con 0x55f701e011b0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.748+0000 7f1058ff9640 1 -- 172.21.15.38:0/2064015117 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f1050107ca0 con 0x7f105c105280 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.748+0000 7f1041ffb640 1 -- 172.21.15.38:0/1020561653 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f104c011910 con 0x55f701e011b0 2024-09-21T06:26:28.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.748+0000 7f1041ffb640 1 -- 172.21.15.38:0/1020561653 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c0109c0 con 0x55f701e011b0 2024-09-21T06:26:28.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- 172.21.15.38:0/1020561653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 msgr2=0x55f7021d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f105bfff640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 0x7f10440b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1054005fd0 tx=0x7f10540085b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f104c00bcb0 tx=0x7f104c00f730 comp rx=0 tx=0).stop 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- 172.21.15.38:0/1020561653 shutdown_connections 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e09390 0x55f7021d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e011b0 0x55f7021d1be0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 --2- 172.21.15.38:0/1020561653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- 172.21.15.38:0/1020561653 >> 172.21.15.38:0/1020561653 conn(0x55f701e1e460 msgr2=0x55f7021cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- 172.21.15.38:0/1020561653 shutdown_connections 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- 172.21.15.38:0/1020561653 wait complete. 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.749+0000 7f106860d740 1 -- start start 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 Processor -- start 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f701f98700 con 0x55f701e09390 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7020d2160 con 0x55f701e2a070 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f7021dfe80 con 0x55f701e011b0 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f106860d740 10 client.0 _ll_register_callbacks cb 0x55f7020eb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33790/0 (socket says 172.21.15.38:33790) 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 -- 172.21.15.38:0/2316936171 learned_addr learned my addr 172.21.15.38:0/2316936171 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105bfff640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 -- 172.21.15.38:0/2316936171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 msgr2=0x55f7021dcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021dcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 -- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 msgr2=0x55f7021dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.750+0000 7f105affd640 1 -- 172.21.15.38:0/2316936171 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7020ffc90 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f105affd640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1050000c00 tx=0x7f1050009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49c27d27d87f6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050049070 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f10500d70d0 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104c011910 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f10500cd490 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f106860d740 10 client.17238 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7021ebb50 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f104c011910 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f10500d2190 con 0x55f701e09390 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f106860d740 10 client.17238 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.751+0000 7f106860d740 10 client.17238 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f106860d740 20 client.17238 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:28.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701de89f0 0x55f7021eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f106860d740 4 client.17238 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f702149df0 con 0x55f701de89f0 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701de89f0 0x55f7021eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f103affd640 10 client.17238 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.752+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701de89f0 0x55f7021eeff0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=603d607bba1ec129 server_cookie=e298b10ca2c04dae in_seq=0 out_seq=0 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f103affd640 1 -- 172.21.15.38:0/2316936171 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f702149df0 con 0x55f701de89f0 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f103affd640 10 client.17238 handle_command_reply: tid=0 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f106860d740 1 client.17238 shutdown 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 msgr2=0x55f7021dd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1050000c00 tx=0x7f1050009620 comp rx=0 tx=0).stop 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 shutdown_connections 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.753+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701de89f0 0x55f7021eeff0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f103affd640 0 client.17238 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e2a070 0x55f7021dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021dd280 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 --2- 172.21.15.38:0/2316936171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 >> 172.21.15.38:0/2316936171 conn(0x55f701e1e460 msgr2=0x55f7021d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 shutdown_connections 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 1 -- 172.21.15.38:0/2316936171 wait complete. 2024-09-21T06:26:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.754+0000 7f106860d740 20 client.17238 trim_cache size 0 max 16384 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 Processor -- start 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 -- start start 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 0x55f7021d9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1b1ed0 con 0x55f701de89f0 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1af7a0 con 0x55f701e09390 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f106860d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1ad610 con 0x55f701e011b0 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f105b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f105b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33794/0 (socket says 172.21.15.38:33794) 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f105b7fe640 1 -- 172.21.15.38:0/2037831041 learned_addr learned my addr 172.21.15.38:0/2037831041 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.767+0000 7f105affd640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105bfff640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 0x55f7021d9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 -- 172.21.15.38:0/2037831041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 msgr2=0x55f7021d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 -- 172.21.15.38:0/2037831041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 msgr2=0x55f7021d9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 0x55f7021d9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 -- 172.21.15.38:0/2037831041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7021de000 con 0x55f701de89f0 2024-09-21T06:26:28.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105bfff640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 0x55f7021d9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:28.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f104c00bc80 tx=0x7f104c010500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942542e66403ada2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f10417fa640 1 -- 172.21.15.38:0/2037831041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c015040 con 0x55f701de89f0 2024-09-21T06:26:28.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f10417fa640 1 -- 172.21.15.38:0/2037831041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f104c005510 con 0x55f701de89f0 2024-09-21T06:26:28.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.768+0000 7f10417fa640 1 -- 172.21.15.38:0/2037831041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c010a90 con 0x55f701de89f0 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- 172.21.15.38:0/2037831041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 msgr2=0x55f7021d84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f104c00bc80 tx=0x7f104c010500 comp rx=0 tx=0).stop 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- 172.21.15.38:0/2037831041 shutdown_connections 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e09390 0x55f7021d9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701e011b0 0x55f7021d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 --2- 172.21.15.38:0/2037831041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701de89f0 0x55f7021d84f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- 172.21.15.38:0/2037831041 >> 172.21.15.38:0/2037831041 conn(0x55f701e1e460 msgr2=0x55f7021d26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- 172.21.15.38:0/2037831041 shutdown_connections 2024-09-21T06:26:28.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- 172.21.15.38:0/2037831041 wait complete. 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.769+0000 7f106860d740 1 -- start start 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 Processor -- start 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701de89f0 0x55f7021e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 0x55f7021e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1adc60 con 0x55f701e09390 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1af0d0 con 0x55f701e011b0 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f105c1ae330 con 0x55f701de89f0 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f106860d740 10 client.0 _ll_register_callbacks cb 0x7f1050005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f105bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f105bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33808/0 (socket says 172.21.15.38:33808) 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f105bfff640 1 -- 172.21.15.38:0/2200328318 learned_addr learned my addr 172.21.15.38:0/2200328318 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701de89f0 0x55f7021e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.770+0000 7f105affd640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 0x55f7021e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 -- 172.21.15.38:0/2200328318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701de89f0 msgr2=0x55f7021e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701de89f0 0x55f7021e57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 -- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 msgr2=0x55f7021e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 0x55f7021e0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 -- 172.21.15.38:0/2200328318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7021e17d0 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105affd640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 0x55f7021e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f105bfff640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f105401ff30 tx=0x7f1054004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5369d96b479416 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f103affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105401f270 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f105401e400 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104c005510 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f105401e600 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f106860d740 10 client.17244 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.771+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f702259840 con 0x55f701e09390 2024-09-21T06:26:28.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f104c005510 con 0x55f701e09390 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1054026070 con 0x55f701e09390 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 10 client.17244 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 10 client.17244 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 20 client.17244 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701e2a070 0x55f70225c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 4 client.17244 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7021458a0 con 0x55f701e2a070 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701e2a070 0x55f70225c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f105b7fe640 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701e2a070 0x55f70225c080 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8203a06570225d19 server_cookie=e97bdd53e013b7ea in_seq=0 out_seq=0 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.772+0000 7f103affd640 10 client.17244 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f103affd640 1 -- 172.21.15.38:0/2200328318 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7021458a0 con 0x55f701e2a070 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f103affd640 10 client.17244 handle_command_reply: tid=0 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 client.17244 shutdown 2024-09-21T06:26:28.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 msgr2=0x55f7021e1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f105401ff30 tx=0x7f1054004a40 comp rx=0 tx=0).stop 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 shutdown_connections 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f701e2a070 0x55f70225c080 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f701e09390 0x55f7021e1190 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f701e011b0 0x55f7021e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f103affd640 0 client.17244 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 --2- 172.21.15.38:0/2200328318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f701de89f0 0x55f7021e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 >> 172.21.15.38:0/2200328318 conn(0x55f701e1e460 msgr2=0x55f7021e8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 shutdown_connections 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 1 -- 172.21.15.38:0/2200328318 wait complete. 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.773+0000 7f106860d740 20 client.17244 trim_cache size 0 max 16384 2024-09-21T06:26:28.781 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 msgr2=0x7f10440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 0x7f10440b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1054005fd0 tx=0x7f10540085b0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 msgr2=0x7f105c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1050005940 tx=0x7f10500042f0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 shutdown_connections 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10440b6680 0x7f10440b8b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105c10de00 0x7f105c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f105c105280 0x7f105c19ab90 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 --2- 172.21.15.38:0/2064015117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f105c104850 0x7f105c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 >> 172.21.15.38:0/2064015117 conn(0x7f105c079710 msgr2=0x7f105c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 shutdown_connections 2024-09-21T06:26:28.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:28.774+0000 7f1062099640 1 -- 172.21.15.38:0/2064015117 wait complete. 2024-09-21T06:26:29.468 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:26:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:29 smithi174 ceph-mon[34815]: pgmap v525: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T06:26:29.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:29 smithi044 ceph-mon[34369]: pgmap v525: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T06:26:29.724 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:29.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:29 smithi038 ceph-mon[31215]: pgmap v525: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 -- 172.21.15.38:0/330327573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 msgr2=0x7f966410ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 --2- 172.21.15.38:0/330327573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966410ecf0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f965c009ca0 tx=0x7f965c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 -- 172.21.15.38:0/330327573 shutdown_connections 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 --2- 172.21.15.38:0/330327573 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966410ecf0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 --2- 172.21.15.38:0/330327573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664107b70 0x7f9664107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 --2- 172.21.15.38:0/330327573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664102230 0x7f9664102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 -- 172.21.15.38:0/330327573 >> 172.21.15.38:0/330327573 conn(0x7f9664079e40 msgr2=0x7f966407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 -- 172.21.15.38:0/330327573 shutdown_connections 2024-09-21T06:26:30.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.198+0000 7f96695ef640 1 -- 172.21.15.38:0/330327573 wait complete. 2024-09-21T06:26:30.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.199+0000 7f96695ef640 1 Processor -- start 2024-09-21T06:26:30.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.199+0000 7f96695ef640 1 -- start start 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102230 0x7f966419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664107b70 0x7f966419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96641122a0 con 0x7f96641084c0 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9664112120 con 0x7f9664107b70 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96695ef640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9664112420 con 0x7f9664102230 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39134/0 (socket says 172.21.15.38:39134) 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 -- 172.21.15.38:0/1439920297 learned_addr learned my addr 172.21.15.38:0/1439920297 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f9662ffd640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102230 0x7f966419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96627fc640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664107b70 0x7f966419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 -- 172.21.15.38:0/1439920297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102230 msgr2=0x7f966419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102230 0x7f966419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 -- 172.21.15.38:0/1439920297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664107b70 msgr2=0x7f966419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664107b70 0x7f966419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 -- 172.21.15.38:0/1439920297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96641a0470 con 0x7f96641084c0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.200+0000 7f96637fe640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f965c005e30 tx=0x7f965c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.201+0000 7f965bfff640 1 -- 172.21.15.38:0/1439920297 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c031650 con 0x7f96641084c0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.201+0000 7f965bfff640 1 -- 172.21.15.38:0/1439920297 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f965c0317f0 con 0x7f96641084c0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.201+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96641a0700 con 0x7f96641084c0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.201+0000 7f965bfff640 1 -- 172.21.15.38:0/1439920297 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c02fac0 con 0x7f96641084c0 2024-09-21T06:26:30.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.201+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96641a6f80 con 0x7f96641084c0 2024-09-21T06:26:30.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.203+0000 7f966fb63740 1 Processor -- start 2024-09-21T06:26:30.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f965bfff640 1 -- 172.21.15.38:0/1439920297 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f965c02fc60 con 0x7f96641084c0 2024-09-21T06:26:30.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 -- start start 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5633c9620ea0 con 0x5633c92e2390 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633c96102d0 con 0x5633c92da1b0 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f966fb63740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5633c96140e0 con 0x5633c9303070 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39148/0 (socket says 172.21.15.38:39148) 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.204+0000 7f96627fc640 1 -- 172.21.15.38:0/2184415595 learned_addr learned my addr 172.21.15.38:0/2184415595 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f9662ffd640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f965bfff640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 0x7f96500b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 -- 172.21.15.38:0/2184415595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 msgr2=0x5633c96aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 -- 172.21.15.38:0/2184415595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 msgr2=0x5633c96aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 -- 172.21.15.38:0/2184415595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c936e650 con 0x5633c92e2390 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f9662ffd640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96637fe640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 0x7f96500b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f965bfff640 1 -- 172.21.15.38:0/1439920297 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f965c108950 con 0x7f96641084c0 2024-09-21T06:26:30.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96627fc640 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f964c013920 tx=0x7f964c00e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d367818b1696a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96597fa640 1 -- 172.21.15.38:0/2184415595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c004020 con 0x5633c92e2390 2024-09-21T06:26:30.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96597fa640 1 -- 172.21.15.38:0/2184415595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f964c00bda0 con 0x5633c92e2390 2024-09-21T06:26:30.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.205+0000 7f96597fa640 1 -- 172.21.15.38:0/2184415595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c003850 con 0x5633c92e2390 2024-09-21T06:26:30.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 -- 172.21.15.38:0/2184415595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 msgr2=0x5633c96ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f96637fe640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 0x7f96500b8c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f965c0cba60 tx=0x7f965c03e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f964c013920 tx=0x7f964c00e430 comp rx=0 tx=0).stop 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 -- 172.21.15.38:0/2184415595 shutdown_connections 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96ab120 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 --2- 172.21.15.38:0/2184415595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.206+0000 7f966fb63740 1 -- 172.21.15.38:0/2184415595 >> 172.21.15.38:0/2184415595 conn(0x5633c92f7460 msgr2=0x5633c96a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- 172.21.15.38:0/2184415595 shutdown_connections 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- 172.21.15.38:0/2184415595 wait complete. 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- start start 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 Processor -- start 2024-09-21T06:26:30.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92e2390 0x5633c96b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5633c9471700 con 0x5633c9303070 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5633c95ab160 con 0x5633c92da1b0 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5633c96b8e80 con 0x5633c92e2390 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.207+0000 7f966fb63740 10 client.0 _ll_register_callbacks cb 0x5633c95c49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39158/0 (socket says 172.21.15.38:39158) 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 -- 172.21.15.38:0/431674814 learned_addr learned my addr 172.21.15.38:0/431674814 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f9662ffd640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92e2390 0x5633c96b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 -- 172.21.15.38:0/431674814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92e2390 msgr2=0x5633c96b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92e2390 0x5633c96b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 -- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 msgr2=0x5633c96b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 -- 172.21.15.38:0/431674814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c95d8c90 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f96627fc640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f964c001eb0 tx=0x7f964c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc31d78b67b77f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f964a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c00bad0 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f964c005020 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964c00bda0 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f964c005220 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.208+0000 7f966fb63740 10 client.17256 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633c96c4ce0 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f964c00bda0 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f964c0035f0 con 0x5633c9303070 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 10 client.17256 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:30.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 20 client.17256 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c92c19f0 0x5633c96c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 4 client.17256 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633c9622df0 con 0x5633c92c19f0 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.209+0000 7f9662ffd640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c92c19f0 0x5633c96c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.210+0000 7f9662ffd640 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c92c19f0 0x5633c96c80f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15fd33dcecf93a6 server_cookie=a8d9eae5d234113a in_seq=0 out_seq=0 2024-09-21T06:26:30.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.210+0000 7f964a7fc640 10 client.17256 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f964a7fc640 1 -- 172.21.15.38:0/431674814 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633c9622df0 con 0x5633c92c19f0 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f964a7fc640 10 client.17256 handle_command_reply: tid=0 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 client.17256 shutdown 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 msgr2=0x5633c96c2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f964c001eb0 tx=0x7f964c005850 comp rx=0 tx=0).stop 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 shutdown_connections 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c9303070 0x5633c96c2170 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c92c19f0 0x5633c96c80f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92e2390 0x5633c96b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 --2- 172.21.15.38:0/431674814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92da1b0 0x5633c96b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 >> 172.21.15.38:0/431674814 conn(0x5633c92f7460 msgr2=0x5633c96ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f964a7fc640 0 client.17256 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 shutdown_connections 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 1 -- 172.21.15.38:0/431674814 wait complete. 2024-09-21T06:26:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.211+0000 7f966fb63740 20 client.17256 trim_cache size 0 max 16384 2024-09-21T06:26:30.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.224+0000 7f966fb63740 1 Processor -- start 2024-09-21T06:26:30.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.224+0000 7f966fb63740 1 -- start start 2024-09-21T06:26:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 0x5633c96b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96641b1fe0 con 0x5633c92da1b0 2024-09-21T06:26:30.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96641af8b0 con 0x5633c92e2390 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f966fb63740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ad720 con 0x5633c9303070 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39164/0 (socket says 172.21.15.38:39164) 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 -- 172.21.15.38:0/3493341262 learned_addr learned my addr 172.21.15.38:0/3493341262 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f9662ffd640 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 0x5633c96b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 -- 172.21.15.38:0/3493341262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 msgr2=0x5633c96c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 -- 172.21.15.38:0/3493341262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 msgr2=0x5633c96b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 0x5633c96b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 -- 172.21.15.38:0/3493341262 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633c96b7170 con 0x5633c92da1b0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f9662ffd640 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 0x5633c96b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.225+0000 7f96627fc640 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ec30 tx=0x7f964c004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55490c3b088ebd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.226+0000 7f9658ff9640 1 -- 172.21.15.38:0/3493341262 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0053c0 con 0x5633c92da1b0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.226+0000 7f9658ff9640 1 -- 172.21.15.38:0/3493341262 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f964c005560 con 0x5633c92da1b0 2024-09-21T06:26:30.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.226+0000 7f9658ff9640 1 -- 172.21.15.38:0/3493341262 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c003db0 con 0x5633c92da1b0 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.226+0000 7f966fb63740 1 -- 172.21.15.38:0/3493341262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 msgr2=0x5633c96ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.226+0000 7f966fb63740 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f964c00ec30 tx=0x7f964c004050 comp rx=0 tx=0).stop 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 -- 172.21.15.38:0/3493341262 shutdown_connections 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c9303070 0x5633c96c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c92e2390 0x5633c96b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 --2- 172.21.15.38:0/3493341262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92da1b0 0x5633c96ac090 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 -- 172.21.15.38:0/3493341262 >> 172.21.15.38:0/3493341262 conn(0x5633c92f7460 msgr2=0x5633c96b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 -- 172.21.15.38:0/3493341262 shutdown_connections 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 -- 172.21.15.38:0/3493341262 wait complete. 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 -- start start 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.227+0000 7f966fb63740 1 Processor -- start 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92da1b0 0x5633c96be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c9303070 0x5633c96bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f96641add70 con 0x5633c92e2390 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96641af1e0 con 0x5633c9303070 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ae440 con 0x5633c92da1b0 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f966fb63740 10 client.0 _ll_register_callbacks cb 0x7f9654009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39168/0 (socket says 172.21.15.38:39168) 2024-09-21T06:26:30.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 -- 172.21.15.38:0/3134312197 learned_addr learned my addr 172.21.15.38:0/3134312197 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f96627fc640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c9303070 0x5633c96bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f96627fc640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92da1b0 0x5633c96be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 -- 172.21.15.38:0/3134312197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92da1b0 msgr2=0x5633c96be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92da1b0 0x5633c96be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 -- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c9303070 msgr2=0x5633c96bc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c9303070 0x5633c96bc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 -- 172.21.15.38:0/3134312197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633c96bc860 con 0x5633c92e2390 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f9662ffd640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9654000c00 tx=0x7f96540128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7336af9c49ea9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f964a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.228+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965402a060 con 0x5633c92e2390 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f9654004460 con 0x5633c92e2390 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964c005560 con 0x5633c92e2390 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9654003610 con 0x5633c92e2390 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 10 client.17262 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:30.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633c9732810 con 0x5633c92e2390 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f964c005560 con 0x5633c92e2390 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f965401fb70 con 0x5633c92e2390 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 10 client.17262 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 20 client.17262 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c9296da0 0x5633c9734fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 4 client.17262 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633c961e8a0 con 0x5633c9296da0 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.229+0000 7f96627fc640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c9296da0 0x5633c9734fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f96627fc640 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c9296da0 0x5633c9734fb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4fa530c48f9cf9 server_cookie=870d3daa50642736 in_seq=0 out_seq=0 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f964a7fc640 10 client.17262 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f964a7fc640 1 -- 172.21.15.38:0/3134312197 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633c961e8a0 con 0x5633c9296da0 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f964a7fc640 10 client.17262 handle_command_reply: tid=0 2024-09-21T06:26:30.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 client.17262 shutdown 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 msgr2=0x5633c96bbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9654000c00 tx=0x7f96540128e0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 shutdown_connections 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5633c9303070 0x5633c96bc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5633c92e2390 0x5633c96bbc80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5633c9296da0 0x5633c9734fb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 --2- 172.21.15.38:0/3134312197 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633c92da1b0 0x5633c96be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f964a7fc640 0 client.17262 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 >> 172.21.15.38:0/3134312197 conn(0x5633c92f7460 msgr2=0x5633c96b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 shutdown_connections 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 1 -- 172.21.15.38:0/3134312197 wait complete. 2024-09-21T06:26:30.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.230+0000 7f966fb63740 20 client.17262 trim_cache size 0 max 16384 2024-09-21T06:26:30.238 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:30.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 msgr2=0x7f96500b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 0x7f96500b8c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f965c0cba60 tx=0x7f965c03e040 comp rx=0 tx=0).stop 2024-09-21T06:26:30.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 msgr2=0x7f966419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f965c005e30 tx=0x7f965c003d80 comp rx=0 tx=0).stop 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 shutdown_connections 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f96500b6730 0x7f96500b8c40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96641084c0 0x7f966419fe00 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9664107b70 0x7f966419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 --2- 172.21.15.38:0/1439920297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664102230 0x7f966419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 >> 172.21.15.38:0/1439920297 conn(0x7f9664079e40 msgr2=0x7f9664100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 shutdown_connections 2024-09-21T06:26:30.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:30.231+0000 7f96695ef640 1 -- 172.21.15.38:0/1439920297 wait complete. 2024-09-21T06:26:31.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:31 smithi174 ceph-mon[34815]: pgmap v526: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:31.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:31 smithi044 ceph-mon[34369]: pgmap v526: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:31 smithi038 ceph-mon[31215]: pgmap v526: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:31.869 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:31.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:32.143 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:32.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1979174065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 msgr2=0x7f3dc8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1979174065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc8102ef0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009900 tx=0x7f3db802a410 comp rx=0 tx=0).stop 2024-09-21T06:26:32.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1979174065 shutdown_connections 2024-09-21T06:26:32.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1979174065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 0x7f3dc810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1979174065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1979174065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc8102ef0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1979174065 >> 172.21.15.38:0/1979174065 conn(0x7f3dc80797b0 msgr2=0x7f3dc8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1979174065 shutdown_connections 2024-09-21T06:26:32.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.606+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1979174065 wait complete. 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.607+0000 7f3dcca0e640 1 Processor -- start 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.607+0000 7f3dcca0e640 1 -- start start 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 0x7f3dc819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8112b20 con 0x7f3dc8102ae0 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81129a0 con 0x7f3dc81083d0 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dcca0e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8112ca0 con 0x7f3dc8108d20 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39200/0 (socket says 172.21.15.38:39200) 2024-09-21T06:26:32.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 -- 172.21.15.38:0/1616454093 learned_addr learned my addr 172.21.15.38:0/1616454093 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dbffff640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 0x7f3dc819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 -- 172.21.15.38:0/1616454093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 msgr2=0x7f3dc819fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 0x7f3dc819fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 -- 172.21.15.38:0/1616454093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 msgr2=0x7f3dc819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dc659c640 1 -- 172.21.15.38:0/1616454093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc81a05d0 con 0x7f3dc8102ae0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.608+0000 7f3dbffff640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dc659c640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3db8005ab0 tx=0x7f3db80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dbf7fe640 1 -- 172.21.15.38:0/1616454093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db803f030 con 0x7f3dc8102ae0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dbf7fe640 1 -- 172.21.15.38:0/1616454093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3db8003ac0 con 0x7f3dc8102ae0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc81a0860 con 0x7f3dc8102ae0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dbf7fe640 1 -- 172.21.15.38:0/1616454093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8035070 con 0x7f3dc8102ae0 2024-09-21T06:26:32.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.609+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc81a7020 con 0x7f3dc8102ae0 2024-09-21T06:26:32.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.612+0000 7f3dd2f82740 1 Processor -- start 2024-09-21T06:26:32.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 -- start start 2024-09-21T06:26:32.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66894c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66894ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a6688c2e60 con 0x55a6685a5350 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a6688b2290 con 0x55a668584670 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a6688b60a0 con 0x55a66857c490 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dbf7fe640 1 -- 172.21.15.38:0/1616454093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3db8042030 con 0x7f3dc8102ae0 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39210/0 (socket says 172.21.15.38:39210) 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/3890840838 learned_addr learned my addr 172.21.15.38:0/3890840838 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.613+0000 7f3dbffff640 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66894ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc659c640 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66894c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/3890840838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 msgr2=0x55a66894c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66894c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/3890840838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 msgr2=0x55a66894ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66894ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/3890840838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a668610930 con 0x55a6685a5350 2024-09-21T06:26:32.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009f50 tx=0x7f3dc00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc16060843b12cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dbcff9640 1 -- 172.21.15.38:0/3890840838 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0004d20 con 0x55a6685a5350 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dbcff9640 1 -- 172.21.15.38:0/3890840838 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3dc0004050 con 0x55a6685a5350 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dbcff9640 1 -- 172.21.15.38:0/3890840838 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0005240 con 0x55a6685a5350 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.614+0000 7f3dbf7fe640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dc659c640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dbf7fe640 1 -- 172.21.15.38:0/1616454093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f3db8107d90 con 0x7f3dc8102ae0 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dc659c640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 0x7f3db40b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3db81055e0 tx=0x7f3db8035000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 -- 172.21.15.38:0/3890840838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 msgr2=0x55a66894c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009f50 tx=0x7f3dc00118d0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 -- 172.21.15.38:0/3890840838 shutdown_connections 2024-09-21T06:26:32.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66894ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66894c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/3890840838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a66894c430 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.615+0000 7f3dd2f82740 1 -- 172.21.15.38:0/3890840838 >> 172.21.15.38:0/3890840838 conn(0x55a668599740 msgr2=0x55a66894a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.616+0000 7f3dd2f82740 1 -- 172.21.15.38:0/3890840838 shutdown_connections 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.616+0000 7f3dd2f82740 1 -- 172.21.15.38:0/3890840838 wait complete. 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.616+0000 7f3dd2f82740 1 -- start start 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.616+0000 7f3dd2f82740 1 Processor -- start 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.616+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a66857c490 0x55a668957fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6685a5350 0x55a668963f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a668713890 con 0x55a668584670 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a66884cd40 con 0x55a66857c490 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a66895ac10 con 0x55a6685a5350 2024-09-21T06:26:32.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dd2f82740 10 client.0 _ll_register_callbacks cb 0x55a6688b0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39212/0 (socket says 172.21.15.38:39212) 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 -- 172.21.15.38:0/4260955018 learned_addr learned my addr 172.21.15.38:0/4260955018 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a66857c490 0x55a668957fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6685a5350 0x55a668963f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 -- 172.21.15.38:0/4260955018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6685a5350 msgr2=0x55a668963f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6685a5350 0x55a668963f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 -- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a66857c490 msgr2=0x55a668957fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a66857c490 0x55a668957fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 -- 172.21.15.38:0/4260955018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6689644c0 con 0x55a668584670 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dbffff640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3db0012d50 tx=0x7f3db000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e204496386d378f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.617+0000 7f3dadffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:32.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0012110 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc0004050 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f3db0004050 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3db00122b0 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 10 client.17274 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a668966e50 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3dc0004050 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3db0026480 con 0x55a668584670 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 10 client.17274 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 20 client.17274 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668563cd0 0x55a66896a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 4 client.17274 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.618+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6688c4db0 con 0x55a668563cd0 2024-09-21T06:26:32.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.619+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668563cd0 0x55a66896a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.619+0000 7f3dadffb640 10 client.17274 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:32.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.619+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668563cd0 0x55a66896a6f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e601d51d6fe107 server_cookie=acbc139c2c693d77 in_seq=0 out_seq=0 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dadffb640 1 -- 172.21.15.38:0/4260955018 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a6688c4db0 con 0x55a668563cd0 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dadffb640 10 client.17274 handle_command_reply: tid=0 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 client.17274 shutdown 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 msgr2=0x55a668958520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3db0012d50 tx=0x7f3db000f790 comp rx=0 tx=0).stop 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 shutdown_connections 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668563cd0 0x55a66896a6f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6685a5350 0x55a668963f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a668584670 0x55a668958520 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dadffb640 0 client.17274 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/4260955018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a66857c490 0x55a668957fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.620+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 >> 172.21.15.38:0/4260955018 conn(0x55a668599740 msgr2=0x55a66894f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.621+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 shutdown_connections 2024-09-21T06:26:32.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.621+0000 7f3dd2f82740 1 -- 172.21.15.38:0/4260955018 wait complete. 2024-09-21T06:26:32.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.621+0000 7f3dd2f82740 20 client.17274 trim_cache size 0 max 16384 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 Processor -- start 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 -- start start 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a668953590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a668952550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81b2020 con 0x55a6685a5350 2024-09-21T06:26:32.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81af8f0 con 0x55a668584670 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81ad760 con 0x55a66857c490 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39222/0 (socket says 172.21.15.38:39222) 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/310844936 learned_addr learned my addr 172.21.15.38:0/310844936 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dbffff640 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a668952550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.659+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a668953590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/310844936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 msgr2=0x55a668953590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a668953590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/310844936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 msgr2=0x55a668952550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a668952550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/310844936 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a668944520 con 0x55a6685a5350 2024-09-21T06:26:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0011dd0 tx=0x7f3dc0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf35c649ca2cfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3daffff640 1 -- 172.21.15.38:0/310844936 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0003ed0 con 0x55a6685a5350 2024-09-21T06:26:32.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3daffff640 1 -- 172.21.15.38:0/310844936 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3dc0004300 con 0x55a6685a5350 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.660+0000 7f3daffff640 1 -- 172.21.15.38:0/310844936 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0027b70 con 0x55a6685a5350 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 -- 172.21.15.38:0/310844936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 msgr2=0x55a668959a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0011dd0 tx=0x7f3dc0009500 comp rx=0 tx=0).stop 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 -- 172.21.15.38:0/310844936 shutdown_connections 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a668959a10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a668952550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/310844936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a668953590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 -- 172.21.15.38:0/310844936 >> 172.21.15.38:0/310844936 conn(0x55a668599740 msgr2=0x55a668959300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 -- 172.21.15.38:0/310844936 shutdown_connections 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.661+0000 7f3dd2f82740 1 -- 172.21.15.38:0/310844936 wait complete. 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 -- start start 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 Processor -- start 2024-09-21T06:26:32.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66895c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66895cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81addb0 con 0x55a6685a5350 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81af220 con 0x55a668584670 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc81ae480 con 0x55a66857c490 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dd2f82740 10 client.0 _ll_register_callbacks cb 0x7f3db0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dc6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39228/0 (socket says 172.21.15.38:39228) 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/469282265 learned_addr learned my addr 172.21.15.38:0/469282265 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66895c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.662+0000 7f3dbffff640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66895cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/469282265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 msgr2=0x55a66895c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66895c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 msgr2=0x55a66895cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66895cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 -- 172.21.15.38:0/469282265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6689ce730 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dbffff640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66895cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dc6d9d640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0004500 tx=0x7f3dc0005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd69c4cb004a26df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dadffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0041060 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f3dc0004830 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc0004300 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3dc0003f90 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dd2f82740 10 client.17280 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.663+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a6689d5a90 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3dc0004300 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc003a040 con 0x55a6685a5350 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 10 client.17280 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:32.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:32.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 20 client.17280 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:32.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668539080 0x55a6689d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:32.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 4 client.17280 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:32.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a6688c0860 con 0x55a668539080 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.664+0000 7f3dbffff640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668539080 0x55a6689d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.665+0000 7f3dadffb640 10 client.17280 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.665+0000 7f3dbffff640 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668539080 0x55a6689d7fe0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87940af1f2675691 server_cookie=4730594f51ae8d74 in_seq=0 out_seq=0 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.666+0000 7f3dadffb640 1 -- 172.21.15.38:0/469282265 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a6688c0860 con 0x55a668539080 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.666+0000 7f3dadffb640 10 client.17280 handle_command_reply: tid=0 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.666+0000 7f3dd2f82740 1 client.17280 shutdown 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 msgr2=0x55a6689ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0004500 tx=0x7f3dc0005cf0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 shutdown_connections 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6685a5350 0x55a6689ce0c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a668584670 0x55a66895cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a668539080 0x55a6689d7fe0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 --2- 172.21.15.38:0/469282265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a66857c490 0x55a66895c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 >> 172.21.15.38:0/469282265 conn(0x55a668599740 msgr2=0x55a66894dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dadffb640 0 client.17280 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 shutdown_connections 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 1 -- 172.21.15.38:0/469282265 wait complete. 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.667+0000 7f3dd2f82740 20 client.17280 trim_cache size 0 max 16384 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:32.672 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "44214bd5-b452-43e8-8096-757e3e46aa97", 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 msgr2=0x7f3db40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 0x7f3db40b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3db81055e0 tx=0x7f3db8035000 comp rx=0 tx=0).stop 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 msgr2=0x7f3dc819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3db8005ab0 tx=0x7f3db80040c0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 shutdown_connections 2024-09-21T06:26:32.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f3db40b6680 0x7f3db40b8b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3dc8108d20 0x7f3dc819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3dc81083d0 0x7f3dc819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 --2- 172.21.15.38:0/1616454093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3dc8102ae0 0x7f3dc819a660 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 >> 172.21.15.38:0/1616454093 conn(0x7f3dc80797b0 msgr2=0x7f3dc8101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 shutdown_connections 2024-09-21T06:26:32.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:32.668+0000 7f3dcca0e640 1 -- 172.21.15.38:0/1616454093 wait complete. 2024-09-21T06:26:33.311 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:33.578 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: pgmap v527: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:33 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: pgmap v527: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:33 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: pgmap v527: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:33.687 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:33 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 -- 172.21.15.38:0/4030497686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a810deb0 msgr2=0x7fd6a8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/4030497686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a810deb0 0x7fd6a8110330 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009ca0 tx=0x7fd6a002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 -- 172.21.15.38:0/4030497686 shutdown_connections 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/4030497686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a810deb0 0x7fd6a8110330 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/4030497686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/4030497686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a8104900 0x7fd6a8104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 -- 172.21.15.38:0/4030497686 >> 172.21.15.38:0/4030497686 conn(0x7fd6a8079760 msgr2=0x7fd6a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 -- 172.21.15.38:0/4030497686 shutdown_connections 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.019+0000 7fd6ade1b640 1 -- 172.21.15.38:0/4030497686 wait complete. 2024-09-21T06:26:34.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 Processor -- start 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 -- start start 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 0x7fd6a819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8113be0 con 0x7fd6a8104900 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8113a60 con 0x7fd6a810deb0 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6ade1b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8113d60 con 0x7fd6a8105250 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39254/0 (socket says 172.21.15.38:39254) 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.020+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2892936669 learned_addr learned my addr 172.21.15.38:0/2892936669 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 0x7fd6a819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2892936669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 msgr2=0x7fd6a819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2892936669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 msgr2=0x7fd6a819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 0x7fd6a819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2892936669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a81a04e0 con 0x7fd6a8104900 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 0x7fd6a819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c970 tx=0x7fd69800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a4ff9640 1 -- 172.21.15.38:0/2892936669 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698004220 con 0x7fd6a8104900 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a4ff9640 1 -- 172.21.15.38:0/2892936669 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd6980043c0 con 0x7fd6a8104900 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a81a07d0 con 0x7fd6a8104900 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6a4ff9640 1 -- 172.21.15.38:0/2892936669 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800f450 con 0x7fd6a8104900 2024-09-21T06:26:34.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.021+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a81a6f30 con 0x7fd6a8104900 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 Processor -- start 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 -- start start 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6a4ff9640 1 -- 172.21.15.38:0/2892936669 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd698003730 con 0x7fd6a8104900 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x56178706e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178706f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561786fe4e50 con 0x561786c9e1b0 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561786fd4280 con 0x561786ca6390 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6b438f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561786fd8090 con 0x561786cc7070 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.024+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39266/0 (socket says 172.21.15.38:39266) 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 -- 172.21.15.38:0/619258075 learned_addr learned my addr 172.21.15.38:0/619258075 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:34.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x56178706e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178706f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 -- 172.21.15.38:0/619258075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 msgr2=0x56178706e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x56178706e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 -- 172.21.15.38:0/619258075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 msgr2=0x56178706f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178706f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 -- 172.21.15.38:0/619258075 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561786d32650 con 0x561786c9e1b0 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e4b90 tx=0x7fd6980edbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5c580051ba1377 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.025+0000 7fd6a4ff9640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 0x7fd6900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.026+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 0x7fd6900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.026+0000 7fd68dffb640 1 -- 172.21.15.38:0/619258075 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6980fa070 con 0x561786c9e1b0 2024-09-21T06:26:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.026+0000 7fd68dffb640 1 -- 172.21.15.38:0/619258075 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd6980ace30 con 0x561786c9e1b0 2024-09-21T06:26:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.026+0000 7fd68dffb640 1 -- 172.21.15.38:0/619258075 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6980aca90 con 0x561786c9e1b0 2024-09-21T06:26:34.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.026+0000 7fd6a4ff9640 1 -- 172.21.15.38:0/2892936669 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd6980e7480 con 0x7fd6a8104900 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- 172.21.15.38:0/619258075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 msgr2=0x56178706eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e4b90 tx=0x7fd6980edbd0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 0x7fd6900b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00094e0 tx=0x7fd6a0009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- 172.21.15.38:0/619258075 shutdown_connections 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178706f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178706eb90 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 --2- 172.21.15.38:0/619258075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x56178706e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- 172.21.15.38:0/619258075 >> 172.21.15.38:0/619258075 conn(0x561786cbb460 msgr2=0x56178706c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- 172.21.15.38:0/619258075 shutdown_connections 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- 172.21.15.38:0/619258075 wait complete. 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 -- start start 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.027+0000 7fd6b438f740 1 Processor -- start 2024-09-21T06:26:34.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786c9e1b0 0x561787079d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786cc7070 0x56178708a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561786e35700 con 0x561786ca6390 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561786f6f110 con 0x561786cc7070 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561787081240 con 0x561786c9e1b0 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6b438f740 10 client.0 _ll_register_callbacks cb 0x561786f88990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39270/0 (socket says 172.21.15.38:39270) 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 -- 172.21.15.38:0/3230297390 learned_addr learned my addr 172.21.15.38:0/3230297390 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786cc7070 0x56178708a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786c9e1b0 0x561787079d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 -- 172.21.15.38:0/3230297390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786c9e1b0 msgr2=0x561787079d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786c9e1b0 0x561787079d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 -- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786cc7070 msgr2=0x56178708a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786cc7070 0x56178708a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.028+0000 7fd6a6ffd640 1 -- 172.21.15.38:0/3230297390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561786f9cc40 con 0x561786ca6390 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00f670 tx=0x7fd69c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c11a0a8c24f5ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c016070 con 0x561786ca6390 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd69c00bb00 con 0x561786ca6390 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6980ace30 con 0x561786ca6390 2024-09-21T06:26:34.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd69c00bd00 con 0x561786ca6390 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd6b438f740 10 client.17292 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56178708cf80 con 0x561786ca6390 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd6980ace30 con 0x561786ca6390 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.029+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd69c01a490 con 0x561786ca6390 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 10 client.17292 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 20 client.17292 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c859f0 0x5617870905b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 4 client.17292 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561786fe6da0 con 0x561786c859f0 2024-09-21T06:26:34.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c859f0 0x5617870905b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd686ffd640 10 client.17292 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.030+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c859f0 0x5617870905b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f97bf2048d0f55 server_cookie=78d49823374fe8f3 in_seq=0 out_seq=0 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd686ffd640 1 -- 172.21.15.38:0/3230297390 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561786fe6da0 con 0x561786c859f0 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd686ffd640 10 client.17292 handle_command_reply: tid=0 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 client.17292 shutdown 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 msgr2=0x56178707a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00f670 tx=0x7fd69c00fb30 comp rx=0 tx=0).stop 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 shutdown_connections 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786cc7070 0x56178708a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786ca6390 0x56178707a240 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c859f0 0x5617870905b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 --2- 172.21.15.38:0/3230297390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786c9e1b0 0x561787079d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 >> 172.21.15.38:0/3230297390 conn(0x561786cbb460 msgr2=0x5617870717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd686ffd640 0 client.17292 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:34.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.031+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 shutdown_connections 2024-09-21T06:26:34.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.033+0000 7fd6b438f740 1 -- 172.21.15.38:0/3230297390 wait complete. 2024-09-21T06:26:34.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.033+0000 7fd6b438f740 20 client.17292 trim_cache size 0 max 16384 2024-09-21T06:26:34.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 Processor -- start 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 -- start start 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178708a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81afe10 con 0x561786c9e1b0 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ad6e0 con 0x561786ca6390 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.049+0000 7fd6b438f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ab550 con 0x561786cc7070 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39276/0 (socket says 172.21.15.38:39276) 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2435898476 learned_addr learned my addr 172.21.15.38:0/2435898476 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:34.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178708a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2435898476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 msgr2=0x561787076ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2435898476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 msgr2=0x56178708a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178708a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 -- 172.21.15.38:0/2435898476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56178707ada0 con 0x561786c9e1b0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e4cd0 tx=0x7fd698003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f81f2bdfaea56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd68d7fa640 1 -- 172.21.15.38:0/2435898476 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69801d040 con 0x561786c9e1b0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd68d7fa640 1 -- 172.21.15.38:0/2435898476 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd69801fe70 con 0x561786c9e1b0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.050+0000 7fd68d7fa640 1 -- 172.21.15.38:0/2435898476 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698014470 con 0x561786c9e1b0 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 -- 172.21.15.38:0/2435898476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 msgr2=0x56178707a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e4cd0 tx=0x7fd698003ad0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 -- 172.21.15.38:0/2435898476 shutdown_connections 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787076ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x56178708a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 --2- 172.21.15.38:0/2435898476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x56178707a1c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 -- 172.21.15.38:0/2435898476 >> 172.21.15.38:0/2435898476 conn(0x561786cbb460 msgr2=0x561787079ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 -- 172.21.15.38:0/2435898476 shutdown_connections 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.051+0000 7fd6b438f740 1 -- 172.21.15.38:0/2435898476 wait complete. 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 -- start start 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 Processor -- start 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x561787082990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787082ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81abba0 con 0x561786c9e1b0 2024-09-21T06:26:34.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ad010 con 0x561786ca6390 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81ac270 con 0x561786cc7070 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6b438f740 10 client.0 _ll_register_callbacks cb 0x7fd69c00d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6a77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39278/0 (socket says 172.21.15.38:39278) 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6a77fe640 1 -- 172.21.15.38:0/507487309 learned_addr learned my addr 172.21.15.38:0/507487309 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6a7fff640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787082ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.052+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x561787082990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 -- 172.21.15.38:0/507487309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 msgr2=0x561787082ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787082ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 -- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 msgr2=0x561787082990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x561787082990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 -- 172.21.15.38:0/507487309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617870f9f70 con 0x561786c9e1b0 2024-09-21T06:26:34.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6a77fe640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd6980149b0 tx=0x7fd6980ad200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b3e6ce531cce98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd686ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69801d070 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fd698014d60 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69801fe70 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd6980147f0 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6b438f740 10 client.17298 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5617870fb1b0 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.053+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd69801fe70 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd6980a9590 con 0x561786c9e1b0 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 10 client.17298 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 20 client.17298 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:34.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c5ada0 0x5617870fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 4 client.17298 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561786fe2850 con 0x561786c5ada0 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c5ada0 0x5617870fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd686ffd640 10 client.17298 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.054+0000 7fd6a6ffd640 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c5ada0 0x5617870fd3e0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483512b507eb57fc server_cookie=20e5556e5d02a0d6 in_seq=0 out_seq=0 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd686ffd640 1 -- 172.21.15.38:0/507487309 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x561786fe2850 con 0x561786c5ada0 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd686ffd640 10 client.17298 handle_command_reply: tid=0 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 client.17298 shutdown 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 msgr2=0x561787082450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd6980149b0 tx=0x7fd6980ad200 comp rx=0 tx=0).stop 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 shutdown_connections 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561786c5ada0 0x5617870fd3e0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561786cc7070 0x561787082ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561786ca6390 0x561787082990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 --2- 172.21.15.38:0/507487309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561786c9e1b0 0x561787082450 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 >> 172.21.15.38:0/507487309 conn(0x561786cbb460 msgr2=0x56178706f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd686ffd640 0 client.17298 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 shutdown_connections 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 1 -- 172.21.15.38:0/507487309 wait complete. 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6b438f740 20 client.17298 trim_cache size 0 max 16384 2024-09-21T06:26:34.064 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:34.065 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.067 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.068 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.069 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.070 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.072 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:34.073 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 msgr2=0x7fd6900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 0x7fd6900b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00094e0 tx=0x7fd6a0009360 comp rx=0 tx=0).stop 2024-09-21T06:26:34.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 msgr2=0x7fd6a819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c970 tx=0x7fd69800ce30 comp rx=0 tx=0).stop 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 shutdown_connections 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd6900b6680 0x7fd6900b8b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6a810deb0 0x7fd6a819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6a8105250 0x7fd6a819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 --2- 172.21.15.38:0/2892936669 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd6a8104900 0x7fd6a819a570 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 >> 172.21.15.38:0/2892936669 conn(0x7fd6a8079760 msgr2=0x7fd6a8105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 shutdown_connections 2024-09-21T06:26:34.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:34.056+0000 7fd6ade1b640 1 -- 172.21.15.38:0/2892936669 wait complete. 2024-09-21T06:26:34.821 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:34.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:35.082 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:35 smithi038 ceph-mon[31215]: pgmap v528: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 -- 172.21.15.38:0/125754462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29481094a0 msgr2=0x7f29481098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 --2- 172.21.15.38:0/125754462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29481094a0 0x7f29481098b0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2930009900 tx=0x7f293002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 -- 172.21.15.38:0/125754462 shutdown_connections 2024-09-21T06:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 --2- 172.21.15.38:0/125754462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948109df0 0x7f2948110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 --2- 172.21.15.38:0/125754462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29481094a0 0x7f29481098b0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 --2- 172.21.15.38:0/125754462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2948103b60 0x7f2948103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 -- 172.21.15.38:0/125754462 >> 172.21.15.38:0/125754462 conn(0x7f294807b850 msgr2=0x7f294807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 -- 172.21.15.38:0/125754462 shutdown_connections 2024-09-21T06:26:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.604+0000 7f294d45a640 1 -- 172.21.15.38:0/125754462 wait complete. 2024-09-21T06:26:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 Processor -- start 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 -- start start 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948103b60 0x7f2948075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29481094a0 0x7f2948075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113bd0 con 0x7f2948109df0 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113a50 con 0x7f29481094a0 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f294d45a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2948113d50 con 0x7f2948103b60 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f29477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f29477fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39294/0 (socket says 172.21.15.38:39294) 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.605+0000 7f29477fe640 1 -- 172.21.15.38:0/2670054750 learned_addr learned my addr 172.21.15.38:0/2670054750 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f293ffff640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29481094a0 0x7f2948075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f2946ffd640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948103b60 0x7f2948075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 -- 172.21.15.38:0/2670054750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948103b60 msgr2=0x7f2948075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948103b60 0x7f2948075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 -- 172.21.15.38:0/2670054750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29481094a0 msgr2=0x7f2948075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29481094a0 0x7f2948075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 -- 172.21.15.38:0/2670054750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29481a88e0 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f29477fe640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f294000eaa0 tx=0x7f294000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294000cdb0 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29481a8bd0 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2940005020 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29400116d0 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.606+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481a9090 con 0x7f2948109df0 2024-09-21T06:26:35.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.607+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2948103f70 con 0x7f2948109df0 2024-09-21T06:26:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.609+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f29400051d0 con 0x7f2948109df0 2024-09-21T06:26:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.609+0000 7f2944ff9640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 0x7f29340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.610+0000 7f2946ffd640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 0x7f29340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.610+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f29400e7cc0 con 0x7f2948109df0 2024-09-21T06:26:35.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.610+0000 7f2946ffd640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 0x7f29340b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2938005fd0 tx=0x7f2938005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:35.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.613+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2940016030 con 0x7f2948109df0 2024-09-21T06:26:35.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:35 smithi174 ceph-mon[34815]: pgmap v528: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:35 smithi044 ceph-mon[34369]: pgmap v528: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.838+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2948076a10 con 0x7f2948109df0 2024-09-21T06:26:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.839+0000 7f2944ff9640 1 -- 172.21.15.38:0/2670054750 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f2948076a10 con 0x7f2948109df0 2024-09-21T06:26:35.841 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:35.841 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 msgr2=0x7f29340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 0x7f29340b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2938005fd0 tx=0x7f2938005850 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 msgr2=0x7f2948076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f294000eaa0 tx=0x7f294000ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 shutdown_connections 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f29340b6680 0x7f29340b8b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2948109df0 0x7f2948076190 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29481094a0 0x7f2948075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 --2- 172.21.15.38:0/2670054750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2948103b60 0x7f2948075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 >> 172.21.15.38:0/2670054750 conn(0x7f294807b850 msgr2=0x7f2948107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 shutdown_connections 2024-09-21T06:26:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:35.841+0000 7f294d45a640 1 -- 172.21.15.38:0/2670054750 wait complete. 2024-09-21T06:26:36.407 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:36 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2670054750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:36.438 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:36.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:36 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2670054750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:36.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:36 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2670054750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:36.698 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 -- 172.21.15.38:0/3490407840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078108b00 msgr2=0x7fa07810f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 --2- 172.21.15.38:0/3490407840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078108b00 0x7fa07810f330 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa070009ca0 tx=0x7fa07002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 -- 172.21.15.38:0/3490407840 shutdown_connections 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 --2- 172.21.15.38:0/3490407840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078108b00 0x7fa07810f330 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 --2- 172.21.15.38:0/3490407840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 0x7fa0781085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 --2- 172.21.15.38:0/3490407840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078102870 0x7fa078102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 -- 172.21.15.38:0/3490407840 >> 172.21.15.38:0/3490407840 conn(0x7fa0780fe2c0 msgr2=0x7fa078100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 -- 172.21.15.38:0/3490407840 shutdown_connections 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.169+0000 7fa07759e640 1 -- 172.21.15.38:0/3490407840 wait complete. 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 Processor -- start 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 -- start start 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 0x7fa078199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078108b00 0x7fa07819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa078112910 con 0x7fa078102870 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa078112790 con 0x7fa0781081b0 2024-09-21T06:26:37.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07759e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa078112a90 con 0x7fa078108b00 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.170+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39320/0 (socket says 172.21.15.38:39320) 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 -- 172.21.15.38:0/2675834918 learned_addr learned my addr 172.21.15.38:0/2675834918 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa076d9d640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078108b00 0x7fa07819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa06ffff640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 0x7fa078199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 -- 172.21.15.38:0/2675834918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078108b00 msgr2=0x7fa07819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078108b00 0x7fa07819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 -- 172.21.15.38:0/2675834918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 msgr2=0x7fa078199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 0x7fa078199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 -- 172.21.15.38:0/2675834918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07819f230 con 0x7fa078102870 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07659c640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa06800d770 tx=0x7fa06800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa06f7fe640 1 -- 172.21.15.38:0/2675834918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068017070 con 0x7fa078102870 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa06f7fe640 1 -- 172.21.15.38:0/2675834918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa0680054f0 con 0x7fa078102870 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07819f520 con 0x7fa078102870 2024-09-21T06:26:37.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa06f7fe640 1 -- 172.21.15.38:0/2675834918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068004de0 con 0x7fa078102870 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.171+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07806ae60 con 0x7fa078102870 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.174+0000 7fa082f78740 1 Processor -- start 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.174+0000 7fa082f78740 1 -- start start 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.174+0000 7fa06f7fe640 1 -- 172.21.15.38:0/2675834918 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa068004f80 con 0x7fa078102870 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b9b353ea0 con 0x561b9b00d1b0 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b9b3432d0 con 0x561b9b036070 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa082f78740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b9b3470e0 con 0x561b9b015390 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39324/0 (socket says 172.21.15.38:39324) 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 -- 172.21.15.38:0/2985357744 learned_addr learned my addr 172.21.15.38:0/2985357744 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:37.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa06ffff640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa076d9d640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 -- 172.21.15.38:0/2985357744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 msgr2=0x561b9b3ddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ddee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 -- 172.21.15.38:0/2985357744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 msgr2=0x561b9b3dd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3dd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 -- 172.21.15.38:0/2985357744 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9b0a1650 con 0x561b9b00d1b0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa076d9d640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3dd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa06f7fe640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 0x7fa0640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.175+0000 7fa07659c640 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa0680e49c0 tx=0x7fa0680ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2470103be0ecfc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.176+0000 7fa076d9d640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 0x7fa0640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.176+0000 7fa06f7fe640 1 -- 172.21.15.38:0/2675834918 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa0680e72b0 con 0x7fa078102870 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.176+0000 7fa06cff9640 1 -- 172.21.15.38:0/2985357744 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680a97a0 con 0x561b9b00d1b0 2024-09-21T06:26:37.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.176+0000 7fa06cff9640 1 -- 172.21.15.38:0/2985357744 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa0680acc60 con 0x561b9b00d1b0 2024-09-21T06:26:37.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.176+0000 7fa06cff9640 1 -- 172.21.15.38:0/2985357744 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680ac8c0 con 0x561b9b00d1b0 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- 172.21.15.38:0/2985357744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 msgr2=0x561b9b3dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa076d9d640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 0x7fa0640b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa070031040 tx=0x7fa0700094a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa0680e49c0 tx=0x7fa0680ef9b0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- 172.21.15.38:0/2985357744 shutdown_connections 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3dd9a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 --2- 172.21.15.38:0/2985357744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3dd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- 172.21.15.38:0/2985357744 >> 172.21.15.38:0/2985357744 conn(0x561b9b02a460 msgr2=0x561b9b3db350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- 172.21.15.38:0/2985357744 shutdown_connections 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- 172.21.15.38:0/2985357744 wait complete. 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.177+0000 7fa082f78740 1 -- start start 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 Processor -- start 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b9b1a4700 con 0x561b9b00d1b0 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b9b2de160 con 0x561b9b036070 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b9b3effa0 con 0x561b9b015390 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa082f78740 10 client.0 _ll_register_callbacks cb 0x561b9b2f79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39336/0 (socket says 172.21.15.38:39336) 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 -- 172.21.15.38:0/3674127591 learned_addr learned my addr 172.21.15.38:0/3674127591 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa06ffff640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa076d9d640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 -- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 msgr2=0x561b9b3ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 -- 172.21.15.38:0/3674127591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 msgr2=0x561b9b3f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa07659c640 1 -- 172.21.15.38:0/3674127591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b9b30bc90 con 0x561b9b00d1b0 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.178+0000 7fa06ffff640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa07659c640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa0680e4b00 tx=0x7fa068005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e25f15081754987 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:37.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068020070 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa0680e4cd0 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0680acc60 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa0680acaa0 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 10 client.17316 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b9b3fbda0 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa0680acc60 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa0680b66e0 con 0x561b9b00d1b0 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 10 client.17316 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 10 client.17316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.179+0000 7fa082f78740 20 client.17316 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9aff49f0 0x561b9b3ff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa082f78740 4 client.17316 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b9b355df0 con 0x561b9aff49f0 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa06ffff640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9aff49f0 0x561b9b3ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa06ffff640 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9aff49f0 0x561b9b3ff100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21c71595a39863a9 server_cookie=24d3927fe920406d in_seq=0 out_seq=0 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.180+0000 7fa05dffb640 10 client.17316 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa05dffb640 1 -- 172.21.15.38:0/3674127591 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b9b355df0 con 0x561b9aff49f0 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa05dffb640 10 client.17316 handle_command_reply: tid=0 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 client.17316 shutdown 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 msgr2=0x561b9b3ecfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fa0680e4b00 tx=0x7fa068005710 comp rx=0 tx=0).stop 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 shutdown_connections 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9aff49f0 0x561b9b3ff100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b036070 0x561b9b3f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b015390 0x561b9b3ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa05dffb640 0 client.17316 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 --2- 172.21.15.38:0/3674127591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b00d1b0 0x561b9b3ecfe0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.181+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 >> 172.21.15.38:0/3674127591 conn(0x561b9b02a460 msgr2=0x561b9b3d9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.182+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 shutdown_connections 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.182+0000 7fa082f78740 1 -- 172.21.15.38:0/3674127591 wait complete. 2024-09-21T06:26:37.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.182+0000 7fa082f78740 20 client.17316 trim_cache size 0 max 16384 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 Processor -- start 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 -- start start 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b00d1b0 0x561b9b3eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b036070 0x561b9b3f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781afcd0 con 0x561b9b015390 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781ad5a0 con 0x561b9b00d1b0 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa082f78740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781ab410 con 0x561b9b036070 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39340/0 (socket says 172.21.15.38:39340) 2024-09-21T06:26:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa06ffff640 1 -- 172.21.15.38:0/1883588103 learned_addr learned my addr 172.21.15.38:0/1883588103 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.195+0000 7fa076d9d640 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b036070 0x561b9b3f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa07659c640 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b00d1b0 0x561b9b3eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 -- 172.21.15.38:0/1883588103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b036070 msgr2=0x561b9b3f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b036070 0x561b9b3f9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 -- 172.21.15.38:0/1883588103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b00d1b0 msgr2=0x561b9b3eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b00d1b0 0x561b9b3eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 -- 172.21.15.38:0/1883588103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b9b3dfce0 con 0x561b9b015390 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa06ffff640 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa07806a800 tx=0x7fa060008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad7625899987383 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa05ffff640 1 -- 172.21.15.38:0/1883588103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060022670 con 0x561b9b015390 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa05ffff640 1 -- 172.21.15.38:0/1883588103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa06001d070 con 0x561b9b015390 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.196+0000 7fa05ffff640 1 -- 172.21.15.38:0/1883588103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060010bd0 con 0x561b9b015390 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- 172.21.15.38:0/1883588103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 msgr2=0x561b9b3deba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa07806a800 tx=0x7fa060008040 comp rx=0 tx=0).stop 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- 172.21.15.38:0/1883588103 shutdown_connections 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b036070 0x561b9b3f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b015390 0x561b9b3deba0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 --2- 172.21.15.38:0/1883588103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b00d1b0 0x561b9b3eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- 172.21.15.38:0/1883588103 >> 172.21.15.38:0/1883588103 conn(0x561b9b02a460 msgr2=0x561b9b3de490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- 172.21.15.38:0/1883588103 shutdown_connections 2024-09-21T06:26:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- 172.21.15.38:0/1883588103 wait complete. 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.197+0000 7fa082f78740 1 -- start start 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 Processor -- start 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 0x561b9b402b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b015390 0x561b9b400040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781aba60 con 0x561b9b036070 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781aced0 con 0x561b9b015390 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa0781ac130 con 0x561b9b00d1b0 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa082f78740 10 client.0 _ll_register_callbacks cb 0x7fa0680ef3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39354/0 (socket says 172.21.15.38:39354) 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 -- 172.21.15.38:0/4019170108 learned_addr learned my addr 172.21.15.38:0/4019170108 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa06ffff640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b015390 0x561b9b400040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa07659c640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 0x561b9b402b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 -- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 msgr2=0x561b9b402b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 0x561b9b402b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 -- 172.21.15.38:0/4019170108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b015390 msgr2=0x561b9b400040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b015390 0x561b9b400040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa076d9d640 1 -- 172.21.15.38:0/4019170108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b9b468880 con 0x561b9b036070 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.198+0000 7fa07659c640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 0x561b9b402b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa076d9d640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa070009390 tx=0x7fa07003e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a718c7d97b70c9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070056060 con 0x561b9b036070 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa0700047d0 con 0x561b9b036070 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa06001d070 con 0x561b9b036070 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa0700305e0 con 0x561b9b036070 2024-09-21T06:26:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 10 client.17322 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b9b4699b0 con 0x561b9b036070 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa06001d070 con 0x561b9b036070 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa070043040 con 0x561b9b036070 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 10 client.17322 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 10 client.17322 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.199+0000 7fa082f78740 20 client.17322 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9afc9da0 0x561b9b46c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa082f78740 4 client.17322 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b9b3518a0 con 0x561b9afc9da0 2024-09-21T06:26:37.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa07659c640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9afc9da0 0x561b9b46c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa05dffb640 10 client.17322 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa07659c640 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9afc9da0 0x561b9b46c140 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=695315aff61f0928 server_cookie=a3748afe62d2dc46 in_seq=0 out_seq=0 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa05dffb640 1 -- 172.21.15.38:0/4019170108 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b9b3518a0 con 0x561b9afc9da0 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa05dffb640 10 client.17322 handle_command_reply: tid=0 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.200+0000 7fa082f78740 1 client.17322 shutdown 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 msgr2=0x561b9b400750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa070009390 tx=0x7fa07003e040 comp rx=0 tx=0).stop 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 shutdown_connections 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x561b9afc9da0 0x561b9b46c140 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa05dffb640 0 client.17322 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b9b036070 0x561b9b400750 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b9b015390 0x561b9b400040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 --2- 172.21.15.38:0/4019170108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b9b00d1b0 0x561b9b402b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 >> 172.21.15.38:0/4019170108 conn(0x561b9b02a460 msgr2=0x561b9b3eebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 shutdown_connections 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 1 -- 172.21.15.38:0/4019170108 wait complete. 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa082f78740 20 client.17322 trim_cache size 0 max 16384 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 msgr2=0x7fa0640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.201+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 0x7fa0640b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa070031040 tx=0x7fa0700094a0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 msgr2=0x7fa0781992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa06800d770 tx=0x7fa06800dc30 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 shutdown_connections 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa0640b6680 0x7fa0640b8b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa078108b00 0x7fa07819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0781081b0 0x7fa078199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 --2- 172.21.15.38:0/2675834918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa078102870 0x7fa0781992c0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 >> 172.21.15.38:0/2675834918 conn(0x7fa0780fe2c0 msgr2=0x7fa0781006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 shutdown_connections 2024-09-21T06:26:37.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:37.202+0000 7fa07759e640 1 -- 172.21.15.38:0/2675834918 wait complete. 2024-09-21T06:26:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:37 smithi174 ceph-mon[34815]: pgmap v529: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:37.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:37 smithi044 ceph-mon[34369]: pgmap v529: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:37.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:37 smithi038 ceph-mon[31215]: pgmap v529: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:37.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:38.152 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:38.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 -- 172.21.15.38:0/4189496746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c105350 msgr2=0x7f905c10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 --2- 172.21.15.38:0/4189496746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c105350 0x7f905c10d8a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9044009900 tx=0x7f904402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 -- 172.21.15.38:0/4189496746 shutdown_connections 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 --2- 172.21.15.38:0/4189496746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c10de30 0x7f905c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 --2- 172.21.15.38:0/4189496746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c105350 0x7f905c10d8a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 --2- 172.21.15.38:0/4189496746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c104a00 0x7f905c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 -- 172.21.15.38:0/4189496746 >> 172.21.15.38:0/4189496746 conn(0x7f905c079730 msgr2=0x7f905c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 -- 172.21.15.38:0/4189496746 shutdown_connections 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.671+0000 7f9062854640 1 -- 172.21.15.38:0/4189496746 wait complete. 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 Processor -- start 2024-09-21T06:26:38.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 -- start start 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 0x7f905c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 0x7f905c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f905c113bb0 con 0x7f905c104a00 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f905c113a30 con 0x7f905c10de30 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f9062854640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f905c113d30 con 0x7f905c105350 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.672+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39384/0 (socket says 172.21.15.38:39384) 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 -- 172.21.15.38:0/3235588118 learned_addr learned my addr 172.21.15.38:0/3235588118 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9060df1640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 0x7f905c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9053fff640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 0x7f905c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 -- 172.21.15.38:0/3235588118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 msgr2=0x7f905c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 0x7f905c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 -- 172.21.15.38:0/3235588118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 msgr2=0x7f905c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 0x7f905c19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 -- 172.21.15.38:0/3235588118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c1a0530 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9053fff640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 0x7f905c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9060df1640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 0x7f905c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f905bfff640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f904c00d770 tx=0x7f904c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9059ffb640 1 -- 172.21.15.38:0/3235588118 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c017070 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9059ffb640 1 -- 172.21.15.38:0/3235588118 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f904c009c30 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c1a0820 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9059ffb640 1 -- 172.21.15.38:0/3235588118 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c003d70 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.673+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c1a6f80 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 Processor -- start 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 -- start start 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9059ffb640 1 -- 172.21.15.38:0/3235588118 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f904c003f10 con 0x7f905c104a00 2024-09-21T06:26:38.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5574686a4070 0x557468a4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a4c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5574689c1ea0 con 0x55746867b1b0 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5574689b12d0 con 0x557468683390 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.676+0000 7f9068dc8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5574689b50e0 con 0x5574686a4070 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39388/0 (socket says 172.21.15.38:39388) 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f905bfff640 1 -- 172.21.15.38:0/3650127106 learned_addr learned my addr 172.21.15.38:0/3650127106 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a4c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9060df1640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5574686a4070 0x557468a4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 -- 172.21.15.38:0/3650127106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5574686a4070 msgr2=0x557468a4b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5574686a4070 0x557468a4b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 -- 172.21.15.38:0/3650127106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 msgr2=0x557468a4bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 -- 172.21.15.38:0/3650127106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55746870f650 con 0x557468683390 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f905bfff640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9059ffb640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 0x7f90480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9053fff640 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a4c120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9044009230 tx=0x7f9044032c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a02640a25e24464a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9060df1640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 0x7f90480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.677+0000 7f9059ffb640 1 -- 172.21.15.38:0/3235588118 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f904c0e70b0 con 0x7f905c104a00 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.678+0000 7f90527fc640 1 -- 172.21.15.38:0/3650127106 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904403f070 con 0x557468683390 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.678+0000 7f90527fc640 1 -- 172.21.15.38:0/3650127106 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9044031710 con 0x557468683390 2024-09-21T06:26:38.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.678+0000 7f90527fc640 1 -- 172.21.15.38:0/3650127106 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044035070 con 0x557468683390 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- 172.21.15.38:0/3650127106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 msgr2=0x557468a4c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9060df1640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 0x7f90480b8c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f905400af80 tx=0x7f905400a730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a4c120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9044009230 tx=0x7f9044032c80 comp rx=0 tx=0).stop 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- 172.21.15.38:0/3650127106 shutdown_connections 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a4c120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a4bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 --2- 172.21.15.38:0/3650127106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5574686a4070 0x557468a4b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- 172.21.15.38:0/3650127106 >> 172.21.15.38:0/3650127106 conn(0x557468698460 msgr2=0x557468a49590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- 172.21.15.38:0/3650127106 shutdown_connections 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- 172.21.15.38:0/3650127106 wait complete. 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 -- start start 2024-09-21T06:26:38.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.679+0000 7f9068dc8740 1 Processor -- start 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a57300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557468812700 con 0x5574686a4070 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55746894c160 con 0x55746867b1b0 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557468a5e230 con 0x557468683390 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9068dc8740 10 client.0 _ll_register_callbacks cb 0x5574689659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f905bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39398/0 (socket says 172.21.15.38:39398) 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f905bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:43662/0 (socket says 172.21.15.38:43662) 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 -- 172.21.15.38:0/1439448965 learned_addr learned my addr 172.21.15.38:0/1439448965 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9053fff640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a57300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 -- 172.21.15.38:0/1439448965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 msgr2=0x557468a57300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a57300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 -- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 msgr2=0x557468a56dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 -- 172.21.15.38:0/1439448965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557468979c90 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f905bfff640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9053fff640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a57300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.680+0000 7f9060df1640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f905400fe90 tx=0x7f9054004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3502993c272ab904 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054029060 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9044031710 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f905401a460 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f905401a660 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 10 client.17334 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557468a69f60 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9044031710 con 0x5574686a4070 2024-09-21T06:26:38.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9054018040 con 0x5574686a4070 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 10 client.17334 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 10 client.17334 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 20 client.17334 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5574686629f0 0x557468a6d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 4 client.17334 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.681+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574689c3df0 con 0x5574686629f0 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.682+0000 7f905bfff640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5574686629f0 0x557468a6d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.683+0000 7f903b7fe640 10 client.17334 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.683+0000 7f905bfff640 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5574686629f0 0x557468a6d4e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f94b0574737e0306 server_cookie=9e1d333da5abf7a7 in_seq=0 out_seq=0 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.683+0000 7f903b7fe640 1 -- 172.21.15.38:0/1439448965 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574689c3df0 con 0x5574686629f0 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.683+0000 7f903b7fe640 10 client.17334 handle_command_reply: tid=0 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.683+0000 7f9068dc8740 1 client.17334 shutdown 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 msgr2=0x557468a57880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f905400fe90 tx=0x7f9054004a40 comp rx=0 tx=0).stop 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 shutdown_connections 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5574686629f0 0x557468a6d4e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a57880 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a57300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f903b7fe640 0 client.17334 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1439448965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55746867b1b0 0x557468a56dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 >> 172.21.15.38:0/1439448965 conn(0x557468698460 msgr2=0x557468a4e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 shutdown_connections 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 1 -- 172.21.15.38:0/1439448965 wait complete. 2024-09-21T06:26:38.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.684+0000 7f9068dc8740 20 client.17334 trim_cache size 0 max 16384 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 Processor -- start 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 -- start start 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55746867b1b0 0x557468a4d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1afe80 con 0x5574686a4070 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ad750 con 0x557468683390 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9068dc8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ab5c0 con 0x55746867b1b0 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9060df1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9060df1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39408/0 (socket says 172.21.15.38:39408) 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.697+0000 7f9060df1640 1 -- 172.21.15.38:0/1536129719 learned_addr learned my addr 172.21.15.38:0/1536129719 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9053fff640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f905bfff640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55746867b1b0 0x557468a4d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 -- 172.21.15.38:0/1536129719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55746867b1b0 msgr2=0x557468a4d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55746867b1b0 0x557468a4d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 -- 172.21.15.38:0/1536129719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 msgr2=0x557468a589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 -- 172.21.15.38:0/1536129719 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557468a4a350 con 0x5574686a4070 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9053fff640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9060df1640 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f905400f8e0 tx=0x7f905400a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8f11e07584d442 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9051ffb640 1 -- 172.21.15.38:0/1536129719 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054004cb0 con 0x5574686a4070 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9051ffb640 1 -- 172.21.15.38:0/1536129719 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9054004e50 con 0x5574686a4070 2024-09-21T06:26:38.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.698+0000 7f9051ffb640 1 -- 172.21.15.38:0/1536129719 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905402e6c0 con 0x5574686a4070 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- 172.21.15.38:0/1536129719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 msgr2=0x557468a48bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f905400f8e0 tx=0x7f905400a820 comp rx=0 tx=0).stop 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- 172.21.15.38:0/1536129719 shutdown_connections 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5574686a4070 0x557468a48bc0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557468683390 0x557468a589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 --2- 172.21.15.38:0/1536129719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55746867b1b0 0x557468a4d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- 172.21.15.38:0/1536129719 >> 172.21.15.38:0/1536129719 conn(0x557468698460 msgr2=0x557468a582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- 172.21.15.38:0/1536129719 shutdown_connections 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- 172.21.15.38:0/1536129719 wait complete. 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.699+0000 7f9068dc8740 1 -- start start 2024-09-21T06:26:38.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 Processor -- start 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a5fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5574686a4070 0x557468ad6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1abc10 con 0x55746867b1b0 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ad080 con 0x5574686a4070 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ac2e0 con 0x557468683390 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9068dc8740 10 client.0 _ll_register_callbacks cb 0x7f905400abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39424/0 (socket says 172.21.15.38:39424) 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 -- 172.21.15.38:0/2221626821 learned_addr learned my addr 172.21.15.38:0/2221626821 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9053fff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a5fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f9060df1640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5574686a4070 0x557468ad6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 -- 172.21.15.38:0/2221626821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 msgr2=0x557468a5fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a5fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 -- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5574686a4070 msgr2=0x557468ad6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5574686a4070 0x557468ad6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.700+0000 7f905bfff640 1 -- 172.21.15.38:0/2221626821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557468ad73e0 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f905bfff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f904c0acc50 tx=0x7f904c0e72b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b7ee1a1c058c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c020040 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f904c0a91c0 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9054004e50 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f904c0ac6c0 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 10 client.17340 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557468ad8530 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9054004e50 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f904c098110 con 0x55746867b1b0 2024-09-21T06:26:38.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 10 client.17340 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 10 client.17340 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 20 client.17340 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x557468637da0 0x557468adac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 4 client.17340 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.701+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574689bf8a0 con 0x557468637da0 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f9053fff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x557468637da0 0x557468adac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f9053fff640 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x557468637da0 0x557468adac10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3703f146eb9bcf5 server_cookie=f43e46d2f8423ea9 in_seq=0 out_seq=0 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f903b7fe640 10 client.17340 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:38.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f903b7fe640 1 -- 172.21.15.38:0/2221626821 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574689bf8a0 con 0x557468637da0 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f903b7fe640 10 client.17340 handle_command_reply: tid=0 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.702+0000 7f9068dc8740 1 client.17340 shutdown 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 msgr2=0x557468a5f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f904c0acc50 tx=0x7f904c0e72b0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 shutdown_connections 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x557468637da0 0x557468adac10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5574686a4070 0x557468ad6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557468683390 0x557468a5fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f903b7fe640 0 client.17340 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 --2- 172.21.15.38:0/2221626821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55746867b1b0 0x557468a5f830 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 >> 172.21.15.38:0/2221626821 conn(0x557468698460 msgr2=0x557468a66440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 shutdown_connections 2024-09-21T06:26:38.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 1 -- 172.21.15.38:0/2221626821 wait complete. 2024-09-21T06:26:38.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9068dc8740 20 client.17340 trim_cache size 0 max 16384 2024-09-21T06:26:38.710 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:38.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 msgr2=0x7f90480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 0x7f90480b8c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f905400af80 tx=0x7f905400a730 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 msgr2=0x7f905c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f904c00d770 tx=0x7f904c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 shutdown_connections 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f90480b6700 0x7f90480b8c10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f905c10de30 0x7f905c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f905c105350 0x7f905c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 --2- 172.21.15.38:0/3235588118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f905c104a00 0x7f905c19a5c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.703+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 >> 172.21.15.38:0/3235588118 conn(0x7f905c079730 msgr2=0x7f905c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.704+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 shutdown_connections 2024-09-21T06:26:38.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:38.704+0000 7f9062854640 1 -- 172.21.15.38:0/3235588118 wait complete. 2024-09-21T06:26:39.378 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:26:39.637 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:39 smithi174 ceph-mon[34815]: pgmap v530: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:39.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:39 smithi044 ceph-mon[34369]: pgmap v530: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:39 smithi038 ceph-mon[31215]: pgmap v530: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:40.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 -- 172.21.15.38:0/3838272079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 msgr2=0x7fb96c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 --2- 172.21.15.38:0/3838272079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c104df0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009900 tx=0x7fb95c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:40.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 -- 172.21.15.38:0/3838272079 shutdown_connections 2024-09-21T06:26:40.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 --2- 172.21.15.38:0/3838272079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c10df20 0x7fb96c110430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 --2- 172.21.15.38:0/3838272079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c105410 0x7fb96c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 --2- 172.21.15.38:0/3838272079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c104df0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 -- 172.21.15.38:0/3838272079 >> 172.21.15.38:0/3838272079 conn(0x7fb96c079650 msgr2=0x7fb96c079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 -- 172.21.15.38:0/3838272079 shutdown_connections 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.096+0000 7fb971f4b640 1 -- 172.21.15.38:0/3838272079 wait complete. 2024-09-21T06:26:40.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 Processor -- start 2024-09-21T06:26:40.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 -- start start 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c105410 0x7fb96c19acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 0x7fb96c19ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c113d60 con 0x7fb96c1049e0 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c113be0 con 0x7fb96c105410 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb971f4b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c113ee0 con 0x7fb96c10df20 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb96b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb96b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60722/0 (socket says 172.21.15.38:60722) 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb96b7fe640 1 -- 172.21.15.38:0/1268980729 learned_addr learned my addr 172.21.15.38:0/1268980729 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb96affd640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c105410 0x7fb96c19acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.097+0000 7fb96bfff640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 0x7fb96c19ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 -- 172.21.15.38:0/1268980729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 msgr2=0x7fb96c19ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 0x7fb96c19ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 -- 172.21.15.38:0/1268980729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c105410 msgr2=0x7fb96c19acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c105410 0x7fb96c19acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 -- 172.21.15.38:0/1268980729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c1a06a0 con 0x7fb96c1049e0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96bfff640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 0x7fb96c19ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005940 tx=0x7fb95c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb968ff9640 1 -- 172.21.15.38:0/1268980729 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c03f030 con 0x7fb96c1049e0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb968ff9640 1 -- 172.21.15.38:0/1268980729 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb95c003cd0 con 0x7fb96c1049e0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb968ff9640 1 -- 172.21.15.38:0/1268980729 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c035070 con 0x7fb96c1049e0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c1a0930 con 0x7fb96c1049e0 2024-09-21T06:26:40.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.098+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c1a70f0 con 0x7fb96c1049e0 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 Processor -- start 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb968ff9640 1 -- 172.21.15.38:0/1268980729 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb95c042030 con 0x7fb96c1049e0 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 -- start start 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37565be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37566120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ad374dbea0 con 0x55ad371be070 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ad374cb2d0 con 0x55ad3719d390 2024-09-21T06:26:40.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb9784bf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad374cf0e0 con 0x55ad371951b0 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60736/0 (socket says 172.21.15.38:60736) 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.101+0000 7fb96bfff640 1 -- 172.21.15.38:0/3775827704 learned_addr learned my addr 172.21.15.38:0/3775827704 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96affd640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37566120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37565be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 -- 172.21.15.38:0/3775827704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 msgr2=0x55ad37565be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37565be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 -- 172.21.15.38:0/3775827704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 msgr2=0x55ad37566120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37566120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 -- 172.21.15.38:0/3775827704 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad37229650 con 0x55ad371be070 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96affd640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37566120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb968ff9640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 0x7fb9540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c450 tx=0x7fb96400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc6f83d428cb074 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 0x7fb9540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb968ff9640 1 -- 172.21.15.38:0/1268980729 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb95c107d80 con 0x7fb96c1049e0 2024-09-21T06:26:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb951ffb640 1 -- 172.21.15.38:0/3775827704 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964007430 con 0x55ad371be070 2024-09-21T06:26:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb951ffb640 1 -- 172.21.15.38:0/3775827704 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb964007aa0 con 0x55ad371be070 2024-09-21T06:26:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.102+0000 7fb951ffb640 1 -- 172.21.15.38:0/3775827704 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96400aad0 con 0x55ad371be070 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 -- 172.21.15.38:0/3775827704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 msgr2=0x55ad375656a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb96b7fe640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 0x7fb9540b8c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb95c1055d0 tx=0x7fb95c009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c450 tx=0x7fb96400c910 comp rx=0 tx=0).stop 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 -- 172.21.15.38:0/3775827704 shutdown_connections 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37566120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37565be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3775827704 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad375656a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 -- 172.21.15.38:0/3775827704 >> 172.21.15.38:0/3775827704 conn(0x55ad371b2460 msgr2=0x55ad37563590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 -- 172.21.15.38:0/3775827704 shutdown_connections 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.103+0000 7fb9784bf740 1 -- 172.21.15.38:0/3775827704 wait complete. 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 -- start start 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 Processor -- start 2024-09-21T06:26:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37570d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37571280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ad3732c700 con 0x55ad371be070 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ad37466160 con 0x55ad3719d390 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad37573e80 con 0x55ad371951b0 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.104+0000 7fb9784bf740 10 client.0 _ll_register_callbacks cb 0x55ad3747f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60740/0 (socket says 172.21.15.38:60740) 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 -- 172.21.15.38:0/596569529 learned_addr learned my addr 172.21.15.38:0/596569529 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96affd640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37571280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37570d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 -- 172.21.15.38:0/596569529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 msgr2=0x55ad37570d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37570d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 -- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 msgr2=0x55ad37571280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37571280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 -- 172.21.15.38:0/596569529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad37493c90 con 0x55ad371be070 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96affd640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37571280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb96bfff640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x55ad37567cf0 tx=0x7fb96400a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46265e27e946fe1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb94affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964007780 con 0x55ad371be070 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb964012040 con 0x55ad371be070 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.105+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb964007aa0 con 0x55ad371be070 2024-09-21T06:26:40.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb96400a850 con 0x55ad371be070 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 10 client.17352 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ad3757fb70 con 0x55ad371be070 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb964007aa0 con 0x55ad371be070 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb964021040 con 0x55ad371be070 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 10 client.17352 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 20 client.17352 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad3717c9f0 0x55ad37582fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 4 client.17352 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad374dddf0 con 0x55ad3717c9f0 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.106+0000 7fb96affd640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad3717c9f0 0x55ad37582fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.107+0000 7fb96affd640 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad3717c9f0 0x55ad37582fe0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=892909d625e7b218 server_cookie=3003375f86486d7 in_seq=0 out_seq=0 2024-09-21T06:26:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.107+0000 7fb94affd640 10 client.17352 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb94affd640 1 -- 172.21.15.38:0/596569529 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad374dddf0 con 0x55ad3717c9f0 2024-09-21T06:26:40.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb94affd640 10 client.17352 handle_command_reply: tid=0 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 client.17352 shutdown 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 msgr2=0x55ad3757d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x55ad37567cf0 tx=0x7fb96400a6b0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 shutdown_connections 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371be070 0x55ad3757d170 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad3719d390 0x55ad37571280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad3717c9f0 0x55ad37582fe0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 --2- 172.21.15.38:0/596569529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37570d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb94affd640 0 client.17352 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 >> 172.21.15.38:0/596569529 conn(0x55ad371b2460 msgr2=0x55ad37568880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 shutdown_connections 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 1 -- 172.21.15.38:0/596569529 wait complete. 2024-09-21T06:26:40.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.108+0000 7fb9784bf740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.121+0000 7fb9784bf740 1 Processor -- start 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.121+0000 7fb9784bf740 1 -- start start 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37572d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad3757d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1b20a0 con 0x55ad3719d390 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1af970 con 0x55ad371be070 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb9784bf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1ad7e0 con 0x55ad371951b0 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60754/0 (socket says 172.21.15.38:60754) 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 -- 172.21.15.38:0/3421606548 learned_addr learned my addr 172.21.15.38:0/3421606548 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37572d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad3757d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 -- 172.21.15.38:0/3421606548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 msgr2=0x55ad37572d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37572d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 -- 172.21.15.38:0/3421606548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 msgr2=0x55ad3757d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad3757d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 -- 172.21.15.38:0/3421606548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad37567990 con 0x55ad3719d390 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad3757d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:40.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.122+0000 7fb96affd640 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb960005e90 tx=0x7fb960011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd943b68a743bd99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9517fa640 1 -- 172.21.15.38:0/3421606548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960004220 con 0x55ad3719d390 2024-09-21T06:26:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9517fa640 1 -- 172.21.15.38:0/3421606548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9600043c0 con 0x55ad3719d390 2024-09-21T06:26:40.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9517fa640 1 -- 172.21.15.38:0/3421606548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96001d920 con 0x55ad3719d390 2024-09-21T06:26:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 -- 172.21.15.38:0/3421606548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 msgr2=0x55ad37567090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb960005e90 tx=0x7fb960011810 comp rx=0 tx=0).stop 2024-09-21T06:26:40.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 -- 172.21.15.38:0/3421606548 shutdown_connections 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad3757d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad3719d390 0x55ad37567090 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3421606548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad371951b0 0x55ad37572d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 -- 172.21.15.38:0/3421606548 >> 172.21.15.38:0/3421606548 conn(0x55ad371b2460 msgr2=0x55ad3756a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 -- 172.21.15.38:0/3421606548 shutdown_connections 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.123+0000 7fb9784bf740 1 -- 172.21.15.38:0/3421606548 wait complete. 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 -- start start 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 Processor -- start 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad3719d390 0x55ad375758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad375ec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1ade30 con 0x55ad371951b0 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1af2a0 con 0x55ad371be070 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c1ae500 con 0x55ad3719d390 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.124+0000 7fb9784bf740 10 client.0 _ll_register_callbacks cb 0x7fb964009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60758/0 (socket says 172.21.15.38:60758) 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 -- 172.21.15.38:0/3419961113 learned_addr learned my addr 172.21.15.38:0/3419961113 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96affd640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad3719d390 0x55ad375758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad375ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 -- 172.21.15.38:0/3419961113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad3719d390 msgr2=0x55ad375758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad3719d390 0x55ad375758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 -- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 msgr2=0x55ad375ec870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:40.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad375ec870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 -- 172.21.15.38:0/3419961113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad37576140 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb96bfff640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb964002230 tx=0x7fb96400a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b33eb320e5e48a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb94affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964033020 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb96401b040 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.125+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9600043c0 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb964007990 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 10 client.17358 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ad375edda0 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9600043c0 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb96402c4f0 con 0x55ad371951b0 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 10 client.17358 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 10 client.17358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:40.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 20 client.17358 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad37151da0 0x55ad375f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 4 client.17358 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad374d98a0 con 0x55ad37151da0 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.126+0000 7fb96affd640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad37151da0 0x55ad375f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb96affd640 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad37151da0 0x55ad375f04a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33d257ef1dcd708a server_cookie=29b932615450e122 in_seq=0 out_seq=0 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb94affd640 10 client.17358 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb94affd640 1 -- 172.21.15.38:0/3419961113 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad374d98a0 con 0x55ad37151da0 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb94affd640 10 client.17358 handle_command_reply: tid=0 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 client.17358 shutdown 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 msgr2=0x55ad37575360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fb964002230 tx=0x7fb96400a6b0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 shutdown_connections 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ad371be070 0x55ad375ec870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ad37151da0 0x55ad375f04a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad3719d390 0x55ad375758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 --2- 172.21.15.38:0/3419961113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ad371951b0 0x55ad37575360 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb94affd640 0 client.17358 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.127+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 >> 172.21.15.38:0/3419961113 conn(0x55ad371b2460 msgr2=0x55ad37566e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 shutdown_connections 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb9784bf740 1 -- 172.21.15.38:0/3419961113 wait complete. 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb9784bf740 20 client.17358 trim_cache size 0 max 16384 2024-09-21T06:26:40.134 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 msgr2=0x7fb9540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 0x7fb9540b8c10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb95c1055d0 tx=0x7fb95c009260 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 msgr2=0x7fb96c19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005940 tx=0x7fb95c004360 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 shutdown_connections 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb9540b6700 0x7fb9540b8c10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb96c10df20 0x7fb96c19ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb96c105410 0x7fb96c19acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 --2- 172.21.15.38:0/1268980729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb96c1049e0 0x7fb96c19a730 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:40.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 >> 172.21.15.38:0/1268980729 conn(0x7fb96c079650 msgr2=0x7fb96c0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 shutdown_connections 2024-09-21T06:26:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:40.128+0000 7fb971f4b640 1 -- 172.21.15.38:0/1268980729 wait complete. 2024-09-21T06:26:41.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:41 smithi044 ceph-mon[34369]: pgmap v531: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:41.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:41 smithi038 ceph-mon[31215]: pgmap v531: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:41.814 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:41.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:41 smithi174 ceph-mon[34815]: pgmap v531: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:42.086 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- 172.21.15.38:0/1739716421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c4104870 msgr2=0x7fe5c4104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 --2- 172.21.15.38:0/1739716421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c4104870 0x7fe5c4104c80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009900 tx=0x7fe5c002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- 172.21.15.38:0/1739716421 shutdown_connections 2024-09-21T06:26:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 --2- 172.21.15.38:0/1739716421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c410de20 0x7fe5c4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 --2- 172.21.15.38:0/1739716421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c410d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 --2- 172.21.15.38:0/1739716421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c4104870 0x7fe5c4104c80 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- 172.21.15.38:0/1739716421 >> 172.21.15.38:0/1739716421 conn(0x7fe5c4079750 msgr2=0x7fe5c4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- 172.21.15.38:0/1739716421 shutdown_connections 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- 172.21.15.38:0/1739716421 wait complete. 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 Processor -- start 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.582+0000 7fe5caaba640 1 -- start start 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c4104870 0x7fe5c419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4113c40 con 0x7fe5c410de20 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4113ac0 con 0x7fe5c4104870 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5caaba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4113dc0 con 0x7fe5c41052a0 2024-09-21T06:26:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60790/0 (socket says 172.21.15.38:60790) 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 -- 172.21.15.38:0/4283855966 learned_addr learned my addr 172.21.15.38:0/4283855966 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c8856640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c4104870 0x7fe5c419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 -- 172.21.15.38:0/4283855966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 msgr2=0x7fe5c419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 -- 172.21.15.38:0/4283855966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c4104870 msgr2=0x7fe5c419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c4104870 0x7fe5c419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5c9057640 1 -- 172.21.15.38:0/4283855966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41a0540 con 0x7fe5c410de20 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.583+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5c9057640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00eaa0 tx=0x7fe5bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5b9ffb640 1 -- 172.21.15.38:0/4283855966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00cdb0 con 0x7fe5c410de20 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5b9ffb640 1 -- 172.21.15.38:0/4283855966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5bc005020 con 0x7fe5c410de20 2024-09-21T06:26:42.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c41a0830 con 0x7fe5c410de20 2024-09-21T06:26:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5b9ffb640 1 -- 172.21.15.38:0/4283855966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0116d0 con 0x7fe5c410de20 2024-09-21T06:26:42.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.584+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41a6f90 con 0x7fe5c410de20 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.587+0000 7fe5d102e740 1 Processor -- start 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5b9ffb640 1 -- 172.21.15.38:0/4283855966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe5bc0051d0 con 0x7fe5c410de20 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 -- start start 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73caca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b73ca40e60 con 0x55b73c6fa490 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b73ca30290 con 0x55b73c723350 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5d102e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b73ca340a0 con 0x55b73c702670 2024-09-21T06:26:42.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5c8856640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5c8856640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60796/0 (socket says 172.21.15.38:60796) 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5c8856640 1 -- 172.21.15.38:0/2387405980 learned_addr learned my addr 172.21.15.38:0/2387405980 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73caca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.588+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 -- 172.21.15.38:0/2387405980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 msgr2=0x55b73cacaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 -- 172.21.15.38:0/2387405980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 msgr2=0x55b73caca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73caca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 -- 172.21.15.38:0/2387405980 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73c78e930 con 0x55b73c6fa490 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5b9ffb640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 0x7fe5ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 0x7fe5ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5b9ffb640 1 -- 172.21.15.38:0/4283855966 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fe5bc0e78f0 con 0x7fe5c410de20 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009900 tx=0x7fe5c0031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd81bed6cc2fa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5aaffd640 1 -- 172.21.15.38:0/2387405980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0040070 con 0x55b73c6fa490 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5aaffd640 1 -- 172.21.15.38:0/2387405980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5c0031710 con 0x55b73c6fa490 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.589+0000 7fe5aaffd640 1 -- 172.21.15.38:0/2387405980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0035040 con 0x55b73c6fa490 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 -- 172.21.15.38:0/2387405980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 msgr2=0x55b73caca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 0x7fe5ac0b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4102290 tx=0x7fe5b400a2b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0009900 tx=0x7fe5c0031c70 comp rx=0 tx=0).stop 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 -- 172.21.15.38:0/2387405980 shutdown_connections 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73caca970 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2387405980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73caca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 -- 172.21.15.38:0/2387405980 >> 172.21.15.38:0/2387405980 conn(0x55b73c717740 msgr2=0x55b73cac8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 -- 172.21.15.38:0/2387405980 shutdown_connections 2024-09-21T06:26:42.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.590+0000 7fe5d102e740 1 -- 172.21.15.38:0/2387405980 wait complete. 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 -- start start 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 Processor -- start 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c6fa490 0x55b73cad6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 0x55b73cad6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b73c891890 con 0x55b73c723350 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b73c9cad40 con 0x55b73c702670 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b73cad8bb0 con 0x55b73c6fa490 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5d102e740 10 client.0 _ll_register_callbacks cb 0x55b73ca2ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.591+0000 7fe5c9057640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60810/0 (socket says 172.21.15.38:60810) 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 -- 172.21.15.38:0/466086446 learned_addr learned my addr 172.21.15.38:0/466086446 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c8856640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c6fa490 0x55b73cad6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 0x55b73cad6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 -- 172.21.15.38:0/466086446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c6fa490 msgr2=0x55b73cad6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c6fa490 0x55b73cad6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 -- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 msgr2=0x55b73cad6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 0x55b73cad6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 -- 172.21.15.38:0/466086446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b73cae24f0 con 0x55b73c723350 2024-09-21T06:26:42.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 0x55b73cad6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5c9057640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0e5690 tx=0x7fe5bc0ad2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ab5b59bb48e901 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0b2020 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fe5bc0ac460 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c0031710 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5bc098070 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.592+0000 7fe5d102e740 10 client.17370 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b73cae4e60 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5c0031710 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5bc00f040 con 0x55b73c723350 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 10 client.17370 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 10 client.17370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 20 client.17370 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6e1cd0 0x55b73cae8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 4 client.17370 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b73ca42db0 con 0x55b73c6e1cd0 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.593+0000 7fe5c8856640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6e1cd0 0x55b73cae8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.594+0000 7fe5a3fff640 10 client.17370 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.594+0000 7fe5c8856640 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6e1cd0 0x55b73cae8480 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6834f7a13a0af99 server_cookie=2f6a51f81cae4d9f in_seq=0 out_seq=0 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5a3fff640 1 -- 172.21.15.38:0/466086446 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b73ca42db0 con 0x55b73c6e1cd0 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5a3fff640 10 client.17370 handle_command_reply: tid=0 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 client.17370 shutdown 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 msgr2=0x55b73cae1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0e5690 tx=0x7fe5bc0ad2a0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 shutdown_connections 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c723350 0x55b73cae1f00 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c702670 0x55b73cad6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6e1cd0 0x55b73cae8480 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 --2- 172.21.15.38:0/466086446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c6fa490 0x55b73cad6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5a3fff640 0 client.17370 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 >> 172.21.15.38:0/466086446 conn(0x55b73c717740 msgr2=0x55b73cacd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 shutdown_connections 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 1 -- 172.21.15.38:0/466086446 wait complete. 2024-09-21T06:26:42.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.595+0000 7fe5d102e740 20 client.17370 trim_cache size 0 max 16384 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 Processor -- start 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 -- start start 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73cad3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41b1f10 con 0x55b73c6fa490 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41af7e0 con 0x55b73c723350 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.613+0000 7fe5d102e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41ad650 con 0x55b73c702670 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60814/0 (socket says 172.21.15.38:60814) 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 -- 172.21.15.38:0/811101929 learned_addr learned my addr 172.21.15.38:0/811101929 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c9057640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73cad3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 -- 172.21.15.38:0/811101929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 msgr2=0x55b73cacbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 -- 172.21.15.38:0/811101929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 msgr2=0x55b73cad3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73cad3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 -- 172.21.15.38:0/811101929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b73cad8450 con 0x55b73c6fa490 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c9057640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73cad3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5c8856640 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0004730 tx=0x7fe5c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18148adef9009bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5aa7fc640 1 -- 172.21.15.38:0/811101929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0040070 con 0x55b73c6fa490 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5aa7fc640 1 -- 172.21.15.38:0/811101929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5c0031870 con 0x55b73c6fa490 2024-09-21T06:26:42.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.614+0000 7fe5aa7fc640 1 -- 172.21.15.38:0/811101929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0035040 con 0x55b73c6fa490 2024-09-21T06:26:42.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 -- 172.21.15.38:0/811101929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 msgr2=0x55b73cacfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0004730 tx=0x7fe5c00046c0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 -- 172.21.15.38:0/811101929 shutdown_connections 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c723350 0x55b73cad3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c702670 0x55b73cacbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 --2- 172.21.15.38:0/811101929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c6fa490 0x55b73cacfbb0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 -- 172.21.15.38:0/811101929 >> 172.21.15.38:0/811101929 conn(0x55b73c717740 msgr2=0x55b73cacb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 -- 172.21.15.38:0/811101929 shutdown_connections 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.615+0000 7fe5d102e740 1 -- 172.21.15.38:0/811101929 wait complete. 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 -- start start 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 Processor -- start 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 0x55b73cad9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c723350 0x55b73cada800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41adca0 con 0x55b73c702670 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41af110 con 0x55b73c6fa490 2024-09-21T06:26:42.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c41ae370 con 0x55b73c723350 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5d102e740 10 client.0 _ll_register_callbacks cb 0x7fe5bc0a9e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60826/0 (socket says 172.21.15.38:60826) 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5bbfff640 1 -- 172.21.15.38:0/2422881244 learned_addr learned my addr 172.21.15.38:0/2422881244 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.616+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 0x55b73cad9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5c9057640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c723350 0x55b73cada800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 -- 172.21.15.38:0/2422881244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c723350 msgr2=0x55b73cada800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c723350 0x55b73cada800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 -- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 msgr2=0x55b73cad9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 0x55b73cad9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 -- 172.21.15.38:0/2422881244 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b73cb51e80 con 0x55b73c702670 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 0x55b73cad9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5bbfff640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe5c406b910 tx=0x7fe5b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a654482d3a047 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:42.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4021040 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fe5b40177e0 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5c0031870 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5b40059c0 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5d102e740 10 client.17376 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.617+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b73cb53110 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5c0031870 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5b4024070 con 0x55b73c702670 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 10 client.17376 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 20 client.17376 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6b7080 0x55b73cb55980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 4 client.17376 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b73ca3e860 con 0x55b73c6b7080 2024-09-21T06:26:42.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.618+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6b7080 0x55b73cb55980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:42.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.619+0000 7fe5c8856640 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6b7080 0x55b73cb55980 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eae5779152ae3ef server_cookie=7d058f90fc147b66 in_seq=0 out_seq=0 2024-09-21T06:26:42.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.619+0000 7fe5a3fff640 10 client.17376 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.620+0000 7fe5a3fff640 1 -- 172.21.15.38:0/2422881244 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b73ca3e860 con 0x55b73c6b7080 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.620+0000 7fe5a3fff640 10 client.17376 handle_command_reply: tid=0 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.620+0000 7fe5d102e740 1 client.17376 shutdown 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 msgr2=0x55b73cada2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe5c406b910 tx=0x7fe5b40046c0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 shutdown_connections 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b73c6b7080 0x55b73cb55980 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b73c723350 0x55b73cada800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5a3fff640 0 client.17376 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b73c702670 0x55b73cada2c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 --2- 172.21.15.38:0/2422881244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b73c6fa490 0x55b73cad9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 >> 172.21.15.38:0/2422881244 conn(0x55b73c717740 msgr2=0x55b73cacb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 shutdown_connections 2024-09-21T06:26:42.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 1 -- 172.21.15.38:0/2422881244 wait complete. 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.621+0000 7fe5d102e740 20 client.17376 trim_cache size 0 max 16384 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "e2a19825-79ac-4efb-b1ac-68ac5b225b50", 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:42.626 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 msgr2=0x7fe5ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 0x7fe5ac0b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4102290 tx=0x7fe5b400a2b0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 msgr2=0x7fe5c419fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00eaa0 tx=0x7fe5bc00ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 shutdown_connections 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5ac0b6680 0x7fe5ac0b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe5c410de20 0x7fe5c419fe10 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5c41052a0 0x7fe5c419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 --2- 172.21.15.38:0/4283855966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5c4104870 0x7fe5c419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 >> 172.21.15.38:0/4283855966 conn(0x7fe5c4079750 msgr2=0x7fe5c41007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:42.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 shutdown_connections 2024-09-21T06:26:42.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:42.622+0000 7fe5caaba640 1 -- 172.21.15.38:0/4283855966 wait complete. 2024-09-21T06:26:43.459 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: pgmap v532: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:43.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:43.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:43.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.460 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:43 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:43.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: pgmap v532: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:43 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:43.749 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:43.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: pgmap v532: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:43.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:43 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.230+0000 7f13b1a92640 1 -- 172.21.15.38:0/957980486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac103bb0 msgr2=0x7f13ac103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.230+0000 7f13b1a92640 1 --2- 172.21.15.38:0/957980486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac103bb0 0x7f13ac103fc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f139c009900 tx=0x7f139c02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 -- 172.21.15.38:0/957980486 shutdown_connections 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 --2- 172.21.15.38:0/957980486 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac109e40 0x7f13ac110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 --2- 172.21.15.38:0/957980486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 0x7f13ac109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 --2- 172.21.15.38:0/957980486 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac103bb0 0x7f13ac103fc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 -- 172.21.15.38:0/957980486 >> 172.21.15.38:0/957980486 conn(0x7f13ac0ff600 msgr2=0x7f13ac101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 -- 172.21.15.38:0/957980486 shutdown_connections 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 -- 172.21.15.38:0/957980486 wait complete. 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.231+0000 7f13b1a92640 1 Processor -- start 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 -- start start 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac103bb0 0x7f13ac19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 0x7f13ac19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac113c20 con 0x7f13ac109e40 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac113aa0 con 0x7f13ac103bb0 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13b1a92640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac113da0 con 0x7f13ac1094f0 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60852/0 (socket says 172.21.15.38:60852) 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 -- 172.21.15.38:0/958861519 learned_addr learned my addr 172.21.15.38:0/958861519 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac103bb0 0x7f13ac19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13aaffd640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 0x7f13ac19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 -- 172.21.15.38:0/958861519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 msgr2=0x7f13ac19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 0x7f13ac19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 -- 172.21.15.38:0/958861519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac103bb0 msgr2=0x7f13ac19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac103bb0 0x7f13ac19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.232+0000 7f13abfff640 1 -- 172.21.15.38:0/958861519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac1a0580 con 0x7f13ac109e40 2024-09-21T06:26:44.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13abfff640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f13a400eaa0 tx=0x7f13a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13a8ff9640 1 -- 172.21.15.38:0/958861519 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a400cdb0 con 0x7f13ac109e40 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13a8ff9640 1 -- 172.21.15.38:0/958861519 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f13a4005020 con 0x7f13ac109e40 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac1a0870 con 0x7f13ac109e40 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13a8ff9640 1 -- 172.21.15.38:0/958861519 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a40116d0 con 0x7f13ac109e40 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.233+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac1a6fd0 con 0x7f13ac109e40 2024-09-21T06:26:44.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.236+0000 7f13b8006740 1 Processor -- start 2024-09-21T06:26:44.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.236+0000 7f13a8ff9640 1 -- 172.21.15.38:0/958861519 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f13a40051d0 con 0x7f13ac109e40 2024-09-21T06:26:44.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.236+0000 7f13b8006740 1 -- start start 2024-09-21T06:26:44.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b25650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b25b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5603f4a9be50 con 0x5603f475d390 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5603f4a8b280 con 0x5603f47551b0 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13b8006740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5603f4a8f090 con 0x5603f477e070 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60860/0 (socket says 172.21.15.38:60860) 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 -- 172.21.15.38:0/884285286 learned_addr learned my addr 172.21.15.38:0/884285286 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:44.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b25b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b25650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 -- 172.21.15.38:0/884285286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 msgr2=0x5603f4b25650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b25650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 -- 172.21.15.38:0/884285286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 msgr2=0x5603f4b25b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b25b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13aaffd640 1 -- 172.21.15.38:0/884285286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f47e9650 con 0x5603f475d390 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.237+0000 7f13a8ff9640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 0x7f13940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f13aaffd640 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f13a000cfa0 tx=0x7f13a000c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545e6891b2ce4d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 0x7f13940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f13a8ff9640 1 -- 172.21.15.38:0/958861519 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f13a40e7810 con 0x7f13ac109e40 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f1391ffb640 1 -- 172.21.15.38:0/884285286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0019030 con 0x5603f475d390 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f1391ffb640 1 -- 172.21.15.38:0/884285286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f13a00119f0 con 0x5603f475d390 2024-09-21T06:26:44.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.238+0000 7f1391ffb640 1 -- 172.21.15.38:0/884285286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a000f900 con 0x5603f475d390 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- 172.21.15.38:0/884285286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 msgr2=0x5603f4b260d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 0x7f13940b8c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f139c009230 tx=0x7f139c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f13a000cfa0 tx=0x7f13a000c670 comp rx=0 tx=0).stop 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- 172.21.15.38:0/884285286 shutdown_connections 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b260d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b25b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 --2- 172.21.15.38:0/884285286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b25650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- 172.21.15.38:0/884285286 >> 172.21.15.38:0/884285286 conn(0x5603f4772460 msgr2=0x5603f4b23540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- 172.21.15.38:0/884285286 shutdown_connections 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- 172.21.15.38:0/884285286 wait complete. 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.239+0000 7f13b8006740 1 -- start start 2024-09-21T06:26:44.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 Processor -- start 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f475d390 0x5603f4b356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b41490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5603f48ec700 con 0x5603f47551b0 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5603f4a26110 con 0x5603f475d390 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5603f4b38160 con 0x5603f477e070 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13b8006740 10 client.0 _ll_register_callbacks cb 0x5603f4a3f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60864/0 (socket says 172.21.15.38:60864) 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 -- 172.21.15.38:0/1947177488 learned_addr learned my addr 172.21.15.38:0/1947177488 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13aaffd640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f475d390 0x5603f4b356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13abfff640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b41490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 -- 172.21.15.38:0/1947177488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 msgr2=0x5603f4b41490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b41490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 -- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f475d390 msgr2=0x5603f4b356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f475d390 0x5603f4b356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.240+0000 7f13ab7fe640 1 -- 172.21.15.38:0/1947177488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603f4a53c40 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f139c033000 tx=0x7f139c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5996ac3a7fb11ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f138affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c04d030 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f139c004310 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a00119f0 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f139c056020 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f13b8006740 10 client.17388 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5603f4b43f30 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.241+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f13a00119f0 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f139c03d6b0 con 0x5603f47551b0 2024-09-21T06:26:44.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 10 client.17388 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 20 client.17388 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f473c9f0 0x5603f4b47420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 4 client.17388 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603f4a9dda0 con 0x5603f473c9f0 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13aaffd640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f473c9f0 0x5603f4b47420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f13aaffd640 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f473c9f0 0x5603f4b47420 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c0e71f96093aba server_cookie=715e07d3e33240d in_seq=0 out_seq=0 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.242+0000 7f138affd640 10 client.17388 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f138affd640 1 -- 172.21.15.38:0/1947177488 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603f4a9dda0 con 0x5603f473c9f0 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f138affd640 10 client.17388 handle_command_reply: tid=0 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 client.17388 shutdown 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 msgr2=0x5603f4b35190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f139c033000 tx=0x7f139c009260 comp rx=0 tx=0).stop 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 shutdown_connections 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f473c9f0 0x5603f4b47420 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b41490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f475d390 0x5603f4b356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 --2- 172.21.15.38:0/1947177488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b35190 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 >> 172.21.15.38:0/1947177488 conn(0x5603f4772460 msgr2=0x5603f4b21b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.243+0000 7f138affd640 0 client.17388 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.244+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 shutdown_connections 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.244+0000 7f13b8006740 1 -- 172.21.15.38:0/1947177488 wait complete. 2024-09-21T06:26:44.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.244+0000 7f13b8006740 20 client.17388 trim_cache size 0 max 16384 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 Processor -- start 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 -- start start 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f475d390 0x5603f4b26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f477e070 0x5603f4b32380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1afdb0 con 0x5603f47551b0 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1ad680 con 0x5603f477e070 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.261+0000 7f13b8006740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1ab4f0 con 0x5603f475d390 2024-09-21T06:26:44.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60874/0 (socket says 172.21.15.38:60874) 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 -- 172.21.15.38:0/2986521714 learned_addr learned my addr 172.21.15.38:0/2986521714 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13abfff640 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f477e070 0x5603f4b32380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 -- 172.21.15.38:0/2986521714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f475d390 msgr2=0x5603f4b26d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f475d390 0x5603f4b26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 -- 172.21.15.38:0/2986521714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f477e070 msgr2=0x5603f4b32380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f477e070 0x5603f4b32380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 -- 172.21.15.38:0/2986521714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f4b2fd90 con 0x5603f47551b0 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f139c03dad0 tx=0x7f139c03df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76ad61bd075537d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13917fa640 1 -- 172.21.15.38:0/2986521714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c060030 con 0x5603f47551b0 2024-09-21T06:26:44.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13917fa640 1 -- 172.21.15.38:0/2986521714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f139c004310 con 0x5603f47551b0 2024-09-21T06:26:44.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.262+0000 7f13917fa640 1 -- 172.21.15.38:0/2986521714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c04d070 con 0x5603f47551b0 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- 172.21.15.38:0/2986521714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 msgr2=0x5603f4b2b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f139c03dad0 tx=0x7f139c03df80 comp rx=0 tx=0).stop 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- 172.21.15.38:0/2986521714 shutdown_connections 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f477e070 0x5603f4b32380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f475d390 0x5603f4b26d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 --2- 172.21.15.38:0/2986521714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f47551b0 0x5603f4b2b0d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- 172.21.15.38:0/2986521714 >> 172.21.15.38:0/2986521714 conn(0x5603f4772460 msgr2=0x5603f4b26680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- 172.21.15.38:0/2986521714 shutdown_connections 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- 172.21.15.38:0/2986521714 wait complete. 2024-09-21T06:26:44.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.263+0000 7f13b8006740 1 -- start start 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 Processor -- start 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b3b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1abb40 con 0x5603f475d390 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1acfb0 con 0x5603f47551b0 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1ac210 con 0x5603f477e070 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13b8006740 10 client.0 _ll_register_callbacks cb 0x7f139c032e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60876/0 (socket says 172.21.15.38:60876) 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 -- 172.21.15.38:0/941075091 learned_addr learned my addr 172.21.15.38:0/941075091 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b3dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13abfff640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b3b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 -- 172.21.15.38:0/941075091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 msgr2=0x5603f4b3b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b3b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 -- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 msgr2=0x5603f4b3dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b3dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.264+0000 7f13aaffd640 1 -- 172.21.15.38:0/941075091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603f4b3bd80 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f13aaffd640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f13a000f4b0 tx=0x7f13a000f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5dfa47283e5797 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f138affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a002b070 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f13a0004040 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f139c004310 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13a0037050 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f13b8006740 10 client.17394 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5603f4bb1d50 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.265+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f139c004310 con 0x5603f475d390 2024-09-21T06:26:44.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13a0003680 con 0x5603f475d390 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 10 client.17394 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 10 client.17394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 20 client.17394 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f4711da0 0x5603f4bb4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 4 client.17394 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603f4a99850 con 0x5603f4711da0 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f4711da0 0x5603f4bb4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f13ab7fe640 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f4711da0 0x5603f4bb4190 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6957202a88a6c015 server_cookie=8370af93a86d8d81 in_seq=0 out_seq=0 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.266+0000 7f138affd640 10 client.17394 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f138affd640 1 -- 172.21.15.38:0/941075091 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x5603f4a99850 con 0x5603f4711da0 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f138affd640 10 client.17394 handle_command_reply: tid=0 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 client.17394 shutdown 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 msgr2=0x5603f4b3b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f13a000f4b0 tx=0x7f13a000f550 comp rx=0 tx=0).stop 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 shutdown_connections 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5603f4711da0 0x5603f4bb4190 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603f477e070 0x5603f4b3b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5603f475d390 0x5603f4b3b0b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f138affd640 0 client.17394 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 --2- 172.21.15.38:0/941075091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603f47551b0 0x5603f4b3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 >> 172.21.15.38:0/941075091 conn(0x5603f4772460 msgr2=0x5603f4b27040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 shutdown_connections 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 1 -- 172.21.15.38:0/941075091 wait complete. 2024-09-21T06:26:44.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.267+0000 7f13b8006740 20 client.17394 trim_cache size 0 max 16384 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.274 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.275 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.276 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.277 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:44.278 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:44.279 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.280 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.281 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.282 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 msgr2=0x7f13940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 0x7f13940b8c10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f139c009230 tx=0x7f139c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 msgr2=0x7f13ac19fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f13a400eaa0 tx=0x7f13a400ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 shutdown_connections 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13940b6700 0x7f13940b8c10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13ac109e40 0x7f13ac19fe50 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ac1094f0 0x7f13ac19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 --2- 172.21.15.38:0/958861519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13ac103bb0 0x7f13ac19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 >> 172.21.15.38:0/958861519 conn(0x7f13ac0ff600 msgr2=0x7f13ac101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 shutdown_connections 2024-09-21T06:26:44.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:44.268+0000 7f13b1a92640 1 -- 172.21.15.38:0/958861519 wait complete. 2024-09-21T06:26:44.903 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:44.904 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:45.537 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:45 smithi038 ceph-mon[31215]: pgmap v533: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:45.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 -- 172.21.15.38:0/2096209414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9810109df0 msgr2=0x7f9810110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 --2- 172.21.15.38:0/2096209414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9810109df0 0x7f9810110620 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f9808009ca0 tx=0x7f980802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 -- 172.21.15.38:0/2096209414 shutdown_connections 2024-09-21T06:26:45.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 --2- 172.21.15.38:0/2096209414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9810109df0 0x7f9810110620 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 --2- 172.21.15.38:0/2096209414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98101094a0 0x7f98101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 --2- 172.21.15.38:0/2096209414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810103b60 0x7f9810103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 -- 172.21.15.38:0/2096209414 >> 172.21.15.38:0/2096209414 conn(0x7f981007b850 msgr2=0x7f981007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 -- 172.21.15.38:0/2096209414 shutdown_connections 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.628+0000 7f9817992640 1 -- 172.21.15.38:0/2096209414 wait complete. 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 Processor -- start 2024-09-21T06:26:45.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 -- start start 2024-09-21T06:26:45.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9810103b60 0x7f981019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810109df0 0x7f981019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9810113bf0 con 0x7f98101094a0 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9810113a70 con 0x7f9810103b60 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9817992640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9810113d70 con 0x7f9810109df0 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9814f2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9814f2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60890/0 (socket says 172.21.15.38:60890) 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9814f2d640 1 -- 172.21.15.38:0/2453545490 learned_addr learned my addr 172.21.15.38:0/2453545490 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f981572e640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9810103b60 0x7f981019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.629+0000 7f9815f2f640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810109df0 0x7f981019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 -- 172.21.15.38:0/2453545490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810109df0 msgr2=0x7f981019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810109df0 0x7f981019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 -- 172.21.15.38:0/2453545490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9810103b60 msgr2=0x7f981019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9810103b60 0x7f981019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 -- 172.21.15.38:0/2453545490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101a0490 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9814f2d640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f980000d950 tx=0x7f980000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800017070 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98101a0780 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9800009c30 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000047a0 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.630+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101a6ee0 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.631+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810103f70 con 0x7f98101094a0 2024-09-21T06:26:45.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.633+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9800004020 con 0x7f98101094a0 2024-09-21T06:26:45.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.633+0000 7f98067fc640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 0x7f97fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:45.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.634+0000 7f981572e640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 0x7f97fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:45.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.634+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f98000e7380 con 0x7f98101094a0 2024-09-21T06:26:45.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.634+0000 7f981572e640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 0x7f97fc0b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f980c005fd0 tx=0x7f980c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:45.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.638+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9800020020 con 0x7f98101094a0 2024-09-21T06:26:45.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.864+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f981010bc40 con 0x7f98101094a0 2024-09-21T06:26:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.865+0000 7f98067fc640 1 -- 172.21.15.38:0/2453545490 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f98000ad920 con 0x7f98101094a0 2024-09-21T06:26:45.867 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:45.867 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:45.867 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:45.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.867+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 msgr2=0x7f97fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.867+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 0x7f97fc0b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f980c005fd0 tx=0x7f980c00b390 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.867+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 msgr2=0x7f981019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.867+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f980000d950 tx=0x7f980000de10 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 shutdown_connections 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f97fc0b6680 0x7f97fc0b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9810109df0 0x7f981019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98101094a0 0x7f981019aac0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 --2- 172.21.15.38:0/2453545490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9810103b60 0x7f981019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 >> 172.21.15.38:0/2453545490 conn(0x7f981007b850 msgr2=0x7f9810105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 shutdown_connections 2024-09-21T06:26:45.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:45.868+0000 7f9817992640 1 -- 172.21.15.38:0/2453545490 wait complete. 2024-09-21T06:26:45.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:45 smithi174 ceph-mon[34815]: pgmap v533: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:45.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:45 smithi044 ceph-mon[34369]: pgmap v533: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:46.459 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2453545490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:46.488 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:46.747 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:46.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2453545490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:46.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2453545490' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 -- 172.21.15.38:0/679541909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c104a30 msgr2=0x7fb13c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 --2- 172.21.15.38:0/679541909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c104a30 0x7fb13c104e40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009ca0 tx=0x7fb12c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 -- 172.21.15.38:0/679541909 shutdown_connections 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 --2- 172.21.15.38:0/679541909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c10de90 0x7fb13c110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 --2- 172.21.15.38:0/679541909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c105380 0x7fb13c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 --2- 172.21.15.38:0/679541909 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c104a30 0x7fb13c104e40 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.246+0000 7fb14133b640 1 -- 172.21.15.38:0/679541909 >> 172.21.15.38:0/679541909 conn(0x7fb13c079770 msgr2=0x7fb13c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.247+0000 7fb14133b640 1 -- 172.21.15.38:0/679541909 shutdown_connections 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.247+0000 7fb14133b640 1 -- 172.21.15.38:0/679541909 wait complete. 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.247+0000 7fb14133b640 1 Processor -- start 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.247+0000 7fb14133b640 1 -- start start 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c104a30 0x7fb13c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c10de90 0x7fb13c1a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c113c30 con 0x7fb13c105380 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c113ab0 con 0x7fb13c104a30 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb14133b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c113db0 con 0x7fb13c10de90 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60906/0 (socket says 172.21.15.38:60906) 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 -- 172.21.15.38:0/584338383 learned_addr learned my addr 172.21.15.38:0/584338383 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb13affd640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c104a30 0x7fb13c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c10de90 0x7fb13c1a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 -- 172.21.15.38:0/584338383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c10de90 msgr2=0x7fb13c1a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c10de90 0x7fb13c1a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 -- 172.21.15.38:0/584338383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c104a30 msgr2=0x7fb13c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c104a30 0x7fb13c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.248+0000 7fb1327fc640 1 -- 172.21.15.38:0/584338383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c1a2730 con 0x7fb13c105380 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb1327fc640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb12400d950 tx=0x7fb12400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb138ff9640 1 -- 172.21.15.38:0/584338383 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124017070 con 0x7fb13c105380 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb138ff9640 1 -- 172.21.15.38:0/584338383 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb124009c30 con 0x7fb13c105380 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c1a2a20 con 0x7fb13c105380 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb138ff9640 1 -- 172.21.15.38:0/584338383 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240047a0 con 0x7fb13c105380 2024-09-21T06:26:47.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.249+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c1a9180 con 0x7fb13c105380 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.251+0000 7fb1478af740 1 Processor -- start 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 -- start start 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb138ff9640 1 -- 172.21.15.38:0/584338383 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb124004020 con 0x7fb13c105380 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd909800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd909d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd87fea0 con 0x55e2dd5391b0 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd86f2d0 con 0x55e2dd541390 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1478af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd8730e0 con 0x55e2dd562070 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:52142/0 (socket says 172.21.15.38:52142) 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb13affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd909800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1651714098 learned_addr learned my addr 172.21.15.38:0/1651714098 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:47.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.252+0000 7fb1327fc640 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd909d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1651714098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 msgr2=0x55e2dd909d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd909d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1651714098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 msgr2=0x55e2dd909800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd909800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1651714098 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2dd5cd650 con 0x55e2dd562070 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb1327fc640 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd909d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:47.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb138ff9640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 0x7fb1280b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b6b0 tx=0x7fb134004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b971dcd4e270b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb13affd640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 0x7fb1280b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb138ff9640 1 -- 172.21.15.38:0/584338383 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb1240e72b0 con 0x7fb13c105380 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb1317fa640 1 -- 172.21.15.38:0/1651714098 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134003b20 con 0x55e2dd562070 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb1317fa640 1 -- 172.21.15.38:0/1651714098 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb134015070 con 0x55e2dd562070 2024-09-21T06:26:47.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.253+0000 7fb1317fa640 1 -- 172.21.15.38:0/1651714098 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340116a0 con 0x55e2dd562070 2024-09-21T06:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 -- 172.21.15.38:0/1651714098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 msgr2=0x55e2dd9092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb13affd640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 0x7fb1280b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55e2dd907f40 tx=0x7fb12c009410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b6b0 tx=0x7fb134004610 comp rx=0 tx=0).stop 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 -- 172.21.15.38:0/1651714098 shutdown_connections 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd909d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd909800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 --2- 172.21.15.38:0/1651714098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9092c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 -- 172.21.15.38:0/1651714098 >> 172.21.15.38:0/1651714098 conn(0x55e2dd556460 msgr2=0x55e2dd9071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.254+0000 7fb1478af740 1 -- 172.21.15.38:0/1651714098 shutdown_connections 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 -- 172.21.15.38:0/1651714098 wait complete. 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 -- start start 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 Processor -- start 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd5391b0 0x55e2dd9149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd914f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd6d0700 con 0x55e2dd562070 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd80a160 con 0x55e2dd541390 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.255+0000 7fb1478af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e2dd917aa0 con 0x55e2dd5391b0 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1478af740 10 client.0 _ll_register_callbacks cb 0x55e2dd8239e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60926/0 (socket says 172.21.15.38:60926) 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 -- 172.21.15.38:0/832990068 learned_addr learned my addr 172.21.15.38:0/832990068 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13affd640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd5391b0 0x55e2dd9149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1327fc640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd914f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 -- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd5391b0 msgr2=0x55e2dd9149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd5391b0 0x55e2dd9149f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 -- 172.21.15.38:0/832990068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 msgr2=0x55e2dd914f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd914f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 -- 172.21.15.38:0/832990068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2dd837c90 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb134004290 tx=0x7fb134003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d3a6486748974e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1227fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134028060 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb134015070 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.256+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb134005230 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb134005430 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 10 client.17412 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e2dd9237f0 con 0x55e2dd562070 2024-09-21T06:26:47.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb134015070 con 0x55e2dd562070 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb134004b40 con 0x55e2dd562070 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 10 client.17412 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 10 client.17412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 20 client.17412 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd5209f0 0x55e2dd926c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 4 client.17412 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.257+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2dd881df0 con 0x55e2dd5209f0 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.258+0000 7fb13affd640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd5209f0 0x55e2dd926c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.258+0000 7fb13affd640 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd5209f0 0x55e2dd926c00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7398375f4e579eec server_cookie=f51f2245498d4629 in_seq=0 out_seq=0 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.258+0000 7fb1227fc640 10 client.17412 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1227fc640 1 -- 172.21.15.38:0/832990068 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2dd881df0 con 0x55e2dd5209f0 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1227fc640 10 client.17412 handle_command_reply: tid=0 2024-09-21T06:26:47.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 client.17412 shutdown 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 msgr2=0x55e2dd920dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb134004290 tx=0x7fb134003bd0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 shutdown_connections 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd5209f0 0x55e2dd926c00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd920dc0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd914f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1227fc640 0 client.17412 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 --2- 172.21.15.38:0/832990068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd5391b0 0x55e2dd9149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 >> 172.21.15.38:0/832990068 conn(0x55e2dd556460 msgr2=0x55e2dd90c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 shutdown_connections 2024-09-21T06:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 1 -- 172.21.15.38:0/832990068 wait complete. 2024-09-21T06:26:47.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.259+0000 7fb1478af740 20 client.17412 trim_cache size 0 max 16384 2024-09-21T06:26:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 Processor -- start 2024-09-21T06:26:47.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 -- start start 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd920d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1b4210 con 0x55e2dd5391b0 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1b1ae0 con 0x55e2dd541390 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1478af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1af950 con 0x55e2dd562070 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60934/0 (socket says 172.21.15.38:60934) 2024-09-21T06:26:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 -- 172.21.15.38:0/965480029 learned_addr learned my addr 172.21.15.38:0/965480029 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb1327fc640 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd920d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 -- 172.21.15.38:0/965480029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 msgr2=0x55e2dd9147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 -- 172.21.15.38:0/965480029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 msgr2=0x55e2dd920d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.273+0000 7fb13affd640 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd920d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.274+0000 7fb13affd640 1 -- 172.21.15.38:0/965480029 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2dd915cb0 con 0x55e2dd5391b0 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.274+0000 7fb13affd640 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb12c02ade0 tx=0x7fb12c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb0355f8c41a6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.274+0000 7fb130ff9640 1 -- 172.21.15.38:0/965480029 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c003dc0 con 0x55e2dd5391b0 2024-09-21T06:26:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.274+0000 7fb130ff9640 1 -- 172.21.15.38:0/965480029 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb12c036050 con 0x55e2dd5391b0 2024-09-21T06:26:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.274+0000 7fb130ff9640 1 -- 172.21.15.38:0/965480029 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c02f660 con 0x55e2dd5391b0 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- 172.21.15.38:0/965480029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 msgr2=0x55e2dd9071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fb12c02ade0 tx=0x7fb12c044000 comp rx=0 tx=0).stop 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- 172.21.15.38:0/965480029 shutdown_connections 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd562070 0x55e2dd9147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd541390 0x55e2dd920d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 --2- 172.21.15.38:0/965480029 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd5391b0 0x55e2dd9071e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- 172.21.15.38:0/965480029 >> 172.21.15.38:0/965480029 conn(0x55e2dd556460 msgr2=0x55e2dd906ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- 172.21.15.38:0/965480029 shutdown_connections 2024-09-21T06:26:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- 172.21.15.38:0/965480029 wait complete. 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 -- start start 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.275+0000 7fb1478af740 1 Processor -- start 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd5391b0 0x55e2dd928030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd541390 0x55e2dd928570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1affa0 con 0x55e2dd562070 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1b1410 con 0x55e2dd5391b0 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1b0670 con 0x55e2dd541390 2024-09-21T06:26:47.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1478af740 10 client.0 _ll_register_callbacks cb 0x7fb12c009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd5391b0 0x55e2dd928030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60944/0 (socket says 172.21.15.38:60944) 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1353661168 learned_addr learned my addr 172.21.15.38:0/1353661168 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb1327fc640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd541390 0x55e2dd928570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd541390 msgr2=0x55e2dd928570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd541390 0x55e2dd928570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1353661168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd5391b0 msgr2=0x55e2dd928030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd5391b0 0x55e2dd928030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.276+0000 7fb13b7fe640 1 -- 172.21.15.38:0/1353661168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2dd9908c0 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb13b7fe640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b590 tx=0x7fb13402d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd2b90807993841 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134028040 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb13402da20 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb12c036050 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb13400b2e0 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 10 client.17418 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e2dd9919b0 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb12c036050 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb13401a940 con 0x55e2dd562070 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 10 client.17418 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 10 client.17418 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 20 client.17418 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd4f5da0 0x55e2dd994130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 4 client.17418 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.277+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2dd87d8a0 con 0x55e2dd4f5da0 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb13affd640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd4f5da0 0x55e2dd994130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb13affd640 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd4f5da0 0x55e2dd994130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58875deedc33d57e server_cookie=f428cd0774bb713 in_seq=0 out_seq=0 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1227fc640 10 client.17418 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1227fc640 1 -- 172.21.15.38:0/1353661168 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2dd87d8a0 con 0x55e2dd4f5da0 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1227fc640 10 client.17418 handle_command_reply: tid=0 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1478af740 1 client.17418 shutdown 2024-09-21T06:26:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 msgr2=0x55e2dd990380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.278+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b590 tx=0x7fb13402d580 comp rx=0 tx=0).stop 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 shutdown_connections 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e2dd4f5da0 0x55e2dd994130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e2dd562070 0x55e2dd990380 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e2dd541390 0x55e2dd928570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 --2- 172.21.15.38:0/1353661168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e2dd5391b0 0x55e2dd928030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 >> 172.21.15.38:0/1353661168 conn(0x55e2dd556460 msgr2=0x55e2dd9147a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1227fc640 0 client.17418 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 shutdown_connections 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 1 -- 172.21.15.38:0/1353661168 wait complete. 2024-09-21T06:26:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb1478af740 20 client.17418 trim_cache size 0 max 16384 2024-09-21T06:26:47.288 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 msgr2=0x7fb1280b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 0x7fb1280b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55e2dd907f40 tx=0x7fb12c009410 comp rx=0 tx=0).stop 2024-09-21T06:26:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 msgr2=0x7fb13c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb12400d950 tx=0x7fb12400de10 comp rx=0 tx=0).stop 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 shutdown_connections 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb1280b6700 0x7fb1280b8c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb13c10de90 0x7fb13c1a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb13c105380 0x7fb13c19cd60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 --2- 172.21.15.38:0/584338383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb13c104a30 0x7fb13c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.279+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 >> 172.21.15.38:0/584338383 conn(0x7fb13c079770 msgr2=0x7fb13c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.280+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 shutdown_connections 2024-09-21T06:26:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:47.280+0000 7fb14133b640 1 -- 172.21.15.38:0/584338383 wait complete. 2024-09-21T06:26:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:47 smithi038 ceph-mon[31215]: pgmap v534: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:47.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:47 smithi174 ceph-mon[34815]: pgmap v534: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:47 smithi044 ceph-mon[34369]: pgmap v534: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:47.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:48.207 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:48.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 -- 172.21.15.38:0/1382805241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 msgr2=0x7f2c141087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 --2- 172.21.15.38:0/1382805241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c141087b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009900 tx=0x7f2c0402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 -- 172.21.15.38:0/1382805241 shutdown_connections 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 --2- 172.21.15.38:0/1382805241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 0x7f2c1410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 --2- 172.21.15.38:0/1382805241 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c141087b0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 --2- 172.21.15.38:0/1382805241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 0x7f2c14102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.663+0000 7f2c1b832640 1 -- 172.21.15.38:0/1382805241 >> 172.21.15.38:0/1382805241 conn(0x7f2c14079730 msgr2=0x7f2c14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.664+0000 7f2c1b832640 1 -- 172.21.15.38:0/1382805241 shutdown_connections 2024-09-21T06:26:48.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.664+0000 7f2c1b832640 1 -- 172.21.15.38:0/1382805241 wait complete. 2024-09-21T06:26:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.664+0000 7f2c1b832640 1 Processor -- start 2024-09-21T06:26:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 -- start start 2024-09-21T06:26:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 0x7f2c1419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 0x7f2c1419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14112ae0 con 0x7f2c141083a0 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14112960 con 0x7f2c14102a60 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c1b832640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14112c60 con 0x7f2c14108cf0 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60972/0 (socket says 172.21.15.38:60972) 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2464398398 learned_addr learned my addr 172.21.15.38:0/2464398398 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c195ce640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 0x7f2c1419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 0x7f2c1419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2464398398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 msgr2=0x7f2c1419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 0x7f2c1419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2464398398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 msgr2=0x7f2c1419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 0x7f2c1419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.665+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2464398398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141a0570 con 0x7f2c141083a0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005940 tx=0x7f2c04004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c0a7fc640 1 -- 172.21.15.38:0/2464398398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0403f030 con 0x7f2c141083a0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c0a7fc640 1 -- 172.21.15.38:0/2464398398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c04003cd0 con 0x7f2c141083a0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c0a7fc640 1 -- 172.21.15.38:0/2464398398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04035070 con 0x7f2c141083a0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c141a0800 con 0x7f2c141083a0 2024-09-21T06:26:48.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.666+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c141a6fc0 con 0x7f2c141083a0 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 Processor -- start 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 -- start start 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c0a7fc640 1 -- 172.21.15.38:0/2464398398 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2c04042030 con 0x7f2c141083a0 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4be46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4be5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4b5aea0 con 0x55b8f48141b0 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4b4a2d0 con 0x55b8f481c390 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c21da6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4b4e0e0 con 0x55b8f483d070 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c195ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c195ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60980/0 (socket says 172.21.15.38:60980) 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.669+0000 7f2c195ce640 1 -- 172.21.15.38:0/1191256319 learned_addr learned my addr 172.21.15.38:0/1191256319 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4be46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4be5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 -- 172.21.15.38:0/1191256319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 msgr2=0x55b8f4be46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4be46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 -- 172.21.15.38:0/1191256319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 msgr2=0x55b8f4be5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4be5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 -- 172.21.15.38:0/1191256319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f48a8650 con 0x55b8f48141b0 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4be5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c195ce640 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000ac20 tx=0x7f2c1000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7f62d0d6653bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c0a7fc640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 0x7f2c000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 0x7f2c000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2bff7fe640 1 -- 172.21.15.38:0/1191256319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1001d070 con 0x55b8f48141b0 2024-09-21T06:26:48.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2c0a7fc640 1 -- 172.21.15.38:0/2464398398 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f2c04107d30 con 0x7f2c141083a0 2024-09-21T06:26:48.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2bff7fe640 1 -- 172.21.15.38:0/1191256319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c10018b10 con 0x55b8f48141b0 2024-09-21T06:26:48.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.670+0000 7f2bff7fe640 1 -- 172.21.15.38:0/1191256319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10010b50 con 0x55b8f48141b0 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 -- 172.21.15.38:0/1191256319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 msgr2=0x55b8f4be4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 0x7f2c000b8c10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009fd0 tx=0x7f2c0c00e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000ac20 tx=0x7f2c1000f790 comp rx=0 tx=0).stop 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 -- 172.21.15.38:0/1191256319 shutdown_connections 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4be5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4be4be0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 --2- 172.21.15.38:0/1191256319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4be46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 -- 172.21.15.38:0/1191256319 >> 172.21.15.38:0/1191256319 conn(0x55b8f4831460 msgr2=0x55b8f4be2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 -- 172.21.15.38:0/1191256319 shutdown_connections 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.671+0000 7f2c21da6740 1 -- 172.21.15.38:0/1191256319 wait complete. 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 -- start start 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 Processor -- start 2024-09-21T06:26:48.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f48141b0 0x55b8f4befcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b8f49ab700 con 0x55b8f481c390 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4ae5160 con 0x55b8f48141b0 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4bf2e80 con 0x55b8f483d070 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.672+0000 7f2c21da6740 10 client.0 _ll_register_callbacks cb 0x55b8f4afe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60996/0 (socket says 172.21.15.38:60996) 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 -- 172.21.15.38:0/335844479 learned_addr learned my addr 172.21.15.38:0/335844479 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c195ce640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f48141b0 0x55b8f4befcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 -- 172.21.15.38:0/335844479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 msgr2=0x55b8f4bf0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 -- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f48141b0 msgr2=0x55b8f4befcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f48141b0 0x55b8f4befcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 -- 172.21.15.38:0/335844479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f4b12c90 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000c00 tx=0x7f2c040c9b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae781f13e6e18b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2bfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04049070 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c10018b10 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.673+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f2c0403b4f0 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c040cd340 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 10 client.17430 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b8f4bfea50 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c10018b10 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2c040f1070 con 0x55b8f481c390 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 10 client.17430 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:48.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 10 client.17430 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 20 client.17430 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47fb9f0 0x55b8f4c01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 4 client.17430 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f4b5cdf0 con 0x55b8f47fb9f0 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.674+0000 7f2c195ce640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47fb9f0 0x55b8f4c01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.675+0000 7f2bfcff9640 10 client.17430 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:48.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.675+0000 7f2c195ce640 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47fb9f0 0x55b8f4c01ef0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f332c45bc72ba231 server_cookie=edb4337bec731bce in_seq=0 out_seq=0 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2bfcff9640 1 -- 172.21.15.38:0/335844479 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b8f4b5cdf0 con 0x55b8f47fb9f0 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2bfcff9640 10 client.17430 handle_command_reply: tid=0 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 client.17430 shutdown 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 msgr2=0x55b8f4bf0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000c00 tx=0x7f2c040c9b30 comp rx=0 tx=0).stop 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 shutdown_connections 2024-09-21T06:26:48.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47fb9f0 0x55b8f4c01ef0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4bf0210 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 --2- 172.21.15.38:0/335844479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f48141b0 0x55b8f4befcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 >> 172.21.15.38:0/335844479 conn(0x55b8f4831460 msgr2=0x55b8f4be7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2bfcff9640 0 client.17430 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 shutdown_connections 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 1 -- 172.21.15.38:0/335844479 wait complete. 2024-09-21T06:26:48.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.676+0000 7f2c21da6740 20 client.17430 trim_cache size 0 max 16384 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.689+0000 7f2c21da6740 1 Processor -- start 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 -- start start 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f48141b0 0x55b8f4bf1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f483d070 0x55b8f4bed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b20c0 con 0x55b8f481c390 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141af990 con 0x55b8f483d070 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c21da6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141ad800 con 0x55b8f48141b0 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60998/0 (socket says 172.21.15.38:60998) 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2601514965 learned_addr learned my addr 172.21.15.38:0/2601514965 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c195ce640 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f48141b0 0x55b8f4bf1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f483d070 0x55b8f4bed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2601514965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f48141b0 msgr2=0x55b8f4bf1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f48141b0 0x55b8f4bf1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2601514965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f483d070 msgr2=0x55b8f4bed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f483d070 0x55b8f4bed400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.690+0000 7f2c18dcd640 1 -- 172.21.15.38:0/2601514965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f4c02460 con 0x55b8f481c390 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cd8d0 tx=0x7f2c0402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27745a9b72006f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2bfeffd640 1 -- 172.21.15.38:0/2601514965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04049030 con 0x55b8f481c390 2024-09-21T06:26:48.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2bfeffd640 1 -- 172.21.15.38:0/2601514965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c040044d0 con 0x55b8f481c390 2024-09-21T06:26:48.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2bfeffd640 1 -- 172.21.15.38:0/2601514965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040c9340 con 0x55b8f481c390 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 -- 172.21.15.38:0/2601514965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 msgr2=0x55b8f4becec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cd8d0 tx=0x7f2c0402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 -- 172.21.15.38:0/2601514965 shutdown_connections 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f483d070 0x55b8f4bed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f481c390 0x55b8f4becec0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 --2- 172.21.15.38:0/2601514965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f48141b0 0x55b8f4bf1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.691+0000 7f2c21da6740 1 -- 172.21.15.38:0/2601514965 >> 172.21.15.38:0/2601514965 conn(0x55b8f4831460 msgr2=0x55b8f4bf11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.692+0000 7f2c21da6740 1 -- 172.21.15.38:0/2601514965 shutdown_connections 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.692+0000 7f2c21da6740 1 -- 172.21.15.38:0/2601514965 wait complete. 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.692+0000 7f2c21da6740 1 -- start start 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.692+0000 7f2c21da6740 1 Processor -- start 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4bf45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141ade50 con 0x55b8f48141b0 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141af2c0 con 0x55b8f481c390 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141ae520 con 0x55b8f483d070 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c21da6740 10 client.0 _ll_register_callbacks cb 0x7f2c04032ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:48.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32770/0 (socket says 172.21.15.38:32770) 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 -- 172.21.15.38:0/3844841105 learned_addr learned my addr 172.21.15.38:0/3844841105 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4bf45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c19dcf640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 -- 172.21.15.38:0/3844841105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 msgr2=0x55b8f4bf4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 -- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 msgr2=0x55b8f4bf45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4bf45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 -- 172.21.15.38:0/3844841105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f4c6b8b0 con 0x55b8f48141b0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2c195ce640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x55b8f4be3320 tx=0x7f2c10005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346d942fba821ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.693+0000 7f2bfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1001d040 con 0x55b8f48141b0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c040044d0 con 0x55b8f48141b0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f2c10005040 con 0x55b8f48141b0 2024-09-21T06:26:48.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c10039050 con 0x55b8f48141b0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 10 client.17436 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b8f4c6ca60 con 0x55b8f48141b0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c040044d0 con 0x55b8f48141b0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2c10010ac0 con 0x55b8f48141b0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 10 client.17436 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 10 client.17436 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 20 client.17436 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47d0da0 0x55b8f4c6efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 4 client.17436 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.694+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8f4bdd9e0 con 0x55b8f47d0da0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47d0da0 0x55b8f4c6efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2c18dcd640 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47d0da0 0x55b8f4c6efa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3868ade55f3f7200 server_cookie=a5896a01aafa1fec in_seq=0 out_seq=0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2bfcff9640 10 client.17436 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2bfcff9640 1 -- 172.21.15.38:0/3844841105 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8f4bdd9e0 con 0x55b8f47d0da0 2024-09-21T06:26:48.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2bfcff9640 10 client.17436 handle_command_reply: tid=0 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2c21da6740 1 client.17436 shutdown 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.695+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 msgr2=0x55b8f4bf4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x55b8f4be3320 tx=0x7f2c10005a50 comp rx=0 tx=0).stop 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 shutdown_connections 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55b8f47d0da0 0x55b8f4c6efa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8f483d070 0x55b8f4bf4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b8f481c390 0x55b8f4bf45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 --2- 172.21.15.38:0/3844841105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b8f48141b0 0x55b8f4bf4060 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 >> 172.21.15.38:0/3844841105 conn(0x55b8f4831460 msgr2=0x55b8f4bfb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2bfcff9640 0 client.17436 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 shutdown_connections 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 1 -- 172.21.15.38:0/3844841105 wait complete. 2024-09-21T06:26:48.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c21da6740 20 client.17436 trim_cache size 0 max 16384 2024-09-21T06:26:48.703 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 msgr2=0x7f2c000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 0x7f2c000b8c10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009fd0 tx=0x7f2c0c00e040 comp rx=0 tx=0).stop 2024-09-21T06:26:48.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 msgr2=0x7f2c1419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005940 tx=0x7f2c04004360 comp rx=0 tx=0).stop 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 shutdown_connections 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f2c000b6700 0x7f2c000b8c10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c14108cf0 0x7f2c1419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2c141083a0 0x7f2c1419aba0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.696+0000 7f2c1b832640 1 --2- 172.21.15.38:0/2464398398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c14102a60 0x7f2c1419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.697+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 >> 172.21.15.38:0/2464398398 conn(0x7f2c14079730 msgr2=0x7f2c14100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.697+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 shutdown_connections 2024-09-21T06:26:48.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:48.697+0000 7f2c1b832640 1 -- 172.21.15.38:0/2464398398 wait complete. 2024-09-21T06:26:49.387 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:26:49.652 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:49 smithi038 ceph-mon[31215]: pgmap v535: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:49.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:49 smithi174 ceph-mon[34815]: pgmap v535: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:49.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:49 smithi044 ceph-mon[34369]: pgmap v535: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.112+0000 7fa936963640 1 -- 172.21.15.38:0/1926116713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa93010de40 msgr2=0x7fa930110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.112+0000 7fa936963640 1 --2- 172.21.15.38:0/1926116713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa93010de40 0x7fa930110330 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa928009ca0 tx=0x7fa92802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 -- 172.21.15.38:0/1926116713 shutdown_connections 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 --2- 172.21.15.38:0/1926116713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa93010de40 0x7fa930110330 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 --2- 172.21.15.38:0/1926116713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 0x7fa93010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 --2- 172.21.15.38:0/1926116713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9301049e0 0x7fa930104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 -- 172.21.15.38:0/1926116713 >> 172.21.15.38:0/1926116713 conn(0x7fa930079750 msgr2=0x7fa930079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 -- 172.21.15.38:0/1926116713 shutdown_connections 2024-09-21T06:26:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 -- 172.21.15.38:0/1926116713 wait complete. 2024-09-21T06:26:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 Processor -- start 2024-09-21T06:26:50.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.113+0000 7fa936963640 1 -- start start 2024-09-21T06:26:50.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 0x7fa93019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa93010de40 0x7fa93019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa930113c00 con 0x7fa9301049e0 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa930113a80 con 0x7fa930105330 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa936963640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa930113d80 con 0x7fa93010de40 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41926/0 (socket says 172.21.15.38:41926) 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 -- 172.21.15.38:0/2716834875 learned_addr learned my addr 172.21.15.38:0/2716834875 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa934f00640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa93010de40 0x7fa93019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 0x7fa93019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 -- 172.21.15.38:0/2716834875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa93010de40 msgr2=0x7fa93019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa93010de40 0x7fa93019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 -- 172.21.15.38:0/2716834875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 msgr2=0x7fa93019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 0x7fa93019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.114+0000 7fa92ffff640 1 -- 172.21.15.38:0/2716834875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9301a0480 con 0x7fa9301049e0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa92000d950 tx=0x7fa92000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa92d7fa640 1 -- 172.21.15.38:0/2716834875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920017070 con 0x7fa9301049e0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa92d7fa640 1 -- 172.21.15.38:0/2716834875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa920009c30 con 0x7fa9301049e0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9301a0770 con 0x7fa9301049e0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa92d7fa640 1 -- 172.21.15.38:0/2716834875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92000f620 con 0x7fa9301049e0 2024-09-21T06:26:50.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.115+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301a6ed0 con 0x7fa9301049e0 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 Processor -- start 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 -- start start 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa92d7fa640 1 -- 172.21.15.38:0/2716834875 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa92001a070 con 0x7fa9301049e0 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f68be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9ba0390 0x562fe9f69120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562fe9edeea0 con 0x562fe9bc1070 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562fe9ece2d0 con 0x562fe9b981b0 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa93ced7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562fe9ed20e0 con 0x562fe9ba0390 2024-09-21T06:26:50.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa934f00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa934f00640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41928/0 (socket says 172.21.15.38:41928) 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa934f00640 1 -- 172.21.15.38:0/2894130156 learned_addr learned my addr 172.21.15.38:0/2894130156 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.118+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f68be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 -- 172.21.15.38:0/2894130156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9ba0390 msgr2=0x562fe9f69120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9ba0390 0x562fe9f69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9ba0390 0x562fe9f69120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 -- 172.21.15.38:0/2894130156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 msgr2=0x562fe9f68be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f68be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 -- 172.21.15.38:0/2894130156 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe9c2c650 con 0x562fe9bc1070 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f68be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa934f00640 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098b0 tx=0x7fa9280098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2662383b5d698a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa92d7fa640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 0x7fa9180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa9167fc640 1 -- 172.21.15.38:0/2894130156 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928031d40 con 0x562fe9bc1070 2024-09-21T06:26:50.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 0x7fa9180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa9167fc640 1 -- 172.21.15.38:0/2894130156 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa928036030 con 0x562fe9bc1070 2024-09-21T06:26:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa9167fc640 1 -- 172.21.15.38:0/2894130156 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928004310 con 0x562fe9bc1070 2024-09-21T06:26:50.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.119+0000 7fa92d7fa640 1 -- 172.21.15.38:0/2716834875 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa9200e7030 con 0x7fa9301049e0 2024-09-21T06:26:50.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 -- 172.21.15.38:0/2894130156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 msgr2=0x562fe9f686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa92ffff640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 0x7fa9180b8c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9200e4880 tx=0x7fa9200a96a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fa9280098b0 tx=0x7fa9280098e0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 -- 172.21.15.38:0/2894130156 shutdown_connections 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9ba0390 0x562fe9f69120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f68be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2894130156 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9bc1070 0x562fe9f686a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 -- 172.21.15.38:0/2894130156 >> 172.21.15.38:0/2894130156 conn(0x562fe9bb5460 msgr2=0x562fe9f66590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 -- 172.21.15.38:0/2894130156 shutdown_connections 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.120+0000 7fa93ced7740 1 -- 172.21.15.38:0/2894130156 wait complete. 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 -- start start 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 Processor -- start 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f73d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f7ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562fe9d2f700 con 0x562fe9ba0390 2024-09-21T06:26:50.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562fe9e69160 con 0x562fe9bc1070 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562fe9f76ca0 con 0x562fe9b981b0 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa93ced7740 10 client.0 _ll_register_callbacks cb 0x562fe9e829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41942/0 (socket says 172.21.15.38:41942) 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.121+0000 7fa92f7fe640 1 -- 172.21.15.38:0/3719282356 learned_addr learned my addr 172.21.15.38:0/3719282356 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa934f00640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f73d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa934f00640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f7ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 -- 172.21.15.38:0/3719282356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 msgr2=0x562fe9f73d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f73d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 -- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 msgr2=0x562fe9f7ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f7ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 -- 172.21.15.38:0/3719282356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe9e96c90 con 0x562fe9ba0390 2024-09-21T06:26:50.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa92400bde0 tx=0x7fa9240117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31476d5bcbca0be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa90f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924012860 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa924012a00 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa928036030 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa924012c00 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa93ced7740 10 client.17448 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.122+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562fe9f82990 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa928036030 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa92401d5a0 con 0x562fe9ba0390 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 10 client.17448 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 20 client.17448 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b7f9f0 0x562fe9f85e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 4 client.17448 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:50.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fe9ee0df0 con 0x562fe9b7f9f0 2024-09-21T06:26:50.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.123+0000 7fa934f00640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b7f9f0 0x562fe9f85e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.124+0000 7fa934f00640 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b7f9f0 0x562fe9f85e00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc7a82ea2c6bac67 server_cookie=68c06b473e860b37 in_seq=0 out_seq=0 2024-09-21T06:26:50.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.124+0000 7fa90f7fe640 10 client.17448 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.124+0000 7fa90f7fe640 1 -- 172.21.15.38:0/3719282356 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562fe9ee0df0 con 0x562fe9b7f9f0 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.124+0000 7fa90f7fe640 10 client.17448 handle_command_reply: tid=0 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.124+0000 7fa93ced7740 1 client.17448 shutdown 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 msgr2=0x562fe9f742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fa92400bde0 tx=0x7fa9240117b0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 shutdown_connections 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f7ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f742c0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b7f9f0 0x562fe9f85e00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 --2- 172.21.15.38:0/3719282356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f73d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa90f7fe640 0 client.17448 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 >> 172.21.15.38:0/3719282356 conn(0x562fe9bb5460 msgr2=0x562fe9f6b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 shutdown_connections 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 1 -- 172.21.15.38:0/3719282356 wait complete. 2024-09-21T06:26:50.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.125+0000 7fa93ced7740 20 client.17448 trim_cache size 0 max 16384 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 Processor -- start 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 -- start start 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f74240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9bc1070 0x562fe9f70f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301b1ea0 con 0x562fe9ba0390 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301af770 con 0x562fe9b981b0 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.138+0000 7fa93ced7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301ad5e0 con 0x562fe9bc1070 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41956/0 (socket says 172.21.15.38:41956) 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 -- 172.21.15.38:0/2012708708 learned_addr learned my addr 172.21.15.38:0/2012708708 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa934f00640 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f74240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 -- 172.21.15.38:0/2012708708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9bc1070 msgr2=0x562fe9f70f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9bc1070 0x562fe9f70f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 -- 172.21.15.38:0/2012708708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 msgr2=0x562fe9f74240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f74240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 -- 172.21.15.38:0/2012708708 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe9f72280 con 0x562fe9ba0390 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa9240058d0 tx=0x7fa92401df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d848f595dada2e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa915ffb640 1 -- 172.21.15.38:0/2012708708 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92402d070 con 0x562fe9ba0390 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa915ffb640 1 -- 172.21.15.38:0/2012708708 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa92401dde0 con 0x562fe9ba0390 2024-09-21T06:26:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.139+0000 7fa915ffb640 1 -- 172.21.15.38:0/2012708708 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa924005570 con 0x562fe9ba0390 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- 172.21.15.38:0/2012708708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 msgr2=0x562fe9f7fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa9240058d0 tx=0x7fa92401df90 comp rx=0 tx=0).stop 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- 172.21.15.38:0/2012708708 shutdown_connections 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9bc1070 0x562fe9f70f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f7fe90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 --2- 172.21.15.38:0/2012708708 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9b981b0 0x562fe9f74240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- 172.21.15.38:0/2012708708 >> 172.21.15.38:0/2012708708 conn(0x562fe9bb5460 msgr2=0x562fe9f73b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- 172.21.15.38:0/2012708708 shutdown_connections 2024-09-21T06:26:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- 172.21.15.38:0/2012708708 wait complete. 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.140+0000 7fa93ced7740 1 -- start start 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 Processor -- start 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f77f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f78a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301adc30 con 0x562fe9ba0390 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301af0a0 con 0x562fe9bc1070 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9301ae300 con 0x562fe9b981b0 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa93ced7740 10 client.0 _ll_register_callbacks cb 0x7fa92400ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41972/0 (socket says 172.21.15.38:41972) 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 -- 172.21.15.38:0/605329282 learned_addr learned my addr 172.21.15.38:0/605329282 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa934f00640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f77f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa934f00640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f78a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 -- 172.21.15.38:0/605329282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 msgr2=0x562fe9f77f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f77f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 -- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 msgr2=0x562fe9f78a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.141+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f78a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa92f7fe640 1 -- 172.21.15.38:0/605329282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe9ff3c70 con 0x562fe9ba0390 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa934f00640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f77f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa92f7fe640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa9240059f0 tx=0x7fa9240053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e442ebdfba0f4961 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92402d070 con 0x562fe9ba0390 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa92401dbe0 con 0x562fe9ba0390 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa92401dde0 con 0x562fe9ba0390 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa924011cb0 con 0x562fe9ba0390 2024-09-21T06:26:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa93ced7740 10 client.17454 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562fe9ff4ef0 con 0x562fe9ba0390 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa92401dde0 con 0x562fe9ba0390 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.142+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa924003850 con 0x562fe9ba0390 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 10 client.17454 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 20 client.17454 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b54da0 0x562fe9ff7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 4 client.17454 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fe9edc8a0 con 0x562fe9b54da0 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa934f00640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b54da0 0x562fe9ff7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa934f00640 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b54da0 0x562fe9ff7600 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c286bbbf2d108f0 server_cookie=23e17451bdb1fc29 in_seq=0 out_seq=0 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa90f7fe640 10 client.17454 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa90f7fe640 1 -- 172.21.15.38:0/605329282 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fe9edc8a0 con 0x562fe9b54da0 2024-09-21T06:26:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa90f7fe640 10 client.17454 handle_command_reply: tid=0 2024-09-21T06:26:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.143+0000 7fa93ced7740 1 client.17454 shutdown 2024-09-21T06:26:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 msgr2=0x562fe9f784c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa9240059f0 tx=0x7fa9240053a0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 shutdown_connections 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562fe9bc1070 0x562fe9f78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562fe9ba0390 0x562fe9f784c0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x562fe9b54da0 0x562fe9ff7600 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 --2- 172.21.15.38:0/605329282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562fe9b981b0 0x562fe9f77f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa90f7fe640 0 client.17454 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 >> 172.21.15.38:0/605329282 conn(0x562fe9bb5460 msgr2=0x562fe9f696d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 shutdown_connections 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 1 -- 172.21.15.38:0/605329282 wait complete. 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa93ced7740 20 client.17454 trim_cache size 0 max 16384 2024-09-21T06:26:50.150 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 msgr2=0x7fa9180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 0x7fa9180b8c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9200e4880 tx=0x7fa9200a96a0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 msgr2=0x7fa93019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.144+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa92000d950 tx=0x7fa92000de10 comp rx=0 tx=0).stop 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 shutdown_connections 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa9180b6700 0x7fa9180b8c10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa93010de40 0x7fa93019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa930105330 0x7fa93019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 --2- 172.21.15.38:0/2716834875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9301049e0 0x7fa93019a510 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 >> 172.21.15.38:0/2716834875 conn(0x7fa930079750 msgr2=0x7fa930105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 shutdown_connections 2024-09-21T06:26:50.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:50.145+0000 7fa936963640 1 -- 172.21.15.38:0/2716834875 wait complete. 2024-09-21T06:26:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:51 smithi038 ceph-mon[31215]: pgmap v536: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:51.818 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:26:51.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:26:51.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:51 smithi174 ceph-mon[34815]: pgmap v536: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:51.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:51 smithi044 ceph-mon[34369]: pgmap v536: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:26:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 -- 172.21.15.38:0/2428408939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708109e40 msgr2=0x7f3708110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 --2- 172.21.15.38:0/2428408939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708109e40 0x7f3708110670 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3700009ca0 tx=0x7f370002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 -- 172.21.15.38:0/2428408939 shutdown_connections 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 --2- 172.21.15.38:0/2428408939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708109e40 0x7f3708110670 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 --2- 172.21.15.38:0/2428408939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37081094f0 0x7f3708109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 --2- 172.21.15.38:0/2428408939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3708103bb0 0x7f3708103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 -- 172.21.15.38:0/2428408939 >> 172.21.15.38:0/2428408939 conn(0x7f37080ff600 msgr2=0x7f3708101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 -- 172.21.15.38:0/2428408939 shutdown_connections 2024-09-21T06:26:52.551 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.549+0000 7f370e7be640 1 -- 172.21.15.38:0/2428408939 wait complete. 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.550+0000 7f370e7be640 1 Processor -- start 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.550+0000 7f370e7be640 1 -- start start 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37081094f0 0x7f3708075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708109e40 0x7f3708076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f3708113c50 con 0x7f3708103bb0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3708113ad0 con 0x7f3708109e40 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370e7be640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3708113dd0 con 0x7f37081094f0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41992/0 (socket says 172.21.15.38:41992) 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 -- 172.21.15.38:0/300100641 learned_addr learned my addr 172.21.15.38:0/300100641 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f37077fe640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37081094f0 0x7f3708075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f370cd5b640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708109e40 0x7f3708076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 -- 172.21.15.38:0/300100641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37081094f0 msgr2=0x7f3708075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37081094f0 0x7f3708075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 -- 172.21.15.38:0/300100641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708109e40 msgr2=0x7f3708076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708109e40 0x7f3708076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 -- 172.21.15.38:0/300100641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37081a8830 con 0x7f3708103bb0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.551+0000 7f3707fff640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c970 tx=0x7f36f800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.552+0000 7f37057fa640 1 -- 172.21.15.38:0/300100641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8007bb0 con 0x7f3708103bb0 2024-09-21T06:26:52.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.552+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37081a8b20 con 0x7f3708103bb0 2024-09-21T06:26:52.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.552+0000 7f37057fa640 1 -- 172.21.15.38:0/300100641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36f8007d50 con 0x7f3708103bb0 2024-09-21T06:26:52.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.552+0000 7f37057fa640 1 -- 172.21.15.38:0/300100641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f800f450 con 0x7f3708103bb0 2024-09-21T06:26:52.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.552+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081a9010 con 0x7f3708103bb0 2024-09-21T06:26:52.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.554+0000 7f3714d32740 1 Processor -- start 2024-09-21T06:26:52.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.554+0000 7f3714d32740 1 -- start start 2024-09-21T06:26:52.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.554+0000 7f37057fa640 1 -- 172.21.15.38:0/300100641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f36f8004f10 con 0x7f3708103bb0 2024-09-21T06:26:52.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071e1350 0x559207588430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 0x559207588970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5592074fee60 con 0x5592071c0670 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5592074ee290 con 0x5592071b8490 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3714d32740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592074f20a0 con 0x5592071e1350 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42000/0 (socket says 172.21.15.38:42000) 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 -- 172.21.15.38:0/1234488911 learned_addr learned my addr 172.21.15.38:0/1234488911 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3707fff640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 0x559207588970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f370cd5b640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071e1350 0x559207588430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 -- 172.21.15.38:0/1234488911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071e1350 msgr2=0x559207588430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071e1350 0x559207588430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 -- 172.21.15.38:0/1234488911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 msgr2=0x559207588970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 0x559207588970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.558 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 -- 172.21.15.38:0/1234488911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920724c930 con 0x5592071c0670 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f3707fff640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 0x559207588970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37057fa640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 0x7f36f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.555+0000 7f37077fe640 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099d0 tx=0x7f36fc009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6663fb0dc2602bac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.556+0000 7f370cd5b640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 0x7f36f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.556+0000 7f37057fa640 1 -- 172.21.15.38:0/300100641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f36f80e7350 con 0x7f3708103bb0 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.556+0000 7f36ee7fc640 1 -- 172.21.15.38:0/1234488911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc017070 con 0x5592071c0670 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.556+0000 7f36ee7fc640 1 -- 172.21.15.38:0/1234488911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36fc013470 con 0x5592071c0670 2024-09-21T06:26:52.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.556+0000 7f36ee7fc640 1 -- 172.21.15.38:0/1234488911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc012630 con 0x5592071c0670 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- 172.21.15.38:0/1234488911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 msgr2=0x559207588eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f370cd5b640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 0x7f36f00b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f37000098d0 tx=0x7f3700009900 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099d0 tx=0x7f36fc009e90 comp rx=0 tx=0).stop 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- 172.21.15.38:0/1234488911 shutdown_connections 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071c0670 0x559207588eb0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071b8490 0x559207588970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 --2- 172.21.15.38:0/1234488911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071e1350 0x559207588430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- 172.21.15.38:0/1234488911 >> 172.21.15.38:0/1234488911 conn(0x5592071d5740 msgr2=0x559207586320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- 172.21.15.38:0/1234488911 shutdown_connections 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- 172.21.15.38:0/1234488911 wait complete. 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.557+0000 7f3714d32740 1 -- start start 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 Processor -- start 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x5592075944e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071e1350 0x55920759ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55920734f890 con 0x5592071b8490 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559207488d40 con 0x5592071e1350 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559207596c10 con 0x5592071c0670 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3714d32740 10 client.0 _ll_register_callbacks cb 0x5592074ecc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42016/0 (socket says 172.21.15.38:42016) 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f3707fff640 1 -- 172.21.15.38:0/65910900 learned_addr learned my addr 172.21.15.38:0/65910900 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f370cd5b640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071e1350 0x55920759ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.558+0000 7f37077fe640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x5592075944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 -- 172.21.15.38:0/65910900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 msgr2=0x5592075944e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x5592075944e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 -- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071e1350 msgr2=0x55920759ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071e1350 0x55920759ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 -- 172.21.15.38:0/65910900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592075a0490 con 0x5592071b8490 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f37077fe640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x5592075944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3707fff640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f36f80e4b50 tx=0x7f36f80a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3e9deab4e9458e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f36e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f801d040 con 0x5592071b8490 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f36f80ac450 con 0x5592071b8490 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36fc013470 con 0x5592071b8490 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f36f80ac960 con 0x5592071b8490 2024-09-21T06:26:52.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3714d32740 10 client.17466 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592075a2da0 con 0x5592071b8490 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.559+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36fc013470 con 0x5592071b8490 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f36f80e7030 con 0x5592071b8490 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 10 client.17466 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 20 client.17466 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55920719fcd0 0x5592075a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 4 client.17466 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559207500db0 con 0x55920719fcd0 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f37077fe640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55920719fcd0 0x5592075a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f37077fe640 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55920719fcd0 0x5592075a62d0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bdad08e45fafbfb server_cookie=16591bf40f10491b in_seq=0 out_seq=0 2024-09-21T06:26:52.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.560+0000 7f36e77fe640 10 client.17466 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:52.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f36e77fe640 1 -- 172.21.15.38:0/65910900 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559207500db0 con 0x55920719fcd0 2024-09-21T06:26:52.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f36e77fe640 10 client.17466 handle_command_reply: tid=0 2024-09-21T06:26:52.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 client.17466 shutdown 2024-09-21T06:26:52.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 msgr2=0x559207593fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f36f80e4b50 tx=0x7f36f80a9900 comp rx=0 tx=0).stop 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 shutdown_connections 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071e1350 0x55920759ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55920719fcd0 0x5592075a62d0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f36e77fe640 0 client.17466 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x5592075944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 --2- 172.21.15.38:0/65910900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207593fa0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.561+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 >> 172.21.15.38:0/65910900 conn(0x5592071d5740 msgr2=0x55920758b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.562+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 shutdown_connections 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.562+0000 7f3714d32740 1 -- 172.21.15.38:0/65910900 wait complete. 2024-09-21T06:26:52.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.562+0000 7f3714d32740 20 client.17466 trim_cache size 0 max 16384 2024-09-21T06:26:52.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.579+0000 7f3714d32740 1 Processor -- start 2024-09-21T06:26:52.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.579+0000 7f3714d32740 1 -- start start 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071b8490 0x55920758e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071c0670 0x559207590f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b4210 con 0x55920719fcd0 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b1ae0 con 0x5592071c0670 2024-09-21T06:26:52.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3714d32740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37081af950 con 0x5592071b8490 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42020/0 (socket says 172.21.15.38:42020) 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 -- 172.21.15.38:0/2308672266 learned_addr learned my addr 172.21.15.38:0/2308672266 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f37077fe640 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071b8490 0x55920758e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f370cd5b640 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071c0670 0x559207590f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 -- 172.21.15.38:0/2308672266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071b8490 msgr2=0x55920758e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071b8490 0x55920758e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 -- 172.21.15.38:0/2308672266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071c0670 msgr2=0x559207590f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071c0670 0x559207590f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 -- 172.21.15.38:0/2308672266 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920758f630 con 0x55920719fcd0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f3707fff640 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f36f80ad180 tx=0x7f36f80e7700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1a20b6dc4e8f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.580+0000 7f36edffb640 1 -- 172.21.15.38:0/2308672266 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f801d070 con 0x55920719fcd0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f36edffb640 1 -- 172.21.15.38:0/2308672266 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36f80ad8f0 con 0x55920719fcd0 2024-09-21T06:26:52.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f36edffb640 1 -- 172.21.15.38:0/2308672266 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80d0e20 con 0x55920719fcd0 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 -- 172.21.15.38:0/2308672266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 msgr2=0x55920759fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f36f80ad180 tx=0x7f36f80e7700 comp rx=0 tx=0).stop 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 -- 172.21.15.38:0/2308672266 shutdown_connections 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592071c0670 0x559207590f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071b8490 0x55920758e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 --2- 172.21.15.38:0/2308672266 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55920719fcd0 0x55920759fe00 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 -- 172.21.15.38:0/2308672266 >> 172.21.15.38:0/2308672266 conn(0x5592071d5740 msgr2=0x559207592620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 -- 172.21.15.38:0/2308672266 shutdown_connections 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.581+0000 7f3714d32740 1 -- 172.21.15.38:0/2308672266 wait complete. 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 -- start start 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 Processor -- start 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55920719fcd0 0x559207598510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x55920760fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f37081affa0 con 0x5592071b8490 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b1410 con 0x55920719fcd0 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37081b0670 con 0x5592071c0670 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.582+0000 7f3714d32740 10 client.0 _ll_register_callbacks cb 0x7f36f80058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42032/0 (socket says 172.21.15.38:42032) 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 -- 172.21.15.38:0/1750613522 learned_addr learned my addr 172.21.15.38:0/1750613522 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:52.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f370cd5b640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x55920760fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f3707fff640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55920719fcd0 0x559207598510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 -- 172.21.15.38:0/1750613522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 msgr2=0x55920760fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x55920760fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 -- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55920719fcd0 msgr2=0x559207598510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55920719fcd0 0x559207598510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 -- 172.21.15.38:0/1750613522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592076101d0 con 0x5592071b8490 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f37077fe640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e5a0 tx=0x7f36fc013db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5488315e242340 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f36e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc017040 con 0x5592071b8490 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f36fc013880 con 0x5592071b8490 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f80ad8f0 con 0x5592071b8490 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f36fc006d60 con 0x5592071b8490 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f3714d32740 10 client.17472 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:52.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.583+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592076113d0 con 0x5592071b8490 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36f80ad8f0 con 0x5592071b8490 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f36fc02b070 con 0x5592071b8490 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 10 client.17472 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 20 client.17472 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592071e1350 0x559207613880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 4 client.17472 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5592074fc860 con 0x5592071e1350 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.584+0000 7f3707fff640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592071e1350 0x559207613880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.585+0000 7f3707fff640 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592071e1350 0x559207613880 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1bcc8305b3f98d server_cookie=8cfb5ec6e22b96ae in_seq=0 out_seq=0 2024-09-21T06:26:52.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.585+0000 7f36e77fe640 10 client.17472 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.586+0000 7f36e77fe640 1 -- 172.21.15.38:0/1750613522 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5592074fc860 con 0x5592071e1350 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.586+0000 7f36e77fe640 10 client.17472 handle_command_reply: tid=0 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.586+0000 7f3714d32740 1 client.17472 shutdown 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 msgr2=0x559207598a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e5a0 tx=0x7f36fc013db0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 shutdown_connections 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5592071e1350 0x559207613880 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592071c0670 0x55920760fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592071b8490 0x559207598a50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f36e77fe640 0 client.17472 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 --2- 172.21.15.38:0/1750613522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55920719fcd0 0x559207598510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 >> 172.21.15.38:0/1750613522 conn(0x5592071d5740 msgr2=0x559207595250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 shutdown_connections 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 1 -- 172.21.15.38:0/1750613522 wait complete. 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f3714d32740 20 client.17472 trim_cache size 0 max 16384 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:52.591 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "11957ca1-5032-432a-abc6-8183a74e5c82", 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 msgr2=0x7f36f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 0x7f36f00b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f37000098d0 tx=0x7f3700009900 comp rx=0 tx=0).stop 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 msgr2=0x7f3708075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:52.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.587+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c970 tx=0x7f36f800cd70 comp rx=0 tx=0).stop 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 shutdown_connections 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f36f00b6680 0x7f36f00b8b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708109e40 0x7f3708076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37081094f0 0x7f3708075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 --2- 172.21.15.38:0/300100641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3708103bb0 0x7f3708075710 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 >> 172.21.15.38:0/300100641 conn(0x7f37080ff600 msgr2=0x7f3708108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 shutdown_connections 2024-09-21T06:26:52.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:52.588+0000 7f370e7be640 1 -- 172.21.15.38:0/300100641 wait complete. 2024-09-21T06:26:53.455 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:26:53.481 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: pgmap v537: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:53.481 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:26:53.481 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.482 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:26:53.482 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.482 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:53 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: pgmap v537: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:53 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:26:53.717 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: pgmap v537: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:26:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:53 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/2220431857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54102ae0 msgr2=0x7f0b54102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/2220431857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54102ae0 0x7f0b54102ef0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009900 tx=0x7f0b5002a410 comp rx=0 tx=0).stop 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/2220431857 shutdown_connections 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/2220431857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54108d20 0x7f0b5410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/2220431857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/2220431857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54102ae0 0x7f0b54102ef0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/2220431857 >> 172.21.15.38:0/2220431857 conn(0x7f0b54079760 msgr2=0x7f0b54079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/2220431857 shutdown_connections 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.181+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/2220431857 wait complete. 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.182+0000 7f0b5bfa4640 1 Processor -- start 2024-09-21T06:26:54.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.182+0000 7f0b5bfa4640 1 -- start start 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.182+0000 7f0b5bfa4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54102ae0 0x7f0b5419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.182+0000 7f0b5bfa4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b5419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.182+0000 7f0b5bfa4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5bfa4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54113bd0 con 0x7f0b54108d20 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5bfa4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54113a50 con 0x7f0b54102ae0 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5bfa4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54113d50 con 0x7f0b541083d0 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42052/0 (socket says 172.21.15.38:42052) 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 -- 172.21.15.38:0/3121979481 learned_addr learned my addr 172.21.15.38:0/3121979481 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5953f640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b5419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b59d40640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54102ae0 0x7f0b5419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 -- 172.21.15.38:0/3121979481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 msgr2=0x7f0b5419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b5419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 -- 172.21.15.38:0/3121979481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54102ae0 msgr2=0x7f0b5419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54102ae0 0x7f0b5419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 -- 172.21.15.38:0/3121979481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541a0510 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5953f640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b5419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5a541640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00eaa0 tx=0x7f0b4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b4affd640 1 -- 172.21.15.38:0/3121979481 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00cdb0 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b4affd640 1 -- 172.21.15.38:0/3121979481 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b4c005020 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541a0800 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b4affd640 1 -- 172.21.15.38:0/3121979481 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0116d0 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.183+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a6f60 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.186+0000 7f0b62518740 1 Processor -- start 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.186+0000 7f0b4affd640 1 -- 172.21.15.38:0/3121979481 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0b4c0051d0 con 0x7f0b54108d20 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 -- start start 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 0x5594736bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559473631e50 con 0x5594732eb1b0 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559473621280 con 0x5594732f3390 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b62518740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559473625090 con 0x559473314070 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42054/0 (socket says 172.21.15.38:42054) 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b59d40640 1 -- 172.21.15.38:0/3598163658 learned_addr learned my addr 172.21.15.38:0/3598163658 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b5953f640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b5953f640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 0x5594736bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.187+0000 7f0b4affd640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 0x7f0b400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 -- 172.21.15.38:0/3598163658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 msgr2=0x5594736bb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 0x5594736bb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 -- 172.21.15.38:0/3598163658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 msgr2=0x5594736bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 -- 172.21.15.38:0/3598163658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55947337f650 con 0x5594732eb1b0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b5a541640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 0x7f0b400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b5953f640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 0x5594736bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b4affd640 1 -- 172.21.15.38:0/3121979481 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b4c0e78d0 con 0x7f0b54108d20 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b59d40640 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009900 tx=0x7f0b50032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386947412de5da99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b3ffff640 1 -- 172.21.15.38:0/3598163658 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5003f070 con 0x5594732eb1b0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b3ffff640 1 -- 172.21.15.38:0/3598163658 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b50004030 con 0x5594732eb1b0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.188+0000 7f0b3ffff640 1 -- 172.21.15.38:0/3598163658 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50035070 con 0x5594732eb1b0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 -- 172.21.15.38:0/3598163658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 msgr2=0x5594736bb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009900 tx=0x7f0b50032c00 comp rx=0 tx=0).stop 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b5a541640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 0x7f0b400b8c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ad470 tx=0x7f0b4c0a9dc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 -- 172.21.15.38:0/3598163658 shutdown_connections 2024-09-21T06:26:54.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732eb1b0 0x5594736bb7b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 --2- 172.21.15.38:0/3598163658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473314070 0x5594736bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 -- 172.21.15.38:0/3598163658 >> 172.21.15.38:0/3598163658 conn(0x559473308460 msgr2=0x5594736b9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 -- 172.21.15.38:0/3598163658 shutdown_connections 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.189+0000 7f0b62518740 1 -- 172.21.15.38:0/3598163658 wait complete. 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 -- start start 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 Processor -- start 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559473314070 0x5594736d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559473482700 con 0x5594732f3390 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594735bc110 con 0x559473314070 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5594736c99f0 con 0x5594732eb1b0 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b62518740 10 client.0 _ll_register_callbacks cb 0x5594735d5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42062/0 (socket says 172.21.15.38:42062) 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.190+0000 7f0b59d40640 1 -- 172.21.15.38:0/1673898035 learned_addr learned my addr 172.21.15.38:0/1673898035 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559473314070 0x5594736d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 -- 172.21.15.38:0/1673898035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 msgr2=0x5594736c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 -- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559473314070 msgr2=0x5594736d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559473314070 0x5594736d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 -- 172.21.15.38:0/1673898035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594735e9c40 con 0x5594732f3390 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b59d40640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002a450 tx=0x7f0b50004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2b485f7e8f908b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50035070 con 0x5594732f3390 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b500035f0 con 0x5594732f3390 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b50004030 con 0x5594732f3390 2024-09-21T06:26:54.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0b50055050 con 0x5594732f3390 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b62518740 10 client.17484 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.191+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5594736d5740 con 0x5594732f3390 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b50004030 con 0x5594732f3390 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0b50004a90 con 0x5594732f3390 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 10 client.17484 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 20 client.17484 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5594732d29f0 0x5594736d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 4 client.17484 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559473633da0 con 0x5594732d29f0 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.192+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5594732d29f0 0x5594736d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.193+0000 7f0b3d7fa640 10 client.17484 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.193+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5594732d29f0 0x5594736d8aa0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=523a0129735ded70 server_cookie=820bbc7d18dac412 in_seq=0 out_seq=0 2024-09-21T06:26:54.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.193+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/1673898035 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559473633da0 con 0x5594732d29f0 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.193+0000 7f0b3d7fa640 10 client.17484 handle_command_reply: tid=0 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 client.17484 shutdown 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 msgr2=0x5594736c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002a450 tx=0x7f0b50004490 comp rx=0 tx=0).stop 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 shutdown_connections 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559473314070 0x5594736d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736c6ee0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5594732d29f0 0x5594736d8aa0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 --2- 172.21.15.38:0/1673898035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b3d7fa640 0 client.17484 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 >> 172.21.15.38:0/1673898035 conn(0x559473308460 msgr2=0x5594736be400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 shutdown_connections 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 1 -- 172.21.15.38:0/1673898035 wait complete. 2024-09-21T06:26:54.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.194+0000 7f0b62518740 20 client.17484 trim_cache size 0 max 16384 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 Processor -- start 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 -- start start 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b1fa0 con 0x559473308460 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541af870 con 0x5594732f3390 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b62518740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541ad6e0 con 0x5594732eb1b0 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b5953f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b5953f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42066/0 (socket says 172.21.15.38:42066) 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.212+0000 7f0b5953f640 1 -- 172.21.15.38:0/1612919293 learned_addr learned my addr 172.21.15.38:0/1612919293 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b59d40640 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 -- 172.21.15.38:0/1612919293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 msgr2=0x5594736d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 -- 172.21.15.38:0/1612919293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 msgr2=0x5594736c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 -- 172.21.15.38:0/1612919293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594736c7c60 con 0x559473308460 2024-09-21T06:26:54.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b5953f640 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400cf60 tx=0x7f0b44014ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd560c7943459d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b3f7fe640 1 -- 172.21.15.38:0/1612919293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44014190 con 0x559473308460 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b3f7fe640 1 -- 172.21.15.38:0/1612919293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b44014330 con 0x559473308460 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.213+0000 7f0b3f7fe640 1 -- 172.21.15.38:0/1612919293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440105b0 con 0x559473308460 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- 172.21.15.38:0/1612919293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 msgr2=0x5594736b9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400cf60 tx=0x7f0b44014ac0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- 172.21.15.38:0/1612919293 shutdown_connections 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732f3390 0x5594736c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5594732eb1b0 0x5594736d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 --2- 172.21.15.38:0/1612919293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559473308460 0x5594736b9190 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- 172.21.15.38:0/1612919293 >> 172.21.15.38:0/1612919293 conn(0x5594736c7060 msgr2=0x5594736b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- 172.21.15.38:0/1612919293 shutdown_connections 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- 172.21.15.38:0/1612919293 wait complete. 2024-09-21T06:26:54.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 -- start start 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.214+0000 7f0b62518740 1 Processor -- start 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732eb1b0 0x5594736d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473308460 0x5594736da610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541add30 con 0x5594732f3390 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541af1a0 con 0x5594732eb1b0 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541ae400 con 0x559473308460 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b62518740 10 client.0 _ll_register_callbacks cb 0x7f0b50032b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b59d40640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42076/0 (socket says 172.21.15.38:42076) 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b59d40640 1 -- 172.21.15.38:0/513207818 learned_addr learned my addr 172.21.15.38:0/513207818 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b5953f640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732eb1b0 0x5594736d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.215+0000 7f0b5953f640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473308460 0x5594736da610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 -- 172.21.15.38:0/513207818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473308460 msgr2=0x5594736da610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473308460 0x5594736da610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 -- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732eb1b0 msgr2=0x5594736d9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732eb1b0 0x5594736d9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 -- 172.21.15.38:0/513207818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594737422f0 con 0x5594732f3390 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b59d40640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002a930 tx=0x7f0b50032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2685a1e1047798da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5005e030 con 0x5594732f3390 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f0b500048d0 con 0x5594732f3390 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55947362f850 con 0x5594732f3390 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0b50068050 con 0x5594732f3390 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b62518740 10 client.17490 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:54.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559473743580 con 0x5594732f3390 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.216+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55947362f850 con 0x5594732f3390 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0b50032070 con 0x5594732f3390 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 10 client.17490 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 10 client.17490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 20 client.17490 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559473314070 0x559473745cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 4 client.17490 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:26:54.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55947362cc80 con 0x559473314070 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b5953f640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559473314070 0x559473745cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b5953f640 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559473314070 0x559473745cd0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c74b584d2a1e310 server_cookie=30b808afc1a54826 in_seq=0 out_seq=0 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.217+0000 7f0b3d7fa640 10 client.17490 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b3d7fa640 1 -- 172.21.15.38:0/513207818 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x55947362cc80 con 0x559473314070 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b3d7fa640 10 client.17490 handle_command_reply: tid=0 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 client.17490 shutdown 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 msgr2=0x5594736da0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0b5002a930 tx=0x7f0b50032c00 comp rx=0 tx=0).stop 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 shutdown_connections 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559473314070 0x559473745cd0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559473308460 0x5594736da610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594732f3390 0x5594736da0d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b3d7fa640 0 client.17490 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:26:54.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 --2- 172.21.15.38:0/513207818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594732eb1b0 0x5594736d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 >> 172.21.15.38:0/513207818 conn(0x5594736c7060 msgr2=0x5594736c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 shutdown_connections 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 1 -- 172.21.15.38:0/513207818 wait complete. 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.218+0000 7f0b62518740 20 client.17490 trim_cache size 0 max 16384 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:26:54.224 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.225 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.228 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.229 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.230 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:26:54.231 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 msgr2=0x7f0b400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 0x7f0b400b8c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0ad470 tx=0x7f0b4c0a9dc0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 msgr2=0x7f0b5419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00eaa0 tx=0x7f0b4c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 shutdown_connections 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0b400b6700 0x7f0b400b8c10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0b54108d20 0x7f0b5419fde0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b541083d0 0x7f0b5419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 --2- 172.21.15.38:0/3121979481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b54102ae0 0x7f0b5419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 >> 172.21.15.38:0/3121979481 conn(0x7f0b54079760 msgr2=0x7f0b541014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 shutdown_connections 2024-09-21T06:26:54.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:54.219+0000 7f0b5bfa4640 1 -- 172.21.15.38:0/3121979481 wait complete. 2024-09-21T06:26:55.104 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:26:55.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:26:55.407 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:55 smithi038 ceph-mon[31215]: pgmap v538: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:55.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:55 smithi174 ceph-mon[34815]: pgmap v538: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/1556123690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a01062e0 msgr2=0x7ff6a01066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/1556123690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a01062e0 0x7ff6a01066f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff694009900 tx=0x7ff69402a410 comp rx=0 tx=0).stop 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/1556123690 shutdown_connections 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/1556123690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a0106c30 0x7ff6a0110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/1556123690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a01062e0 0x7ff6a01066f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/1556123690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/1556123690 >> 172.21.15.38:0/1556123690 conn(0x7ff6a0079e40 msgr2=0x7ff6a007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/1556123690 shutdown_connections 2024-09-21T06:26:55.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.898+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/1556123690 wait complete. 2024-09-21T06:26:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 Processor -- start 2024-09-21T06:26:55.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 -- start start 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a01062e0 0x7ff6a01034e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0113bf0 con 0x7ff6a0106c30 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0113a70 con 0x7ff6a01062e0 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.899+0000 7ff6a4b6e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a0113d70 con 0x7ff6a0102000 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42098/0 (socket says 172.21.15.38:42098) 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69e59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 -- 172.21.15.38:0/2569093522 learned_addr learned my addr 172.21.15.38:0/2569093522 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69dd9b640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a01062e0 0x7ff6a01034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 -- 172.21.15.38:0/2569093522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 msgr2=0x7ff6a0102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:55.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 -- 172.21.15.38:0/2569093522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a01062e0 msgr2=0x7ff6a01034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a01062e0 0x7ff6a01034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 -- 172.21.15.38:0/2569093522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a01a88e0 con 0x7ff6a0106c30 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69e59c640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff69ed9d640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff69800eaa0 tx=0x7ff69800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.900+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69800cdb0 con 0x7ff6a0106c30 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.901+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff698005020 con 0x7ff6a0106c30 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.901+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a01a8bd0 con 0x7ff6a0106c30 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.901+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6980116d0 con 0x7ff6a0106c30 2024-09-21T06:26:55.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.901+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a01a90e0 con 0x7ff6a0106c30 2024-09-21T06:26:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:55 smithi044 ceph-mon[34369]: pgmap v538: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:26:55.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.902+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a0102410 con 0x7ff6a0106c30 2024-09-21T06:26:55.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.904+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff6980051d0 con 0x7ff6a0106c30 2024-09-21T06:26:55.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.905+0000 7ff68f7fe640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 0x7ff6880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:55.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.905+0000 7ff69e59c640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 0x7ff6880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:55.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.905+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7ff6980e7bb0 con 0x7ff6a0106c30 2024-09-21T06:26:55.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.906+0000 7ff69e59c640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 0x7ff6880b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6a01049f0 tx=0x7ff69000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:55.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:55.908+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff698016030 con 0x7ff6a0106c30 2024-09-21T06:26:56.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.133+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6a002e640 con 0x7ff6a0106c30 2024-09-21T06:26:56.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.133+0000 7ff68f7fe640 1 -- 172.21.15.38:0/2569093522 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7ff6980b2550 con 0x7ff6a0106c30 2024-09-21T06:26:56.135 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:26:56.136 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:26:56.136 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:26:56.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 msgr2=0x7ff6880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 0x7ff6880b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6a01049f0 tx=0x7ff69000b390 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 msgr2=0x7ff6a0103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff69800eaa0 tx=0x7ff69800ef60 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 shutdown_connections 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ff6880b6700 0x7ff6880b8c10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6a0106c30 0x7ff6a0103a20 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6a01062e0 0x7ff6a01034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 --2- 172.21.15.38:0/2569093522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a0102000 0x7ff6a0102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 >> 172.21.15.38:0/2569093522 conn(0x7ff6a0079e40 msgr2=0x7ff6a0107fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 shutdown_connections 2024-09-21T06:26:56.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:56.136+0000 7ff6a4b6e640 1 -- 172.21.15.38:0/2569093522 wait complete. 2024-09-21T06:26:56.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:56 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2569093522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:56.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:56 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2569093522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:56 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2569093522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:26:56.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:26:57.169 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:57.557 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:57 smithi038 ceph-mon[31215]: pgmap v539: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:57.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 -- 172.21.15.38:0/515606186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d81094d0 msgr2=0x7fa2d81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 --2- 172.21.15.38:0/515606186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d81094d0 0x7fa2d81098e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009900 tx=0x7fa2cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 -- 172.21.15.38:0/515606186 shutdown_connections 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 --2- 172.21.15.38:0/515606186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 0x7fa2d8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 --2- 172.21.15.38:0/515606186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d81094d0 0x7fa2d81098e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 --2- 172.21.15.38:0/515606186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d8103b90 0x7fa2d8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 -- 172.21.15.38:0/515606186 >> 172.21.15.38:0/515606186 conn(0x7fa2d80ff5e0 msgr2=0x7fa2d8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 -- 172.21.15.38:0/515606186 shutdown_connections 2024-09-21T06:26:57.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 -- 172.21.15.38:0/515606186 wait complete. 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.651+0000 7fa2dd825640 1 Processor -- start 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 -- start start 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 0x7fa2d819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 0x7fa2d819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113c40 con 0x7fa2d8103b90 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113ac0 con 0x7fa2d8109e20 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2dd825640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8113dc0 con 0x7fa2d81094d0 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42114/0 (socket says 172.21.15.38:42114) 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/1165389788 learned_addr learned my addr 172.21.15.38:0/1165389788 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 0x7fa2d819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 0x7fa2d819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/1165389788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 msgr2=0x7fa2d819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 0x7fa2d819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/1165389788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 msgr2=0x7fa2d819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.652+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 0x7fa2d819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/1165389788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d81a0580 con 0x7fa2d8103b90 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 0x7fa2d819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b4a0 tx=0x7fa2c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2dc823640 1 -- 172.21.15.38:0/1165389788 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8014070 con 0x7fa2d8103b90 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d81a0870 con 0x7fa2d8103b90 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2dc823640 1 -- 172.21.15.38:0/1165389788 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2c8010ae0 con 0x7fa2d8103b90 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2dc823640 1 -- 172.21.15.38:0/1165389788 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8017ce0 con 0x7fa2d8103b90 2024-09-21T06:26:57.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.653+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81a6fd0 con 0x7fa2d8103b90 2024-09-21T06:26:57.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 Processor -- start 2024-09-21T06:26:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 -- start start 2024-09-21T06:26:57.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2dc823640 1 -- 172.21.15.38:0/1165389788 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa2c8017070 con 0x7fa2d8103b90 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c6a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e5789a1b0 0x560e57c6abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560e57be0ea0 con 0x560e578a2390 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e57bd02d0 con 0x560e578c3070 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560e57bd40e0 con 0x560e5789a1b0 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2d67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2d67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42126/0 (socket says 172.21.15.38:42126) 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.656+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2175458583 learned_addr learned my addr 172.21.15.38:0/2175458583 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c6a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e5789a1b0 0x560e57c6abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2175458583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e5789a1b0 msgr2=0x560e57c6abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e5789a1b0 0x560e57c6abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2175458583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 msgr2=0x560e57c6a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c6a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2175458583 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5792e650 con 0x560e578a2390 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2dc823640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 0x7fa2c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa2d806bb30 tx=0x7fa2cc032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbad307edfe3cf69 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 0x7fa2c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2bdffb640 1 -- 172.21.15.38:0/2175458583 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc03f070 con 0x560e578a2390 2024-09-21T06:26:57.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.657+0000 7fa2dc823640 1 -- 172.21.15.38:0/1165389788 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa2c80e6d50 con 0x7fa2d8103b90 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.658+0000 7fa2bdffb640 1 -- 172.21.15.38:0/2175458583 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2cc032e50 con 0x560e578a2390 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.658+0000 7fa2bdffb640 1 -- 172.21.15.38:0/2175458583 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc035070 con 0x560e578a2390 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.658+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2175458583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 msgr2=0x560e57c6b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.658+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 0x7fa2c00b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005fd0 tx=0x7fa2d0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.658+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa2d806bb30 tx=0x7fa2cc032c60 comp rx=0 tx=0).stop 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2175458583 shutdown_connections 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c6b120 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e5789a1b0 0x560e57c6abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2175458583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c6a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2175458583 >> 172.21.15.38:0/2175458583 conn(0x560e578b7460 msgr2=0x560e57c68590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2175458583 shutdown_connections 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2175458583 wait complete. 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 -- start start 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.659+0000 7fa2e3d99740 1 Processor -- start 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e5789a1b0 0x560e57c75d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c82110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x560e57a31700 con 0x560e578a2390 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560e57b6b160 con 0x560e5789a1b0 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560e57c78e20 con 0x560e578c3070 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2e3d99740 10 client.0 _ll_register_callbacks cb 0x560e57b849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c82110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42134/0 (socket says 172.21.15.38:42134) 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2042666963 learned_addr learned my addr 172.21.15.38:0/2042666963 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e5789a1b0 0x560e57c75d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 msgr2=0x560e57c82110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c82110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2042666963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e5789a1b0 msgr2=0x560e57c75d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e5789a1b0 0x560e57c75d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 -- 172.21.15.38:0/2042666963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e57b98c90 con 0x560e578a2390 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000c00 tx=0x7fa2cc031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac763d805bc2a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.660+0000 7fa2b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc04a020 con 0x560e578a2390 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa2cc03b840 con 0x560e578a2390 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2cc032e50 con 0x560e578a2390 2024-09-21T06:26:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa2cc055050 con 0x560e578a2390 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 10 client.17508 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560e57c84b60 con 0x560e578a2390 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2cc032e50 con 0x560e578a2390 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa2cc004ef0 con 0x560e578a2390 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 10 client.17508 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 10 client.17508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 20 client.17508 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.661+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e578819f0 0x560e57c87ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.662+0000 7fa2e3d99740 4 client.17508 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.662+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e57be2df0 con 0x560e578819f0 2024-09-21T06:26:57.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.662+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e578819f0 0x560e57c87ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.662+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e578819f0 0x560e57c87ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1bba3aa3cfd73d80 server_cookie=52973148bdedf56b in_seq=0 out_seq=0 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.662+0000 7fa2b6ffd640 10 client.17508 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.663+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2042666963 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e57be2df0 con 0x560e578819f0 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.663+0000 7fa2b6ffd640 10 client.17508 handle_command_reply: tid=0 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.663+0000 7fa2e3d99740 1 client.17508 shutdown 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 msgr2=0x560e57c762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000c00 tx=0x7fa2cc031830 comp rx=0 tx=0).stop 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 shutdown_connections 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e578819f0 0x560e57c87ec0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c82110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e578a2390 0x560e57c762c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2b6ffd640 0 client.17508 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2042666963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e5789a1b0 0x560e57c75d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 >> 172.21.15.38:0/2042666963 conn(0x560e578b7460 msgr2=0x560e57c6d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 shutdown_connections 2024-09-21T06:26:57.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2042666963 wait complete. 2024-09-21T06:26:57.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.664+0000 7fa2e3d99740 20 client.17508 trim_cache size 0 max 16384 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 Processor -- start 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 -- start start 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578a2390 0x560e57c82080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81b2040 con 0x560e5789a1b0 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81af910 con 0x560e578c3070 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.677+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81ad780 con 0x560e578a2390 2024-09-21T06:26:57.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42142/0 (socket says 172.21.15.38:42142) 2024-09-21T06:26:57.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/340830988 learned_addr learned my addr 172.21.15.38:0/340830988 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578a2390 0x560e57c82080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/340830988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578a2390 msgr2=0x560e57c82080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578a2390 0x560e57c82080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/340830988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 msgr2=0x560e57c72f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c72f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/340830988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e57c77040 con 0x560e5789a1b0 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8017fd0 tx=0x7fa2c80e9260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35b1e7058edd7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2bd7fa640 1 -- 172.21.15.38:0/340830988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c801e040 con 0x560e5789a1b0 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2bd7fa640 1 -- 172.21.15.38:0/340830988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2c80ac700 con 0x560e5789a1b0 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.678+0000 7fa2bd7fa640 1 -- 172.21.15.38:0/340830988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80b16d0 con 0x560e5789a1b0 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- 172.21.15.38:0/340830988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 msgr2=0x560e57c76240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8017fd0 tx=0x7fa2c80e9260 comp rx=0 tx=0).stop 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- 172.21.15.38:0/340830988 shutdown_connections 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578c3070 0x560e57c72f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578a2390 0x560e57c82080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/340830988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c76240 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- 172.21.15.38:0/340830988 >> 172.21.15.38:0/340830988 conn(0x560e578b7460 msgr2=0x560e57c75b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- 172.21.15.38:0/340830988 shutdown_connections 2024-09-21T06:26:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- 172.21.15.38:0/340830988 wait complete. 2024-09-21T06:26:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.679+0000 7fa2e3d99740 1 -- start start 2024-09-21T06:26:57.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 Processor -- start 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 0x560e57c894b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81addd0 con 0x560e5789a1b0 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81af240 con 0x560e578a2390 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81ae4a0 con 0x560e578c3070 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2e3d99740 10 client.0 _ll_register_callbacks cb 0x7fa2d00099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2d6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42152/0 (socket says 172.21.15.38:42152) 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/2079106848 learned_addr learned my addr 172.21.15.38:0/2079106848 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 0x560e57c894b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.680+0000 7fa2d77fe640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 msgr2=0x560e57c899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/2079106848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 msgr2=0x560e57c894b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 0x560e57c894b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 -- 172.21.15.38:0/2079106848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e57cf16c0 con 0x560e5789a1b0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 0x560e57c894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2d6ffd640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80acb80 tx=0x7fa2c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a8f65020e53067 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c801e070 con 0x560e5789a1b0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa2c80d00e0 con 0x560e5789a1b0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c80ac700 con 0x560e5789a1b0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa2c80a8360 con 0x560e5789a1b0 2024-09-21T06:26:57.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2e3d99740 10 client.17514 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560e57cf28b0 con 0x560e5789a1b0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2c80ac700 con 0x560e5789a1b0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.681+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c80a8040 con 0x560e5789a1b0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 10 client.17514 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 10 client.17514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 20 client.17514 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e57856da0 0x560e57cf4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 4 client.17514 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e57bde8a0 con 0x560e57856da0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e57856da0 0x560e57cf4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2d67fc640 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e57856da0 0x560e57cf4f40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f811abf0401b959d server_cookie=f24c1533f8db87b4 in_seq=0 out_seq=0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2b6ffd640 10 client.17514 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2b6ffd640 1 -- 172.21.15.38:0/2079106848 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e57bde8a0 con 0x560e57856da0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2b6ffd640 10 client.17514 handle_command_reply: tid=0 2024-09-21T06:26:57.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.682+0000 7fa2e3d99740 1 client.17514 shutdown 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 msgr2=0x560e57c88f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80acb80 tx=0x7fa2c8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 shutdown_connections 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x560e57856da0 0x560e57cf4f40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2b6ffd640 0 client.17514 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e578c3070 0x560e57c899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560e578a2390 0x560e57c894b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 --2- 172.21.15.38:0/2079106848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x560e5789a1b0 0x560e57c88f70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 >> 172.21.15.38:0/2079106848 conn(0x560e578b7460 msgr2=0x560e57c741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 shutdown_connections 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 1 -- 172.21.15.38:0/2079106848 wait complete. 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2e3d99740 20 client.17514 trim_cache size 0 max 16384 2024-09-21T06:26:57.689 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 msgr2=0x7fa2c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 0x7fa2c00b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005fd0 tx=0x7fa2d0009500 comp rx=0 tx=0).stop 2024-09-21T06:26:57.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 msgr2=0x7fa2d819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.683+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b4a0 tx=0x7fa2c800b960 comp rx=0 tx=0).stop 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 shutdown_connections 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa2c00b6680 0x7fa2c00b8b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2d8109e20 0x7fa2d819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2d81094d0 0x7fa2d819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 --2- 172.21.15.38:0/1165389788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa2d8103b90 0x7fa2d819a610 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 >> 172.21.15.38:0/1165389788 conn(0x7fa2d80ff5e0 msgr2=0x7fa2d8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 shutdown_connections 2024-09-21T06:26:57.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:57.684+0000 7fa2dd825640 1 -- 172.21.15.38:0/1165389788 wait complete. 2024-09-21T06:26:57.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:57 smithi174 ceph-mon[34815]: pgmap v539: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:57 smithi044 ceph-mon[34369]: pgmap v539: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:26:58.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:26:58.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:58 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:58.767 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:58 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:58.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:58 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 -- 172.21.15.38:0/415846334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550108d20 msgr2=0x7fa55010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 --2- 172.21.15.38:0/415846334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550108d20 0x7fa55010f550 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ca0 tx=0x7fa54802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 -- 172.21.15.38:0/415846334 shutdown_connections 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 --2- 172.21.15.38:0/415846334 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550108d20 0x7fa55010f550 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 --2- 172.21.15.38:0/415846334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa5501087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 --2- 172.21.15.38:0/415846334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550102ae0 0x7fa550102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 -- 172.21.15.38:0/415846334 >> 172.21.15.38:0/415846334 conn(0x7fa550079760 msgr2=0x7fa550079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 -- 172.21.15.38:0/415846334 shutdown_connections 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.242+0000 7fa556e2a640 1 -- 172.21.15.38:0/415846334 wait complete. 2024-09-21T06:26:59.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.243+0000 7fa556e2a640 1 Processor -- start 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.243+0000 7fa556e2a640 1 -- start start 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa550199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 0x7fa55019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa550112ab0 con 0x7fa550102ae0 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa550112930 con 0x7fa5501083d0 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa550112c30 con 0x7fa550108d20 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42170/0 (socket says 172.21.15.38:42170) 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 -- 172.21.15.38:0/3451476286 learned_addr learned my addr 172.21.15.38:0/3451476286 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa54ffff640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa550199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa5553c7640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 0x7fa55019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 -- 172.21.15.38:0/3451476286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 msgr2=0x7fa55019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 0x7fa55019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 -- 172.21.15.38:0/3451476286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 msgr2=0x7fa550199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa550199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 -- 172.21.15.38:0/3451476286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55019f230 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa5553c7640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 0x7fa55019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa54ffff640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa550199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa554bc6640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9f0 tx=0x7fa54000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa54dffb640 1 -- 172.21.15.38:0/3451476286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000cd80 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa54dffb640 1 -- 172.21.15.38:0/3451476286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa540010900 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa54dffb640 1 -- 172.21.15.38:0/3451476286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540018920 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.244+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55019f520 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.245+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a5d40 con 0x7fa550102ae0 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.247+0000 7fa55d39e740 1 Processor -- start 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.247+0000 7fa55d39e740 1 -- start start 2024-09-21T06:26:59.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.247+0000 7fa54dffb640 1 -- 172.21.15.38:0/3451476286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa540010ab0 con 0x7fa550102ae0 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b00fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b00fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0071ea0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3b00612d0 con 0x55f3afd54070 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa55d39e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f3b00650e0 con 0x55f3afd33390 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42184/0 (socket says 172.21.15.38:42184) 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 -- 172.21.15.38:0/942774115 learned_addr learned my addr 172.21.15.38:0/942774115 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa54ffff640 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b00fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa5553c7640 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b00fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 -- 172.21.15.38:0/942774115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 msgr2=0x55f3b00fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b00fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 -- 172.21.15.38:0/942774115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 msgr2=0x55f3b00fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b00fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa54dffb640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 0x7fa53c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa554bc6640 1 -- 172.21.15.38:0/942774115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3afdbf650 con 0x55f3afd2b1b0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa5553c7640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 0x7fa53c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.248+0000 7fa54dffb640 1 -- 172.21.15.38:0/3451476286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa5400e7b00 con 0x7fa550102ae0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.249+0000 7fa554bc6640 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa5400e5210 tx=0x7fa5400adb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5b43d106163e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.249+0000 7fa546ffd640 1 -- 172.21.15.38:0/942774115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5400ad770 con 0x55f3afd2b1b0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.249+0000 7fa546ffd640 1 -- 172.21.15.38:0/942774115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa540010e20 con 0x55f3afd2b1b0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.249+0000 7fa546ffd640 1 -- 172.21.15.38:0/942774115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5400ad110 con 0x55f3afd2b1b0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 -- 172.21.15.38:0/942774115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 msgr2=0x55f3b00fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa5400e5210 tx=0x7fa5400adb90 comp rx=0 tx=0).stop 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa5553c7640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 0x7fa53c0b8c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa54802f500 tx=0x7fa548005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 -- 172.21.15.38:0/942774115 shutdown_connections 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b00fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd2b1b0 0x55f3b00fb800 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.250+0000 7fa55d39e740 1 --2- 172.21.15.38:0/942774115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b00fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.251+0000 7fa55d39e740 1 -- 172.21.15.38:0/942774115 >> 172.21.15.38:0/942774115 conn(0x55f3afd48460 msgr2=0x55f3b00f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.251+0000 7fa55d39e740 1 -- 172.21.15.38:0/942774115 shutdown_connections 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.251+0000 7fa55d39e740 1 -- 172.21.15.38:0/942774115 wait complete. 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.251+0000 7fa55d39e740 1 -- start start 2024-09-21T06:26:59.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.251+0000 7fa55d39e740 1 Processor -- start 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0112d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f3afec2700 con 0x55f3afd54070 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3afffc160 con 0x55f3afd2b1b0 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f3b0109aa0 con 0x55f3afd33390 2024-09-21T06:26:59.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa55d39e740 10 client.0 _ll_register_callbacks cb 0x55f3b00159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.252+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:43220/0 (socket says 172.21.15.38:43220) 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 -- 172.21.15.38:0/1474716227 learned_addr learned my addr 172.21.15.38:0/1474716227 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa5553c7640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa554bc6640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 -- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd2b1b0 msgr2=0x55f3b0106a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 -- 172.21.15.38:0/1474716227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 msgr2=0x55f3b0112d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0112d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.253+0000 7fa54ffff640 1 -- 172.21.15.38:0/1474716227 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b0029c90 con 0x55f3afd33390 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.254+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa538010800 tx=0x7fa538010cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a381795104843952 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.254+0000 7fa52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.254+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53801d060 con 0x55f3afd33390 2024-09-21T06:26:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.254+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa53800eda0 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3b0073df0 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa538018430 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 10 client.26848 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f3b01158c0 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55f3b0073df0 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa53800d5a0 con 0x55f3afd33390 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 10 client.26848 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 10 client.26848 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 20 client.26848 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afd129f0 0x55f3b0118d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 4 client.26848 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.255+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3b006f8a0 con 0x55f3afd129f0 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.256+0000 7fa554bc6640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afd129f0 0x55f3b0118d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.256+0000 7fa52ffff640 10 client.26848 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.256+0000 7fa554bc6640 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afd129f0 0x55f3b0118d10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7b026f83cdf36f1 server_cookie=3bb9aa2bc5c07548 in_seq=0 out_seq=0 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa52ffff640 1 -- 172.21.15.38:0/1474716227 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3b006f8a0 con 0x55f3afd129f0 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa52ffff640 10 client.26848 handle_command_reply: tid=0 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 client.26848 shutdown 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 msgr2=0x55f3b0106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa538010800 tx=0x7fa538010cc0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 shutdown_connections 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afd129f0 0x55f3b0118d10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0112d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd33390 0x55f3b0106f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa52ffff640 0 client.26848 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1474716227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 >> 172.21.15.38:0/1474716227 conn(0x55f3afd48460 msgr2=0x55f3b00fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.257+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 shutdown_connections 2024-09-21T06:26:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.258+0000 7fa55d39e740 1 -- 172.21.15.38:0/1474716227 wait complete. 2024-09-21T06:26:59.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.258+0000 7fa55d39e740 20 client.26848 trim_cache size 0 max 16384 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.271+0000 7fa55d39e740 1 Processor -- start 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.271+0000 7fa55d39e740 1 -- start start 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0103c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501afdb0 con 0x55f3afd54070 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501ad680 con 0x55f3afd33390 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa55d39e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501ab4f0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa5553c7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:36290/0 (socket says 172.21.15.38:36290) 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 -- 172.21.15.38:0/1928472668 learned_addr learned my addr 172.21.15.38:0/1928472668 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 -- 172.21.15.38:0/1928472668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 msgr2=0x55f3b0106f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 -- 172.21.15.38:0/1928472668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 msgr2=0x55f3b0103c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0103c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 -- 172.21.15.38:0/1928472668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3b00fd5b0 con 0x55f3afd33390 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa554bc6640 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:59.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.272+0000 7fa54ffff640 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa538001eb0 tx=0x7fa53800dd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc2ef3c3ac83ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.273+0000 7fa5467fc640 1 -- 172.21.15.38:0/1928472668 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538000e60 con 0x55f3afd33390 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.273+0000 7fa5467fc640 1 -- 172.21.15.38:0/1928472668 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa53800eda0 con 0x55f3afd33390 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.273+0000 7fa5467fc640 1 -- 172.21.15.38:0/1928472668 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538027080 con 0x55f3afd33390 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.273+0000 7fa55d39e740 1 -- 172.21.15.38:0/1928472668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 msgr2=0x55f3b0112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.273+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa538001eb0 tx=0x7fa53800dd60 comp rx=0 tx=0).stop 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 -- 172.21.15.38:0/1928472668 shutdown_connections 2024-09-21T06:26:59.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd54070 0x55f3b0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd33390 0x55f3b0112c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 --2- 172.21.15.38:0/1928472668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b0106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 -- 172.21.15.38:0/1928472668 >> 172.21.15.38:0/1928472668 conn(0x55f3afd48460 msgr2=0x55f3b01067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 -- 172.21.15.38:0/1928472668 shutdown_connections 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 -- 172.21.15.38:0/1928472668 wait complete. 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 -- start start 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 Processor -- start 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.274+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b010f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b010af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501abb40 con 0x55f3afd33390 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501acfb0 con 0x55f3afd54070 2024-09-21T06:26:59.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501ac210 con 0x55f3afd2b1b0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa55d39e740 10 client.0 _ll_register_callbacks cb 0x7fa538010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b010f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42222/0 (socket says 172.21.15.38:42222) 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa54ffff640 1 -- 172.21.15.38:0/246581399 learned_addr learned my addr 172.21.15.38:0/246581399 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa5553c7640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b010af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 -- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 msgr2=0x55f3b010af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b010af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 -- 172.21.15.38:0/246581399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 msgr2=0x55f3b010a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 -- 172.21.15.38:0/246581399 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b010b6a0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa54ffff640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:26:59.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa554bc6640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b010f500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c6a0 tx=0x7fa5400eb700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbb765ff1c380819 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.275+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5400ad2f0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fa5400b20d0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53800eda0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa5400ad110 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 10 client.26854 fetch_fsmap learned FSMap version 34 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f3b0183650 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa53800eda0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa5400b0ce0 con 0x55f3afd2b1b0 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 10 client.26854 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 10 client.26854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 20 client.26854 populate_metadata read hostname 'smithi038' 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afce7da0 0x55f3b01858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:26:59.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 4 client.26854 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3b006ccd0 con 0x55f3afce7da0 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.276+0000 7fa54ffff640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afce7da0 0x55f3b01858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa54ffff640 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afce7da0 0x55f3b01858f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=649bedf05fd646d1 server_cookie=92036fda773d85fa in_seq=0 out_seq=0 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa52ffff640 10 client.26854 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa52ffff640 1 -- 172.21.15.38:0/246581399 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3b006ccd0 con 0x55f3afce7da0 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa52ffff640 10 client.26854 handle_command_reply: tid=0 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 client.26854 shutdown 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 msgr2=0x55f3b010f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b010f500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c6a0 tx=0x7fa5400eb700 comp rx=0 tx=0).stop 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 shutdown_connections 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55f3afce7da0 0x55f3b01858f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3afd54070 0x55f3b010af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3afd33390 0x55f3b010a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa52ffff640 0 client.26854 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 --2- 172.21.15.38:0/246581399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3afd2b1b0 0x55f3b010f500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 >> 172.21.15.38:0/246581399 conn(0x55f3afd48460 msgr2=0x55f3b00fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 shutdown_connections 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.277+0000 7fa55d39e740 1 -- 172.21.15.38:0/246581399 wait complete. 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa55d39e740 20 client.26854 trim_cache size 0 max 16384 2024-09-21T06:26:59.284 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 msgr2=0x7fa53c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 0x7fa53c0b8c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa54802f500 tx=0x7fa548005d80 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 msgr2=0x7fa550199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9f0 tx=0x7fa54000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 shutdown_connections 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa53c0b6730 0x7fa53c0b8c40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550108d20 0x7fa55019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5501083d0 0x7fa550199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 --2- 172.21.15.38:0/3451476286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa550102ae0 0x7fa550199380 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 >> 172.21.15.38:0/3451476286 conn(0x7fa550079760 msgr2=0x7fa550104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:26:59.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 shutdown_connections 2024-09-21T06:26:59.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:26:59.278+0000 7fa556e2a640 1 -- 172.21.15.38:0/3451476286 wait complete. 2024-09-21T06:26:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: pgmap v540: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:59.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:59.738 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:26:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: pgmap v540: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.807 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.808 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:59.808 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:59.808 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:26:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: pgmap v540: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8 op/s 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:59.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:59.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:59.896 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:26:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:26:59.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:27:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi038 to 177.0M 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Unable to set osd_memory_target on smithi174 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Unable to set osd_memory_target on smithi038 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T06:27:00.568 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:00 smithi038 ceph-mon[31215]: Unable to set osd_memory_target on smithi044 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:27:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 -- 172.21.15.38:0/1378731498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe80109df0 msgr2=0x7fbe80110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1378731498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe80109df0 0x7fbe80110620 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009ca0 tx=0x7fbe7802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 -- 172.21.15.38:0/1378731498 shutdown_connections 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1378731498 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe80109df0 0x7fbe80110620 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1378731498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe801094a0 0x7fbe801098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1378731498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80103b60 0x7fbe80103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 -- 172.21.15.38:0/1378731498 >> 172.21.15.38:0/1378731498 conn(0x7fbe8007b850 msgr2=0x7fbe8007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.660+0000 7fbe87eca640 1 -- 172.21.15.38:0/1378731498 shutdown_connections 2024-09-21T06:27:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.661+0000 7fbe87eca640 1 -- 172.21.15.38:0/1378731498 wait complete. 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.661+0000 7fbe87eca640 1 Processor -- start 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.661+0000 7fbe87eca640 1 -- start start 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.661+0000 7fbe87eca640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe80103b60 0x7fbe8019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 0x7fbe801a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80113c50 con 0x7fbe801094a0 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80113ad0 con 0x7fbe80103b60 2024-09-21T06:27:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80113dd0 con 0x7fbe80109df0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33078/0 (socket says 172.21.15.38:33078) 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 -- 172.21.15.38:0/1855126073 learned_addr learned my addr 172.21.15.38:0/1855126073 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe80103b60 0x7fbe8019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe86467640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 0x7fbe801a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 -- 172.21.15.38:0/1855126073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 msgr2=0x7fbe801a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 0x7fbe801a2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 -- 172.21.15.38:0/1855126073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe80103b60 msgr2=0x7fbe8019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe80103b60 0x7fbe8019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 -- 172.21.15.38:0/1855126073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe801a27b0 con 0x7fbe801094a0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe86467640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 0x7fbe801a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe85465640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000d950 tx=0x7fbe7000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe76ffd640 1 -- 172.21.15.38:0/1855126073 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70017070 con 0x7fbe801094a0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe76ffd640 1 -- 172.21.15.38:0/1855126073 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe70009c30 con 0x7fbe801094a0 2024-09-21T06:27:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe801a2aa0 con 0x7fbe801094a0 2024-09-21T06:27:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe76ffd640 1 -- 172.21.15.38:0/1855126073 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700047a0 con 0x7fbe801094a0 2024-09-21T06:27:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.662+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe801a9200 con 0x7fbe801094a0 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.665+0000 7fbe8e43e740 1 Processor -- start 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.665+0000 7fbe8e43e740 1 -- start start 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe76ffd640 1 -- 172.21.15.38:0/1855126073 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbe70004020 con 0x7fbe801094a0 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55968a94cea0 con 0x55968a6061b0 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55968a93c2d0 con 0x55968a60e390 2024-09-21T06:27:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55968a9400e0 con 0x55968a62f070 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33094/0 (socket says 172.21.15.38:33094) 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe86467640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 -- 172.21.15.38:0/1241696314 learned_addr learned my addr 172.21.15.38:0/1241696314 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85465640 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 -- 172.21.15.38:0/1241696314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 msgr2=0x55968a9d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 -- 172.21.15.38:0/1241696314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 msgr2=0x55968a9d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.666+0000 7fbe85c66640 1 -- 172.21.15.38:0/1241696314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55968a69a650 con 0x55968a6061b0 2024-09-21T06:27:00.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009a70 tx=0x7fbe7c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66df1283e32dba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe6bfff640 1 -- 172.21.15.38:0/1241696314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c017070 con 0x55968a6061b0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe76ffd640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 0x7fbe6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe6bfff640 1 -- 172.21.15.38:0/1241696314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe7c013470 con 0x55968a6061b0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe6bfff640 1 -- 172.21.15.38:0/1241696314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c012630 con 0x55968a6061b0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe86467640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 0x7fbe6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.667+0000 7fbe76ffd640 1 -- 172.21.15.38:0/1855126073 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbe700e71c0 con 0x7fbe801094a0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1241696314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 msgr2=0x55968a9d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe86467640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 0x7fbe6c0b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005cc0 tx=0x7fbe78005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009a70 tx=0x7fbe7c009f30 comp rx=0 tx=0).stop 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1241696314 shutdown_connections 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9d6800 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1241696314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1241696314 >> 172.21.15.38:0/1241696314 conn(0x55968a623460 msgr2=0x55968a9d41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1241696314 shutdown_connections 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1241696314 wait complete. 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 -- start start 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.668+0000 7fbe8e43e740 1 Processor -- start 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55968a79d700 con 0x55968a62f070 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55968a8d7160 con 0x55968a60e390 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55968a9e4aa0 con 0x55968a6061b0 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe8e43e740 10 client.0 _ll_register_callbacks cb 0x55968a8f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33104/0 (socket says 172.21.15.38:33104) 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 -- 172.21.15.38:0/1878453800 learned_addr learned my addr 172.21.15.38:0/1878453800 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe85465640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 -- 172.21.15.38:0/1878453800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 msgr2=0x55968a9e1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 -- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 msgr2=0x55968a9e1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9e1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.669+0000 7fbe86467640 1 -- 172.21.15.38:0/1878453800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55968a904c90 con 0x55968a62f070 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe86467640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbe78035000 tx=0x7fbe7802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eab8335e1ba59c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe697fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe780318e0 con 0x55968a62f070 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbe78004040 con 0x55968a62f070 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7c013470 con 0x55968a62f070 2024-09-21T06:27:00.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbe78004240 con 0x55968a62f070 2024-09-21T06:27:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe8e43e740 10 client.17544 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55968a9f0820 con 0x55968a62f070 2024-09-21T06:27:00.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.670+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe7c013470 con 0x55968a62f070 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbe78051070 con 0x55968a62f070 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 10 client.17544 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 10 client.17544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 20 client.17544 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5ed9f0 0x55968a9f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 4 client.17544 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:00.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55968a94edf0 con 0x55968a5ed9f0 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5ed9f0 0x55968a9f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe697fa640 10 client.17544 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.671+0000 7fbe85c66640 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5ed9f0 0x55968a9f3da0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f549b2f09de298c2 server_cookie=ed2d396d337925ed in_seq=0 out_seq=0 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe697fa640 1 -- 172.21.15.38:0/1878453800 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55968a94edf0 con 0x55968a5ed9f0 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe697fa640 10 client.17544 handle_command_reply: tid=0 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 client.17544 shutdown 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 msgr2=0x55968a9ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbe78035000 tx=0x7fbe7802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 shutdown_connections 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a62f070 0x55968a9ede20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9e1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5ed9f0 0x55968a9f3da0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/1878453800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 >> 172.21.15.38:0/1878453800 conn(0x55968a623460 msgr2=0x55968a9d9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.672+0000 7fbe697fa640 0 client.17544 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.673+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 shutdown_connections 2024-09-21T06:27:00.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.673+0000 7fbe8e43e740 1 -- 172.21.15.38:0/1878453800 wait complete. 2024-09-21T06:27:00.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.673+0000 7fbe8e43e740 20 client.17544 trim_cache size 0 max 16384 2024-09-21T06:27:00.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 Processor -- start 2024-09-21T06:27:00.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 -- start start 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9edd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe64010f40 con 0x55968a6061b0 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6400e810 con 0x55968a60e390 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6400c680 con 0x55968a62f070 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe85c66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe85c66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33108/0 (socket says 172.21.15.38:33108) 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.686+0000 7fbe85c66640 1 -- 172.21.15.38:0/571818778 learned_addr learned my addr 172.21.15.38:0/571818778 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85465640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe86467640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 -- 172.21.15.38:0/571818778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 msgr2=0x55968a9d9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 -- 172.21.15.38:0/571818778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 msgr2=0x55968a9edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9edd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 -- 172.21.15.38:0/571818778 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55968a9d8200 con 0x55968a6061b0 2024-09-21T06:27:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe86467640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:00.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe85c66640 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c004700 tx=0x7fbe7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fca34dec9a84f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe6b7fe640 1 -- 172.21.15.38:0/571818778 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c034070 con 0x55968a6061b0 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe6b7fe640 1 -- 172.21.15.38:0/571818778 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe7c013940 con 0x55968a6061b0 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.687+0000 7fbe6b7fe640 1 -- 172.21.15.38:0/571818778 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c02b040 con 0x55968a6061b0 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- 172.21.15.38:0/571818778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 msgr2=0x55968a9e3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c004700 tx=0x7fbe7c008040 comp rx=0 tx=0).stop 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- 172.21.15.38:0/571818778 shutdown_connections 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a62f070 0x55968a9d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a60e390 0x55968a9edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/571818778 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a6061b0 0x55968a9e3870 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- 172.21.15.38:0/571818778 >> 172.21.15.38:0/571818778 conn(0x55968a623460 msgr2=0x55968a9d93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- 172.21.15.38:0/571818778 shutdown_connections 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- 172.21.15.38:0/571818778 wait complete. 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.688+0000 7fbe8e43e740 1 -- start start 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 Processor -- start 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 0x55968aa57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6400ccd0 con 0x55968a60e390 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6400e140 con 0x55968a62f070 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6400d3a0 con 0x55968a6061b0 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe8e43e740 10 client.0 _ll_register_callbacks cb 0x7fbe7802f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe85465640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe85465640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33122/0 (socket says 172.21.15.38:33122) 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe85465640 1 -- 172.21.15.38:0/3714048071 learned_addr learned my addr 172.21.15.38:0/3714048071 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe86467640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 0x55968aa57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.689+0000 7fbe85c66640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 -- 172.21.15.38:0/3714048071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 msgr2=0x55968a9e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 -- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 msgr2=0x55968aa57770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 0x55968aa57770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 -- 172.21.15.38:0/3714048071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55968aa57de0 con 0x55968a60e390 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe86467640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 0x55968aa57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe85465640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbe700e4f60 tx=0x7fbe70005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af75fe0d191ed7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe700a96b0 con 0x55968a60e390 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fbe700a8bb0 con 0x55968a60e390 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7c013940 con 0x55968a60e390 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbe700ac7d0 con 0x55968a60e390 2024-09-21T06:27:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe8e43e740 10 client.17550 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55968aa5f0f0 con 0x55968a60e390 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe7c013940 con 0x55968a60e390 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.690+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbe700981a0 con 0x55968a60e390 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 10 client.17550 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 20 client.17550 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5c2da0 0x55968aa618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 4 client.17550 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55968a94a8a0 con 0x55968a5c2da0 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe85c66640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5c2da0 0x55968aa618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe697fa640 10 client.17550 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.691+0000 7fbe85c66640 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5c2da0 0x55968aa618b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b39d5a4b70cf757 server_cookie=61fe62117fb8fa52 in_seq=0 out_seq=0 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe697fa640 1 -- 172.21.15.38:0/3714048071 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55968a94a8a0 con 0x55968a5c2da0 2024-09-21T06:27:00.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe697fa640 10 client.17550 handle_command_reply: tid=0 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 client.17550 shutdown 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 msgr2=0x55968a9e6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbe700e4f60 tx=0x7fbe70005bd0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 shutdown_connections 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55968a62f070 0x55968aa57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55968a60e390 0x55968a9e6c40 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55968a5c2da0 0x55968aa618b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 --2- 172.21.15.38:0/3714048071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55968a6061b0 0x55968a9e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe697fa640 0 client.17550 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 >> 172.21.15.38:0/3714048071 conn(0x55968a623460 msgr2=0x55968a9e35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 shutdown_connections 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 1 -- 172.21.15.38:0/3714048071 wait complete. 2024-09-21T06:27:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.692+0000 7fbe8e43e740 20 client.17550 trim_cache size 0 max 16384 2024-09-21T06:27:00.699 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:27:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 msgr2=0x7fbe6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 0x7fbe6c0b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005cc0 tx=0x7fbe78005c30 comp rx=0 tx=0).stop 2024-09-21T06:27:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 msgr2=0x7fbe8019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000d950 tx=0x7fbe7000dd50 comp rx=0 tx=0).stop 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 shutdown_connections 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbe6c0b6680 0x7fbe6c0b8b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe80109df0 0x7fbe801a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe801094a0 0x7fbe8019cde0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 --2- 172.21.15.38:0/1855126073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe80103b60 0x7fbe8019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 >> 172.21.15.38:0/1855126073 conn(0x7fbe8007b850 msgr2=0x7fbe801072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 shutdown_connections 2024-09-21T06:27:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:00.693+0000 7fbe87eca640 1 -- 172.21.15.38:0/1855126073 wait complete. 2024-09-21T06:27:00.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T06:27:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi038 to 177.0M 2024-09-21T06:27:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-21T06:27:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Unable to set osd_memory_target on smithi174 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:27:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Unable to set osd_memory_target on smithi038 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T06:27:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:00 smithi174 ceph-mon[34815]: Unable to set osd_memory_target on smithi044 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi038 to 177.0M 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Unable to set osd_memory_target on smithi174 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Unable to set osd_memory_target on smithi038 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T06:27:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:00 smithi044 ceph-mon[34369]: Unable to set osd_memory_target on smithi044 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:27:01.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:01 smithi038 ceph-mon[31215]: pgmap v541: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:01.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:01 smithi174 ceph-mon[34815]: pgmap v541: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:01.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:01 smithi044 ceph-mon[34369]: pgmap v541: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:02.556 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:27:02.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:27:02.830 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:03.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 -- 172.21.15.38:0/893918731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac1083b0 msgr2=0x7f94ac1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 --2- 172.21.15.38:0/893918731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac1083b0 0x7f94ac1087c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009900 tx=0x7f94a002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 -- 172.21.15.38:0/893918731 shutdown_connections 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 --2- 172.21.15.38:0/893918731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac108d00 0x7f94ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 --2- 172.21.15.38:0/893918731 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac1083b0 0x7f94ac1087c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 --2- 172.21.15.38:0/893918731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 0x7f94ac102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 -- 172.21.15.38:0/893918731 >> 172.21.15.38:0/893918731 conn(0x7f94ac079730 msgr2=0x7f94ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 -- 172.21.15.38:0/893918731 shutdown_connections 2024-09-21T06:27:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.270+0000 7f94b18c1640 1 -- 172.21.15.38:0/893918731 wait complete. 2024-09-21T06:27:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.271+0000 7f94b18c1640 1 Processor -- start 2024-09-21T06:27:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.271+0000 7f94b18c1640 1 -- start start 2024-09-21T06:27:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 0x7f94ac0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac1083b0 0x7f94ac0ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac112a90 con 0x7f94ac108d00 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac112910 con 0x7f94ac102a70 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94b18c1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac112c10 con 0x7f94ac1083b0 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33152/0 (socket says 172.21.15.38:33152) 2024-09-21T06:27:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 -- 172.21.15.38:0/2619496917 learned_addr learned my addr 172.21.15.38:0/2619496917 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac1083b0 0x7f94ac0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 0x7f94ac0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 -- 172.21.15.38:0/2619496917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac1083b0 msgr2=0x7f94ac0ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac1083b0 0x7f94ac0ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 -- 172.21.15.38:0/2619496917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 msgr2=0x7f94ac0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 0x7f94ac0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 -- 172.21.15.38:0/2619496917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac1a8890 con 0x7f94ac108d00 2024-09-21T06:27:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.272+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f94a400eaa0 tx=0x7f94a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.273+0000 7f94b08bf640 1 -- 172.21.15.38:0/2619496917 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a400cdb0 con 0x7f94ac108d00 2024-09-21T06:27:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.273+0000 7f94b08bf640 1 -- 172.21.15.38:0/2619496917 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94a4005020 con 0x7f94ac108d00 2024-09-21T06:27:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.273+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac1a8b80 con 0x7f94ac108d00 2024-09-21T06:27:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.273+0000 7f94b08bf640 1 -- 172.21.15.38:0/2619496917 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a40116d0 con 0x7f94ac108d00 2024-09-21T06:27:03.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.273+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac1a90e0 con 0x7f94ac108d00 2024-09-21T06:27:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.275+0000 7f94b7e35740 1 Processor -- start 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b08bf640 1 -- 172.21.15.38:0/2619496917 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f94a4011870 con 0x7f94ac108d00 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 -- start start 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34830430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 0x559d34830970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d347a6e60 con 0x559d34468670 2024-09-21T06:27:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d34796290 con 0x559d34489350 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94b7e35740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d3479a0a0 con 0x559d34460490 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33154/0 (socket says 172.21.15.38:33154) 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94aa7fc640 1 -- 172.21.15.38:0/995672096 learned_addr learned my addr 172.21.15.38:0/995672096 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94aaffd640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 0x559d34830970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.276+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34830430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 -- 172.21.15.38:0/995672096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 msgr2=0x559d34830430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34830430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 -- 172.21.15.38:0/995672096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 msgr2=0x559d34830eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94b08bf640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 0x7f94940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 -- 172.21.15.38:0/995672096 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d344f4930 con 0x559d34460490 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:03.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 0x7f94940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94b08bf640 1 -- 172.21.15.38:0/2619496917 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f94a40e7780 con 0x7f94ac108d00 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f94aaffd640 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 0x559d34830970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f949c00bbc0 tx=0x7f949c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49ff656b14ba646e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f9491ffb640 1 -- 172.21.15.38:0/995672096 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c004030 con 0x559d34460490 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f9491ffb640 1 -- 172.21.15.38:0/995672096 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f949c0041d0 con 0x559d34460490 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.277+0000 7f9491ffb640 1 -- 172.21.15.38:0/995672096 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0116a0 con 0x559d34460490 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- 172.21.15.38:0/995672096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 msgr2=0x559d34830970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 0x7f94940b8c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94a0032fd0 tx=0x7f94a0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 0x559d34830970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f949c00bbc0 tx=0x7f949c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- 172.21.15.38:0/995672096 shutdown_connections 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d34830eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34460490 0x559d34830970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 --2- 172.21.15.38:0/995672096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34830430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- 172.21.15.38:0/995672096 >> 172.21.15.38:0/995672096 conn(0x559d3447d740 msgr2=0x559d3482e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- 172.21.15.38:0/995672096 shutdown_connections 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- 172.21.15.38:0/995672096 wait complete. 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.278+0000 7f94b7e35740 1 -- start start 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 Processor -- start 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d3483c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34847f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d345f7890 con 0x559d34460490 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d34730d40 con 0x559d34489350 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d3483ec10 con 0x559d34468670 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94b7e35740 10 client.0 _ll_register_callbacks cb 0x559d34794c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33168/0 (socket says 172.21.15.38:33168) 2024-09-21T06:27:03.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94aaffd640 1 -- 172.21.15.38:0/162811186 learned_addr learned my addr 172.21.15.38:0/162811186 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d3483c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.279+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34847f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 -- 172.21.15.38:0/162811186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 msgr2=0x559d3483c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d3483c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 -- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 msgr2=0x559d34847f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34847f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 -- 172.21.15.38:0/162811186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d34848470 con 0x559d34460490 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34847f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94aaffd640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f949c005890 tx=0x7f949c0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a7e3c42a18e370 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f948affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c02a060 con 0x559d34460490 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f949c0035f0 con 0x559d34460490 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f949c0041d0 con 0x559d34460490 2024-09-21T06:27:03.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f949c0037f0 con 0x559d34460490 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94b7e35740 10 client.17562 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.280+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d3484ada0 con 0x559d34460490 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f949c0041d0 con 0x559d34460490 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f949c004800 con 0x559d34460490 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 10 client.17562 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 10 client.17562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 20 client.17562 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d34447cd0 0x559d3484e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 4 client.17562 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d347a8db0 con 0x559d34447cd0 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.281+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d34447cd0 0x559d3484e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.282+0000 7f948affd640 10 client.17562 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.282+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d34447cd0 0x559d3484e1b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d97fb017b6089e87 server_cookie=e0ddfa80975de370 in_seq=0 out_seq=0 2024-09-21T06:27:03.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f948affd640 1 -- 172.21.15.38:0/162811186 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d347a8db0 con 0x559d34447cd0 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f948affd640 10 client.17562 handle_command_reply: tid=0 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 client.17562 shutdown 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 msgr2=0x559d3483bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f949c005890 tx=0x7f949c0045b0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 shutdown_connections 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34847f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d34447cd0 0x559d3484e1b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d3483c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 --2- 172.21.15.38:0/162811186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d3483bf70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 >> 172.21.15.38:0/162811186 conn(0x559d3447d740 msgr2=0x559d348335c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f948affd640 0 client.17562 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 shutdown_connections 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 1 -- 172.21.15.38:0/162811186 wait complete. 2024-09-21T06:27:03.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.283+0000 7f94b7e35740 20 client.17562 trim_cache size 0 max 16384 2024-09-21T06:27:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 Processor -- start 2024-09-21T06:27:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 -- start start 2024-09-21T06:27:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d34831b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34838f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1b4280 con 0x559d34460490 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1b1b50 con 0x559d34489350 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94b7e35740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1af9c0 con 0x559d34468670 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33174/0 (socket says 172.21.15.38:33174) 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.301+0000 7f94aaffd640 1 -- 172.21.15.38:0/2455164034 learned_addr learned my addr 172.21.15.38:0/2455164034 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34838f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d34831b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 -- 172.21.15.38:0/2455164034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 msgr2=0x559d34831b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d34831b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 -- 172.21.15.38:0/2455164034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 msgr2=0x559d34838f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34838f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 -- 172.21.15.38:0/2455164034 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d34447f00 con 0x559d34460490 2024-09-21T06:27:03.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f949c00b5f0 tx=0x7f949c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdbbc80e8ff0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94917fa640 1 -- 172.21.15.38:0/2455164034 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c02a070 con 0x559d34460490 2024-09-21T06:27:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94917fa640 1 -- 172.21.15.38:0/2455164034 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f949c00b770 con 0x559d34460490 2024-09-21T06:27:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.302+0000 7f94917fa640 1 -- 172.21.15.38:0/2455164034 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c005040 con 0x559d34460490 2024-09-21T06:27:03.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- 172.21.15.38:0/2455164034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 msgr2=0x559d34836550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f949c00b5f0 tx=0x7f949c00b390 comp rx=0 tx=0).stop 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- 172.21.15.38:0/2455164034 shutdown_connections 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34489350 0x559d34838f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34468670 0x559d34831b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2455164034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34460490 0x559d34836550 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- 172.21.15.38:0/2455164034 >> 172.21.15.38:0/2455164034 conn(0x559d3447d740 msgr2=0x559d34831460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- 172.21.15.38:0/2455164034 shutdown_connections 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- 172.21.15.38:0/2455164034 wait complete. 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.303+0000 7f94b7e35740 1 -- start start 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 Processor -- start 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34460490 0x559d3484fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 0x559d348b7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1b0010 con 0x559d34468670 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1b1480 con 0x559d34460490 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac1b06e0 con 0x559d34489350 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94b7e35740 10 client.0 _ll_register_callbacks cb 0x7f94a0005d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33190/0 (socket says 172.21.15.38:33190) 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 -- 172.21.15.38:0/2854340309 learned_addr learned my addr 172.21.15.38:0/2854340309 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34460490 0x559d3484fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 0x559d348b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 -- 172.21.15.38:0/2854340309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 msgr2=0x559d348b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 0x559d348b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 -- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34460490 msgr2=0x559d3484fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34460490 0x559d3484fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94aa7fc640 1 -- 172.21.15.38:0/2854340309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d348b7f70 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.304+0000 7f94ab7fe640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 0x559d348b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f94aa7fc640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f94a00314b0 tx=0x7f94a00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6407dce8f052c534 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0035040 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f94a0004780 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f949c00b770 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f94a0063050 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f94b7e35740 10 client.17568 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d348b9230 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f949c00b770 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.305+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f94a003d9f0 con 0x559d34468670 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 10 client.17568 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:03.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 20 client.17568 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d3441d080 0x559d348bb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 4 client.17568 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d347a4860 con 0x559d3441d080 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d3441d080 0x559d348bb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f948affd640 10 client.17568 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:03.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.306+0000 7f94aaffd640 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d3441d080 0x559d348bb9d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a943da78a67ec6d server_cookie=802e8c7b5f59db94 in_seq=0 out_seq=0 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f948affd640 1 -- 172.21.15.38:0/2854340309 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d347a4860 con 0x559d3441d080 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f948affd640 10 client.17568 handle_command_reply: tid=0 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 client.17568 shutdown 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 msgr2=0x559d3484ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f94a00314b0 tx=0x7f94a00058d0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 shutdown_connections 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559d3441d080 0x559d348bb9d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d34489350 0x559d348b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d34468670 0x559d3484ffa0 secure :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f94a00314b0 tx=0x7f94a00058d0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 --2- 172.21.15.38:0/2854340309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d34460490 0x559d3484fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 >> 172.21.15.38:0/2854340309 conn(0x559d3447d740 msgr2=0x559d34831bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f948affd640 0 client.17568 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 shutdown_connections 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.308+0000 7f94b7e35740 1 -- 172.21.15.38:0/2854340309 wait complete. 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b7e35740 20 client.17568 trim_cache size 0 max 16384 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "5200e6e3-2912-474b-a40a-e79b2b144851", 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:27:03.314 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 msgr2=0x7f94940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 0x7f94940b8c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94a0032fd0 tx=0x7f94a0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 msgr2=0x7f94ac100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f94a400eaa0 tx=0x7f94a400ef60 comp rx=0 tx=0).stop 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 shutdown_connections 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94940b6700 0x7f94940b8c10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f94ac108d00 0x7f94ac100070 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f94ac1083b0 0x7f94ac0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 --2- 172.21.15.38:0/2619496917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94ac102a70 0x7f94ac0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 >> 172.21.15.38:0/2619496917 conn(0x7f94ac079730 msgr2=0x7f94ac06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 shutdown_connections 2024-09-21T06:27:03.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:03.309+0000 7f94b18c1640 1 -- 172.21.15.38:0/2619496917 wait complete. 2024-09-21T06:27:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:03 smithi038 ceph-mon[31215]: pgmap v542: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:27:03.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:03 smithi174 ceph-mon[34815]: pgmap v542: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:27:03.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:03 smithi044 ceph-mon[34369]: pgmap v542: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:27:04.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:27:04.413 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:04.786 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:04 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:27:04.787 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:04 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.787 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:04 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:27:04.787 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:04 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 -- 172.21.15.38:0/1511144857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 msgr2=0x7fb414102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 --2- 172.21.15.38:0/1511144857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb414102ef0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb404009900 tx=0x7fb40402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 -- 172.21.15.38:0/1511144857 shutdown_connections 2024-09-21T06:27:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 --2- 172.21.15.38:0/1511144857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb414108d20 0x7fb41410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 --2- 172.21.15.38:0/1511144857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb4141083d0 0x7fb4141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 --2- 172.21.15.38:0/1511144857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb414102ef0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 -- 172.21.15.38:0/1511144857 >> 172.21.15.38:0/1511144857 conn(0x7fb414079760 msgr2=0x7fb414079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 -- 172.21.15.38:0/1511144857 shutdown_connections 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.878+0000 7fb41ac99640 1 -- 172.21.15.38:0/1511144857 wait complete. 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 Processor -- start 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 -- start start 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4141083d0 0x7fb41419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 0x7fb41419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb414112ab0 con 0x7fb414102ae0 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb414112930 con 0x7fb4141083d0 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb41ac99640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb414112c30 con 0x7fb414108d20 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33216/0 (socket says 172.21.15.38:33216) 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 -- 172.21.15.38:0/3147835518 learned_addr learned my addr 172.21.15.38:0/3147835518 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb419236640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 0x7fb41419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 -- 172.21.15.38:0/3147835518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 msgr2=0x7fb41419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb413fff640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4141083d0 0x7fb41419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 0x7fb41419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 -- 172.21.15.38:0/3147835518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4141083d0 msgr2=0x7fb41419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.879+0000 7fb418a35640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4141083d0 0x7fb41419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb418a35640 1 -- 172.21.15.38:0/3147835518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4141a03a0 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb419236640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 0x7fb41419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb418a35640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fb404005ab0 tx=0x7fb4040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb411ffb640 1 -- 172.21.15.38:0/3147835518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40403f030 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb411ffb640 1 -- 172.21.15.38:0/3147835518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb404003cd0 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4141a0630 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb411ffb640 1 -- 172.21.15.38:0/3147835518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404035070 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.880+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4141a0b60 con 0x7fb414102ae0 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 Processor -- start 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 -- start start 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44a1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586d4417e50 con 0x5586d40d9390 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586d4407280 con 0x5586d40fa070 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb42120d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586d440b090 con 0x5586d40d11b0 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb411ffb640 1 -- 172.21.15.38:0/3147835518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb404042030 con 0x7fb414102ae0 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33232/0 (socket says 172.21.15.38:33232) 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb413fff640 1 -- 172.21.15.38:0/4025981600 learned_addr learned my addr 172.21.15.38:0/4025981600 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.883+0000 7fb419236640 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 -- 172.21.15.38:0/4025981600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 msgr2=0x5586d44a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 -- 172.21.15.38:0/4025981600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 msgr2=0x5586d44a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 -- 172.21.15.38:0/4025981600 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d4165650 con 0x5586d40d9390 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb413fff640 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fb408009b10 tx=0x7fb40800e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc95fdc04438b05f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb3faffd640 1 -- 172.21.15.38:0/4025981600 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408016070 con 0x5586d40d9390 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb3faffd640 1 -- 172.21.15.38:0/4025981600 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4080054f0 con 0x5586d40d9390 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb3faffd640 1 -- 172.21.15.38:0/4025981600 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408011470 con 0x5586d40d9390 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb411ffb640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 0x7fb3fc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb419236640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 0x7fb3fc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.884+0000 7fb411ffb640 1 -- 172.21.15.38:0/3147835518 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb404107cd0 con 0x7fb414102ae0 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 -- 172.21.15.38:0/4025981600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 msgr2=0x5586d44a20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb419236640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 0x7fb3fc0b8c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005fd0 tx=0x7fb40c0086a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fb408009b10 tx=0x7fb40800e2f0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 -- 172.21.15.38:0/4025981600 shutdown_connections 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44a20d0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 --2- 172.21.15.38:0/4025981600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 -- 172.21.15.38:0/4025981600 >> 172.21.15.38:0/4025981600 conn(0x5586d40ee460 msgr2=0x5586d449f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 -- 172.21.15.38:0/4025981600 shutdown_connections 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.885+0000 7fb42120d740 1 -- 172.21.15.38:0/4025981600 wait complete. 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 -- start start 2024-09-21T06:27:04.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 Processor -- start 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5586d4268700 con 0x5586d40d9390 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586d43a2110 con 0x5586d40fa070 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5586d44afe30 con 0x5586d40d11b0 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.886+0000 7fb42120d740 10 client.0 _ll_register_callbacks cb 0x5586d43bb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33248/0 (socket says 172.21.15.38:33248) 2024-09-21T06:27:04.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 -- 172.21.15.38:0/2044429176 learned_addr learned my addr 172.21.15.38:0/2044429176 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb418a35640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb419236640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 -- 172.21.15.38:0/2044429176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 msgr2=0x5586d44acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 -- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 msgr2=0x5586d44b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 -- 172.21.15.38:0/2044429176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d43cfc40 con 0x5586d40d9390 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb413fff640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb408004b40 tx=0x7fb40800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13b34eee737119b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb3f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408028060 con 0x5586d40d9390 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb40800ee10 con 0x5586d40d9390 2024-09-21T06:27:04.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.887+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4080054f0 con 0x5586d40d9390 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb408016040 con 0x5586d40d9390 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 10 client.17580 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5586d44bbc00 con 0x5586d40d9390 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4080054f0 con 0x5586d40d9390 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb40800f040 con 0x5586d40d9390 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 10 client.17580 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 20 client.17580 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d40b89f0 0x5586d44bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 4 client.17580 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d4419da0 con 0x5586d40b89f0 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.888+0000 7fb418a35640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d40b89f0 0x5586d44bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.889+0000 7fb3f3fff640 10 client.17580 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.889+0000 7fb418a35640 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d40b89f0 0x5586d44bef60 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e96bd169a6bab4 server_cookie=ad226e39aa5e07e7 in_seq=0 out_seq=0 2024-09-21T06:27:04.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb3f3fff640 1 -- 172.21.15.38:0/2044429176 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5586d4419da0 con 0x5586d40b89f0 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb3f3fff640 10 client.17580 handle_command_reply: tid=0 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 client.17580 shutdown 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 msgr2=0x5586d44ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb408004b40 tx=0x7fb40800ed20 comp rx=0 tx=0).stop 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 shutdown_connections 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d44ad2b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d40b89f0 0x5586d44bef60 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 --2- 172.21.15.38:0/2044429176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d44acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 >> 172.21.15.38:0/2044429176 conn(0x5586d40ee460 msgr2=0x5586d44a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb3f3fff640 0 client.17580 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:04.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 shutdown_connections 2024-09-21T06:27:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 1 -- 172.21.15.38:0/2044429176 wait complete. 2024-09-21T06:27:04.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.890+0000 7fb42120d740 20 client.17580 trim_cache size 0 max 16384 2024-09-21T06:27:04.900 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:04 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:27:04.900 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:04 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.900 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:04 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:27:04.900 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:04 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:04 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:27:04.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:04 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:04 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:27:04.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:04 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 Processor -- start 2024-09-21T06:27:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 -- start start 2024-09-21T06:27:04.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 0x5586d44a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141b1e90 con 0x5586d40d11b0 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141af760 con 0x5586d40fa070 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb42120d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141ad5d0 con 0x5586d40d9390 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb418a35640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb418a35640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33264/0 (socket says 172.21.15.38:33264) 2024-09-21T06:27:04.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.908+0000 7fb418a35640 1 -- 172.21.15.38:0/3608530746 learned_addr learned my addr 172.21.15.38:0/3608530746 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 -- 172.21.15.38:0/3608530746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 msgr2=0x5586d44a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb419236640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb413fff640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 0x5586d44a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 0x5586d44a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 -- 172.21.15.38:0/3608530746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 msgr2=0x5586d44b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 -- 172.21.15.38:0/3608530746 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d40b8c20 con 0x5586d40d11b0 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb419236640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:04.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb413fff640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 0x5586d44a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb418a35640 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ca0e0 tx=0x7fb40402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31de1bde12775e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb3fa7fc640 1 -- 172.21.15.38:0/3608530746 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404049040 con 0x5586d40d11b0 2024-09-21T06:27:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb3fa7fc640 1 -- 172.21.15.38:0/3608530746 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4040d0e50 con 0x5586d40d11b0 2024-09-21T06:27:04.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.909+0000 7fb3fa7fc640 1 -- 172.21.15.38:0/3608530746 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4040d7530 con 0x5586d40d11b0 2024-09-21T06:27:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 -- 172.21.15.38:0/3608530746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 msgr2=0x5586d44aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ca0e0 tx=0x7fb40402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 -- 172.21.15.38:0/3608530746 shutdown_connections 2024-09-21T06:27:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d9390 0x5586d44a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 --2- 172.21.15.38:0/3608530746 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d11b0 0x5586d44aec50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 -- 172.21.15.38:0/3608530746 >> 172.21.15.38:0/3608530746 conn(0x5586d40ee460 msgr2=0x5586d44a2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 -- 172.21.15.38:0/3608530746 shutdown_connections 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.910+0000 7fb42120d740 1 -- 172.21.15.38:0/3608530746 wait complete. 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 -- start start 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 Processor -- start 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d4524ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141adc20 con 0x5586d40d9390 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141af090 con 0x5586d40fa070 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141ae2f0 con 0x5586d40d11b0 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb42120d740 10 client.0 _ll_register_callbacks cb 0x7fb40c008570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:04.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb413fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33266/0 (socket says 172.21.15.38:33266) 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb413fff640 1 -- 172.21.15.38:0/1487725904 learned_addr learned my addr 172.21.15.38:0/1487725904 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.911+0000 7fb418a35640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d4524ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb419236640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 -- 172.21.15.38:0/1487725904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 msgr2=0x5586d4524ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d4524ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 -- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 msgr2=0x5586d44bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 -- 172.21.15.38:0/1487725904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d44bffa0 con 0x5586d40d9390 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb413fff640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb408004ae0 tx=0x7fb408005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806229f0d7d88040 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb3f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408028070 con 0x5586d40d9390 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7fb4080057d0 con 0x5586d40d9390 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4040d0e50 con 0x5586d40d9390 2024-09-21T06:27:04.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb40803d050 con 0x5586d40d9390 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb42120d740 10 client.17586 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.912+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5586d4522080 con 0x5586d40d9390 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4040d0e50 con 0x5586d40d9390 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb408035020 con 0x5586d40d9390 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 10 client.17586 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 10 client.17586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 20 client.17586 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d408dda0 0x5586d452fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 4 client.17586 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5586d4415850 con 0x5586d408dda0 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb418a35640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d408dda0 0x5586d452fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb418a35640 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d408dda0 0x5586d452fc50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f66edf4df85dbbe server_cookie=850987d1d543cb10 in_seq=0 out_seq=0 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.913+0000 7fb3f3fff640 10 client.17586 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:04.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb3f3fff640 1 -- 172.21.15.38:0/1487725904 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x5586d4415850 con 0x5586d408dda0 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb3f3fff640 10 client.17586 handle_command_reply: tid=0 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 client.17586 shutdown 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 msgr2=0x5586d4525080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb408004ae0 tx=0x7fb408005720 comp rx=0 tx=0).stop 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 shutdown_connections 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d40fa070 0x5586d44bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5586d40d9390 0x5586d4525080 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5586d408dda0 0x5586d452fc50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 --2- 172.21.15.38:0/1487725904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5586d40d11b0 0x5586d4524ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb3f3fff640 0 client.17586 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 >> 172.21.15.38:0/1487725904 conn(0x5586d40ee460 msgr2=0x5586d44ae9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 shutdown_connections 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 1 -- 172.21.15.38:0/1487725904 wait complete. 2024-09-21T06:27:04.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.914+0000 7fb42120d740 20 client.17586 trim_cache size 0 max 16384 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "5200e6e3-2912-474b-a40a-e79b2b144851", 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:27:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:27:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:27:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:27:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:04.934 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 msgr2=0x7fb3fc0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 0x7fb3fc0b8c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005fd0 tx=0x7fb40c0086a0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 msgr2=0x7fb41419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fb404005ab0 tx=0x7fb4040042f0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 shutdown_connections 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb3fc0b6730 0x7fb3fc0b8c40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb414108d20 0x7fb41419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4141083d0 0x7fb41419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 --2- 172.21.15.38:0/3147835518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb414102ae0 0x7fb41419a4f0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 >> 172.21.15.38:0/3147835518 conn(0x7fb414079760 msgr2=0x7fb414106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 shutdown_connections 2024-09-21T06:27:04.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:04.915+0000 7fb41ac99640 1 -- 172.21.15.38:0/3147835518 wait complete. 2024-09-21T06:27:05.655 INFO:tasks.cephfs.filesystem:scrub status for tag:5200e6e3-2912-474b-a40a-e79b2b144851 - {'path': '/', 'tag': '5200e6e3-2912-474b-a40a-e79b2b144851', 'options': 'recursive,force'} 2024-09-21T06:27:05.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:05 smithi174 ceph-mon[34815]: pgmap v543: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:27:05.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:05 smithi044 ceph-mon[34369]: pgmap v543: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:27:05.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:05 smithi038 ceph-mon[31215]: pgmap v543: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:27:07.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:07 smithi174 ceph-mon[34815]: pgmap v544: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:27:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:07 smithi044 ceph-mon[34369]: pgmap v544: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:27:07.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:07 smithi038 ceph-mon[31215]: pgmap v544: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:27:08.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:08 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:27:08.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:08 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:27:08.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:08 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:27:09.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:09 smithi174 ceph-mon[34815]: pgmap v545: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:27:09.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:09 smithi174 ceph-mon[34815]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:27:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:09 smithi044 ceph-mon[34369]: pgmap v545: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:27:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:09 smithi044 ceph-mon[34369]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:27:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:09 smithi038 ceph-mon[31215]: pgmap v545: 97 pgs: 97 active+clean; 169 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:27:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:09 smithi038 ceph-mon[31215]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:27:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:11 smithi174 ceph-mon[34815]: pgmap v547: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:27:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:11 smithi044 ceph-mon[34369]: pgmap v547: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:27:11.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:11 smithi038 ceph-mon[31215]: pgmap v547: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:27:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:13 smithi174 ceph-mon[34815]: pgmap v548: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 133 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:27:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:13 smithi044 ceph-mon[34369]: pgmap v548: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 133 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:27:13.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:13 smithi038 ceph-mon[31215]: pgmap v548: 97 pgs: 16 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 75 active+clean; 133 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T06:27:15.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:15 smithi174 ceph-mon[34815]: pgmap v549: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:15 smithi044 ceph-mon[34369]: pgmap v549: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:15.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:15 smithi038 ceph-mon[31215]: pgmap v549: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:17.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:17 smithi174 ceph-mon[34815]: pgmap v550: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:17 smithi174 ceph-mon[34815]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:27:17.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:17 smithi044 ceph-mon[34369]: pgmap v550: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:17 smithi044 ceph-mon[34369]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:27:17.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:17 smithi038 ceph-mon[31215]: pgmap v550: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:27:17.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:17 smithi038 ceph-mon[31215]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:27:19.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:19 smithi174 ceph-mon[34815]: pgmap v552: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:27:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:19 smithi044 ceph-mon[34369]: pgmap v552: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:27:19.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:19 smithi038 ceph-mon[31215]: pgmap v552: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:27:21.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:21 smithi174 ceph-mon[34815]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:27:21.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:21 smithi044 ceph-mon[34369]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:27:21.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:21 smithi038 ceph-mon[31215]: pgmap v553: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:27:23.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:23 smithi174 ceph-mon[34815]: pgmap v554: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:23.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:23 smithi044 ceph-mon[34369]: pgmap v554: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:23.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:23 smithi038 ceph-mon[31215]: pgmap v554: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:25 smithi174 ceph-mon[34815]: pgmap v555: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:25.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:25 smithi044 ceph-mon[34369]: pgmap v555: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:25.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:25 smithi038 ceph-mon[31215]: pgmap v555: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:27.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:27 smithi174 ceph-mon[34815]: pgmap v556: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:27.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:27 smithi044 ceph-mon[34369]: pgmap v556: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:27.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:27 smithi038 ceph-mon[31215]: pgmap v556: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:27:29.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:29 smithi174 ceph-mon[34815]: pgmap v557: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:27:29.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:29 smithi044 ceph-mon[34369]: pgmap v557: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:27:29.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:29 smithi038 ceph-mon[31215]: pgmap v557: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:27:31.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:31 smithi174 ceph-mon[34815]: pgmap v558: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:31 smithi044 ceph-mon[34369]: pgmap v558: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:31.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:31 smithi038 ceph-mon[31215]: pgmap v558: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:33.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:33 smithi174 ceph-mon[34815]: pgmap v559: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:33.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:33 smithi044 ceph-mon[34369]: pgmap v559: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:33.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:33 smithi038 ceph-mon[31215]: pgmap v559: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:34.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:34 smithi174 ceph-mon[34815]: pgmap v560: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:34.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:34 smithi044 ceph-mon[34369]: pgmap v560: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:34.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:34 smithi038 ceph-mon[31215]: pgmap v560: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:35.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:27:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 -- 172.21.15.38:0/3717540936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f01094b0 msgr2=0x7f55f01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3717540936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f01094b0 0x7f55f01098c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009900 tx=0x7f55e002a410 comp rx=0 tx=0).stop 2024-09-21T06:27:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 -- 172.21.15.38:0/3717540936 shutdown_connections 2024-09-21T06:27:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3717540936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3717540936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f01094b0 0x7f55f01098c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3717540936 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f0103bc0 0x7f55f0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 -- 172.21.15.38:0/3717540936 >> 172.21.15.38:0/3717540936 conn(0x7f55f007b910 msgr2=0x7f55f007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 -- 172.21.15.38:0/3717540936 shutdown_connections 2024-09-21T06:27:36.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.521+0000 7f55f7f56640 1 -- 172.21.15.38:0/3717540936 wait complete. 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 Processor -- start 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 -- start start 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f01094b0 0x7f55f019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f01a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0113be0 con 0x7f55f0103bc0 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0113a60 con 0x7f55f01094b0 2024-09-21T06:27:36.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f7f56640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0113d60 con 0x7f55f0109e00 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f5cf2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f5cf2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51694/0 (socket says 172.21.15.38:51694) 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.522+0000 7f55f5cf2640 1 -- 172.21.15.38:0/3119626805 learned_addr learned my addr 172.21.15.38:0/3119626805 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f54f1640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f01094b0 0x7f55f019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f01a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 -- 172.21.15.38:0/3119626805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 msgr2=0x7f55f01a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f01a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 -- 172.21.15.38:0/3119626805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f01094b0 msgr2=0x7f55f019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f01094b0 0x7f55f019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 -- 172.21.15.38:0/3119626805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f01a26e0 con 0x7f55f0103bc0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f01a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d950 tx=0x7f55ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55e6ffd640 1 -- 172.21.15.38:0/3119626805 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec017070 con 0x7f55f0103bc0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f01a29d0 con 0x7f55f0103bc0 2024-09-21T06:27:36.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55e6ffd640 1 -- 172.21.15.38:0/3119626805 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55ec009c30 con 0x7f55f0103bc0 2024-09-21T06:27:36.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55e6ffd640 1 -- 172.21.15.38:0/3119626805 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00f6b0 con 0x7f55f0103bc0 2024-09-21T06:27:36.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.523+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f01a9130 con 0x7f55f0103bc0 2024-09-21T06:27:36.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 Processor -- start 2024-09-21T06:27:36.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 -- start start 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c10270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 0x5609a4c107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c10cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5609a4b86e50 con 0x5609a48401b0 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5609a4b76280 con 0x5609a4848390 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5609a4b7a090 con 0x5609a4869070 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.526+0000 7f55e6ffd640 1 -- 172.21.15.38:0/3119626805 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f55ec010460 con 0x7f55f0103bc0 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f64f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c10270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 0x5609a4c107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f64f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c10270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47496/0 (socket says 172.21.15.38:47496) 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f64f3640 1 -- 172.21.15.38:0/1856710983 learned_addr learned my addr 172.21.15.38:0/1856710983 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f54f1640 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c10cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 -- 172.21.15.38:0/1856710983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 msgr2=0x5609a4c10270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c10270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 -- 172.21.15.38:0/1856710983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 msgr2=0x5609a4c10cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c10cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 -- 172.21.15.38:0/1856710983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a48d4650 con 0x5609a48401b0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 0x5609a4c107b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0e4b20 tx=0x7f55ec0efa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d8cb9a6ade469e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.527+0000 7f55e6ffd640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.528+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.528+0000 7f55dbfff640 1 -- 172.21.15.38:0/1856710983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0fa070 con 0x5609a48401b0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.528+0000 7f55e6ffd640 1 -- 172.21.15.38:0/3119626805 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f55ec0e7380 con 0x7f55f0103bc0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.528+0000 7f55dbfff640 1 -- 172.21.15.38:0/1856710983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55ec009e00 con 0x5609a48401b0 2024-09-21T06:27:36.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.528+0000 7f55dbfff640 1 -- 172.21.15.38:0/1856710983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0acff0 con 0x5609a48401b0 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- 172.21.15.38:0/1856710983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 msgr2=0x5609a4c107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 0x7f55dc0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f55e8012560 tx=0x7f55e8009790 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 0x5609a4c107b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0e4b20 tx=0x7f55ec0efa10 comp rx=0 tx=0).stop 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- 172.21.15.38:0/1856710983 shutdown_connections 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c10cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a48401b0 0x5609a4c107b0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/1856710983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c10270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- 172.21.15.38:0/1856710983 >> 172.21.15.38:0/1856710983 conn(0x5609a485d460 msgr2=0x5609a4c0e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- 172.21.15.38:0/1856710983 shutdown_connections 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- 172.21.15.38:0/1856710983 wait complete. 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 -- start start 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.529+0000 7f55fe4ca740 1 Processor -- start 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c1be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5609a49d7700 con 0x5609a4869070 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5609a4b11110 con 0x5609a4848390 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5609a4c1ea50 con 0x5609a48401b0 2024-09-21T06:27:36.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55fe4ca740 10 client.0 _ll_register_callbacks cb 0x5609a4b2a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f64f3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f5cf2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f64f3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51708/0 (socket says 172.21.15.38:51708) 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f64f3640 1 -- 172.21.15.38:0/3194256036 learned_addr learned my addr 172.21.15.38:0/3194256036 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f5cf2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:47508/0 (socket says 172.21.15.38:47508) 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.530+0000 7f55f54f1640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c1be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 -- 172.21.15.38:0/3194256036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 msgr2=0x5609a4c1b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 -- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 msgr2=0x5609a4c1be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c1be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 -- 172.21.15.38:0/3194256036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a4b3ec40 con 0x5609a4869070 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:36.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013fd0 tx=0x7f55e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e740736753b2d01d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e801e6d0 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f55e801e870 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609a4b88da0 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55e801ea70 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55fe4ca740 10 client.17598 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5609a4c2a790 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.531+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5609a4b88da0 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f55e801d410 con 0x5609a4869070 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 10 client.17598 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 20 client.17598 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a48279f0 0x5609a4c2dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 4 client.17598 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609a4b84850 con 0x5609a48279f0 2024-09-21T06:27:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a48279f0 0x5609a4c2dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55d97fa640 10 client.17598 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:36.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.532+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a48279f0 0x5609a4c2dcc0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bed9bf2497c9a4f server_cookie=4a204cb174965271 in_seq=0 out_seq=0 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55d97fa640 1 -- 172.21.15.38:0/3194256036 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609a4b84850 con 0x5609a48279f0 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55d97fa640 10 client.17598 handle_command_reply: tid=0 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55fe4ca740 1 client.17598 shutdown 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 msgr2=0x5609a4c27d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f55e8013fd0 tx=0x7f55e8004a40 comp rx=0 tx=0).stop 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 shutdown_connections 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.533+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4869070 0x5609a4c27d40 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4848390 0x5609a4c1be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a48279f0 0x5609a4c2dcc0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3194256036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55d97fa640 0 client.17598 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 >> 172.21.15.38:0/3194256036 conn(0x5609a485d460 msgr2=0x5609a4c13400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 shutdown_connections 2024-09-21T06:27:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3194256036 wait complete. 2024-09-21T06:27:36.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.534+0000 7f55fe4ca740 20 client.17598 trim_cache size 0 max 16384 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 Processor -- start 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 -- start start 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 0x5609a4c138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b42c0 con 0x5609a4848390 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b1b90 con 0x5609a4869070 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.551+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01afa00 con 0x5609a48401b0 2024-09-21T06:27:36.554 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51712/0 (socket says 172.21.15.38:51712) 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 -- 172.21.15.38:0/3745209372 learned_addr learned my addr 172.21.15.38:0/3745209372 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 0x5609a4c138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 -- 172.21.15.38:0/3745209372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 msgr2=0x5609a4c1bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 -- 172.21.15.38:0/3745209372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 msgr2=0x5609a4c138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 0x5609a4c138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 -- 172.21.15.38:0/3745209372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a4c1a860 con 0x5609a4848390 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f64f3640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 0x5609a4c138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55f54f1640 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f55e0005ab0 tx=0x7f55e0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed92fe52e4cc7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55db7fe640 1 -- 172.21.15.38:0/3745209372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0035040 con 0x5609a4848390 2024-09-21T06:27:36.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55db7fe640 1 -- 172.21.15.38:0/3745209372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55e00317d0 con 0x5609a4848390 2024-09-21T06:27:36.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.552+0000 7f55db7fe640 1 -- 172.21.15.38:0/3745209372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004920 con 0x5609a4848390 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3745209372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 msgr2=0x5609a4c13370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f55e0005ab0 tx=0x7f55e0032e40 comp rx=0 tx=0).stop 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3745209372 shutdown_connections 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a4869070 0x5609a4c138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c13370 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/3745209372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a48401b0 0x5609a4c1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3745209372 >> 172.21.15.38:0/3745209372 conn(0x5609a485d460 msgr2=0x5609a4c1b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3745209372 shutdown_connections 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.553+0000 7f55fe4ca740 1 -- 172.21.15.38:0/3745209372 wait complete. 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 -- start start 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 Processor -- start 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a48401b0 0x5609a4c242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b0050 con 0x5609a4848390 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b14c0 con 0x5609a48401b0 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55f01b0720 con 0x5609a4869070 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55fe4ca740 10 client.0 _ll_register_callbacks cb 0x7f55e8009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:36.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55f54f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55f54f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51718/0 (socket says 172.21.15.38:51718) 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55f54f1640 1 -- 172.21.15.38:0/2422861715 learned_addr learned my addr 172.21.15.38:0/2422861715 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a48401b0 0x5609a4c242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.554+0000 7f55f64f3640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 -- 172.21.15.38:0/2422861715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 msgr2=0x5609a4c1fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c1fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 -- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a48401b0 msgr2=0x5609a4c242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a48401b0 0x5609a4c242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 -- 172.21.15.38:0/2422861715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a4c20250 con 0x5609a4848390 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55f54f1640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a930 tx=0x7f55e0031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64c848dd9f6c9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0035070 con 0x5609a4848390 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f55e0004440 con 0x5609a4848390 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e00317d0 con 0x5609a4848390 2024-09-21T06:27:36.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55e0056050 con 0x5609a4848390 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55fe4ca740 10 client.17604 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5609a4c98350 con 0x5609a4848390 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.555+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55e00317d0 con 0x5609a4848390 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f55e0046a20 con 0x5609a4848390 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 10 client.17604 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 10 client.17604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 20 client.17604 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a47fcda0 0x5609a4c9aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 4 client.17604 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609a4b81c80 con 0x5609a47fcda0 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a47fcda0 0x5609a4c9aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55d97fa640 10 client.17604 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:36.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.556+0000 7f55f5cf2640 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a47fcda0 0x5609a4c9aa60 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adbf1828829c749e server_cookie=edca8400de1a7157 in_seq=0 out_seq=0 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55d97fa640 1 -- 172.21.15.38:0/2422861715 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x5609a4b81c80 con 0x5609a47fcda0 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55d97fa640 10 client.17604 handle_command_reply: tid=0 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 client.17604 shutdown 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 msgr2=0x5609a4c1f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a930 tx=0x7f55e0031980 comp rx=0 tx=0).stop 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 shutdown_connections 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5609a47fcda0 0x5609a4c9aa60 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5609a4869070 0x5609a4c1fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5609a4848390 0x5609a4c1f750 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 --2- 172.21.15.38:0/2422861715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5609a48401b0 0x5609a4c242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55d97fa640 0 client.17604 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 >> 172.21.15.38:0/2422861715 conn(0x5609a485d460 msgr2=0x5609a4c13370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 shutdown_connections 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 1 -- 172.21.15.38:0/2422861715 wait complete. 2024-09-21T06:27:36.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.557+0000 7f55fe4ca740 20 client.17604 trim_cache size 0 max 16384 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:27:36.564 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.565 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.566 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:27:36.567 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:27:36.568 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.570 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.571 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.572 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.573 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:27:36.574 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:36.575 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 msgr2=0x7f55dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 0x7f55dc0b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f55e8012560 tx=0x7f55e8009790 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 msgr2=0x7f55f019c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d950 tx=0x7f55ec00de10 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 shutdown_connections 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f55dc0b6680 0x7f55dc0b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55f0109e00 0x7f55f01a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55f01094b0 0x7f55f019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 --2- 172.21.15.38:0/3119626805 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f55f0103bc0 0x7f55f019c770 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 >> 172.21.15.38:0/3119626805 conn(0x7f55f007b910 msgr2=0x7f55f01072c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 shutdown_connections 2024-09-21T06:27:36.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:36.558+0000 7f55f7f56640 1 -- 172.21.15.38:0/3119626805 wait complete. 2024-09-21T06:27:37.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:36 smithi044 ceph-mon[34369]: pgmap v561: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:27:37.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:36 smithi038 ceph-mon[31215]: pgmap v561: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:27:37.368 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:27:37.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:27:37.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:36 smithi174 ceph-mon[34815]: pgmap v561: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:27:37.630 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:38.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 -- 172.21.15.38:0/967578709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec108cf0 msgr2=0x7f52ec10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 --2- 172.21.15.38:0/967578709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec108cf0 0x7f52ec10f520 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009ca0 tx=0x7f52e402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 -- 172.21.15.38:0/967578709 shutdown_connections 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 --2- 172.21.15.38:0/967578709 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec108cf0 0x7f52ec10f520 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 --2- 172.21.15.38:0/967578709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec1083a0 0x7f52ec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 --2- 172.21.15.38:0/967578709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 0x7f52ec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.079+0000 7f52f10b1640 1 -- 172.21.15.38:0/967578709 >> 172.21.15.38:0/967578709 conn(0x7f52ec079730 msgr2=0x7f52ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.080+0000 7f52f10b1640 1 -- 172.21.15.38:0/967578709 shutdown_connections 2024-09-21T06:27:38.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.080+0000 7f52f10b1640 1 -- 172.21.15.38:0/967578709 wait complete. 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 Processor -- start 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 -- start start 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 0x7f52ec199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec108cf0 0x7f52ec19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec112a80 con 0x7f52ec1083a0 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec112900 con 0x7f52ec108cf0 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52f10b1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec112c00 con 0x7f52ec102a60 2024-09-21T06:27:38.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52ea59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52ea59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51734/0 (socket says 172.21.15.38:51734) 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52ea59c640 1 -- 172.21.15.38:0/1351556123 learned_addr learned my addr 172.21.15.38:0/1351556123 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.081+0000 7f52ead9d640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 0x7f52ec199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52eb59e640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec108cf0 0x7f52ec19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 -- 172.21.15.38:0/1351556123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 msgr2=0x7f52ec199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 0x7f52ec199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 -- 172.21.15.38:0/1351556123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec108cf0 msgr2=0x7f52ec19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec108cf0 0x7f52ec19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 -- 172.21.15.38:0/1351556123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec19f3c0 con 0x7f52ec1083a0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52ea59c640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f52e000d770 tx=0x7f52e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0017070 con 0x7f52ec1083a0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec19f6b0 con 0x7f52ec1083a0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52e0009c30 con 0x7f52ec1083a0 2024-09-21T06:27:38.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e000f620 con 0x7f52ec1083a0 2024-09-21T06:27:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.082+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a5e10 con 0x7f52ec1083a0 2024-09-21T06:27:38.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.084+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec102e70 con 0x7f52ec1083a0 2024-09-21T06:27:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.086+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f52e001a070 con 0x7f52ec1083a0 2024-09-21T06:27:38.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.087+0000 7f52d3fff640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 0x7f52d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.087+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f52e00e7140 con 0x7f52ec1083a0 2024-09-21T06:27:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.087+0000 7f52ead9d640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 0x7f52d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:38.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.088+0000 7f52ead9d640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 0x7f52d40b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00bbe0 tx=0x7f52dc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:38.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.090+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52e0009de0 con 0x7f52ec1083a0 2024-09-21T06:27:38.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.316+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52ec19a580 con 0x7f52ec1083a0 2024-09-21T06:27:38.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.317+0000 7f52d3fff640 1 -- 172.21.15.38:0/1351556123 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f52e00ad680 con 0x7f52ec1083a0 2024-09-21T06:27:38.319 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:27:38.319 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:27:38.319 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 msgr2=0x7f52d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 0x7f52d40b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00bbe0 tx=0x7f52dc00b390 comp rx=0 tx=0).stop 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 msgr2=0x7f52ec1999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f52e000d770 tx=0x7f52e000dc30 comp rx=0 tx=0).stop 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 shutdown_connections 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f52d40b6680 0x7f52d40b8b90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52ec108cf0 0x7f52ec19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52ec1083a0 0x7f52ec1999f0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 --2- 172.21.15.38:0/1351556123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52ec102a60 0x7f52ec199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 >> 172.21.15.38:0/1351556123 conn(0x7f52ec079730 msgr2=0x7f52ec1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 shutdown_connections 2024-09-21T06:27:38.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:38.319+0000 7f52f10b1640 1 -- 172.21.15.38:0/1351556123 wait complete. 2024-09-21T06:27:38.985 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:38 smithi038 ceph-mon[31215]: pgmap v562: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:38.985 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:38 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1351556123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:39.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:27:39.280 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:39.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:38 smithi174 ceph-mon[34815]: pgmap v562: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:39.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:38 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1351556123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:38 smithi044 ceph-mon[34369]: pgmap v562: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:38 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1351556123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 -- 172.21.15.38:0/4263659280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58102ae0 msgr2=0x7fdc58102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 --2- 172.21.15.38:0/4263659280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58102ae0 0x7fdc58102ef0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009900 tx=0x7fdc4802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 -- 172.21.15.38:0/4263659280 shutdown_connections 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 --2- 172.21.15.38:0/4263659280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc58108d20 0x7fdc5810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 --2- 172.21.15.38:0/4263659280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc581083d0 0x7fdc581087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 --2- 172.21.15.38:0/4263659280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58102ae0 0x7fdc58102ef0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 -- 172.21.15.38:0/4263659280 >> 172.21.15.38:0/4263659280 conn(0x7fdc58079760 msgr2=0x7fdc58079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 -- 172.21.15.38:0/4263659280 shutdown_connections 2024-09-21T06:27:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 -- 172.21.15.38:0/4263659280 wait complete. 2024-09-21T06:27:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.722+0000 7fdc5e807640 1 Processor -- start 2024-09-21T06:27:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 -- start start 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc58102ae0 0x7fdc58104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc581083d0 0x7fdc581047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58112b30 con 0x7fdc58108d20 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581129b0 con 0x7fdc58102ae0 2024-09-21T06:27:39.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5e807640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58112cb0 con 0x7fdc581083d0 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45896/0 (socket says 172.21.15.38:45896) 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 -- 172.21.15.38:0/3613323446 learned_addr learned my addr 172.21.15.38:0/3613323446 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc581083d0 0x7fdc581047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc57fff640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc58102ae0 0x7fdc58104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 -- 172.21.15.38:0/3613323446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc581083d0 msgr2=0x7fdc581047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc581083d0 0x7fdc581047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 -- 172.21.15.38:0/3613323446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc58102ae0 msgr2=0x7fdc58104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc58102ae0 0x7fdc58104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.723+0000 7fdc5cda4640 1 -- 172.21.15.38:0/3613323446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581a8850 con 0x7fdc58108d20 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc5cda4640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b970 tx=0x7fdc5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc55ffb640 1 -- 172.21.15.38:0/3613323446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50019070 con 0x7fdc58108d20 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc55ffb640 1 -- 172.21.15.38:0/3613323446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc5000cb40 con 0x7fdc58108d20 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581a8b40 con 0x7fdc58108d20 2024-09-21T06:27:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc55ffb640 1 -- 172.21.15.38:0/3613323446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50007650 con 0x7fdc58108d20 2024-09-21T06:27:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.724+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581a9080 con 0x7fdc58108d20 2024-09-21T06:27:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 Processor -- start 2024-09-21T06:27:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc55ffb640 1 -- 172.21.15.38:0/3613323446 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdc5001c070 con 0x7fdc58108d20 2024-09-21T06:27:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 -- start start 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x565011626ea0 con 0x5650112e8390 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5650116162d0 con 0x565011309070 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.727+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56501161a0e0 con 0x5650112e01b0 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45904/0 (socket says 172.21.15.38:45904) 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/2540546424 learned_addr learned my addr 172.21.15.38:0/2540546424 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc57fff640 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc55ffb640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 0x7fdc440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/2540546424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 msgr2=0x5650116b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/2540546424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 msgr2=0x5650116b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/2540546424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565011374650 con 0x5650112e8390 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc5cda4640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 0x7fdc440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fdc40012770 tx=0x7fdc40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2be4dceecf088c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc55ffb640 1 -- 172.21.15.38:0/3613323446 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdc500e6c10 con 0x7fdc58108d20 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4e7fc640 1 -- 172.21.15.38:0/2540546424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40012cf0 con 0x5650112e8390 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4e7fc640 1 -- 172.21.15.38:0/2540546424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc40010770 con 0x5650112e8390 2024-09-21T06:27:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.728+0000 7fdc4e7fc640 1 -- 172.21.15.38:0/2540546424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003850 con 0x5650112e8390 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 -- 172.21.15.38:0/2540546424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 msgr2=0x5650116b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc5cda4640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 0x7fdc440b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdc500aca90 tx=0x7fdc500797b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fdc40012770 tx=0x7fdc40004730 comp rx=0 tx=0).stop 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 -- 172.21.15.38:0/2540546424 shutdown_connections 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1120 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/2540546424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 -- 172.21.15.38:0/2540546424 >> 172.21.15.38:0/2540546424 conn(0x5650112fd460 msgr2=0x5650116ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 -- 172.21.15.38:0/2540546424 shutdown_connections 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.729+0000 7fdc64d7b740 1 -- 172.21.15.38:0/2540546424 wait complete. 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.730+0000 7fdc64d7b740 1 -- start start 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.730+0000 7fdc64d7b740 1 Processor -- start 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x565011477700 con 0x5650112e8390 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5650115b1160 con 0x565011309070 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5650116bee80 con 0x5650112e01b0 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc64d7b740 10 client.0 _ll_register_callbacks cb 0x5650115ca9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:39.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45920/0 (socket says 172.21.15.38:45920) 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 -- 172.21.15.38:0/1645640457 learned_addr learned my addr 172.21.15.38:0/1645640457 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 -- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 msgr2=0x5650116bbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 -- 172.21.15.38:0/1645640457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 msgr2=0x5650116c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 -- 172.21.15.38:0/1645640457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650115dec90 con 0x5650112e8390 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc57fff640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009230 tx=0x7fdc48031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b36516ea95fb4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc377fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.731+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48035040 con 0x5650112e8390 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdc48004250 con 0x5650112e8390 2024-09-21T06:27:39.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc40010770 con 0x5650112e8390 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdc48004450 con 0x5650112e8390 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 10 client.17622 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5650116cac10 con 0x5650112e8390 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc40010770 con 0x5650112e8390 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdc48004ce0 con 0x5650112e8390 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 10 client.17622 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 10 client.17622 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 20 client.17622 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5650112c79f0 0x5650116ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 4 client.17622 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.732+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565011628df0 con 0x5650112c79f0 2024-09-21T06:27:39.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.733+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5650112c79f0 0x5650116ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.733+0000 7fdc377fe640 10 client.17622 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.733+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5650112c79f0 0x5650116ce0b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e0e7d5e9a5a4822 server_cookie=33efdf9fc2c63cd3 in_seq=0 out_seq=0 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc377fe640 1 -- 172.21.15.38:0/1645640457 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565011628df0 con 0x5650112c79f0 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc377fe640 10 client.17622 handle_command_reply: tid=0 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 client.17622 shutdown 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 msgr2=0x5650116bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009230 tx=0x7fdc48031510 comp rx=0 tx=0).stop 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 shutdown_connections 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5650112c79f0 0x5650116ce0b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116bc310 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc377fe640 0 client.17622 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/1645640457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 >> 172.21.15.38:0/1645640457 conn(0x5650112fd460 msgr2=0x5650116b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 shutdown_connections 2024-09-21T06:27:39.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 1 -- 172.21.15.38:0/1645640457 wait complete. 2024-09-21T06:27:39.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.734+0000 7fdc64d7b740 20 client.17622 trim_cache size 0 max 16384 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 Processor -- start 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 -- start start 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581b41d0 con 0x5650112e8390 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581b1aa0 con 0x565011309070 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581af910 con 0x5650112e01b0 2024-09-21T06:27:39.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45926/0 (socket says 172.21.15.38:45926) 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 -- 172.21.15.38:0/991816961 learned_addr learned my addr 172.21.15.38:0/991816961 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 -- 172.21.15.38:0/991816961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 msgr2=0x5650116bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 -- 172.21.15.38:0/991816961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 msgr2=0x5650116c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.748+0000 7fdc57fff640 1 -- 172.21.15.38:0/991816961 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650116ba2d0 con 0x5650112e8390 2024-09-21T06:27:39.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc57fff640 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000c00 tx=0x7fdc48005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f868253519548c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc4dffb640 1 -- 172.21.15.38:0/991816961 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48035030 con 0x5650112e8390 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc4dffb640 1 -- 172.21.15.38:0/991816961 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc48041070 con 0x5650112e8390 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc4dffb640 1 -- 172.21.15.38:0/991816961 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48050770 con 0x5650112e8390 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 -- 172.21.15.38:0/991816961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 msgr2=0x5650116b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000c00 tx=0x7fdc48005fd0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 -- 172.21.15.38:0/991816961 shutdown_connections 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x5650116c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e8390 0x5650116b1de0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.749+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/991816961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e01b0 0x5650116bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- 172.21.15.38:0/991816961 >> 172.21.15.38:0/991816961 conn(0x5650112fd460 msgr2=0x5650116b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- 172.21.15.38:0/991816961 shutdown_connections 2024-09-21T06:27:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- 172.21.15.38:0/991816961 wait complete. 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- start start 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 Processor -- start 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e8390 0x5650116c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x565011731a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581aff60 con 0x5650112e01b0 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581b13d0 con 0x565011309070 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.750+0000 7fdc64d7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581b0630 con 0x5650112e8390 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc64d7b740 10 client.0 _ll_register_callbacks cb 0x7fdc48005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45928/0 (socket says 172.21.15.38:45928) 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/4019577991 learned_addr learned my addr 172.21.15.38:0/4019577991 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc57fff640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e8390 0x5650116c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e8390 msgr2=0x5650116c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e8390 0x5650116c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/4019577991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 msgr2=0x565011731a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x565011731a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 -- 172.21.15.38:0/4019577991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565011732090 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc4f7fe640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x5650116a0740 tx=0x7fdc40012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab027832323b110e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc377fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40038060 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdc40010740 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.751+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc48041070 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdc40010940 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 10 client.17628 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5650117393b0 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdc48041070 con 0x5650112e01b0 2024-09-21T06:27:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdc4001f460 con 0x5650112e01b0 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 10 client.17628 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 10 client.17628 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 20 client.17628 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56501129cda0 0x56501173b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 4 client.17628 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650116b7980 con 0x56501129cda0 2024-09-21T06:27:39.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.752+0000 7fdc57fff640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56501129cda0 0x56501173b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:39.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc377fe640 10 client.17628 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:27:39.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc57fff640 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56501129cda0 0x56501173b990 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a1f2722de0a9257 server_cookie=13ea2a4595521eab in_seq=0 out_seq=0 2024-09-21T06:27:39.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc377fe640 1 -- 172.21.15.38:0/4019577991 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650116b7980 con 0x56501129cda0 2024-09-21T06:27:39.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc377fe640 10 client.17628 handle_command_reply: tid=0 2024-09-21T06:27:39.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 client.17628 shutdown 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 msgr2=0x5650116c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x5650116a0740 tx=0x7fdc40012f80 comp rx=0 tx=0).stop 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 shutdown_connections 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x56501129cda0 0x56501173b990 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565011309070 0x565011731a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650112e8390 0x5650116c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 --2- 172.21.15.38:0/4019577991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5650112e01b0 0x5650116c09a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 >> 172.21.15.38:0/4019577991 conn(0x5650112fd460 msgr2=0x5650116b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc377fe640 0 client.17628 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 shutdown_connections 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 1 -- 172.21.15.38:0/4019577991 wait complete. 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.753+0000 7fdc64d7b740 20 client.17628 trim_cache size 0 max 16384 2024-09-21T06:27:39.759 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 msgr2=0x7fdc440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 0x7fdc440b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdc500aca90 tx=0x7fdc500797b0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 msgr2=0x7fdc58104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b970 tx=0x7fdc5000be30 comp rx=0 tx=0).stop 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 shutdown_connections 2024-09-21T06:27:39.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdc440b6680 0x7fdc440b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdc58108d20 0x7fdc58104d00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc581083d0 0x7fdc581047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 --2- 172.21.15.38:0/3613323446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdc58102ae0 0x7fdc58104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 >> 172.21.15.38:0/3613323446 conn(0x7fdc58079760 msgr2=0x7fdc58106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 shutdown_connections 2024-09-21T06:27:39.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:39.754+0000 7fdc5e807640 1 -- 172.21.15.38:0/3613323446 wait complete. 2024-09-21T06:27:40.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:27:40.811 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:41.207 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:40 smithi038 ceph-mon[31215]: pgmap v563: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 -- 172.21.15.38:0/2752320614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 msgr2=0x7f5f301098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2752320614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f301098e0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009900 tx=0x7f5f1802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:41.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 -- 172.21.15.38:0/2752320614 shutdown_connections 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2752320614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30109e20 0x7f5f30110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2752320614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f301098e0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2752320614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30103b90 0x7f5f30103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 -- 172.21.15.38:0/2752320614 >> 172.21.15.38:0/2752320614 conn(0x7f5f300ff600 msgr2=0x7f5f30101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 -- 172.21.15.38:0/2752320614 shutdown_connections 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.300+0000 7f5f357b4640 1 -- 172.21.15.38:0/2752320614 wait complete. 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 Processor -- start 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 -- start start 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30103b90 0x7f5f3019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 0x7f5f3019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30113c00 con 0x7f5f301094d0 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30113a80 con 0x7f5f30103b90 2024-09-21T06:27:41.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f357b4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30113d80 con 0x7f5f30109e20 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45952/0 (socket says 172.21.15.38:45952) 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/2225360907 learned_addr learned my addr 172.21.15.38:0/2225360907 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.301+0000 7f5f2effd640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30103b90 0x7f5f3019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 0x7f5f3019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/2225360907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 msgr2=0x7f5f3019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 0x7f5f3019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/2225360907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30103b90 msgr2=0x7f5f3019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30103b90 0x7f5f3019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/2225360907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f301a0520 con 0x7f5f301094d0 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 0x7f5f3019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005940 tx=0x7f5f180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f27fff640 1 -- 172.21.15.38:0/2225360907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1803f030 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f301a07b0 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f27fff640 1 -- 172.21.15.38:0/2225360907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f18031910 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f27fff640 1 -- 172.21.15.38:0/2225360907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18035070 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.302+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f301a6f70 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 Processor -- start 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 -- start start 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f27fff640 1 -- 172.21.15.38:0/2225360907 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5f18042030 con 0x7f5f301094d0 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c177f1b0 0x5579c1b4fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b50120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5579c1ac5ea0 con 0x5579c17a8070 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5579c1ab52d0 con 0x5579c1787390 2024-09-21T06:27:41.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.305+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5579c1ab90e0 con 0x5579c177f1b0 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45956/0 (socket says 172.21.15.38:45956) 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/644604703 learned_addr learned my addr 172.21.15.38:0/644604703 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b50120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/644604703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c177f1b0 msgr2=0x5579c1b4fbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c177f1b0 0x5579c1b4fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/644604703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 msgr2=0x5579c1b50120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b50120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/644604703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c1813650 con 0x5579c17a8070 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b50120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:41.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f27fff640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 0x7f5f1c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800af40 tx=0x7f5f2800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ab27f1e2ed2a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f2effd640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 0x7f5f1c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f27fff640 1 -- 172.21.15.38:0/2225360907 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f5f18107bd0 con 0x7f5f301094d0 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.306+0000 7f5f257fa640 1 -- 172.21.15.38:0/644604703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28003b70 con 0x5579c17a8070 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.307+0000 7f5f257fa640 1 -- 172.21.15.38:0/644604703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f28010b10 con 0x5579c17a8070 2024-09-21T06:27:41.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.307+0000 7f5f257fa640 1 -- 172.21.15.38:0/644604703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800fbe0 con 0x5579c17a8070 2024-09-21T06:27:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- 172.21.15.38:0/644604703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 msgr2=0x5579c1b4f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f2effd640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 0x7f5f1c0b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5579c1b4e320 tx=0x7f5f2000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800af40 tx=0x7f5f2800e7e0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- 172.21.15.38:0/644604703 shutdown_connections 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b50120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c177f1b0 0x5579c1b4fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/644604703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b4f6a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- 172.21.15.38:0/644604703 >> 172.21.15.38:0/644604703 conn(0x5579c179c460 msgr2=0x5579c1b4d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- 172.21.15.38:0/644604703 shutdown_connections 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- 172.21.15.38:0/644604703 wait complete. 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 -- start start 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.308+0000 7f5f3bd28740 1 Processor -- start 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b5adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b5b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5579c1916700 con 0x5579c17a8070 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5579c1a50160 con 0x5579c177f1b0 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5579c1b5de80 con 0x5579c1787390 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f3bd28740 10 client.0 _ll_register_callbacks cb 0x5579c1a699e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45960/0 (socket says 172.21.15.38:45960) 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/1691225109 learned_addr learned my addr 172.21.15.38:0/1691225109 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2effd640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b5adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b5b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/1691225109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 msgr2=0x5579c1b5b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b5b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 msgr2=0x5579c1b5adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b5adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 -- 172.21.15.38:0/1691225109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c1a7dc90 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f80 tx=0x7f5f28011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14927610e4eb7ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.309+0000 7f5f167fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2802a060 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f5f280108d0 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f28010b10 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5f28004a40 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 10 client.17640 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5579c1b69b60 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f28010b10 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5f280053a0 con 0x5579c17a8070 2024-09-21T06:27:41.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 10 client.17640 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 10 client.17640 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 20 client.17640 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17669f0 0x5579c1b6cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 4 client.17640 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.310+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579c1ac7df0 con 0x5579c17669f0 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.311+0000 7f5f2effd640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17669f0 0x5579c1b6cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.311+0000 7f5f2effd640 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17669f0 0x5579c1b6cf70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69783c25038a0620 server_cookie=9ff0acfe641dc08 in_seq=0 out_seq=0 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.311+0000 7f5f167fc640 10 client.17640 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f167fc640 1 -- 172.21.15.38:0/1691225109 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5579c1ac7df0 con 0x5579c17669f0 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f167fc640 10 client.17640 handle_command_reply: tid=0 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 client.17640 shutdown 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 msgr2=0x5579c1b67170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f80 tx=0x7f5f28011f00 comp rx=0 tx=0).stop 2024-09-21T06:27:41.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 shutdown_connections 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17669f0 0x5579c1b6cf70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f167fc640 0 client.17640 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17a8070 0x5579c1b67170 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b5b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/1691225109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b5adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 >> 172.21.15.38:0/1691225109 conn(0x5579c179c460 msgr2=0x5579c1b52880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 shutdown_connections 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 1 -- 172.21.15.38:0/1691225109 wait complete. 2024-09-21T06:27:41.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.312+0000 7f5f3bd28740 20 client.17640 trim_cache size 0 max 16384 2024-09-21T06:27:41.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 Processor -- start 2024-09-21T06:27:41.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 -- start start 2024-09-21T06:27:41.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 0x5579c1b5b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301b1ff0 con 0x5579c177f1b0 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301af8c0 con 0x5579c1787390 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.326+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301ad730 con 0x5579c17669f0 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45976/0 (socket says 172.21.15.38:45976) 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/3938961691 learned_addr learned my addr 172.21.15.38:0/3938961691 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2effd640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 0x5579c1b5b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/3938961691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 msgr2=0x5579c1b5b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 0x5579c1b5b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/3938961691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 msgr2=0x5579c1b4cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b4cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 -- 172.21.15.38:0/3938961691 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c1b5c080 con 0x5579c177f1b0 2024-09-21T06:27:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2effd640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 0x5579c1b5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5f18105970 tx=0x7f5f1802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3ff2c257b8112e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f24ff9640 1 -- 172.21.15.38:0/3938961691 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f18049040 con 0x5579c177f1b0 2024-09-21T06:27:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f24ff9640 1 -- 172.21.15.38:0/3938961691 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f180cd580 con 0x5579c177f1b0 2024-09-21T06:27:41.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.327+0000 7f5f24ff9640 1 -- 172.21.15.38:0/3938961691 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f180c9040 con 0x5579c177f1b0 2024-09-21T06:27:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 -- 172.21.15.38:0/3938961691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 msgr2=0x5579c1b50de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5f18105970 tx=0x7f5f1802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 -- 172.21.15.38:0/3938961691 shutdown_connections 2024-09-21T06:27:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c1787390 0x5579c1b4cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c177f1b0 0x5579c1b50de0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/3938961691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c17669f0 0x5579c1b5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 -- 172.21.15.38:0/3938961691 >> 172.21.15.38:0/3938961691 conn(0x5579c179c460 msgr2=0x5579c1b506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 -- 172.21.15.38:0/3938961691 shutdown_connections 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.328+0000 7f5f3bd28740 1 -- 172.21.15.38:0/3938961691 wait complete. 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 -- start start 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 Processor -- start 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b6db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b6e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301add80 con 0x5579c17669f0 2024-09-21T06:27:41.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301af1f0 con 0x5579c177f1b0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301ae450 con 0x5579c1787390 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f3bd28740 10 client.0 _ll_register_callbacks cb 0x7f5f28014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45992/0 (socket says 172.21.15.38:45992) 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.329+0000 7f5f2effd640 1 -- 172.21.15.38:0/4280428175 learned_addr learned my addr 172.21.15.38:0/4280428175 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2f7fe640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b6e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b6db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 -- 172.21.15.38:0/4280428175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 msgr2=0x5579c1b6e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b6e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 -- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 msgr2=0x5579c1b6db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b6db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 -- 172.21.15.38:0/4280428175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c1b6e6e0 con 0x5579c17669f0 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b6db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:41.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f2effd640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003dc0 tx=0x7f5f20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b58146fb9ecff24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f167fc640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20005220 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f5f200053c0 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f180cd580 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5f20036050 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f3bd28740 10 client.17646 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.330+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5579c1bd7520 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f180cd580 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5f2001e750 con 0x5579c17669f0 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 10 client.17646 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 10 client.17646 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 20 client.17646 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17a8070 0x5579c1bd9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:41.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 4 client.17646 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579c1ac38a0 con 0x5579c17a8070 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.331+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17a8070 0x5579c1bd9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f2e7fc640 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17a8070 0x5579c1bd9d10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=257e76f28d6f724 server_cookie=70d60f9e27dfd81 in_seq=0 out_seq=0 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f167fc640 10 client.17646 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f167fc640 1 -- 172.21.15.38:0/4280428175 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579c1ac38a0 con 0x5579c17a8070 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f167fc640 10 client.17646 handle_command_reply: tid=0 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 client.17646 shutdown 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 msgr2=0x5579c1b70660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5f20003dc0 tx=0x7f5f20004730 comp rx=0 tx=0).stop 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 shutdown_connections 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5579c17a8070 0x5579c1bd9d10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5579c1787390 0x5579c1b6e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579c177f1b0 0x5579c1b6db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f167fc640 0 client.17646 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:27:41.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 --2- 172.21.15.38:0/4280428175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5579c17669f0 0x5579c1b70660 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 >> 172.21.15.38:0/4280428175 conn(0x5579c179c460 msgr2=0x5579c1b5b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 shutdown_connections 2024-09-21T06:27:41.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 1 -- 172.21.15.38:0/4280428175 wait complete. 2024-09-21T06:27:41.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.332+0000 7f5f3bd28740 20 client.17646 trim_cache size 0 max 16384 2024-09-21T06:27:41.339 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 msgr2=0x7f5f1c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 0x7f5f1c0b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5579c1b4e320 tx=0x7f5f2000b390 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 msgr2=0x7f5f3019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005940 tx=0x7f5f180042f0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 shutdown_connections 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5f1c0b6680 0x7f5f1c0b8b90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f30109e20 0x7f5f3019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f301094d0 0x7f5f3019ab50 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 --2- 172.21.15.38:0/2225360907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5f30103b90 0x7f5f3019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 >> 172.21.15.38:0/2225360907 conn(0x7f5f300ff600 msgr2=0x7f5f30101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 shutdown_connections 2024-09-21T06:27:41.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:41.333+0000 7f5f357b4640 1 -- 172.21.15.38:0/2225360907 wait complete. 2024-09-21T06:27:41.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:40 smithi174 ceph-mon[34815]: pgmap v563: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:41.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:40 smithi044 ceph-mon[34369]: pgmap v563: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:42.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:27:42.283 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 -- 172.21.15.38:0/2914451346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 msgr2=0x7f91e81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 --2- 172.21.15.38:0/2914451346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e81087f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009900 tx=0x7f91dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 -- 172.21.15.38:0/2914451346 shutdown_connections 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 --2- 172.21.15.38:0/2914451346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 0x7f91e810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 --2- 172.21.15.38:0/2914451346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e81087f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 --2- 172.21.15.38:0/2914451346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 0x7f91e8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 -- 172.21.15.38:0/2914451346 >> 172.21.15.38:0/2914451346 conn(0x7f91e8079750 msgr2=0x7f91e8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 -- 172.21.15.38:0/2914451346 shutdown_connections 2024-09-21T06:27:42.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.767+0000 7f91ed338640 1 -- 172.21.15.38:0/2914451346 wait complete. 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 Processor -- start 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 -- start start 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 0x7f91e8110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 0x7f91e8110ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8113c30 con 0x7f91e81083e0 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8113ab0 con 0x7f91e8108d30 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.768+0000 7f91ed338640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8113db0 con 0x7f91e8102aa0 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46010/0 (socket says 172.21.15.38:46010) 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 -- 172.21.15.38:0/1680290706 learned_addr learned my addr 172.21.15.38:0/1680290706 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 0x7f91e8110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e77fe640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 0x7f91e8110ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 -- 172.21.15.38:0/1680290706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 msgr2=0x7f91e8110040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 0x7f91e8110040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 -- 172.21.15.38:0/1680290706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 msgr2=0x7f91e8110ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 0x7f91e8110ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 -- 172.21.15.38:0/1680290706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e81a8860 con 0x7f91e81083e0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91e67fc640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005940 tx=0x7f91dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91cffff640 1 -- 172.21.15.38:0/1680290706 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc03f030 con 0x7f91e81083e0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81a8af0 con 0x7f91e81083e0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91cffff640 1 -- 172.21.15.38:0/1680290706 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91dc031910 con 0x7f91e81083e0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.769+0000 7f91cffff640 1 -- 172.21.15.38:0/1680290706 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc035070 con 0x7f91e81083e0 2024-09-21T06:27:42.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.770+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e81a9020 con 0x7f91e81083e0 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.772+0000 7f91f38ac740 1 Processor -- start 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.772+0000 7f91f38ac740 1 -- start start 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91cffff640 1 -- 172.21.15.38:0/1680290706 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f91dc042030 con 0x7f91e81083e0 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 0x561d294dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561d29452ea0 con 0x561d29114390 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d294422d0 con 0x561d2910c1b0 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91f38ac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d294460e0 con 0x561d29135070 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e67fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46012/0 (socket says 172.21.15.38:46012) 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e67fc640 1 -- 172.21.15.38:0/1962583235 learned_addr learned my addr 172.21.15.38:0/1962583235 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 0x561d294dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 -- 172.21.15.38:0/1962583235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 msgr2=0x561d294dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 -- 172.21.15.38:0/1962583235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 msgr2=0x561d294dcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e77fe640 1 -- 172.21.15.38:0/1962583235 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d291a0650 con 0x561d29135070 2024-09-21T06:27:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.773+0000 7f91e67fc640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:42.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91e77fe640 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 0x561d294dc2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009f30 tx=0x7f91e0010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7753516820fabf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91cffff640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91cd7fa640 1 -- 172.21.15.38:0/1962583235 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0016070 con 0x561d29135070 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91cd7fa640 1 -- 172.21.15.38:0/1962583235 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91e0004d20 con 0x561d29135070 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91cd7fa640 1 -- 172.21.15.38:0/1962583235 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0012870 con 0x561d29135070 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.774+0000 7f91cffff640 1 -- 172.21.15.38:0/1680290706 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f91dc107ae0 con 0x7f91e81083e0 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 -- 172.21.15.38:0/1962583235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 msgr2=0x561d294dc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 0x7f91d00b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x561d294daf40 tx=0x7f91d800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 0x561d294dc2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009f30 tx=0x7f91e0010800 comp rx=0 tx=0).stop 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 -- 172.21.15.38:0/1962583235 shutdown_connections 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29114390 0x561d294dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 --2- 172.21.15.38:0/1962583235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29135070 0x561d294dc2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 -- 172.21.15.38:0/1962583235 >> 172.21.15.38:0/1962583235 conn(0x561d29129460 msgr2=0x561d294da1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 -- 172.21.15.38:0/1962583235 shutdown_connections 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.775+0000 7f91f38ac740 1 -- 172.21.15.38:0/1962583235 wait complete. 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 -- start start 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 Processor -- start 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29135070 0x561d294f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561d292a3700 con 0x561d2910c1b0 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d293dd160 con 0x561d29135070 2024-09-21T06:27:42.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561d294eaaa0 con 0x561d29114390 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91f38ac740 10 client.0 _ll_register_callbacks cb 0x561d293f69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46018/0 (socket says 172.21.15.38:46018) 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91e6ffd640 1 -- 172.21.15.38:0/226634622 learned_addr learned my addr 172.21.15.38:0/226634622 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91e67fc640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.776+0000 7f91e77fe640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29135070 0x561d294f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 -- 172.21.15.38:0/226634622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 msgr2=0x561d294e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294e7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 -- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29135070 msgr2=0x561d294f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29135070 0x561d294f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 -- 172.21.15.38:0/226634622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2940ac90 con 0x561d2910c1b0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f91d8003d00 tx=0x7f91d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c792e009d93e947 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91caff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:42.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d802c060 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f91d8017030 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e0004d20 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91d8031460 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91f38ac740 10 client.17658 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.777+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d294f6840 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91e0004d20 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91d80114d0 con 0x561d2910c1b0 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 10 client.17658 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 20 client.17658 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290f39f0 0x561d294f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 4 client.17658 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d29454df0 con 0x561d290f39f0 2024-09-21T06:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91e67fc640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290f39f0 0x561d294f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91caff5640 10 client.17658 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:42.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.778+0000 7f91e67fc640 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290f39f0 0x561d294f9e00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f7c4d9235d5db1 server_cookie=a5b0e32769619711 in_seq=0 out_seq=0 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91caff5640 1 -- 172.21.15.38:0/226634622 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d29454df0 con 0x561d290f39f0 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91caff5640 10 client.17658 handle_command_reply: tid=0 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 client.17658 shutdown 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 msgr2=0x561d294e79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f91d8003d00 tx=0x7f91d80046c0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 shutdown_connections 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29135070 0x561d294f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290f39f0 0x561d294f9e00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294e7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.779+0000 7f91f38ac740 1 --2- 172.21.15.38:0/226634622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d2910c1b0 0x561d294e79b0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.780+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 >> 172.21.15.38:0/226634622 conn(0x561d29129460 msgr2=0x561d294df450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.780+0000 7f91caff5640 0 client.17658 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.780+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 shutdown_connections 2024-09-21T06:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.780+0000 7f91f38ac740 1 -- 172.21.15.38:0/226634622 wait complete. 2024-09-21T06:27:42.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.780+0000 7f91f38ac740 20 client.17658 trim_cache size 0 max 16384 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 Processor -- start 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 -- start start 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d2910c1b0 0x561d294dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29114390 0x561d294e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b4200 con 0x561d29135070 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b1ad0 con 0x561d29114390 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91f38ac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81af940 con 0x561d2910c1b0 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46034/0 (socket says 172.21.15.38:46034) 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 -- 172.21.15.38:0/3862964357 learned_addr learned my addr 172.21.15.38:0/3862964357 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e67fc640 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29114390 0x561d294e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 -- 172.21.15.38:0/3862964357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d2910c1b0 msgr2=0x561d294dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d2910c1b0 0x561d294dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 -- 172.21.15.38:0/3862964357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29114390 msgr2=0x561d294e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.793+0000 7f91e77fe640 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29114390 0x561d294e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.794+0000 7f91e77fe640 1 -- 172.21.15.38:0/3862964357 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d294d43b0 con 0x561d29135070 2024-09-21T06:27:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.794+0000 7f91e77fe640 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009f30 tx=0x7f91e0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a2024e2a03df7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.794+0000 7f91ccff9640 1 -- 172.21.15.38:0/3862964357 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e002a070 con 0x561d29135070 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.794+0000 7f91ccff9640 1 -- 172.21.15.38:0/3862964357 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91e0004c80 con 0x561d29135070 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.794+0000 7f91ccff9640 1 -- 172.21.15.38:0/3862964357 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0016030 con 0x561d29135070 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- 172.21.15.38:0/3862964357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 msgr2=0x561d294e7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009f30 tx=0x7f91e0005bd0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- 172.21.15.38:0/3862964357 shutdown_connections 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294e7ca0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d29114390 0x561d294e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 --2- 172.21.15.38:0/3862964357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d2910c1b0 0x561d294dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- 172.21.15.38:0/3862964357 >> 172.21.15.38:0/3862964357 conn(0x561d29129460 msgr2=0x561d294df3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- 172.21.15.38:0/3862964357 shutdown_connections 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- 172.21.15.38:0/3862964357 wait complete. 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 -- start start 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 Processor -- start 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.795+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81aff90 con 0x561d29135070 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b1400 con 0x561d2910c1b0 2024-09-21T06:27:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91e81b0660 con 0x561d29114390 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91f38ac740 10 client.0 _ll_register_callbacks cb 0x7f91d8004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:55912/0 (socket says 172.21.15.38:55912) 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e6ffd640 1 -- 172.21.15.38:0/2860659528 learned_addr learned my addr 172.21.15.38:0/2860659528 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e67fc640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 -- 172.21.15.38:0/2860659528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 msgr2=0x561d294ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294ec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 -- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 msgr2=0x561d294ebf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 -- 172.21.15.38:0/2860659528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d29563970 con 0x561d29135070 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91e77fe640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294ec9c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000f80 tx=0x7f91e0010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9f2ff8a590b96d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.796+0000 7f91caff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0032020 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f91e0005400 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91e0004c80 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91e003d050 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 10 client.17664 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d29564bf0 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91e0004c80 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91e002d030 con 0x561d29135070 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 10 client.17664 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 20 client.17664 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290c8da0 0x561d29567020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:42.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 4 client.17664 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.797+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d294508a0 con 0x561d290c8da0 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290c8da0 0x561d29567020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91e6ffd640 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290c8da0 0x561d29567020 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca92a6c199dd2b server_cookie=3cdcb6e30963c858 in_seq=0 out_seq=0 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91caff5640 10 client.17664 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91caff5640 1 -- 172.21.15.38:0/2860659528 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d294508a0 con 0x561d290c8da0 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91caff5640 10 client.17664 handle_command_reply: tid=0 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.798+0000 7f91f38ac740 1 client.17664 shutdown 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 msgr2=0x561d294ec9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294ec9c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f91e0000f80 tx=0x7f91e0010e40 comp rx=0 tx=0).stop 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 shutdown_connections 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561d29135070 0x561d294ec9c0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561d290c8da0 0x561d29567020 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561d29114390 0x561d294ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 --2- 172.21.15.38:0/2860659528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2910c1b0 0x561d294ebf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 >> 172.21.15.38:0/2860659528 conn(0x561d29129460 msgr2=0x561d294df3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91caff5640 0 client.17664 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 shutdown_connections 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 1 -- 172.21.15.38:0/2860659528 wait complete. 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91f38ac740 20 client.17664 trim_cache size 0 max 16384 2024-09-21T06:27:42.806 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 msgr2=0x7f91d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 0x7f91d00b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x561d294daf40 tx=0x7f91d800b390 comp rx=0 tx=0).stop 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 msgr2=0x7f91e8110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.799+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f91dc005940 tx=0x7f91dc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 shutdown_connections 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91d00b6680 0x7f91d00b8b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e8108d30 0x7f91e8110ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f91e81083e0 0x7f91e8110580 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 --2- 172.21.15.38:0/1680290706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f91e8102aa0 0x7f91e8110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:42.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 >> 172.21.15.38:0/1680290706 conn(0x7f91e8079750 msgr2=0x7f91e8106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:42.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 shutdown_connections 2024-09-21T06:27:42.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:42.800+0000 7f91ed338640 1 -- 172.21.15.38:0/1680290706 wait complete. 2024-09-21T06:27:42.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:42 smithi038 ceph-mon[31215]: pgmap v564: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:42 smithi174 ceph-mon[34815]: pgmap v564: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:43.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:42 smithi044 ceph-mon[34369]: pgmap v564: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:27:44.568 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:27:44.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:27:44.838 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:45.198 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:44 smithi038 ceph-mon[31215]: pgmap v565: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 -- 172.21.15.38:0/3843349577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c381094f0 msgr2=0x7f7c38109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/3843349577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c381094f0 0x7f7c38109900 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009900 tx=0x7f7c2c02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 -- 172.21.15.38:0/3843349577 shutdown_connections 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/3843349577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c38109e40 0x7f7c38110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/3843349577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c381094f0 0x7f7c38109900 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/3843349577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38103bb0 0x7f7c38103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 -- 172.21.15.38:0/3843349577 >> 172.21.15.38:0/3843349577 conn(0x7f7c380ff600 msgr2=0x7f7c38101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 -- 172.21.15.38:0/3843349577 shutdown_connections 2024-09-21T06:27:45.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.294+0000 7f7c3d47e640 1 -- 172.21.15.38:0/3843349577 wait complete. 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 Processor -- start 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 -- start start 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 0x7f7c3819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 0x7f7c3819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38113c20 con 0x7f7c38103bb0 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38113aa0 con 0x7f7c38109e40 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c3d47e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38113da0 con 0x7f7c381094f0 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46056/0 (socket says 172.21.15.38:46056) 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c36ffd640 1 -- 172.21.15.38:0/2368996236 learned_addr learned my addr 172.21.15.38:0/2368996236 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c377fe640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 0x7f7c3819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.295+0000 7f7c367fc640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 0x7f7c3819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 -- 172.21.15.38:0/2368996236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 msgr2=0x7f7c3819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 0x7f7c3819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 -- 172.21.15.38:0/2368996236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 msgr2=0x7f7c3819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 0x7f7c3819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 -- 172.21.15.38:0/2368996236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c381a0500 con 0x7f7c38103bb0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c377fe640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 0x7f7c3819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c367fc640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 0x7f7c3819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800eab0 tx=0x7f7c2800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c1ffff640 1 -- 172.21.15.38:0/2368996236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800ce40 con 0x7f7c38103bb0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c1ffff640 1 -- 172.21.15.38:0/2368996236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c28011940 con 0x7f7c38103bb0 2024-09-21T06:27:45.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c381a07f0 con 0x7f7c38103bb0 2024-09-21T06:27:45.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c1ffff640 1 -- 172.21.15.38:0/2368996236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28010aa0 con 0x7f7c38103bb0 2024-09-21T06:27:45.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.296+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c380755f0 con 0x7f7c38103bb0 2024-09-21T06:27:45.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 Processor -- start 2024-09-21T06:27:45.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 -- start start 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6cca1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c1ffff640 1 -- 172.21.15.38:0/2368996236 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7c28010c40 con 0x7f7c38103bb0 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564d6cc17e60 con 0x564d6c8d9670 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564d6cc07290 con 0x564d6c8d1490 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c439f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564d6cc0b0a0 con 0x564d6c8fa350 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46064/0 (socket says 172.21.15.38:46064) 2024-09-21T06:27:45.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c367fc640 1 -- 172.21.15.38:0/3698632276 learned_addr learned my addr 172.21.15.38:0/3698632276 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c377fe640 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6cca1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.299+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 -- 172.21.15.38:0/3698632276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 msgr2=0x564d6cca1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6cca1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 -- 172.21.15.38:0/3698632276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 msgr2=0x564d6cca1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 -- 172.21.15.38:0/3698632276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6c965930 con 0x564d6c8d9670 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000c00 tx=0x7f7c2c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee1272f24261757 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c1ffff640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 0x7f7c200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c1d7fa640 1 -- 172.21.15.38:0/3698632276 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c03f070 con 0x564d6c8d9670 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c377fe640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 0x7f7c200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c1d7fa640 1 -- 172.21.15.38:0/3698632276 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c2c031710 con 0x564d6c8d9670 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c1d7fa640 1 -- 172.21.15.38:0/3698632276 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c035070 con 0x564d6c8d9670 2024-09-21T06:27:45.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.300+0000 7f7c1ffff640 1 -- 172.21.15.38:0/2368996236 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f7c280e7dd0 con 0x7f7c38103bb0 2024-09-21T06:27:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 -- 172.21.15.38:0/3698632276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 msgr2=0x564d6cca1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c377fe640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 0x7f7c200b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c30005fd0 tx=0x7f7c30009420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000c00 tx=0x7f7c2c032c80 comp rx=0 tx=0).stop 2024-09-21T06:27:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 -- 172.21.15.38:0/3698632276 shutdown_connections 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6cca1eb0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3698632276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6cca1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 -- 172.21.15.38:0/3698632276 >> 172.21.15.38:0/3698632276 conn(0x564d6c8ee740 msgr2=0x564d6cc9f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 -- 172.21.15.38:0/3698632276 shutdown_connections 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.301+0000 7f7c439f2740 1 -- 172.21.15.38:0/3698632276 wait complete. 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 -- start start 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 Processor -- start 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x564d6ca68890 con 0x564d6c8d1490 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564d6cba1d40 con 0x564d6c8fa350 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564d6ccafbb0 con 0x564d6c8d9670 2024-09-21T06:27:45.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c439f2740 10 client.0 _ll_register_callbacks cb 0x564d6cc05c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46076/0 (socket says 172.21.15.38:46076) 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c36ffd640 1 -- 172.21.15.38:0/3265603641 learned_addr learned my addr 172.21.15.38:0/3265603641 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.302+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c377fe640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 -- 172.21.15.38:0/3265603641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 msgr2=0x564d6ccad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 -- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 msgr2=0x564d6ccb8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 -- 172.21.15.38:0/3265603641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d6ccb94b0 con 0x564d6c8d1490 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c377fe640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c700 tx=0x7f7c280aa2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6c09a094288c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:45.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280ad5c0 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f7c280ad0d0 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2c031710 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c280b2020 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c439f2740 10 client.17676 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d6ccbbe90 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.303+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c2c031710 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c2800f040 con 0x564d6c8d1490 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 10 client.17676 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 20 client.17676 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c8b8cd0 0x564d6ccbf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 4 client.17676 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d6cc19db0 con 0x564d6c8b8cd0 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c8b8cd0 0x564d6ccbf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c367fc640 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c8b8cd0 0x564d6ccbf480 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1221b1c6fbb68cc6 server_cookie=e0e2c0a98a26264f in_seq=0 out_seq=0 2024-09-21T06:27:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.304+0000 7f7c1aff5640 10 client.17676 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c1aff5640 1 -- 172.21.15.38:0/3265603641 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d6cc19db0 con 0x564d6c8b8cd0 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c1aff5640 10 client.17676 handle_command_reply: tid=0 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 client.17676 shutdown 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 msgr2=0x564d6ccad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c700 tx=0x7f7c280aa2c0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 shutdown_connections 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c8b8cd0 0x564d6ccbf480 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 --2- 172.21.15.38:0/3265603641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccad030 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 >> 172.21.15.38:0/3265603641 conn(0x564d6c8ee740 msgr2=0x564d6cca45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.305+0000 7f7c1aff5640 0 client.17676 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:45.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.306+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 shutdown_connections 2024-09-21T06:27:45.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.306+0000 7f7c439f2740 1 -- 172.21.15.38:0/3265603641 wait complete. 2024-09-21T06:27:45.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.306+0000 7f7c439f2740 20 client.17676 trim_cache size 0 max 16384 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 Processor -- start 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 -- start start 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6ccac340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381b4140 con 0x564d6c8d9670 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381b1a10 con 0x564d6c8d1490 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.323+0000 7f7c439f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381af8a0 con 0x564d6c8fa350 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46082/0 (socket says 172.21.15.38:46082) 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 -- 172.21.15.38:0/2259716841 learned_addr learned my addr 172.21.15.38:0/2259716841 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c377fe640 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6ccac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 -- 172.21.15.38:0/2259716841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 msgr2=0x564d6ccac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6ccac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 -- 172.21.15.38:0/2259716841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 msgr2=0x564d6cca6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 -- 172.21.15.38:0/2259716841 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6ccae0f0 con 0x564d6c8d9670 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c367fc640 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006010 tx=0x7f7c2c005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5c1e4cd6249530 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c1cff9640 1 -- 172.21.15.38:0/2259716841 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c03f040 con 0x564d6c8d9670 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c1cff9640 1 -- 172.21.15.38:0/2259716841 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c2c031940 con 0x564d6c8d9670 2024-09-21T06:27:45.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.324+0000 7f7c1cff9640 1 -- 172.21.15.38:0/2259716841 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c035040 con 0x564d6c8d9670 2024-09-21T06:27:45.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- 172.21.15.38:0/2259716841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 msgr2=0x564d6ccb8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006010 tx=0x7f7c2c005310 comp rx=0 tx=0).stop 2024-09-21T06:27:45.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- 172.21.15.38:0/2259716841 shutdown_connections 2024-09-21T06:27:45.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8fa350 0x564d6ccac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d9670 0x564d6ccb8da0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 --2- 172.21.15.38:0/2259716841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8d1490 0x564d6cca6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- 172.21.15.38:0/2259716841 >> 172.21.15.38:0/2259716841 conn(0x564d6c8ee740 msgr2=0x564d6cca6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- 172.21.15.38:0/2259716841 shutdown_connections 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- 172.21.15.38:0/2259716841 wait complete. 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.325+0000 7f7c439f2740 1 -- start start 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 Processor -- start 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccb13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381afef0 con 0x564d6c8d1490 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381b1340 con 0x564d6c8fa350 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c381b05a0 con 0x564d6c8d9670 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c439f2740 10 client.0 _ll_register_callbacks cb 0x7f7c280e5a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:45.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46092/0 (socket says 172.21.15.38:46092) 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 -- 172.21.15.38:0/247008594 learned_addr learned my addr 172.21.15.38:0/247008594 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c367fc640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccb13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c377fe640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 -- 172.21.15.38:0/247008594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 msgr2=0x564d6ccb13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccb13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 -- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 msgr2=0x564d6ccb1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.326+0000 7f7c36ffd640 1 -- 172.21.15.38:0/247008594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d6cd28ea0 con 0x564d6c8d1490 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c36ffd640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7c2801c040 tx=0x7f7c280aa3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea6c1db516915b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a93e0 con 0x564d6c8d1490 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f7c28011470 con 0x564d6c8d1490 2024-09-21T06:27:45.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c2c031940 con 0x564d6c8d1490 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c280ad3e0 con 0x564d6c8d1490 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 10 client.17682 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d6cd2a190 con 0x564d6c8d1490 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c2c031940 con 0x564d6c8d1490 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c280b21c0 con 0x564d6c8d1490 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 10 client.17682 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 20 client.17682 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c88e080 0x564d6cd2c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 4 client.17682 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.327+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564d6cc15860 con 0x564d6c88e080 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.328+0000 7f7c367fc640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c88e080 0x564d6cd2c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.328+0000 7f7c1aff5640 10 client.17682 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:45.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.328+0000 7f7c367fc640 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c88e080 0x564d6cd2c950 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fe7c2169150a480 server_cookie=6031c16f445f6200 in_seq=0 out_seq=0 2024-09-21T06:27:45.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.330+0000 7f7c1aff5640 1 -- 172.21.15.38:0/247008594 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564d6cc15860 con 0x564d6c88e080 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.330+0000 7f7c1aff5640 10 client.17682 handle_command_reply: tid=0 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.330+0000 7f7c439f2740 1 client.17682 shutdown 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 msgr2=0x564d6ccb0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f7c2801c040 tx=0x7f7c280aa3f0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 shutdown_connections 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564d6c8fa350 0x564d6ccb1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x564d6c88e080 0x564d6cd2c950 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564d6c8d9670 0x564d6ccb13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 --2- 172.21.15.38:0/247008594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x564d6c8d1490 0x564d6ccb0e90 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 >> 172.21.15.38:0/247008594 conn(0x564d6c8ee740 msgr2=0x564d6ccae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c1aff5640 0 client.17682 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 shutdown_connections 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 1 -- 172.21.15.38:0/247008594 wait complete. 2024-09-21T06:27:45.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.331+0000 7f7c439f2740 20 client.17682 trim_cache size 0 max 16384 2024-09-21T06:27:45.336 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:27:45.336 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:27:45.336 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d", 2024-09-21T06:27:45.336 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:27:45.336 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 msgr2=0x7f7c200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 0x7f7c200b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7c30005fd0 tx=0x7f7c30009420 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 msgr2=0x7f7c3819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800eab0 tx=0x7f7c2800ef70 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 shutdown_connections 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c200b6680 0x7f7c200b8b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c38109e40 0x7f7c3819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c381094f0 0x7f7c3819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 --2- 172.21.15.38:0/2368996236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c38103bb0 0x7f7c3819a590 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 >> 172.21.15.38:0/2368996236 conn(0x7f7c380ff600 msgr2=0x7f7c38101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:45.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 shutdown_connections 2024-09-21T06:27:45.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:45.332+0000 7f7c3d47e640 1 -- 172.21.15.38:0/2368996236 wait complete. 2024-09-21T06:27:45.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:44 smithi174 ceph-mon[34815]: pgmap v565: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:44 smithi044 ceph-mon[34369]: pgmap v565: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:27:46.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:27:46.396 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:46.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.848+0000 7f8d64c73640 1 -- 172.21.15.38:0/1307166816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d601094a0 msgr2=0x7f8d601098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.848+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1307166816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d601094a0 0x7f8d601098b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009900 tx=0x7f8d4802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 -- 172.21.15.38:0/1307166816 shutdown_connections 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1307166816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d60109df0 0x7f8d60110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1307166816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d601094a0 0x7f8d601098b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1307166816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60103b60 0x7f8d60103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 -- 172.21.15.38:0/1307166816 >> 172.21.15.38:0/1307166816 conn(0x7f8d6007b850 msgr2=0x7f8d6007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 -- 172.21.15.38:0/1307166816 shutdown_connections 2024-09-21T06:27:46.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 -- 172.21.15.38:0/1307166816 wait complete. 2024-09-21T06:27:46.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.849+0000 7f8d64c73640 1 Processor -- start 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 -- start start 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 0x7f8d6019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60109df0 0x7f8d6019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60113bd0 con 0x7f8d60103b60 2024-09-21T06:27:46.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60113a50 con 0x7f8d601094a0 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d64c73640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60113d50 con 0x7f8d60109df0 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46108/0 (socket says 172.21.15.38:46108) 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 -- 172.21.15.38:0/1787255910 learned_addr learned my addr 172.21.15.38:0/1787255910 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 0x7f8d6019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 -- 172.21.15.38:0/1787255910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60109df0 msgr2=0x7f8d6019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60109df0 0x7f8d6019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 -- 172.21.15.38:0/1787255910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 msgr2=0x7f8d6019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 0x7f8d6019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 -- 172.21.15.38:0/1787255910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d601a0490 con 0x7f8d60103b60 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 0x7f8d6019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.850+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000d950 tx=0x7f8d5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.851+0000 7f8d577fe640 1 -- 172.21.15.38:0/1787255910 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50017070 con 0x7f8d60103b60 2024-09-21T06:27:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.851+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d601a0780 con 0x7f8d60103b60 2024-09-21T06:27:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.851+0000 7f8d577fe640 1 -- 172.21.15.38:0/1787255910 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d50009c30 con 0x7f8d60103b60 2024-09-21T06:27:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.851+0000 7f8d577fe640 1 -- 172.21.15.38:0/1787255910 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000f6b0 con 0x7f8d60103b60 2024-09-21T06:27:46.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.851+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601a6fa0 con 0x7f8d60103b60 2024-09-21T06:27:46.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.853+0000 7f8d577fe640 1 -- 172.21.15.38:0/1787255910 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8d500109c0 con 0x7f8d60103b60 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.853+0000 7f8d6b1e7740 1 Processor -- start 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 -- start start 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5575070 0x55f7e591c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e591ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f7e5892e50 con 0x55f7e554c1b0 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7e5882280 con 0x55f7e5554390 2024-09-21T06:27:46.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f7e5886090 con 0x55f7e5575070 2024-09-21T06:27:46.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d5e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d5e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46122/0 (socket says 172.21.15.38:46122) 2024-09-21T06:27:46.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d5e59c640 1 -- 172.21.15.38:0/2782683219 learned_addr learned my addr 172.21.15.38:0/2782683219 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:46.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e591ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5575070 0x55f7e591c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.854+0000 7f8d577fe640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 0x7f8d4c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 0x7f8d4c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 -- 172.21.15.38:0/2782683219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5575070 msgr2=0x55f7e591c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5575070 0x55f7e591c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 -- 172.21.15.38:0/2782683219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 msgr2=0x55f7e591ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e591ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d577fe640 1 -- 172.21.15.38:0/1787255910 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8d500e7390 con 0x7f8d60103b60 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 -- 172.21.15.38:0/2782683219 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e55e0650 con 0x55f7e554c1b0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8d500e4aa0 tx=0x7f8d50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b21363476573837 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 0x7f8d4c0b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005fd0 tx=0x7f8d58005e90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d54ff9640 1 -- 172.21.15.38:0/2782683219 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50020070 con 0x55f7e554c1b0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d54ff9640 1 -- 172.21.15.38:0/2782683219 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d500acd40 con 0x55f7e554c1b0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.855+0000 7f8d54ff9640 1 -- 172.21.15.38:0/2782683219 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d500b6c50 con 0x55f7e554c1b0 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2782683219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 msgr2=0x55f7e591c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8d500e4aa0 tx=0x7f8d50000bc0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2782683219 shutdown_connections 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e591ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e554c1b0 0x55f7e591c7b0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2782683219 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5575070 0x55f7e591c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2782683219 >> 172.21.15.38:0/2782683219 conn(0x55f7e5569460 msgr2=0x55f7e591a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2782683219 shutdown_connections 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.856+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2782683219 wait complete. 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 -- start start 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 Processor -- start 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e592c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f7e56e3700 con 0x55f7e5575070 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f7e581d110 con 0x55f7e554c1b0 2024-09-21T06:27:46.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f7e592ecf0 con 0x55f7e5554390 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d6b1e7740 10 client.0 _ll_register_callbacks cb 0x55f7e5836990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46136/0 (socket says 172.21.15.38:46136) 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.857+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/1510011690 learned_addr learned my addr 172.21.15.38:0/1510011690 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e592c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/1510011690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 msgr2=0x55f7e592c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e592c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 msgr2=0x55f7e592bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/1510011690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e584ac40 con 0x55f7e5575070 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:46.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8d58007990 tx=0x7f8d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadd05f09df1de20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58022020 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d500acd40 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.858+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8d58010a30 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8d5802d050 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 10 client.17694 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7e593aad0 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d500acd40 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8d5800f040 con 0x55f7e5575070 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 10 client.17694 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 20 client.17694 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e55339f0 0x55f7e593e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 4 client.17694 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:27:46.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7e5894da0 con 0x55f7e55339f0 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.859+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e55339f0 0x55f7e593e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.860+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e55339f0 0x55f7e593e080 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62ce7beb391ac086 server_cookie=d8f7154ca755fe4d in_seq=0 out_seq=0 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.860+0000 7f8d45ffb640 10 client.17694 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d45ffb640 1 -- 172.21.15.38:0/1510011690 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7e5894da0 con 0x55f7e55339f0 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d45ffb640 10 client.17694 handle_command_reply: tid=0 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 client.17694 shutdown 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 msgr2=0x55f7e5938050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8d58007990 tx=0x7f8d58004a40 comp rx=0 tx=0).stop 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 shutdown_connections 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5938050 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e55339f0 0x55f7e593e080 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e592c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/1510011690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d45ffb640 0 client.17694 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:46.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 >> 172.21.15.38:0/1510011690 conn(0x55f7e5569460 msgr2=0x55f7e591dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 shutdown_connections 2024-09-21T06:27:46.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/1510011690 wait complete. 2024-09-21T06:27:46.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.861+0000 7f8d6b1e7740 20 client.17694 trim_cache size 0 max 16384 2024-09-21T06:27:46.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 Processor -- start 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 -- start start 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e5914df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601afe90 con 0x55f7e5575070 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601ad760 con 0x55f7e554c1b0 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601ab5d0 con 0x55f7e5554390 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46138/0 (socket says 172.21.15.38:46138) 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.879+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/2687531500 learned_addr learned my addr 172.21.15.38:0/2687531500 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e5914df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/2687531500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 msgr2=0x55f7e5914df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e5914df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/2687531500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 msgr2=0x55f7e592c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/2687531500 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e592acd0 con 0x55f7e5575070 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8d58007960 tx=0x7f8d58003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4755a06d6fd9f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d47fff640 1 -- 172.21.15.38:0/2687531500 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58022070 con 0x55f7e5575070 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d47fff640 1 -- 172.21.15.38:0/2687531500 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d58036070 con 0x55f7e5575070 2024-09-21T06:27:46.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.880+0000 7f8d47fff640 1 -- 172.21.15.38:0/2687531500 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58010e60 con 0x55f7e5575070 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2687531500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 msgr2=0x55f7e5937f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8d58007960 tx=0x7f8d58003dd0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2687531500 shutdown_connections 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5937f50 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e5554390 0x55f7e5914df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/2687531500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e554c1b0 0x55f7e592c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2687531500 >> 172.21.15.38:0/2687531500 conn(0x55f7e5569460 msgr2=0x55f7e592bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2687531500 shutdown_connections 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/2687531500 wait complete. 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 -- start start 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.881+0000 7f8d6b1e7740 1 Processor -- start 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 0x55f7e5934970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e592fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601abc20 con 0x55f7e5575070 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601ad090 con 0x55f7e5554390 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8d601ac2f0 con 0x55f7e554c1b0 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d6b1e7740 10 client.0 _ll_register_callbacks cb 0x7f8d58007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46150/0 (socket says 172.21.15.38:46150) 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/3125856367 learned_addr learned my addr 172.21.15.38:0/3125856367 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:27:46.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5e59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 0x55f7e5934970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5dd9b640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e592fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/3125856367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 msgr2=0x55f7e5934970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 0x55f7e5934970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 msgr2=0x55f7e592fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e592fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 -- 172.21.15.38:0/3125856367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e59a7a80 con 0x55f7e5575070 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 0x55f7e5934970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d5ed9d640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8d58004a80 tx=0x7f8d58004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5b004e5776a2fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.882+0000 7f8d45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5803e070 con 0x55f7e5575070 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d58036070 con 0x55f7e5575070 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8d5801e850 con 0x55f7e5575070 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8d58022040 con 0x55f7e5575070 2024-09-21T06:27:46.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d6b1e7740 10 client.17700 fetch_fsmap learned FSMap version 34 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f7e59a8b20 con 0x55f7e5575070 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.883+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d58036070 con 0x55f7e5575070 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8d580438c0 con 0x55f7e5575070 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 10 client.17700 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 20 client.17700 populate_metadata read hostname 'smithi038' 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e5508da0 0x55f7e59ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 4 client.17700 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f7e5890850 con 0x55f7e5508da0 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e5508da0 0x55f7e59ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d5e59c640 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e5508da0 0x55f7e59ab1a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e0c8636584d7233 server_cookie=d52d0bcbac11b4e in_seq=0 out_seq=0 2024-09-21T06:27:46.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.884+0000 7f8d45ffb640 10 client.17700 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d45ffb640 1 -- 172.21.15.38:0/3125856367 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x55f7e5890850 con 0x55f7e5508da0 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d45ffb640 10 client.17700 handle_command_reply: tid=0 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 client.17700 shutdown 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 msgr2=0x55f7e5930530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8d58004a80 tx=0x7f8d58004950 comp rx=0 tx=0).stop 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 shutdown_connections 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f7e5575070 0x55f7e5930530 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f7e5554390 0x55f7e592fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f7e5508da0 0x55f7e59ab1a0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 --2- 172.21.15.38:0/3125856367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f7e554c1b0 0x55f7e5934970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 >> 172.21.15.38:0/3125856367 conn(0x55f7e5569460 msgr2=0x55f7e5919a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d45ffb640 0 client.17700 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 shutdown_connections 2024-09-21T06:27:46.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 1 -- 172.21.15.38:0/3125856367 wait complete. 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.885+0000 7f8d6b1e7740 20 client.17700 trim_cache size 0 max 16384 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:27:46.892 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d", 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.893 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:27:46.894 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.895 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:27:46.896 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:27:46.897 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.898 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:27:46.899 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.900 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.901 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.902 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.903 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:27:46.904 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:46.905 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 msgr2=0x7f8d4c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 0x7f8d4c0b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d58005fd0 tx=0x7f8d58005e90 comp rx=0 tx=0).stop 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 msgr2=0x7f8d6019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000d950 tx=0x7f8d5000de10 comp rx=0 tx=0).stop 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 shutdown_connections 2024-09-21T06:27:46.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8d4c0b66b0 0x7f8d4c0b8bc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d60109df0 0x7f8d6019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d601094a0 0x7f8d6019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 --2- 172.21.15.38:0/1787255910 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d60103b60 0x7f8d6019a5e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 >> 172.21.15.38:0/1787255910 conn(0x7f8d6007b850 msgr2=0x7f8d60107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 shutdown_connections 2024-09-21T06:27:46.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:27:46.886+0000 7f8d64c73640 1 -- 172.21.15.38:0/1787255910 wait complete. 2024-09-21T06:27:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:46 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:27:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:46 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:46 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:27:47.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:46 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:46 smithi038 ceph-mon[31215]: pgmap v566: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:27:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:46 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:27:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:46 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:46 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:27:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:46 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:46 smithi174 ceph-mon[34815]: pgmap v566: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:27:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:46 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:27:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:46 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:46 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:27:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:46 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:27:47.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:46 smithi044 ceph-mon[34369]: pgmap v566: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:27:47.686 INFO:tasks.cephfs.filesystem:scrub status for tag:ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d - {'path': '/', 'tag': 'ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d', 'options': 'recursive,force'} 2024-09-21T06:27:49.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:48 smithi038 ceph-mon[31215]: pgmap v567: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:49.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:48 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:27:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:48 smithi174 ceph-mon[34815]: pgmap v567: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:48 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:27:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:48 smithi044 ceph-mon[34369]: pgmap v567: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:48 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:27:51.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:50 smithi038 ceph-mon[31215]: pgmap v568: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:51.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:50 smithi174 ceph-mon[34815]: pgmap v568: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:50 smithi044 ceph-mon[34369]: pgmap v568: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:53 smithi174 ceph-mon[34815]: pgmap v569: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:27:53.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:53 smithi044 ceph-mon[34369]: pgmap v569: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:27:53.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:53 smithi038 ceph-mon[31215]: pgmap v569: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:27:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:55 smithi174 ceph-mon[34815]: pgmap v570: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:55.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:55 smithi044 ceph-mon[34369]: pgmap v570: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:55 smithi038 ceph-mon[31215]: pgmap v570: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:27:57.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:57 smithi174 ceph-mon[34815]: pgmap v571: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:27:57.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:57 smithi044 ceph-mon[34369]: pgmap v571: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:27:57.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:57 smithi038 ceph-mon[31215]: pgmap v571: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:27:59.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:59 smithi174 ceph-mon[34815]: pgmap v572: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:59.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:27:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:59.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:59 smithi044 ceph-mon[34369]: pgmap v572: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:59.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:27:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:59 smithi038 ceph-mon[31215]: pgmap v572: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:27:59.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:27:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:00.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:00.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:00.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:28:00.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:00.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:00.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:28:00.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:00.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:00.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:28:01.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:01 smithi174 ceph-mon[34815]: pgmap v573: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:01.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:01 smithi044 ceph-mon[34369]: pgmap v573: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:01.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:01 smithi038 ceph-mon[31215]: pgmap v573: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:03.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:03 smithi174 ceph-mon[34815]: pgmap v574: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T06:28:03.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:03 smithi044 ceph-mon[34369]: pgmap v574: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T06:28:03.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:03 smithi038 ceph-mon[31215]: pgmap v574: 97 pgs: 97 active+clean; 83 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T06:28:05.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:05 smithi174 ceph-mon[34815]: pgmap v575: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-21T06:28:05.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:05 smithi044 ceph-mon[34369]: pgmap v575: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-21T06:28:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:05 smithi038 ceph-mon[31215]: pgmap v575: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-21T06:28:07.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:07 smithi174 ceph-mon[34815]: pgmap v576: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:28:07.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:07 smithi044 ceph-mon[34369]: pgmap v576: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:28:07.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:07 smithi038 ceph-mon[31215]: pgmap v576: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:28:09.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:09 smithi174 ceph-mon[34815]: pgmap v577: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:28:09.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:09 smithi174 ceph-mon[34815]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:28:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:09 smithi044 ceph-mon[34369]: pgmap v577: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:28:09.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:09 smithi044 ceph-mon[34369]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:28:09.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:09 smithi038 ceph-mon[31215]: pgmap v577: 97 pgs: 97 active+clean; 83 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:28:09.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:09 smithi038 ceph-mon[31215]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:28:11.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:11 smithi174 ceph-mon[34815]: pgmap v579: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 78 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:28:11.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:11 smithi044 ceph-mon[34369]: pgmap v579: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 78 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:28:11.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:11 smithi038 ceph-mon[31215]: pgmap v579: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 78 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:28:13.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:13 smithi174 ceph-mon[34815]: pgmap v580: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 72 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T06:28:13.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:13 smithi044 ceph-mon[34369]: pgmap v580: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 72 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T06:28:13.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:13 smithi038 ceph-mon[31215]: pgmap v580: 97 pgs: 3 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 84 active+clean; 72 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T06:28:15.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:15 smithi174 ceph-mon[34815]: pgmap v581: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-21T06:28:15.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:15 smithi044 ceph-mon[34369]: pgmap v581: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-21T06:28:15.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:15 smithi038 ceph-mon[31215]: pgmap v581: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-09-21T06:28:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:17 smithi044 ceph-mon[34369]: pgmap v582: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:17.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:17 smithi044 ceph-mon[34369]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:28:17.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:17.715 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:17 smithi038 ceph-mon[31215]: pgmap v582: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:17.716 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:17 smithi038 ceph-mon[31215]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:28:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:17 smithi174 ceph-mon[34815]: pgmap v582: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:17 smithi174 ceph-mon[34815]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:28:17.958 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:18.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 -- 172.21.15.38:0/3004267228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 msgr2=0x7f18181087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 --2- 172.21.15.38:0/3004267228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18181087e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f180c009900 tx=0x7f180c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:18.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 -- 172.21.15.38:0/3004267228 shutdown_connections 2024-09-21T06:28:18.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 --2- 172.21.15.38:0/3004267228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818108d20 0x7f181810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 --2- 172.21.15.38:0/3004267228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18181087e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 --2- 172.21.15.38:0/3004267228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818102ae0 0x7f1818102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 -- 172.21.15.38:0/3004267228 >> 172.21.15.38:0/3004267228 conn(0x7f1818079760 msgr2=0x7f1818079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 -- 172.21.15.38:0/3004267228 shutdown_connections 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 -- 172.21.15.38:0/3004267228 wait complete. 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.452+0000 7f181e12b640 1 Processor -- start 2024-09-21T06:28:18.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 -- start start 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818102ae0 0x7f18180ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818108d20 0x7f18181000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1818112ab0 con 0x7f18181083d0 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1818112930 con 0x7f1818102ae0 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f181e12b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1818112c30 con 0x7f1818108d20 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f1816ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f1816ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47890/0 (socket says 172.21.15.38:47890) 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f1816ffd640 1 -- 172.21.15.38:0/2613200122 learned_addr learned my addr 172.21.15.38:0/2613200122 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f18177fe640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818102ae0 0x7f18180ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.453+0000 7f1817fff640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818108d20 0x7f18181000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 -- 172.21.15.38:0/2613200122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818108d20 msgr2=0x7f18181000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818108d20 0x7f18181000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 -- 172.21.15.38:0/2613200122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818102ae0 msgr2=0x7f18180ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818102ae0 0x7f18180ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 -- 172.21.15.38:0/2613200122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18181a8850 con 0x7f18181083d0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f180c005940 tx=0x7f180c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1814ff9640 1 -- 172.21.15.38:0/2613200122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c03f030 con 0x7f18181083d0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1814ff9640 1 -- 172.21.15.38:0/2613200122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f180c0318f0 con 0x7f18181083d0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18181a8ae0 con 0x7f18181083d0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f1814ff9640 1 -- 172.21.15.38:0/2613200122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c035070 con 0x7f18181083d0 2024-09-21T06:28:18.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.454+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18181a8fc0 con 0x7f18181083d0 2024-09-21T06:28:18.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.457+0000 7f182469f740 1 Processor -- start 2024-09-21T06:28:18.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.457+0000 7f182469f740 1 -- start start 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce7547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce754cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561dce6cae50 con 0x561dce38c390 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561dce6ba280 con 0x561dce3ad070 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f182469f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561dce6be090 con 0x561dce3841b0 2024-09-21T06:28:18.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1814ff9640 1 -- 172.21.15.38:0/2613200122 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f180c042030 con 0x7f18181083d0 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56514/0 (socket says 172.21.15.38:56514) 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 -- 172.21.15.38:0/1381516300 learned_addr learned my addr 172.21.15.38:0/1381516300 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f18177fe640 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce7547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1816ffd640 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce754cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 -- 172.21.15.38:0/1381516300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 msgr2=0x561dce7547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce7547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 -- 172.21.15.38:0/1381516300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 msgr2=0x561dce754cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce754cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.458+0000 7f1817fff640 1 -- 172.21.15.38:0/1381516300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dce418650 con 0x561dce3ad070 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f1817fff640 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1810010370 tx=0x7f1810010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f73a757a64d7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f1814ff9640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 0x7f18000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f17fdffb640 1 -- 172.21.15.38:0/1381516300 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810016070 con 0x561dce3ad070 2024-09-21T06:28:18.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f18177fe640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 0x7f18000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f17fdffb640 1 -- 172.21.15.38:0/1381516300 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1810004d20 con 0x561dce3ad070 2024-09-21T06:28:18.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f17fdffb640 1 -- 172.21.15.38:0/1381516300 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18100053c0 con 0x561dce3ad070 2024-09-21T06:28:18.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.459+0000 7f1814ff9640 1 -- 172.21.15.38:0/2613200122 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f180c107b10 con 0x7f18181083d0 2024-09-21T06:28:18.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 -- 172.21.15.38:0/1381516300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 msgr2=0x561dce754270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f18177fe640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 0x7f18000b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x561dce752ef0 tx=0x7f1808005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1810010370 tx=0x7f1810010830 comp rx=0 tx=0).stop 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 -- 172.21.15.38:0/1381516300 shutdown_connections 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce754cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce7547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 --2- 172.21.15.38:0/1381516300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3ad070 0x561dce754270 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 -- 172.21.15.38:0/1381516300 >> 172.21.15.38:0/1381516300 conn(0x561dce3a1460 msgr2=0x561dce752160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 -- 172.21.15.38:0/1381516300 shutdown_connections 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.460+0000 7f182469f740 1 -- 172.21.15.38:0/1381516300 wait complete. 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 -- start start 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 Processor -- start 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 0x561dce75f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 0x561dce76bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561dce51b700 con 0x561dce38c390 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561dce655110 con 0x561dce3841b0 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561dce762a50 con 0x561dce3ad070 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f182469f740 10 client.0 _ll_register_callbacks cb 0x561dce66e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f1816ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.461+0000 7f1816ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47894/0 (socket says 172.21.15.38:47894) 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 -- 172.21.15.38:0/2531329791 learned_addr learned my addr 172.21.15.38:0/2531329791 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f18177fe640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 0x561dce75f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1817fff640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 0x561dce76bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 -- 172.21.15.38:0/2531329791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 msgr2=0x561dce76bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 0x561dce76bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 -- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 msgr2=0x561dce75f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 0x561dce75f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 -- 172.21.15.38:0/2531329791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dce682c40 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f18177fe640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 0x561dce75f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1817fff640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 0x561dce76bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f180c0cd760 tx=0x7f180c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62db404cc5496942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f17f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c049070 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f180c0d7140 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1810004d20 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.462+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f180c0d2020 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 10 client.17712 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561dce76e7c0 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1810004d20 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f180c0cece0 con 0x561dce38c390 2024-09-21T06:28:18.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 10 client.17712 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 10 client.17712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 20 client.17712 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce36b9f0 0x561dce771cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 4 client.17712 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dce6ccda0 con 0x561dce36b9f0 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.463+0000 7f18177fe640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce36b9f0 0x561dce771cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.464+0000 7f17f6ffd640 10 client.17712 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.464+0000 7f18177fe640 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce36b9f0 0x561dce771cd0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a155a7f979099c server_cookie=909e2722bbc0575b in_seq=0 out_seq=0 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.464+0000 7f17f6ffd640 1 -- 172.21.15.38:0/2531329791 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561dce6ccda0 con 0x561dce36b9f0 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.464+0000 7f17f6ffd640 10 client.17712 handle_command_reply: tid=0 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 client.17712 shutdown 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 msgr2=0x561dce75fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f180c0cd760 tx=0x7f180c009300 comp rx=0 tx=0).stop 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 shutdown_connections 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce36b9f0 0x561dce771cd0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f17f6ffd640 0 client.17712 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3ad070 0x561dce76bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce38c390 0x561dce75fea0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 --2- 172.21.15.38:0/2531329791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce3841b0 0x561dce75f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 >> 172.21.15.38:0/2531329791 conn(0x561dce3a1460 msgr2=0x561dce757400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 shutdown_connections 2024-09-21T06:28:18.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 1 -- 172.21.15.38:0/2531329791 wait complete. 2024-09-21T06:28:18.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.465+0000 7f182469f740 20 client.17712 trim_cache size 0 max 16384 2024-09-21T06:28:18.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.482+0000 7f182469f740 1 Processor -- start 2024-09-21T06:28:18.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 -- start start 2024-09-21T06:28:18.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce76bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce75cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f18181b4160 con 0x561dce36b9f0 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f18181b1a30 con 0x561dce38c390 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f182469f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18181af8a0 con 0x561dce3841b0 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47910/0 (socket says 172.21.15.38:47910) 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 -- 172.21.15.38:0/2096719904 learned_addr learned my addr 172.21.15.38:0/2096719904 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f1816ffd640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce76bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 -- 172.21.15.38:0/2096719904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 msgr2=0x561dce76bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce76bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f1817fff640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce75cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 -- 172.21.15.38:0/2096719904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 msgr2=0x561dce75cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce75cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f18177fe640 1 -- 172.21.15.38:0/2096719904 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dce75de60 con 0x561dce36b9f0 2024-09-21T06:28:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.483+0000 7f1817fff640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce75cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f18177fe640 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1808009710 tx=0x7f1808017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba70c3d098cf59d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f17fd7fa640 1 -- 172.21.15.38:0/2096719904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808023070 con 0x561dce36b9f0 2024-09-21T06:28:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f17fd7fa640 1 -- 172.21.15.38:0/2096719904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18080054f0 con 0x561dce36b9f0 2024-09-21T06:28:18.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f17fd7fa640 1 -- 172.21.15.38:0/2096719904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808004d50 con 0x561dce36b9f0 2024-09-21T06:28:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f182469f740 1 -- 172.21.15.38:0/2096719904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 msgr2=0x561dce755960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.484+0000 7f182469f740 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1808009710 tx=0x7f1808017000 comp rx=0 tx=0).stop 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 -- 172.21.15.38:0/2096719904 shutdown_connections 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce75cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce76bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 --2- 172.21.15.38:0/2096719904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce755960 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 -- 172.21.15.38:0/2096719904 >> 172.21.15.38:0/2096719904 conn(0x561dce3a1460 msgr2=0x561dce755250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 -- 172.21.15.38:0/2096719904 shutdown_connections 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 -- 172.21.15.38:0/2096719904 wait complete. 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 -- start start 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.485+0000 7f182469f740 1 Processor -- start 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce764c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce7d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f18181afef0 con 0x561dce36b9f0 2024-09-21T06:28:18.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f18181b1360 con 0x561dce38c390 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18181b05c0 con 0x561dce3841b0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 10 client.0 _ll_register_callbacks cb 0x7f180c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47924/0 (socket says 172.21.15.38:47924) 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 -- 172.21.15.38:0/174004599 learned_addr learned my addr 172.21.15.38:0/174004599 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f1816ffd640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce764c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f1817fff640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce7d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 -- 172.21.15.38:0/174004599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 msgr2=0x561dce764c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce764c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 -- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 msgr2=0x561dce7d56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce7d56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 -- 172.21.15.38:0/174004599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dce7d5d40 con 0x561dce36b9f0 2024-09-21T06:28:18.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f1817fff640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce7d56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f18177fe640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f18080048b0 tx=0x7f18080048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb1f7d91d49c6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f17f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808036070 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1808003cc0 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.486+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18080054f0 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1808023070 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 10 client.17718 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561dce7dd030 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18080054f0 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f18080459a0 con 0x561dce36b9f0 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 10 client.17718 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 10 client.17718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 20 client.17718 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:18.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce3ad070 0x561dce7df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 4 client.17718 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561dce6c8850 con 0x561dce3ad070 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.487+0000 7f1816ffd640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce3ad070 0x561dce7df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f17f6ffd640 10 client.17718 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f1816ffd640 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce3ad070 0x561dce7df770 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de93c8897659c90b server_cookie=c1ccd9f2d8c16ee0 in_seq=0 out_seq=0 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f17f6ffd640 1 -- 172.21.15.38:0/174004599 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x561dce6c8850 con 0x561dce3ad070 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f17f6ffd640 10 client.17718 handle_command_reply: tid=0 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 client.17718 shutdown 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 msgr2=0x561dce764670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f18080048b0 tx=0x7f18080048e0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 shutdown_connections 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561dce38c390 0x561dce7d56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561dce3ad070 0x561dce7df770 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561dce3841b0 0x561dce764c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 --2- 172.21.15.38:0/174004599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561dce36b9f0 0x561dce764670 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 >> 172.21.15.38:0/174004599 conn(0x561dce3a1460 msgr2=0x561dce761740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.488+0000 7f17f6ffd640 0 client.17718 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 shutdown_connections 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f182469f740 1 -- 172.21.15.38:0/174004599 wait complete. 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f182469f740 20 client.17718 trim_cache size 0 max 16384 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:28:18.496 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:28:18.499 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:28:18.500 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.501 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:28:18.504 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.505 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.507 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:18.508 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 msgr2=0x7f18000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 0x7f18000b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x561dce752ef0 tx=0x7f1808005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 msgr2=0x7f18180ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f180c005940 tx=0x7f180c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 shutdown_connections 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f18000b6680 0x7f18000b8b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1818108d20 0x7f18181000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18181083d0 0x7f18180ffbb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 --2- 172.21.15.38:0/2613200122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1818102ae0 0x7f18180ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.489+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 >> 172.21.15.38:0/2613200122 conn(0x7f1818079760 msgr2=0x7f1818101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.490+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 shutdown_connections 2024-09-21T06:28:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:18.490+0000 7f181e12b640 1 -- 172.21.15.38:0/2613200122 wait complete. 2024-09-21T06:28:19.318 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:19.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:19.627 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:19 smithi038 ceph-mon[31215]: pgmap v584: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-09-21T06:28:19.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:19 smithi174 ceph-mon[34815]: pgmap v584: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-09-21T06:28:19.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:19 smithi044 ceph-mon[34369]: pgmap v584: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 215 B/s wr, 6 op/s 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 -- 172.21.15.38:0/4147102983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c102ae0 msgr2=0x7faf0c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 --2- 172.21.15.38:0/4147102983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c102ae0 0x7faf0c102ef0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7faf08009900 tx=0x7faf0802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 -- 172.21.15.38:0/4147102983 shutdown_connections 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 --2- 172.21.15.38:0/4147102983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c108d20 0x7faf0c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 --2- 172.21.15.38:0/4147102983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c1083d0 0x7faf0c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 --2- 172.21.15.38:0/4147102983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c102ae0 0x7faf0c102ef0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 -- 172.21.15.38:0/4147102983 >> 172.21.15.38:0/4147102983 conn(0x7faf0c079760 msgr2=0x7faf0c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 -- 172.21.15.38:0/4147102983 shutdown_connections 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.074+0000 7faf14748640 1 -- 172.21.15.38:0/4147102983 wait complete. 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 Processor -- start 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 -- start start 2024-09-21T06:28:20.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c102ae0 0x7faf0c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c108d20 0x7faf0c1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c112ab0 con 0x7faf0c1083d0 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c112930 con 0x7faf0c102ae0 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf14748640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c112c30 con 0x7faf0c108d20 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf11ce3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf11ce3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42554/0 (socket says 172.21.15.38:42554) 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf11ce3640 1 -- 172.21.15.38:0/2975568869 learned_addr learned my addr 172.21.15.38:0/2975568869 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.075+0000 7faf124e4640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c102ae0 0x7faf0c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf12ce5640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c108d20 0x7faf0c1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 -- 172.21.15.38:0/2975568869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c108d20 msgr2=0x7faf0c1a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c108d20 0x7faf0c1a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 -- 172.21.15.38:0/2975568869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c102ae0 msgr2=0x7faf0c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c102ae0 0x7faf0c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 -- 172.21.15.38:0/2975568869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c1a2670 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf11ce3640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d770 tx=0x7faefc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc017070 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c1a2960 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faefc009c30 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc00f620 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.076+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c1a90c0 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.078+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c103d10 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.079+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7faefc01a070 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.080+0000 7faf037fe640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 0x7faef80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.080+0000 7faf124e4640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 0x7faef80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.080+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7faefc0e71a0 con 0x7faf0c1083d0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.080+0000 7faf124e4640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 0x7faef80b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faf08009230 tx=0x7faf080058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.085+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faefc009de0 con 0x7faf0c1083d0 2024-09-21T06:28:20.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.311+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf0c19d830 con 0x7faf0c1083d0 2024-09-21T06:28:20.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.312+0000 7faf037fe640 1 -- 172.21.15.38:0/2975568869 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7faf0c19d830 con 0x7faf0c1083d0 2024-09-21T06:28:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:28:20.315 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:28:20.315 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:28:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 msgr2=0x7faef80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 0x7faef80b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faf08009230 tx=0x7faf080058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 msgr2=0x7faf0c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d770 tx=0x7faefc00dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:20.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 shutdown_connections 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7faef80b6680 0x7faef80b8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf0c108d20 0x7faf0c1a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf0c1083d0 0x7faf0c19cca0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 --2- 172.21.15.38:0/2975568869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf0c102ae0 0x7faf0c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 >> 172.21.15.38:0/2975568869 conn(0x7faf0c079760 msgr2=0x7faf0c06bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 shutdown_connections 2024-09-21T06:28:20.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:20.314+0000 7faf14748640 1 -- 172.21.15.38:0/2975568869 wait complete. 2024-09-21T06:28:20.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:20 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2975568869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:20.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:20 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2975568869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:20.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:20 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2975568869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:21.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:28:21.285 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:21.728 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:21 smithi038 ceph-mon[31215]: pgmap v585: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3331750575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8108cf0 msgr2=0x7fd8d810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3331750575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8108cf0 0x7fd8d810f520 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009900 tx=0x7fd8d002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3331750575 shutdown_connections 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3331750575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d8108cf0 0x7fd8d810f520 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3331750575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d81083a0 0x7fd8d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3331750575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8102a60 0x7fd8d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3331750575 >> 172.21.15.38:0/3331750575 conn(0x7fd8d8079730 msgr2=0x7fd8d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3331750575 shutdown_connections 2024-09-21T06:28:21.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.726+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3331750575 wait complete. 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.727+0000 7fd8df6ce640 1 Processor -- start 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.727+0000 7fd8df6ce640 1 -- start start 2024-09-21T06:28:21.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d8102a60 0x7fd8d8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8108cf0 0x7fd8d819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8112b00 con 0x7fd8d81083a0 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8112980 con 0x7fd8d8108cf0 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8df6ce640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8112c80 con 0x7fd8d8102a60 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42568/0 (socket says 172.21.15.38:42568) 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 -- 172.21.15.38:0/3021777852 learned_addr learned my addr 172.21.15.38:0/3021777852 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8108cf0 0x7fd8d819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d8102a60 0x7fd8d8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 -- 172.21.15.38:0/3021777852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d8102a60 msgr2=0x7fd8d8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d8102a60 0x7fd8d8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 -- 172.21.15.38:0/3021777852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8108cf0 msgr2=0x7fd8d819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8108cf0 0x7fd8d819ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 -- 172.21.15.38:0/3021777852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d819f3c0 con 0x7fd8d81083a0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.728+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b450 tx=0x7fd8cc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.729+0000 7fd8d67fc640 1 -- 172.21.15.38:0/3021777852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc015020 con 0x7fd8d81083a0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.729+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d819f6b0 con 0x7fd8d81083a0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.729+0000 7fd8d67fc640 1 -- 172.21.15.38:0/3021777852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8cc011d60 con 0x7fd8d81083a0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.729+0000 7fd8d67fc640 1 -- 172.21.15.38:0/3021777852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00f340 con 0x7fd8d81083a0 2024-09-21T06:28:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.729+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d81a5e90 con 0x7fd8d81083a0 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8d67fc640 1 -- 172.21.15.38:0/3021777852 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd8cc018020 con 0x7fd8d81083a0 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 Processor -- start 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 -- start start 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585bdff7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585bdff8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5585bdf6dea0 con 0x5585bdc50070 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585bdf5d2d0 con 0x5585bdc2f390 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585bdf610e0 con 0x5585bdc271b0 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42578/0 (socket says 172.21.15.38:42578) 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/518939601 learned_addr learned my addr 172.21.15.38:0/518939601 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585bdff7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8d67fc640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 0x7fd8c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.732+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585bdff8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/518939601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 msgr2=0x5585bdff7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585bdff7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/518939601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 msgr2=0x5585bdff8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585bdff8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/518939601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585bdcbb650 con 0x5585bdc50070 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8d67fc640 1 -- 172.21.15.38:0/3021777852 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd8cc0e6fe0 con 0x7fd8d81083a0 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 0x7fd8c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0033000 tx=0x7fd8d00095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c19a871009e4b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8bf7fe640 1 -- 172.21.15.38:0/518939601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0035040 con 0x5585bdc50070 2024-09-21T06:28:21.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8bf7fe640 1 -- 172.21.15.38:0/518939601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8d0041d90 con 0x5585bdc50070 2024-09-21T06:28:21.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8bf7fe640 1 -- 172.21.15.38:0/518939601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d004ad60 con 0x5585bdc50070 2024-09-21T06:28:21.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.733+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 0x7fd8c00b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd8d004e000 tx=0x7fd8d004b000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 -- 172.21.15.38:0/518939601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 msgr2=0x5585bdff76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0033000 tx=0x7fd8d00095d0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 -- 172.21.15.38:0/518939601 shutdown_connections 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585bdff8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585bdff7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/518939601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585bdff76a0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 -- 172.21.15.38:0/518939601 >> 172.21.15.38:0/518939601 conn(0x5585bdc44460 msgr2=0x5585bdff5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 -- 172.21.15.38:0/518939601 shutdown_connections 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.734+0000 7fd8e5c42740 1 -- 172.21.15.38:0/518939601 wait complete. 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 -- start start 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 Processor -- start 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be0033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585be003930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5585bddbe700 con 0x5585bdc50070 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585bdef8160 con 0x5585bdc2f390 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585bdffdc10 con 0x5585bdc271b0 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8e5c42740 10 client.0 _ll_register_callbacks cb 0x5585bdf119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.735+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42590/0 (socket says 172.21.15.38:42590) 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/1412532429 learned_addr learned my addr 172.21.15.38:0/1412532429 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be0033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585be003930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 msgr2=0x5585be0033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be0033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/1412532429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 msgr2=0x5585be003930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585be003930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/1412532429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585bdf25c90 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd8d004a690 tx=0x7fd8d0031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d767ae88524bba66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0061060 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d0041d90 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd8d0041ad0 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd8d004aae0 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8e5c42740 10 client.17736 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.736+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5585be011a80 con 0x5585bdc50070 2024-09-21T06:28:21.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8d0041d90 con 0x5585bdc50070 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd8d0054480 con 0x5585bdc50070 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 10 client.17736 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 10 client.17736 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 20 client.17736 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc0e9f0 0x5585be014de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 4 client.17736 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585bdf6fdf0 con 0x5585bdc0e9f0 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.737+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc0e9f0 0x5585be014de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.738+0000 7fd8bcff9640 10 client.17736 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.738+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc0e9f0 0x5585be014de0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43732b0c6e52e140 server_cookie=3cfb10b59a20b876 in_seq=0 out_seq=0 2024-09-21T06:28:21.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8bcff9640 1 -- 172.21.15.38:0/1412532429 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585bdf6fdf0 con 0x5585bdc0e9f0 2024-09-21T06:28:21.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8bcff9640 10 client.17736 handle_command_reply: tid=0 2024-09-21T06:28:21.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 client.17736 shutdown 2024-09-21T06:28:21.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 msgr2=0x5585be00ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fd8d004a690 tx=0x7fd8d0031f60 comp rx=0 tx=0).stop 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 shutdown_connections 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc0e9f0 0x5585be014de0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8bcff9640 0 client.17736 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc50070 0x5585be00ede0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc2f390 0x5585be003930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/1412532429 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be0033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 >> 172.21.15.38:0/1412532429 conn(0x5585bdc44460 msgr2=0x5585bdff3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 shutdown_connections 2024-09-21T06:28:21.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 1 -- 172.21.15.38:0/1412532429 wait complete. 2024-09-21T06:28:21.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.739+0000 7fd8e5c42740 20 client.17736 trim_cache size 0 max 16384 2024-09-21T06:28:21.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 Processor -- start 2024-09-21T06:28:21.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 -- start start 2024-09-21T06:28:21.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585bdff55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be00edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81afda0 con 0x5585bdc2f390 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81ad670 con 0x5585bdc0e9f0 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81ab4e0 con 0x5585bdc271b0 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42598/0 (socket says 172.21.15.38:42598) 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/3370313826 learned_addr learned my addr 172.21.15.38:0/3370313826 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585bdff55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/3370313826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 msgr2=0x5585be00edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be00edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/3370313826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 msgr2=0x5585bdff55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585bdff55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 -- 172.21.15.38:0/3370313826 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585be0044b0 con 0x5585bdc2f390 2024-09-21T06:28:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd8d002a930 tx=0x7fd8d004aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42014bdbbe6a300 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8beffd640 1 -- 172.21.15.38:0/3370313826 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0035070 con 0x5585bdc2f390 2024-09-21T06:28:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8beffd640 1 -- 172.21.15.38:0/3370313826 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8d0058040 con 0x5585bdc2f390 2024-09-21T06:28:21.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.754+0000 7fd8beffd640 1 -- 172.21.15.38:0/3370313826 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0061040 con 0x5585bdc2f390 2024-09-21T06:28:21.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- 172.21.15.38:0/3370313826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 msgr2=0x5585be00f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd8d002a930 tx=0x7fd8d004aa70 comp rx=0 tx=0).stop 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- 172.21.15.38:0/3370313826 shutdown_connections 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc2f390 0x5585be00f330 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc271b0 0x5585be00edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/3370313826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585bdff55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- 172.21.15.38:0/3370313826 >> 172.21.15.38:0/3370313826 conn(0x5585bdc44460 msgr2=0x5585bdff4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- 172.21.15.38:0/3370313826 shutdown_connections 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- 172.21.15.38:0/3370313826 wait complete. 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 -- start start 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.755+0000 7fd8e5c42740 1 Processor -- start 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585be00caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc2f390 0x5585be00d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81abb30 con 0x5585bdc271b0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81acfa0 con 0x5585bdc0e9f0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81ac200 con 0x5585bdc2f390 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8e5c42740 10 client.0 _ll_register_callbacks cb 0x7fd8d004d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42604/0 (socket says 172.21.15.38:42604) 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 -- 172.21.15.38:0/271203967 learned_addr learned my addr 172.21.15.38:0/271203967 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585be00caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8ddc6b640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc2f390 0x5585be00d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 -- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc2f390 msgr2=0x5585be00d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc2f390 0x5585be00d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 -- 172.21.15.38:0/271203967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 msgr2=0x5585be00caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585be00caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.756+0000 7fd8dcc69640 1 -- 172.21.15.38:0/271203967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585be07e560 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8dcc69640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009fd0 tx=0x7fd8cc0ac7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db18dd2b0e6060a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0e92d0 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd8cc0d4150 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d0058040 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd8cc0ad580 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 10 client.17742 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5585be07f7f0 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8d0058040 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd8cc0b4ce0 con 0x5585bdc271b0 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 10 client.17742 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:21.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 10 client.17742 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 20 client.17742 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc50070 0x5585be081fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 4 client.17742 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.757+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585bdf6b8a0 con 0x5585bdc50070 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.758+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc50070 0x5585be081fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.758+0000 7fd8dd46a640 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc50070 0x5585be081fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c53ab0fa0b911bf server_cookie=dff55e51cc34afeb in_seq=0 out_seq=0 2024-09-21T06:28:21.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.758+0000 7fd8bcff9640 10 client.17742 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.758+0000 7fd8bcff9640 1 -- 172.21.15.38:0/271203967 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585bdf6b8a0 con 0x5585bdc50070 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8bcff9640 10 client.17742 handle_command_reply: tid=0 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 client.17742 shutdown 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 msgr2=0x5585be00d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009fd0 tx=0x7fd8cc0ac7d0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 shutdown_connections 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5585bdc50070 0x5585be081fd0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585bdc2f390 0x5585be00d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585bdc271b0 0x5585be00d030 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8bcff9640 0 client.17742 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 --2- 172.21.15.38:0/271203967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585bdc0e9f0 0x5585be00caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 >> 172.21.15.38:0/271203967 conn(0x5585bdc44460 msgr2=0x5585bdff86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 shutdown_connections 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 1 -- 172.21.15.38:0/271203967 wait complete. 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8e5c42740 20 client.17742 trim_cache size 0 max 16384 2024-09-21T06:28:21.766 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 msgr2=0x7fd8c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 0x7fd8c00b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd8d004e000 tx=0x7fd8d004b000 comp rx=0 tx=0).stop 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 msgr2=0x7fd8d81999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.759+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b450 tx=0x7fd8cc00b910 comp rx=0 tx=0).stop 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 shutdown_connections 2024-09-21T06:28:21.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd8c00b6680 0x7fd8c00b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8d8108cf0 0x7fd8d819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8d81083a0 0x7fd8d81999f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 --2- 172.21.15.38:0/3021777852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd8d8102a60 0x7fd8d8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 >> 172.21.15.38:0/3021777852 conn(0x7fd8d8079730 msgr2=0x7fd8d8105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 shutdown_connections 2024-09-21T06:28:21.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:21.760+0000 7fd8df6ce640 1 -- 172.21.15.38:0/3021777852 wait complete. 2024-09-21T06:28:21.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:21 smithi174 ceph-mon[34815]: pgmap v585: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:21.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:21 smithi044 ceph-mon[34369]: pgmap v585: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:28:22.557 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:28:22.818 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 -- 172.21.15.38:0/2520749961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881048c0 msgr2=0x7fd388104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 --2- 172.21.15.38:0/2520749961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881048c0 0x7fd388104cd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd38402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 -- 172.21.15.38:0/2520749961 shutdown_connections 2024-09-21T06:28:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 --2- 172.21.15.38:0/2520749961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 --2- 172.21.15.38:0/2520749961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881052f0 0x7fd38810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 --2- 172.21.15.38:0/2520749961 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881048c0 0x7fd388104cd0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 -- 172.21.15.38:0/2520749961 >> 172.21.15.38:0/2520749961 conn(0x7fd388079740 msgr2=0x7fd388079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 -- 172.21.15.38:0/2520749961 shutdown_connections 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.312+0000 7fd3900d6640 1 -- 172.21.15.38:0/2520749961 wait complete. 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 Processor -- start 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 -- start start 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881048c0 0x7fd3881027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd388113ba0 con 0x7fd3881052f0 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd388113a20 con 0x7fd38810de70 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd3900d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd388113d20 con 0x7fd3881048c0 2024-09-21T06:28:23.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42618/0 (socket says 172.21.15.38:42618) 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 -- 172.21.15.38:0/258648542 learned_addr learned my addr 172.21.15.38:0/258648542 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38de72640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881048c0 0x7fd3881027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38e673640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 -- 172.21.15.38:0/258648542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881048c0 msgr2=0x7fd3881027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881048c0 0x7fd3881027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.313+0000 7fd38d671640 1 -- 172.21.15.38:0/258648542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 msgr2=0x7fd388103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd38d671640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd38d671640 1 -- 172.21.15.38:0/258648542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3881a8870 con 0x7fd3881052f0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd38e673640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd38d671640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d770 tx=0x7fd37800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd37effd640 1 -- 172.21.15.38:0/258648542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378017070 con 0x7fd3881052f0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd37effd640 1 -- 172.21.15.38:0/258648542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd378009c30 con 0x7fd3881052f0 2024-09-21T06:28:23.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3881a8b60 con 0x7fd3881052f0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd37effd640 1 -- 172.21.15.38:0/258648542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37800f620 con 0x7fd3881052f0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.314+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881a90a0 con 0x7fd3881052f0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.317+0000 7fd39664a740 1 Processor -- start 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.317+0000 7fd39664a740 1 -- start start 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc83fd06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fd0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd37effd640 1 -- 172.21.15.38:0/258648542 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd37801a070 con 0x7fd3881052f0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bc83f46ea0 con 0x55bc83c08390 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc83f362d0 con 0x55bc83c29070 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd39664a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bc83f3a0e0 con 0x55bc83c001b0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42632/0 (socket says 172.21.15.38:42632) 2024-09-21T06:28:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd38d671640 1 -- 172.21.15.38:0/1092428885 learned_addr learned my addr 172.21.15.38:0/1092428885 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd38de72640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fd0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.318+0000 7fd38e673640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc83fd06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 -- 172.21.15.38:0/1092428885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 msgr2=0x55bc83fd0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fd0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 -- 172.21.15.38:0/1092428885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 msgr2=0x55bc83fd06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc83fd06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 -- 172.21.15.38:0/1092428885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc83c94650 con 0x55bc83c08390 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38de72640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fd0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38e673640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc83fd06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd37effd640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 0x7fd3740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38e673640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 0x7fd3740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.319+0000 7fd38d671640 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd3780e4950 tx=0x7fd3780ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838a204bb4764acb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.320+0000 7fd37effd640 1 -- 172.21.15.38:0/258648542 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd3780e7210 con 0x7fd3881052f0 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.320+0000 7fd373fff640 1 -- 172.21.15.38:0/1092428885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a9700 con 0x55bc83c08390 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.320+0000 7fd373fff640 1 -- 172.21.15.38:0/1092428885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3780acbc0 con 0x55bc83c08390 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.320+0000 7fd373fff640 1 -- 172.21.15.38:0/1092428885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ac820 con 0x55bc83c08390 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- 172.21.15.38:0/1092428885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 msgr2=0x55bc83fd1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd3780e4950 tx=0x7fd3780ef910 comp rx=0 tx=0).stop 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd38e673640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 0x7fd3740b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd380005fd0 tx=0x7fd380009590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- 172.21.15.38:0/1092428885 shutdown_connections 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fd1120 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fd0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 --2- 172.21.15.38:0/1092428885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc83fd06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- 172.21.15.38:0/1092428885 >> 172.21.15.38:0/1092428885 conn(0x55bc83c1d460 msgr2=0x55bc83fce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- 172.21.15.38:0/1092428885 shutdown_connections 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- 172.21.15.38:0/1092428885 wait complete. 2024-09-21T06:28:23.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 -- start start 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.321+0000 7fd39664a740 1 Processor -- start 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c08390 0x55bc83fdc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 0x55bc83fdc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55bc83d97700 con 0x55bc83c001b0 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc83ed1160 con 0x55bc83c08390 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bc83fdec40 con 0x55bc83c29070 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd39664a740 10 client.0 _ll_register_callbacks cb 0x55bc83eea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd38de72640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd38de72640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42640/0 (socket says 172.21.15.38:42640) 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd38de72640 1 -- 172.21.15.38:0/2344953295 learned_addr learned my addr 172.21.15.38:0/2344953295 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd38d671640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c08390 0x55bc83fdc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.322+0000 7fd38e673640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 0x55bc83fdc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 -- 172.21.15.38:0/2344953295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 msgr2=0x55bc83fdc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 0x55bc83fdc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 -- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c08390 msgr2=0x55bc83fdc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c08390 0x55bc83fdc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 -- 172.21.15.38:0/2344953295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc83efec90 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38e673640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 0x55bc83fdc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd38de72640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd384031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2289f536945c6bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd3717fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384035040 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd384004040 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3780acbc0 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd384004240 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd39664a740 10 client.17754 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bc83fea8e0 con 0x55bc83c001b0 2024-09-21T06:28:23.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.323+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3780acbc0 con 0x55bc83c001b0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd384004ad0 con 0x55bc83c001b0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 10 client.17754 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 10 client.17754 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 20 client.17754 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83be79f0 0x55bc83fedd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 4 client.17754 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc83f48df0 con 0x55bc83be79f0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd38d671640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83be79f0 0x55bc83fedd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd3717fa640 10 client.17754 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.324+0000 7fd38d671640 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83be79f0 0x55bc83fedd60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9a7d0486a1a09ac server_cookie=8f895347435207f2 in_seq=0 out_seq=0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.325+0000 7fd3717fa640 1 -- 172.21.15.38:0/2344953295 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc83f48df0 con 0x55bc83be79f0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.325+0000 7fd3717fa640 10 client.17754 handle_command_reply: tid=0 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.325+0000 7fd39664a740 1 client.17754 shutdown 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.325+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 msgr2=0x55bc83fdbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.325+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd384031740 comp rx=0 tx=0).stop 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 shutdown_connections 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83be79f0 0x55bc83fedd60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c29070 0x55bc83fdc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c08390 0x55bc83fdc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 --2- 172.21.15.38:0/2344953295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c001b0 0x55bc83fdbce0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd3717fa640 0 client.17754 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 >> 172.21.15.38:0/2344953295 conn(0x55bc83c1d460 msgr2=0x55bc83fd3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 shutdown_connections 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 1 -- 172.21.15.38:0/2344953295 wait complete. 2024-09-21T06:28:23.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.326+0000 7fd39664a740 20 client.17754 trim_cache size 0 max 16384 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 Processor -- start 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 -- start start 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c001b0 0x55bc83fd1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c08390 0x55bc83fd8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881b4250 con 0x55bc83c29070 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881b1b20 con 0x55bc83c001b0 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd39664a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881af990 con 0x55bc83c08390 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd38e673640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd38e673640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42650/0 (socket says 172.21.15.38:42650) 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.339+0000 7fd38e673640 1 -- 172.21.15.38:0/3150676064 learned_addr learned my addr 172.21.15.38:0/3150676064 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:23.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38d671640 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c08390 0x55bc83fd8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38de72640 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c001b0 0x55bc83fd1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 -- 172.21.15.38:0/3150676064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c08390 msgr2=0x55bc83fd8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c08390 0x55bc83fd8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 -- 172.21.15.38:0/3150676064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c001b0 msgr2=0x55bc83fd1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c001b0 0x55bc83fd1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 -- 172.21.15.38:0/3150676064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc83fdc450 con 0x55bc83c29070 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd38e673640 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd3800127d0 tx=0x7fd380014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8acc3886a1b9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd3737fe640 1 -- 172.21.15.38:0/3150676064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38001e930 con 0x55bc83c29070 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd3737fe640 1 -- 172.21.15.38:0/3150676064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd38001f420 con 0x55bc83c29070 2024-09-21T06:28:23.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.340+0000 7fd3737fe640 1 -- 172.21.15.38:0/3150676064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38001c670 con 0x55bc83c29070 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 -- 172.21.15.38:0/3150676064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 msgr2=0x55bc83fd9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd3800127d0 tx=0x7fd380014000 comp rx=0 tx=0).stop 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 -- 172.21.15.38:0/3150676064 shutdown_connections 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c29070 0x55bc83fd9410 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c08390 0x55bc83fd8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 --2- 172.21.15.38:0/3150676064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c001b0 0x55bc83fd1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 -- 172.21.15.38:0/3150676064 >> 172.21.15.38:0/3150676064 conn(0x55bc83c1d460 msgr2=0x55bc83fd16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 -- 172.21.15.38:0/3150676064 shutdown_connections 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.341+0000 7fd39664a740 1 -- 172.21.15.38:0/3150676064 wait complete. 2024-09-21T06:28:23.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 -- start start 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 Processor -- start 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fe0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc84057720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.342+0000 7fd39664a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881affe0 con 0x55bc83c08390 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd39664a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881b1450 con 0x55bc83c29070 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd39664a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881b06b0 con 0x55bc83c001b0 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42660/0 (socket says 172.21.15.38:42660) 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 -- 172.21.15.38:0/3310085103 learned_addr learned my addr 172.21.15.38:0/3310085103 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd39664a740 10 client.0 _ll_register_callbacks cb 0x7fd384009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38de72640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fe0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38e673640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc84057720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 -- 172.21.15.38:0/3310085103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 msgr2=0x55bc83fe0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fe0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 -- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 msgr2=0x55bc84057720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc84057720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 -- 172.21.15.38:0/3310085103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc84057c60 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd38d671640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd3780acdb0 tx=0x7fd3780ac8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b744a41119d69a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd3717fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780e7040 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd3780981b0 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.343+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd38001f420 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd37805c020 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 10 client.17760 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bc84058d50 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd38001f420 con 0x55bc83c08390 2024-09-21T06:28:23.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd3780b6640 con 0x55bc83c08390 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 10 client.17760 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 10 client.17760 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 20 client.17760 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83bbcda0 0x55bc8405b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 4 client.17760 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.344+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc83f448a0 con 0x55bc83bbcda0 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd38de72640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83bbcda0 0x55bc8405b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd38de72640 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83bbcda0 0x55bc8405b150 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35983ed3e6295f8e server_cookie=866ff530a6d706f6 in_seq=0 out_seq=0 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd3717fa640 10 client.17760 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd3717fa640 1 -- 172.21.15.38:0/3310085103 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc83f448a0 con 0x55bc83bbcda0 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd3717fa640 10 client.17760 handle_command_reply: tid=0 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd39664a740 1 client.17760 shutdown 2024-09-21T06:28:23.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 msgr2=0x55bc83fe0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.345+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd3780acdb0 tx=0x7fd3780ac8b0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 shutdown_connections 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55bc83bbcda0 0x55bc8405b150 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc83c29070 0x55bc84057720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55bc83c08390 0x55bc83fe0750 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3717fa640 0 client.17760 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 --2- 172.21.15.38:0/3310085103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bc83c001b0 0x55bc83fe0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 >> 172.21.15.38:0/3310085103 conn(0x55bc83c1d460 msgr2=0x55bc83fd16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 shutdown_connections 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 1 -- 172.21.15.38:0/3310085103 wait complete. 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd39664a740 20 client.17760 trim_cache size 0 max 16384 2024-09-21T06:28:23.352 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 msgr2=0x7fd3740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 0x7fd3740b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd380005fd0 tx=0x7fd380009590 comp rx=0 tx=0).stop 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 msgr2=0x7fd388102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d770 tx=0x7fd37800dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 shutdown_connections 2024-09-21T06:28:23.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3740b6680 0x7fd3740b8b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd38810de70 0x7fd388103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3881052f0 0x7fd388102d10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 --2- 172.21.15.38:0/258648542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3881048c0 0x7fd3881027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.346+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 >> 172.21.15.38:0/258648542 conn(0x7fd388079740 msgr2=0x7fd3881008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.347+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 shutdown_connections 2024-09-21T06:28:23.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:23.347+0000 7fd3900d6640 1 -- 172.21.15.38:0/258648542 wait complete. 2024-09-21T06:28:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:23 smithi038 ceph-mon[31215]: pgmap v586: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:23.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:23 smithi174 ceph-mon[34815]: pgmap v586: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:23.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:23 smithi044 ceph-mon[34369]: pgmap v586: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:24.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:28:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.786+0000 7f5cdaf29640 1 -- 172.21.15.38:0/1301163643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4102230 msgr2=0x7f5cd4102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.786+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/1301163643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4102230 0x7f5cd4102640 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 -- 172.21.15.38:0/1301163643 shutdown_connections 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/1301163643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd41084c0 0x7f5cd410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/1301163643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd4107b70 0x7f5cd4107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/1301163643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4102230 0x7f5cd4102640 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 -- 172.21.15.38:0/1301163643 >> 172.21.15.38:0/1301163643 conn(0x7f5cd4079e40 msgr2=0x7f5cd407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 -- 172.21.15.38:0/1301163643 shutdown_connections 2024-09-21T06:28:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 -- 172.21.15.38:0/1301163643 wait complete. 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 Processor -- start 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.787+0000 7f5cdaf29640 1 -- start start 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd4102230 0x7f5cd419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 0x7f5cd419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd4112b20 con 0x7f5cd4107b70 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41129a0 con 0x7f5cd4102230 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cdaf29640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd4112ca0 con 0x7f5cd41084c0 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42678/0 (socket says 172.21.15.38:42678) 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 -- 172.21.15.38:0/2927875680 learned_addr learned my addr 172.21.15.38:0/2927875680 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd4102230 0x7f5cd419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 0x7f5cd419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 -- 172.21.15.38:0/2927875680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 msgr2=0x7f5cd419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 0x7f5cd419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 -- 172.21.15.38:0/2927875680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd4102230 msgr2=0x7f5cd419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd4102230 0x7f5cd419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 -- 172.21.15.38:0/2927875680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd41a0570 con 0x7f5cd4107b70 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 0x7f5cd419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.788+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400d950 tx=0x7f5cc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.789+0000 7f5cc9ffb640 1 -- 172.21.15.38:0/2927875680 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4017070 con 0x7f5cd4107b70 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.789+0000 7f5cc9ffb640 1 -- 172.21.15.38:0/2927875680 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5cc4009c30 con 0x7f5cd4107b70 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.789+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd41a0860 con 0x7f5cd4107b70 2024-09-21T06:28:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.789+0000 7f5cc9ffb640 1 -- 172.21.15.38:0/2927875680 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40047a0 con 0x7f5cd4107b70 2024-09-21T06:28:24.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.789+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd41a6fc0 con 0x7f5cd4107b70 2024-09-21T06:28:24.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cc9ffb640 1 -- 172.21.15.38:0/2927875680 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5cc4004020 con 0x7f5cd4107b70 2024-09-21T06:28:24.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 Processor -- start 2024-09-21T06:28:24.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 -- start start 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff363f070 0x557ff39e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557ff395cea0 con 0x557ff36161b0 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ff394c2d0 con 0x557ff361e390 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ce149d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557ff39500e0 con 0x557ff363f070 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cd8cc5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cd8cc5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42688/0 (socket says 172.21.15.38:42688) 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/3809761261 learned_addr learned my addr 172.21.15.38:0/3809761261 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff363f070 0x557ff39e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5cc9ffb640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 0x7f5cbc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.792+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/3809761261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff363f070 msgr2=0x557ff39e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff363f070 0x557ff39e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/3809761261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 msgr2=0x557ff39e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/3809761261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff36aa650 con 0x557ff36161b0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cc9ffb640 1 -- 172.21.15.38:0/2927875680 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5cc40e7440 con 0x7f5cd4107b70 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 0x7f5cbc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd0031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d57fa1b806abe33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cbaffd640 1 -- 172.21.15.38:0/3809761261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0040070 con 0x557ff36161b0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cbaffd640 1 -- 172.21.15.38:0/3809761261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5cd0031710 con 0x557ff36161b0 2024-09-21T06:28:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.793+0000 7f5cbaffd640 1 -- 172.21.15.38:0/3809761261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0035040 con 0x557ff36161b0 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 -- 172.21.15.38:0/3809761261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 msgr2=0x557ff39e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 0x7f5cbc0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00af60 tx=0x7f5ccc004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd0031c70 comp rx=0 tx=0).stop 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 -- 172.21.15.38:0/3809761261 shutdown_connections 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff36161b0 0x557ff39e6be0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3809761261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff363f070 0x557ff39e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 -- 172.21.15.38:0/3809761261 >> 172.21.15.38:0/3809761261 conn(0x557ff3633460 msgr2=0x557ff39e4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 -- 172.21.15.38:0/3809761261 shutdown_connections 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.794+0000 7f5ce149d740 1 -- 172.21.15.38:0/3809761261 wait complete. 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 -- start start 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 Processor -- start 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff363f070 0x557ff39f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557ff37ad700 con 0x557ff361e390 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ff38e7160 con 0x557ff363f070 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557ff39f9230 con 0x557ff36161b0 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ce149d740 10 client.0 _ll_register_callbacks cb 0x557ff39009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:24.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42698/0 (socket says 172.21.15.38:42698) 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.795+0000 7f5ccbfff640 1 -- 172.21.15.38:0/3897304483 learned_addr learned my addr 172.21.15.38:0/3897304483 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff363f070 0x557ff39f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 -- 172.21.15.38:0/3897304483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 msgr2=0x557ff39f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 -- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff363f070 msgr2=0x557ff39f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff363f070 0x557ff39f2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 -- 172.21.15.38:0/3897304483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff3914c90 con 0x557ff361e390 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40e4be0 tx=0x7f5cc400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d6f750b0c6fda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40ac9f0 con 0x557ff361e390 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5cc40ac6e0 con 0x557ff361e390 2024-09-21T06:28:24.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cd0031710 con 0x557ff361e390 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5cc40e5010 con 0x557ff361e390 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ce149d740 10 client.17772 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.796+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ff3a04e80 con 0x557ff361e390 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5cd0031710 con 0x557ff361e390 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5cc40abf50 con 0x557ff361e390 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 10 client.17772 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 20 client.17772 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff35fd9f0 0x557ff3a083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 4 client.17772 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ff395edf0 con 0x557ff35fd9f0 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.797+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff35fd9f0 0x557ff3a083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff35fd9f0 0x557ff3a083c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bcde8b3e79bcb64 server_cookie=9b7348d4ed9a7791 in_seq=0 out_seq=0 2024-09-21T06:28:24.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5cb3fff640 10 client.17772 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:24.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5cb3fff640 1 -- 172.21.15.38:0/3897304483 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ff395edf0 con 0x557ff35fd9f0 2024-09-21T06:28:24.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5cb3fff640 10 client.17772 handle_command_reply: tid=0 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5ce149d740 1 client.17772 shutdown 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 msgr2=0x557ff39f2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.798+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40e4be0 tx=0x7f5cc400b6b0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 shutdown_connections 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff363f070 0x557ff39f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff361e390 0x557ff39f2230 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff35fd9f0 0x557ff3a083c0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 --2- 172.21.15.38:0/3897304483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 >> 172.21.15.38:0/3897304483 conn(0x557ff3633460 msgr2=0x557ff39e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5cb3fff640 0 client.17772 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 shutdown_connections 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 1 -- 172.21.15.38:0/3897304483 wait complete. 2024-09-21T06:28:24.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.799+0000 7f5ce149d740 20 client.17772 trim_cache size 0 max 16384 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 Processor -- start 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 -- start start 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff36161b0 0x557ff39eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 0x557ff39ef420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41afe70 con 0x557ff3633460 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41ad740 con 0x557ff36161b0 2024-09-21T06:28:24.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.812+0000 7f5ce149d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41ab5b0 con 0x557ff361e390 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42708/0 (socket says 172.21.15.38:42708) 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/601564162 learned_addr learned my addr 172.21.15.38:0/601564162 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff36161b0 0x557ff39eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 0x557ff39ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/601564162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 msgr2=0x557ff39ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 0x557ff39ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/601564162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff36161b0 msgr2=0x557ff39eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff36161b0 0x557ff39eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 -- 172.21.15.38:0/601564162 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff39f4430 con 0x557ff3633460 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 0x557ff39ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0005390 tx=0x7f5cd0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9747531b3a64878 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cba7fc640 1 -- 172.21.15.38:0/601564162 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0040040 con 0x557ff3633460 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cba7fc640 1 -- 172.21.15.38:0/601564162 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5cd0005610 con 0x557ff3633460 2024-09-21T06:28:24.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.813+0000 7f5cba7fc640 1 -- 172.21.15.38:0/601564162 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0035040 con 0x557ff3633460 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 -- 172.21.15.38:0/601564162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 msgr2=0x557ff39e7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0005390 tx=0x7f5cd0005fd0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 -- 172.21.15.38:0/601564162 shutdown_connections 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff361e390 0x557ff39ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff36161b0 0x557ff39eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 --2- 172.21.15.38:0/601564162 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff39e7de0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 -- 172.21.15.38:0/601564162 >> 172.21.15.38:0/601564162 conn(0x557ff3a08710 msgr2=0x557ff39e76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 -- 172.21.15.38:0/601564162 shutdown_connections 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.814+0000 7f5ce149d740 1 -- 172.21.15.38:0/601564162 wait complete. 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 -- start start 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 Processor -- start 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39facb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39fb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41abc00 con 0x557ff3633460 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41ad070 con 0x557ff361e390 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd41ac2d0 con 0x557ff36161b0 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5ce149d740 10 client.0 _ll_register_callbacks cb 0x7f5cc4004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:24.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5cd94c6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5cd94c6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42714/0 (socket says 172.21.15.38:42714) 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.815+0000 7f5cd94c6640 1 -- 172.21.15.38:0/2013876930 learned_addr learned my addr 172.21.15.38:0/2013876930 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5ccbfff640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 -- 172.21.15.38:0/2013876930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 msgr2=0x557ff39facb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39facb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 -- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 msgr2=0x557ff39fb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39fb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 -- 172.21.15.38:0/2013876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff3a723c0 con 0x557ff3633460 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cd94c6640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc01f500 tx=0x7f5ccc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382c963f8dc6a9c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc003970 con 0x557ff3633460 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5ccc003b10 con 0x557ff3633460 2024-09-21T06:28:24.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cd0005610 con 0x557ff3633460 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5ccc003d10 con 0x557ff3633460 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5ce149d740 10 client.17778 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.816+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ff3a73610 con 0x557ff3633460 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5cd0005610 con 0x557ff3633460 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5ccc01da50 con 0x557ff3633460 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 10 client.17778 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 10 client.17778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 20 client.17778 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff363f070 0x557ff3a75de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 4 client.17778 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ff395a8a0 con 0x557ff363f070 2024-09-21T06:28:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.817+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff363f070 0x557ff3a75de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5cd8cc5640 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff363f070 0x557ff3a75de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b8abd191504534 server_cookie=a238350c27672d0e in_seq=0 out_seq=0 2024-09-21T06:28:24.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5cb3fff640 10 client.17778 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5cb3fff640 1 -- 172.21.15.38:0/2013876930 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ff395a8a0 con 0x557ff363f070 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5cb3fff640 10 client.17778 handle_command_reply: tid=0 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 client.17778 shutdown 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 msgr2=0x557ff3a71d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc01f500 tx=0x7f5ccc004ab0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 shutdown_connections 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ff3633460 0x557ff3a71d80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ff361e390 0x557ff39fb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ff363f070 0x557ff3a75de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 --2- 172.21.15.38:0/2013876930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ff36161b0 0x557ff39facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5cb3fff640 0 client.17778 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 >> 172.21.15.38:0/2013876930 conn(0x557ff3a08710 msgr2=0x557ff39e7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 shutdown_connections 2024-09-21T06:28:24.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 1 -- 172.21.15.38:0/2013876930 wait complete. 2024-09-21T06:28:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.818+0000 7f5ce149d740 20 client.17778 trim_cache size 0 max 16384 2024-09-21T06:28:24.825 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 msgr2=0x7f5cbc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 0x7f5cbc0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00af60 tx=0x7f5ccc004a40 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 msgr2=0x7f5cd419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400d950 tx=0x7f5cc400de10 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 shutdown_connections 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5cbc0b6680 0x7f5cbc0b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cd41084c0 0x7f5cd419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5cd4107b70 0x7f5cd419aba0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 --2- 172.21.15.38:0/2927875680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5cd4102230 0x7f5cd419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 >> 172.21.15.38:0/2927875680 conn(0x7f5cd4079e40 msgr2=0x7f5cd4101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 shutdown_connections 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:24.819+0000 7f5cdaf29640 1 -- 172.21.15.38:0/2927875680 wait complete. 2024-09-21T06:28:25.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:25 smithi038 ceph-mon[31215]: pgmap v587: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:25.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:25 smithi174 ceph-mon[34815]: pgmap v587: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:25.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:25 smithi044 ceph-mon[34369]: pgmap v587: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:26.577 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:28:26.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:28:26.850 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 -- 172.21.15.38:0/4153155382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 msgr2=0x7f6a1c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 --2- 172.21.15.38:0/4153155382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c1087c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009ca0 tx=0x7f6a1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 -- 172.21.15.38:0/4153155382 shutdown_connections 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 --2- 172.21.15.38:0/4153155382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 0x7f6a1c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 --2- 172.21.15.38:0/4153155382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c1087c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 --2- 172.21.15.38:0/4153155382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 0x7f6a1c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 -- 172.21.15.38:0/4153155382 >> 172.21.15.38:0/4153155382 conn(0x7f6a1c079720 msgr2=0x7f6a1c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 -- 172.21.15.38:0/4153155382 shutdown_connections 2024-09-21T06:28:27.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.292+0000 7f6a2096a640 1 -- 172.21.15.38:0/4153155382 wait complete. 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 Processor -- start 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 -- start start 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 0x7f6a1c0ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 0x7f6a1c1000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c112b30 con 0x7f6a1c1083b0 2024-09-21T06:28:27.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1129b0 con 0x7f6a1c108d00 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a2096a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c112cb0 con 0x7f6a1c102ac0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42728/0 (socket says 172.21.15.38:42728) 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a19d9b640 1 -- 172.21.15.38:0/2738751044 learned_addr learned my addr 172.21.15.38:0/2738751044 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 0x7f6a1c1000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.293+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 0x7f6a1c0ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 -- 172.21.15.38:0/2738751044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 msgr2=0x7f6a1c0ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 0x7f6a1c0ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 -- 172.21.15.38:0/2738751044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 msgr2=0x7f6a1c1000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 0x7f6a1c1000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 -- 172.21.15.38:0/2738751044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c1a8760 con 0x7f6a1c1083b0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6a10000f80 tx=0x7f6a10003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a0b7fe640 1 -- 172.21.15.38:0/2738751044 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10031650 con 0x7f6a1c1083b0 2024-09-21T06:28:27.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c1a89f0 con 0x7f6a1c1083b0 2024-09-21T06:28:27.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a0b7fe640 1 -- 172.21.15.38:0/2738751044 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a100317f0 con 0x7f6a1c1083b0 2024-09-21T06:28:27.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1a8f80 con 0x7f6a1c1083b0 2024-09-21T06:28:27.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.294+0000 7f6a0b7fe640 1 -- 172.21.15.38:0/2738751044 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1002fbd0 con 0x7f6a1c1083b0 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 Processor -- start 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 -- start start 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a0b7fe640 1 -- 172.21.15.38:0/2738751044 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6a100305c0 con 0x7f6a1c1083b0 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a16970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff464e670 0x55dff4a16eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dff498ce60 con 0x55dff466f350 2024-09-21T06:28:27.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dff497c290 con 0x55dff4646490 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a26ede740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dff49800a0 con 0x55dff464e670 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a1ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a1ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42738/0 (socket says 172.21.15.38:42738) 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1096458328 learned_addr learned my addr 172.21.15.38:0/1096458328 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.297+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff464e670 0x55dff4a16eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a16970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1096458328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff464e670 msgr2=0x55dff4a16eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff464e670 0x55dff4a16eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1096458328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 msgr2=0x55dff4a16970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a16970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1096458328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dff46da930 con 0x55dff466f350 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a16970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400b6b0 tx=0x7f6a1400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1614748ad98d297b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a08ff9640 1 -- 172.21.15.38:0/1096458328 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14003bd0 con 0x55dff466f350 2024-09-21T06:28:27.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a08ff9640 1 -- 172.21.15.38:0/1096458328 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a14015070 con 0x55dff466f350 2024-09-21T06:28:27.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a08ff9640 1 -- 172.21.15.38:0/1096458328 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a140116a0 con 0x55dff466f350 2024-09-21T06:28:27.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.298+0000 7f6a0b7fe640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 0x7f6a040b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 0x7f6a040b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a0b7fe640 1 -- 172.21.15.38:0/2738751044 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f6a10108920 con 0x7f6a1c1083b0 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 -- 172.21.15.38:0/1096458328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 msgr2=0x55dff4a16430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 0x7f6a040b8c10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55dff4a150b0 tx=0x7f6a0c00c350 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400b6b0 tx=0x7f6a1400bb70 comp rx=0 tx=0).stop 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 -- 172.21.15.38:0/1096458328 shutdown_connections 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff464e670 0x55dff4a16eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a16970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1096458328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a16430 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 -- 172.21.15.38:0/1096458328 >> 172.21.15.38:0/1096458328 conn(0x55dff4663740 msgr2=0x55dff4a14320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.299+0000 7f6a26ede740 1 -- 172.21.15.38:0/1096458328 shutdown_connections 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 -- 172.21.15.38:0/1096458328 wait complete. 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 -- start start 2024-09-21T06:28:27.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 Processor -- start 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a220c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff466f350 0x55dff4a2df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55dff47dd890 con 0x55dff464e670 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dff4916d40 con 0x55dff466f350 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dff4a24c10 con 0x55dff4646490 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.300+0000 7f6a26ede740 10 client.0 _ll_register_callbacks cb 0x55dff497ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a1a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42742/0 (socket says 172.21.15.38:42742) 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 -- 172.21.15.38:0/4011043315 learned_addr learned my addr 172.21.15.38:0/4011043315 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff466f350 0x55dff4a2df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 -- 172.21.15.38:0/4011043315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 msgr2=0x55dff4a220c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a220c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 -- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff466f350 msgr2=0x55dff4a2df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff466f350 0x55dff4a2df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 -- 172.21.15.38:0/4011043315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dff4a2e570 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6a10106120 tx=0x7f6a1002f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491479a91a2df769 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100cae10 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f6a100d7d50 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.301+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a14015070 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6a100cdf30 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 10 client.17790 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dff4a30ea0 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a14015070 con 0x55dff464e670 2024-09-21T06:28:27.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6a100ca110 con 0x55dff464e670 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 10 client.17790 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 20 client.17790 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff462dcd0 0x55dff4a343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 4 client.17790 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dff498edb0 con 0x55dff462dcd0 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.302+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff462dcd0 0x55dff4a343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.303+0000 7f6a01ffb640 10 client.17790 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.303+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff462dcd0 0x55dff4a343c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=157100e88621945a server_cookie=ae4ea9c2239e1810 in_seq=0 out_seq=0 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.303+0000 7f6a01ffb640 1 -- 172.21.15.38:0/4011043315 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dff498edb0 con 0x55dff462dcd0 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.303+0000 7f6a01ffb640 10 client.17790 handle_command_reply: tid=0 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 client.17790 shutdown 2024-09-21T06:28:27.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 msgr2=0x55dff4a22660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6a10106120 tx=0x7f6a1002f610 comp rx=0 tx=0).stop 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 shutdown_connections 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff466f350 0x55dff4a2df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a22660 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff462dcd0 0x55dff4a343c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 --2- 172.21.15.38:0/4011043315 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a01ffb640 0 client.17790 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 >> 172.21.15.38:0/4011043315 conn(0x55dff4663740 msgr2=0x55dff4a19610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 shutdown_connections 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 1 -- 172.21.15.38:0/4011043315 wait complete. 2024-09-21T06:28:27.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.304+0000 7f6a26ede740 20 client.17790 trim_cache size 0 max 16384 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 Processor -- start 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 -- start start 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a2de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff466f350 0x55dff4a1bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1b4130 con 0x55dff464e670 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1b1a00 con 0x55dff4646490 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a26ede740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1af870 con 0x55dff466f350 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42746/0 (socket says 172.21.15.38:42746) 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 -- 172.21.15.38:0/122730005 learned_addr learned my addr 172.21.15.38:0/122730005 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:27.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff466f350 0x55dff4a1bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a2de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 -- 172.21.15.38:0/122730005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff466f350 msgr2=0x55dff4a1bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff466f350 0x55dff4a1bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 -- 172.21.15.38:0/122730005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 msgr2=0x55dff4a2de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a2de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.322+0000 7f6a19d9b640 1 -- 172.21.15.38:0/122730005 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dff4a1d750 con 0x55dff464e670 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.323+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6a100cba30 tx=0x7f6a1010e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59d100f3ea10867 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.323+0000 7f6a03fff640 1 -- 172.21.15.38:0/122730005 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100ce110 con 0x55dff464e670 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.323+0000 7f6a03fff640 1 -- 172.21.15.38:0/122730005 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a10036070 con 0x55dff464e670 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.323+0000 7f6a03fff640 1 -- 172.21.15.38:0/122730005 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a100ce590 con 0x55dff464e670 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- 172.21.15.38:0/122730005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 msgr2=0x55dff4a1b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f6a100cba30 tx=0x7f6a1010e580 comp rx=0 tx=0).stop 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- 172.21.15.38:0/122730005 shutdown_connections 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff466f350 0x55dff4a1bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff464e670 0x55dff4a1b6b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 --2- 172.21.15.38:0/122730005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff4646490 0x55dff4a2de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- 172.21.15.38:0/122730005 >> 172.21.15.38:0/122730005 conn(0x55dff4663740 msgr2=0x55dff4a20740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- 172.21.15.38:0/122730005 shutdown_connections 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- 172.21.15.38:0/122730005 wait complete. 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 -- start start 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.324+0000 7f6a26ede740 1 Processor -- start 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a2a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff464e670 0x55dff4a2a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1afec0 con 0x55dff466f350 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1b1330 con 0x55dff464e670 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1b0590 con 0x55dff4646490 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a26ede740 10 client.0 _ll_register_callbacks cb 0x7f6a10009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42748/0 (socket says 172.21.15.38:42748) 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1968225851 learned_addr learned my addr 172.21.15.38:0/1968225851 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a2a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a19d9b640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff464e670 0x55dff4a2a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1968225851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 msgr2=0x55dff4a2a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a2a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff464e670 msgr2=0x55dff4a2a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff464e670 0x55dff4a2a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 -- 172.21.15.38:0/1968225851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dff4a25490 con 0x55dff466f350 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a1ad9d640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6a1401adf0 tx=0x7f6a14003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75fa474b2d0d63b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.325+0000 7f6a01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14005040 con 0x55dff466f350 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f6a140051e0 con 0x55dff466f350 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a10036070 con 0x55dff466f350 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6a14035050 con 0x55dff466f350 2024-09-21T06:28:27.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 10 client.17796 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dff4a9f640 con 0x55dff466f350 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a10036070 con 0x55dff466f350 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6a14004680 con 0x55dff466f350 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 10 client.17796 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 20 client.17796 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff4603080 0x55dff4aa1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 4 client.17796 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.326+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dff498a860 con 0x55dff4603080 2024-09-21T06:28:27.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.327+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff4603080 0x55dff4aa1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.327+0000 7f6a1a59c640 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff4603080 0x55dff4aa1c30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136fe2c7df68143 server_cookie=7afe10000fa26667 in_seq=0 out_seq=0 2024-09-21T06:28:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.327+0000 7f6a01ffb640 10 client.17796 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a01ffb640 1 -- 172.21.15.38:0/1968225851 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dff498a860 con 0x55dff4603080 2024-09-21T06:28:27.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a01ffb640 10 client.17796 handle_command_reply: tid=0 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 client.17796 shutdown 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 msgr2=0x55dff4a24e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6a1401adf0 tx=0x7f6a14003bd0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 shutdown_connections 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dff466f350 0x55dff4a24e50 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dff464e670 0x55dff4a2a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55dff4603080 0x55dff4aa1c30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 --2- 172.21.15.38:0/1968225851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dff4646490 0x55dff4a2a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a01ffb640 0 client.17796 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 >> 172.21.15.38:0/1968225851 conn(0x55dff4663740 msgr2=0x55dff4a13c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 shutdown_connections 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.329+0000 7f6a26ede740 1 -- 172.21.15.38:0/1968225851 wait complete. 2024-09-21T06:28:27.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a26ede740 20 client.17796 trim_cache size 0 max 16384 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "154f3245-8d5b-4a68-b835-86b6199c35ba", 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:27.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 msgr2=0x7f6a040b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 0x7f6a040b8c10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55dff4a150b0 tx=0x7f6a0c00c350 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 msgr2=0x7f6a1c0ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6a10000f80 tx=0x7f6a10003f10 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 shutdown_connections 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6a040b6700 0x7f6a040b8c10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a1c108d00 0x7f6a1c1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6a1c1083b0 0x7f6a1c0ffb90 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 --2- 172.21.15.38:0/2738751044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a1c102ac0 0x7f6a1c0ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 >> 172.21.15.38:0/2738751044 conn(0x7f6a1c079720 msgr2=0x7f6a1c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 shutdown_connections 2024-09-21T06:28:27.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:27.330+0000 7f6a2096a640 1 -- 172.21.15.38:0/2738751044 wait complete. 2024-09-21T06:28:27.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:27 smithi038 ceph-mon[31215]: pgmap v588: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:27.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:27 smithi174 ceph-mon[34815]: pgmap v588: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:27.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:27 smithi044 ceph-mon[34369]: pgmap v588: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:28:28.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:28.398 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:28.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:28 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:28:28.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:28 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:28 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:28:28.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:28 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:28 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:28:28.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:28 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:28:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:28 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:28 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:28:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:28 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:28 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:28:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:28 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:28:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:28 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:28 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:28:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:28 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:28.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:28 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 -- 172.21.15.38:0/1470180211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c1083d0 msgr2=0x7f757c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 --2- 172.21.15.38:0/1470180211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c1083d0 0x7f757c1087e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f756c009900 tx=0x7f756c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 -- 172.21.15.38:0/1470180211 shutdown_connections 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 --2- 172.21.15.38:0/1470180211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c108d20 0x7f757c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 --2- 172.21.15.38:0/1470180211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c1083d0 0x7f757c1087e0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 --2- 172.21.15.38:0/1470180211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c102ae0 0x7f757c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 -- 172.21.15.38:0/1470180211 >> 172.21.15.38:0/1470180211 conn(0x7f757c079760 msgr2=0x7f757c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 -- 172.21.15.38:0/1470180211 shutdown_connections 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.897+0000 7f7583934640 1 -- 172.21.15.38:0/1470180211 wait complete. 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 Processor -- start 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 -- start start 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 0x7f757c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c108d20 0x7f757c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f757c112ab0 con 0x7f757c102ae0 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f757c112930 con 0x7f757c108d20 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7583934640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f757c112c30 con 0x7f757c1083d0 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42764/0 (socket says 172.21.15.38:42764) 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 -- 172.21.15.38:0/3138254686 learned_addr learned my addr 172.21.15.38:0/3138254686 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7580ecf640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 0x7f757c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 -- 172.21.15.38:0/3138254686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 msgr2=0x7f757c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 0x7f757c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7581ed1640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c108d20 0x7f757c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 -- 172.21.15.38:0/3138254686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c108d20 msgr2=0x7f757c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c108d20 0x7f757c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f75816d0640 1 -- 172.21.15.38:0/3138254686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c1a04c0 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.898+0000 7f7580ecf640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 0x7f757c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f75816d0640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f757800d950 tx=0x7f757800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f75727fc640 1 -- 172.21.15.38:0/3138254686 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7578017070 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f75727fc640 1 -- 172.21.15.38:0/3138254686 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7578009c30 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c1a07b0 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f75727fc640 1 -- 172.21.15.38:0/3138254686 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757800f6b0 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.899+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c1a6f10 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.901+0000 7f7589ea8740 1 Processor -- start 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 -- start start 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f75727fc640 1 -- 172.21.15.38:0/3138254686 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f75780109c0 con 0x7f757c102ae0 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.911 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f825e50 con 0x55cb9f508070 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f815280 con 0x55cb9f4df1b0 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7589ea8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f819090 con 0x55cb9f4e7390 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42774/0 (socket says 172.21.15.38:42774) 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 -- 172.21.15.38:0/1684759810 learned_addr learned my addr 172.21.15.38:0/1684759810 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f75816d0640 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7580ecf640 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 -- 172.21.15.38:0/1684759810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 msgr2=0x55cb9f8b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 -- 172.21.15.38:0/1684759810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 msgr2=0x55cb9f8afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.902+0000 7f7581ed1640 1 -- 172.21.15.38:0/1684759810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f573650 con 0x55cb9f508070 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7574009df0 tx=0x7f757400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb03abd5702629f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75727fc640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 0x7f75680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75677fe640 1 -- 172.21.15.38:0/1684759810 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574003970 con 0x55cb9f508070 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75816d0640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 0x7f75680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75677fe640 1 -- 172.21.15.38:0/1684759810 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7574004030 con 0x55cb9f508070 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75677fe640 1 -- 172.21.15.38:0/1684759810 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574011790 con 0x55cb9f508070 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.903+0000 7f75727fc640 1 -- 172.21.15.38:0/3138254686 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f75780e7370 con 0x7f757c102ae0 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- 172.21.15.38:0/1684759810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 msgr2=0x55cb9f8af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f75816d0640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 0x7f75680b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f75780e4bc0 tx=0x7f75780eaec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7574009df0 tx=0x7f757400f730 comp rx=0 tx=0).stop 2024-09-21T06:28:28.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- 172.21.15.38:0/1684759810 shutdown_connections 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1684759810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f508070 0x55cb9f8af650 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- 172.21.15.38:0/1684759810 >> 172.21.15.38:0/1684759810 conn(0x55cb9f4fc460 msgr2=0x55cb9f8ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- 172.21.15.38:0/1684759810 shutdown_connections 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- 172.21.15.38:0/1684759810 wait complete. 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.904+0000 7f7589ea8740 1 -- start start 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 Processor -- start 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f676700 con 0x55cb9f4df1b0 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f7b0110 con 0x55cb9f508070 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb9f8bde30 con 0x55cb9f4e7390 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7589ea8740 10 client.0 _ll_register_callbacks cb 0x55cb9f7c9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42786/0 (socket says 172.21.15.38:42786) 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7581ed1640 1 -- 172.21.15.38:0/1599090252 learned_addr learned my addr 172.21.15.38:0/1599090252 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.905+0000 7f7580ecf640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 -- 172.21.15.38:0/1599090252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 msgr2=0x55cb9f8bb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 -- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 msgr2=0x55cb9f8c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 -- 172.21.15.38:0/1599090252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9f7ddc40 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7580ecf640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7581ed1640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7574009270 tx=0x7f7574004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3335acf94543a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574004e50 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f7574003970 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7574004030 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f757402e020 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7589ea8740 10 client.17808 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.906+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cb9f8c9b10 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7574004030 con 0x55cb9f4df1b0 2024-09-21T06:28:28.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f75740057b0 con 0x55cb9f4df1b0 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 10 client.17808 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 20 client.17808 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f4c69f0 0x55cb9f8cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 4 client.17808 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb9f827da0 con 0x55cb9f4c69f0 2024-09-21T06:28:28.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.907+0000 7f7580ecf640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f4c69f0 0x55cb9f8cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.908+0000 7f7580ecf640 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f4c69f0 0x55cb9f8cce70 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f443f5be62695142 server_cookie=f2d5c96a97e18382 in_seq=0 out_seq=0 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.908+0000 7f7564ff9640 10 client.17808 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.908+0000 7f7564ff9640 1 -- 172.21.15.38:0/1599090252 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb9f827da0 con 0x55cb9f4c69f0 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.908+0000 7f7564ff9640 10 client.17808 handle_command_reply: tid=0 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.908+0000 7f7589ea8740 1 client.17808 shutdown 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 msgr2=0x55cb9f8bad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7574009270 tx=0x7f7574004840 comp rx=0 tx=0).stop 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 shutdown_connections 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f4c69f0 0x55cb9f8cce70 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 --2- 172.21.15.38:0/1599090252 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8bad10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 >> 172.21.15.38:0/1599090252 conn(0x55cb9f4fc460 msgr2=0x55cb9f8b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7564ff9640 0 client.17808 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 shutdown_connections 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 1 -- 172.21.15.38:0/1599090252 wait complete. 2024-09-21T06:28:28.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.909+0000 7f7589ea8740 20 client.17808 trim_cache size 0 max 16384 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.926+0000 7f7589ea8740 1 Processor -- start 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.926+0000 7f7589ea8740 1 -- start start 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1b2000 con 0x55cb9f4df1b0 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1af8d0 con 0x55cb9f508070 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7589ea8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1ad740 con 0x55cb9f4e7390 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42800/0 (socket says 172.21.15.38:42800) 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 -- 172.21.15.38:0/3752334792 learned_addr learned my addr 172.21.15.38:0/3752334792 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:28.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7580ecf640 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 -- 172.21.15.38:0/3752334792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 msgr2=0x55cb9f8bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 -- 172.21.15.38:0/3752334792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 msgr2=0x55cb9f8acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 -- 172.21.15.38:0/3752334792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9f8d3160 con 0x55cb9f4df1b0 2024-09-21T06:28:28.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.927+0000 7f7581ed1640 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7574006010 tx=0x7f7574009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d59bedec8b98c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7566ffd640 1 -- 172.21.15.38:0/3752334792 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757402c0b0 con 0x55cb9f4df1b0 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7566ffd640 1 -- 172.21.15.38:0/3752334792 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f757401f030 con 0x55cb9f4df1b0 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7566ffd640 1 -- 172.21.15.38:0/3752334792 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574003dd0 con 0x55cb9f4df1b0 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 -- 172.21.15.38:0/3752334792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 msgr2=0x55cb9f8b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7574006010 tx=0x7f7574009a20 comp rx=0 tx=0).stop 2024-09-21T06:28:28.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 -- 172.21.15.38:0/3752334792 shutdown_connections 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f508070 0x55cb9f8acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f4e7390 0x55cb9f8bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 --2- 172.21.15.38:0/3752334792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8b1040 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 -- 172.21.15.38:0/3752334792 >> 172.21.15.38:0/3752334792 conn(0x55cb9f4fc460 msgr2=0x55cb9f8bc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.928+0000 7f7589ea8740 1 -- 172.21.15.38:0/3752334792 shutdown_connections 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 -- 172.21.15.38:0/3752334792 wait complete. 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 -- start start 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 Processor -- start 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 0x55cb9f9355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1add90 con 0x55cb9f4e7390 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1af200 con 0x55cb9f4df1b0 2024-09-21T06:28:28.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1ae460 con 0x55cb9f508070 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.929+0000 7f7589ea8740 10 client.0 _ll_register_callbacks cb 0x7f75780ead90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42804/0 (socket says 172.21.15.38:42804) 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 -- 172.21.15.38:0/2488317554 learned_addr learned my addr 172.21.15.38:0/2488317554 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7581ed1640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 0x55cb9f9355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7581ed1640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 -- 172.21.15.38:0/2488317554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 msgr2=0x55cb9f9355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 0x55cb9f9355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 -- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 msgr2=0x55cb9f8cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 -- 172.21.15.38:0/2488317554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9f935b20 con 0x55cb9f4e7390 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7581ed1640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 0x55cb9f9355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7580ecf640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f756c0314b0 tx=0x7f756c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a013783e3eb168 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:28.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c035040 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f756c005240 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.930+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f757401f030 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f756c051020 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 10 client.17814 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cb9f936d20 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f757401f030 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f756c004750 con 0x55cb9f4e7390 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 10 client.17814 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 20 client.17814 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f49bda0 0x55cb9f9394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 4 client.17814 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb9f823850 con 0x55cb9f49bda0 2024-09-21T06:28:28.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.931+0000 7f7581ed1640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f49bda0 0x55cb9f9394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7564ff9640 10 client.17814 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7581ed1640 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f49bda0 0x55cb9f9394e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68046391d039ef7f server_cookie=711bcc92ebba17c2 in_seq=0 out_seq=0 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7564ff9640 1 -- 172.21.15.38:0/2488317554 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x55cb9f823850 con 0x55cb9f49bda0 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7564ff9640 10 client.17814 handle_command_reply: tid=0 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7589ea8740 1 client.17814 shutdown 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 msgr2=0x55cb9f8cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f756c0314b0 tx=0x7f756c004180 comp rx=0 tx=0).stop 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 shutdown_connections 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.932+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55cb9f49bda0 0x55cb9f9394e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9f508070 0x55cb9f9355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7564ff9640 0 client.17814 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55cb9f4e7390 0x55cb9f8cd8e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 --2- 172.21.15.38:0/2488317554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cb9f4df1b0 0x55cb9f8cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 >> 172.21.15.38:0/2488317554 conn(0x55cb9f4fc460 msgr2=0x55cb9f8b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 shutdown_connections 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 1 -- 172.21.15.38:0/2488317554 wait complete. 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7589ea8740 20 client.17814 trim_cache size 0 max 16384 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:28:28.939 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.940 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.942 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.943 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.944 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.945 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.946 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:28:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:28:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.947 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.948 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.949 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:28:28.950 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:28.951 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 msgr2=0x7f75680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 0x7f75680b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f75780e4bc0 tx=0x7f75780eaec0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 msgr2=0x7f757c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f757800d950 tx=0x7f757800de10 comp rx=0 tx=0).stop 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 shutdown_connections 2024-09-21T06:28:28.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f75680b6700 0x7f75680b8c10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f757c108d20 0x7f757c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f757c1083d0 0x7f757c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 --2- 172.21.15.38:0/3138254686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f757c102ae0 0x7f757c19a550 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.933+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 >> 172.21.15.38:0/3138254686 conn(0x7f757c079760 msgr2=0x7f757c06be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.934+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 shutdown_connections 2024-09-21T06:28:28.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:28.934+0000 7f7583934640 1 -- 172.21.15.38:0/3138254686 wait complete. 2024-09-21T06:28:29.628 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:29 smithi038 ceph-mon[31215]: pgmap v589: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:28:29.663 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:29.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:29.806 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:29 smithi044 ceph-mon[34369]: pgmap v589: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:28:29.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:29 smithi174 ceph-mon[34815]: pgmap v589: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T06:28:29.928 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 -- 172.21.15.38:0/282481004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c8103b60 msgr2=0x7fd7c8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/282481004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c8103b60 0x7fd7c8103f70 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009900 tx=0x7fd7c002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 -- 172.21.15.38:0/282481004 shutdown_connections 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/282481004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 0x7fd7c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/282481004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c81094a0 0x7fd7c81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/282481004 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c8103b60 0x7fd7c8103f70 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 -- 172.21.15.38:0/282481004 >> 172.21.15.38:0/282481004 conn(0x7fd7c807b850 msgr2=0x7fd7c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 -- 172.21.15.38:0/282481004 shutdown_connections 2024-09-21T06:28:30.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.372+0000 7fd7cf80a640 1 -- 172.21.15.38:0/282481004 wait complete. 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 Processor -- start 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 -- start start 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c8103b60 0x7fd7c819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 0x7fd7c819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8113bd0 con 0x7fd7c81094a0 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8113a50 con 0x7fd7c8103b60 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7cf80a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c8113d50 con 0x7fd7c8109df0 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7ccda5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7ccda5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35732/0 (socket says 172.21.15.38:35732) 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.373+0000 7fd7ccda5640 1 -- 172.21.15.38:0/2761215466 learned_addr learned my addr 172.21.15.38:0/2761215466 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7cd5a6640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c8103b60 0x7fd7c819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7cdda7640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 0x7fd7c819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 -- 172.21.15.38:0/2761215466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 msgr2=0x7fd7c819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 0x7fd7c819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 -- 172.21.15.38:0/2761215466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c8103b60 msgr2=0x7fd7c819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c8103b60 0x7fd7c819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 -- 172.21.15.38:0/2761215466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c81a0450 con 0x7fd7c81094a0 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7ccda5640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00d740 tx=0x7fd7bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc017070 con 0x7fd7c81094a0 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c81a0740 con 0x7fd7c81094a0 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd7bc00de50 con 0x7fd7c81094a0 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00f620 con 0x7fd7c81094a0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.374+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c81a6f60 con 0x7fd7c81094a0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.375+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8104de0 con 0x7fd7c81094a0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.378+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd7bc01a070 con 0x7fd7c81094a0 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.378+0000 7fd7c67fc640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 0x7fd7b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.379+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd7bc0e70d0 con 0x7fd7c81094a0 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.379+0000 7fd7cd5a6640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 0x7fd7b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.379+0000 7fd7cd5a6640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 0x7fd7b00b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009230 tx=0x7fd7c00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.382+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7bc0ad610 con 0x7fd7c81094a0 2024-09-21T06:28:30.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.610+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c8103f70 con 0x7fd7c81094a0 2024-09-21T06:28:30.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.611+0000 7fd7c67fc640 1 -- 172.21.15.38:0/2761215466 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fd7c8103f70 con 0x7fd7c81094a0 2024-09-21T06:28:30.613 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:28:30.613 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:28:30.614 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 msgr2=0x7fd7b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 0x7fd7b00b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009230 tx=0x7fd7c00058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 msgr2=0x7fd7c819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00d740 tx=0x7fd7bc00dc00 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 shutdown_connections 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd7b00b66b0 0x7fd7b00b8bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd7c8109df0 0x7fd7c819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd7c81094a0 0x7fd7c819ab40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 --2- 172.21.15.38:0/2761215466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7c8103b60 0x7fd7c819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 >> 172.21.15.38:0/2761215466 conn(0x7fd7c807b850 msgr2=0x7fd7c8107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 shutdown_connections 2024-09-21T06:28:30.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:30.615+0000 7fd7cf80a640 1 -- 172.21.15.38:0/2761215466 wait complete. 2024-09-21T06:28:31.250 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:31 smithi038 ceph-mon[31215]: pgmap v590: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:31.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:31 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2761215466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:31.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:31 smithi174 ceph-mon[34815]: pgmap v590: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:31.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:31 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2761215466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:31 smithi044 ceph-mon[34369]: pgmap v590: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-21T06:28:31.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:31 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2761215466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 -- 172.21.15.38:0/3275441896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43941083a0 msgr2=0x7f43941087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 --2- 172.21.15.38:0/3275441896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43941083a0 0x7f43941087b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4388009900 tx=0x7f438802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 -- 172.21.15.38:0/3275441896 shutdown_connections 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 --2- 172.21.15.38:0/3275441896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4394108cf0 0x7f439410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 --2- 172.21.15.38:0/3275441896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f43941083a0 0x7f43941087b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 --2- 172.21.15.38:0/3275441896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 0x7f4394102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 -- 172.21.15.38:0/3275441896 >> 172.21.15.38:0/3275441896 conn(0x7f4394079730 msgr2=0x7f4394079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 -- 172.21.15.38:0/3275441896 shutdown_connections 2024-09-21T06:28:31.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.966+0000 7f4399d9d640 1 -- 172.21.15.38:0/3275441896 wait complete. 2024-09-21T06:28:31.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.967+0000 7f4399d9d640 1 Processor -- start 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.967+0000 7f4399d9d640 1 -- start start 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.967+0000 7f4399d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 0x7f439419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4399d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43941083a0 0x7f439419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4399d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4399d9d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4394112a80 con 0x7f4394108cf0 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4399d9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4394112900 con 0x7f4394102a60 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4399d9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4394112c00 con 0x7f43941083a0 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35736/0 (socket says 172.21.15.38:35736) 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 -- 172.21.15.38:0/1769764228 learned_addr learned my addr 172.21.15.38:0/1769764228 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43941083a0 0x7f439419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f43937fe640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 0x7f439419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 -- 172.21.15.38:0/1769764228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43941083a0 msgr2=0x7f439419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43941083a0 0x7f439419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 -- 172.21.15.38:0/1769764228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 msgr2=0x7f439419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 0x7f439419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 -- 172.21.15.38:0/1769764228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43941a6590 con 0x7f4394108cf0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.968+0000 7f4393fff640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f438c00cce0 tx=0x7f438c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.969+0000 7f4390ff9640 1 -- 172.21.15.38:0/1769764228 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c00f450 con 0x7f4394108cf0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.969+0000 7f4390ff9640 1 -- 172.21.15.38:0/1769764228 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f438c00fac0 con 0x7f4394108cf0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.969+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43941a6880 con 0x7f4394108cf0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.969+0000 7f4390ff9640 1 -- 172.21.15.38:0/1769764228 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c018be0 con 0x7f4394108cf0 2024-09-21T06:28:31.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.969+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43941a6d40 con 0x7f4394108cf0 2024-09-21T06:28:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.971+0000 7f43a0311740 1 Processor -- start 2024-09-21T06:28:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.971+0000 7f4390ff9640 1 -- 172.21.15.38:0/1769764228 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f438c00fc70 con 0x7f4394108cf0 2024-09-21T06:28:31.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.971+0000 7f43a0311740 1 -- start start 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7e912c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac9390 0x5592d7e91d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5592d7e07ea0 con 0x5592d7ac11b0 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5592d7df72d0 con 0x5592d7ac9390 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43a0311740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592d7dfb0e0 con 0x5592d7aea070 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35740/0 (socket says 172.21.15.38:35740) 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 -- 172.21.15.38:0/60878798 learned_addr learned my addr 172.21.15.38:0/60878798 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f4392ffd640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7e912c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f4392ffd640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac9390 0x5592d7e91d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 -- 172.21.15.38:0/60878798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 msgr2=0x5592d7e912c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7e912c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 -- 172.21.15.38:0/60878798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac9390 msgr2=0x5592d7e91d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac9390 0x5592d7e91d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f4390ff9640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 0x7f437c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f43937fe640 1 -- 172.21.15.38:0/60878798 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d7b55650 con 0x5592d7ac11b0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f4392ffd640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7e912c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.972+0000 7f4393fff640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 0x7f437c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.973+0000 7f43937fe640 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f438400bcb0 tx=0x7f43840107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44237b6fda6d0938 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.973+0000 7f4390ff9640 1 -- 172.21.15.38:0/1769764228 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f438c0e7d00 con 0x7f4394108cf0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.973+0000 7f4379ffb640 1 -- 172.21.15.38:0/60878798 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438401c480 con 0x5592d7ac11b0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.973+0000 7f4379ffb640 1 -- 172.21.15.38:0/60878798 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f438401caf0 con 0x5592d7ac11b0 2024-09-21T06:28:31.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.973+0000 7f4379ffb640 1 -- 172.21.15.38:0/60878798 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384011cd0 con 0x5592d7ac11b0 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- 172.21.15.38:0/60878798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 msgr2=0x5592d7e91800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f4393fff640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 0x7f437c0b8bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f438c0e5550 tx=0x7f438c07a850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f438400bcb0 tx=0x7f43840107a0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- 172.21.15.38:0/60878798 shutdown_connections 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac9390 0x5592d7e91d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e91800 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 --2- 172.21.15.38:0/60878798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7e912c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- 172.21.15.38:0/60878798 >> 172.21.15.38:0/60878798 conn(0x5592d7ade460 msgr2=0x5592d7e8f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- 172.21.15.38:0/60878798 shutdown_connections 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- 172.21.15.38:0/60878798 wait complete. 2024-09-21T06:28:31.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.974+0000 7f43a0311740 1 -- start start 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 Processor -- start 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 0x5592d7e9c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7ea8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5592d7c58700 con 0x5592d7ac9390 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5592d7d92160 con 0x5592d7aea070 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592d7e9faa0 con 0x5592d7ac11b0 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43a0311740 10 client.0 _ll_register_callbacks cb 0x5592d7dab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35746/0 (socket says 172.21.15.38:35746) 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f43937fe640 1 -- 172.21.15.38:0/1784193991 learned_addr learned my addr 172.21.15.38:0/1784193991 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 0x5592d7e9c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.975+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7ea8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 -- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 msgr2=0x5592d7e9c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 0x5592d7e9c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 -- 172.21.15.38:0/1784193991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 msgr2=0x5592d7ea8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7ea8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 -- 172.21.15.38:0/1784193991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d7dbfc90 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 0x5592d7e9c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43937fe640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4384000c00 tx=0x7f438400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906b80c8c1fc74c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4372ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438402b060 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f4384011c20 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f438401caf0 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4384011e20 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43a0311740 10 client.17832 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592d7eab780 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.976+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f438401caf0 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f43840046c0 con 0x5592d7ac9390 2024-09-21T06:28:31.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 10 client.17832 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 10 client.17832 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 20 client.17832 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7aa89f0 0x5592d7eaeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 4 client.17832 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d7e09df0 con 0x5592d7aa89f0 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7aa89f0 0x5592d7eaeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7aa89f0 0x5592d7eaeb90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1432b043c6dbe1a server_cookie=6bc9d1b86ea9bfa4 in_seq=0 out_seq=0 2024-09-21T06:28:31.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.977+0000 7f4372ffd640 10 client.17832 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.978+0000 7f4372ffd640 1 -- 172.21.15.38:0/1784193991 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592d7e09df0 con 0x5592d7aa89f0 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.978+0000 7f4372ffd640 10 client.17832 handle_command_reply: tid=0 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.978+0000 7f43a0311740 1 client.17832 shutdown 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 msgr2=0x5592d7e9cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4384000c00 tx=0x7f438400bfd0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 shutdown_connections 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7aa89f0 0x5592d7eaeb90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7ea8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7e9cf00 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f4372ffd640 0 client.17832 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 --2- 172.21.15.38:0/1784193991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac11b0 0x5592d7e9c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 >> 172.21.15.38:0/1784193991 conn(0x5592d7ade460 msgr2=0x5592d7e94450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 shutdown_connections 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 1 -- 172.21.15.38:0/1784193991 wait complete. 2024-09-21T06:28:31.984 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.979+0000 7f43a0311740 20 client.17832 trim_cache size 0 max 16384 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.992+0000 7f43a0311740 1 Processor -- start 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.992+0000 7f43a0311740 1 -- start start 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac9390 0x5592d7ea8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7e8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f43941b1ea0 con 0x5592d7ac11b0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43941af770 con 0x5592d7aea070 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43a0311740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43941ad5e0 con 0x5592d7ac9390 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35752/0 (socket says 172.21.15.38:35752) 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 -- 172.21.15.38:0/1920634821 learned_addr learned my addr 172.21.15.38:0/1920634821 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7e8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f43937fe640 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac9390 0x5592d7ea8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 -- 172.21.15.38:0/1920634821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac9390 msgr2=0x5592d7ea8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac9390 0x5592d7ea8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 -- 172.21.15.38:0/1920634821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 msgr2=0x5592d7e8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7e8ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 -- 172.21.15.38:0/1920634821 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d7e937e0 con 0x5592d7ac11b0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.993+0000 7f4392ffd640 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4388009230 tx=0x7f43880058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7d3337cb6830cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.994+0000 7f43797fa640 1 -- 172.21.15.38:0/1920634821 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388035040 con 0x5592d7ac11b0 2024-09-21T06:28:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.994+0000 7f43797fa640 1 -- 172.21.15.38:0/1920634821 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4388004450 con 0x5592d7ac11b0 2024-09-21T06:28:31.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.994+0000 7f43797fa640 1 -- 172.21.15.38:0/1920634821 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388004dc0 con 0x5592d7ac11b0 2024-09-21T06:28:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.994+0000 7f43a0311740 1 -- 172.21.15.38:0/1920634821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 msgr2=0x5592d7e94ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.994+0000 7f43a0311740 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4388009230 tx=0x7f43880058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 -- 172.21.15.38:0/1920634821 shutdown_connections 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7aea070 0x5592d7e8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7ac9390 0x5592d7ea8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 --2- 172.21.15.38:0/1920634821 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac11b0 0x5592d7e94ad0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 -- 172.21.15.38:0/1920634821 >> 172.21.15.38:0/1920634821 conn(0x5592d7ade460 msgr2=0x5592d7e943c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 -- 172.21.15.38:0/1920634821 shutdown_connections 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 -- 172.21.15.38:0/1920634821 wait complete. 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 -- start start 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.995+0000 7f43a0311740 1 Processor -- start 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 0x5592d7eb2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7eafe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f43941adc30 con 0x5592d7ac9390 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43941af0a0 con 0x5592d7ac11b0 2024-09-21T06:28:32.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43941ae300 con 0x5592d7aea070 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43a0311740 10 client.0 _ll_register_callbacks cb 0x7f438400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35762/0 (socket says 172.21.15.38:35762) 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 -- 172.21.15.38:0/2592169621 learned_addr learned my addr 172.21.15.38:0/2592169621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f4392ffd640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 0x5592d7eb2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 -- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 msgr2=0x5592d7eafe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7eafe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 -- 172.21.15.38:0/2592169621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 msgr2=0x5592d7eb2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 0x5592d7eb2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 -- 172.21.15.38:0/2592169621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d7eb0610 con 0x5592d7ac9390 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f4392ffd640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 0x5592d7eb2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f43937fe640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4384001eb0 tx=0x7f4384011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2a2188c75833ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.996+0000 7f4372ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:32.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438402b040 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4388004450 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f4384004f40 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f438403e050 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 10 client.17838 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592d7f192c0 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4388004450 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f43840035f0 con 0x5592d7ac9390 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 10 client.17838 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 10 client.17838 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 20 client.17838 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7a7dda0 0x5592d7f1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 4 client.17838 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.997+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592d7e98570 con 0x5592d7a7dda0 2024-09-21T06:28:32.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.998+0000 7f4392ffd640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7a7dda0 0x5592d7f1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.998+0000 7f4392ffd640 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7a7dda0 0x5592d7f1ba40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=829b1c8b2073b2b1 server_cookie=151b74e726c25713 in_seq=0 out_seq=0 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.998+0000 7f4372ffd640 10 client.17838 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.998+0000 7f4372ffd640 1 -- 172.21.15.38:0/2592169621 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592d7e98570 con 0x5592d7a7dda0 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.998+0000 7f4372ffd640 10 client.17838 handle_command_reply: tid=0 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 client.17838 shutdown 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 msgr2=0x5592d7eaf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4384001eb0 tx=0x7f4384011440 comp rx=0 tx=0).stop 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 shutdown_connections 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5592d7a7dda0 0x5592d7f1ba40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592d7aea070 0x5592d7eafe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5592d7ac9390 0x5592d7eaf8e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 --2- 172.21.15.38:0/2592169621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5592d7ac11b0 0x5592d7eb2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 >> 172.21.15.38:0/2592169621 conn(0x5592d7ade460 msgr2=0x5592d7e8eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f4372ffd640 0 client.17838 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 shutdown_connections 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 1 -- 172.21.15.38:0/2592169621 wait complete. 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:31.999+0000 7f43a0311740 20 client.17838 trim_cache size 0 max 16384 2024-09-21T06:28:32.005 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 msgr2=0x7f437c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 0x7f437c0b8bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f438c0e5550 tx=0x7f438c07a850 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 msgr2=0x7f439419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f438c00cce0 tx=0x7f438c00a620 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 shutdown_connections 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f437c0b66b0 0x7f437c0b8bc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4394108cf0 0x7f439419be10 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43941083a0 0x7f439419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 --2- 172.21.15.38:0/1769764228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4394102a60 0x7f439419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 >> 172.21.15.38:0/1769764228 conn(0x7f4394079730 msgr2=0x7f43941013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:32.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 shutdown_connections 2024-09-21T06:28:32.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:32.000+0000 7f4399d9d640 1 -- 172.21.15.38:0/1769764228 wait complete. 2024-09-21T06:28:32.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:28:32.871 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:33.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/376008740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 msgr2=0x7f1f5810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/376008740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f5810f550 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009ca0 tx=0x7f1f5002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/376008740 shutdown_connections 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/376008740 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f5810f550 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/376008740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f581083d0 0x7f1f581087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/376008740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f58102a90 0x7f1f58102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/376008740 >> 172.21.15.38:0/376008740 conn(0x7f1f58079750 msgr2=0x7f1f58079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/376008740 shutdown_connections 2024-09-21T06:28:33.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/376008740 wait complete. 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.358+0000 7f1f5d9d3640 1 Processor -- start 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 -- start start 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f58102a90 0x7f1f5810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f581083d0 0x7f1f58110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113bd0 con 0x7f1f58108d20 2024-09-21T06:28:33.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113a50 con 0x7f1f581083d0 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f5d9d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58113d50 con 0x7f1f58102a90 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35782/0 (socket says 172.21.15.38:35782) 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f577fe640 1 -- 172.21.15.38:0/3567232450 learned_addr learned my addr 172.21.15.38:0/3567232450 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f567fc640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f581083d0 0x7f1f58110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.359+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f58102a90 0x7f1f5810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 -- 172.21.15.38:0/3567232450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f58102a90 msgr2=0x7f1f5810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f58102a90 0x7f1f5810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 -- 172.21.15.38:0/3567232450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f581083d0 msgr2=0x7f1f58110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f581083d0 0x7f1f58110520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 -- 172.21.15.38:0/3567232450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f581a86f0 con 0x7f1f58108d20 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f577fe640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1f50005e30 tx=0x7f1f50003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f5c9d1640 1 -- 172.21.15.38:0/3567232450 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50031650 con 0x7f1f58108d20 2024-09-21T06:28:33.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f5c9d1640 1 -- 172.21.15.38:0/3567232450 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f500317f0 con 0x7f1f58108d20 2024-09-21T06:28:33.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f5c9d1640 1 -- 172.21.15.38:0/3567232450 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5002fb70 con 0x7f1f58108d20 2024-09-21T06:28:33.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f581a8980 con 0x7f1f58108d20 2024-09-21T06:28:33.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.360+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a8f10 con 0x7f1f58108d20 2024-09-21T06:28:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 Processor -- start 2024-09-21T06:28:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f5c9d1640 1 -- 172.21.15.38:0/3567232450 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1f5002fd50 con 0x7f1f58108d20 2024-09-21T06:28:33.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 -- start start 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e096416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09642120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563e095b7ea0 con 0x563e092711b0 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563e095a72d0 con 0x563e09279390 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.363+0000 7f1f63f47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563e095ab0e0 con 0x563e0929a070 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35784/0 (socket says 172.21.15.38:35784) 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 -- 172.21.15.38:0/2681025540 learned_addr learned my addr 172.21.15.38:0/2681025540 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f567fc640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e096416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f567fc640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09642120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 -- 172.21.15.38:0/2681025540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 msgr2=0x563e096416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e096416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 -- 172.21.15.38:0/2681025540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 msgr2=0x563e09642120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09642120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 -- 172.21.15.38:0/2681025540 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e09305650 con 0x563e092711b0 2024-09-21T06:28:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f567fc640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e096416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:33.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f5c9d1640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 0x7f1f400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f567fc640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 0x7f1f400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800cc20 tx=0x7f1f4800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba48e8a3285856 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f5c9d1640 1 -- 172.21.15.38:0/3567232450 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1f50108b20 con 0x7f1f58108d20 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.364+0000 7f1f3dffb640 1 -- 172.21.15.38:0/2681025540 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48014070 con 0x563e092711b0 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f3dffb640 1 -- 172.21.15.38:0/2681025540 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f480047a0 con 0x563e092711b0 2024-09-21T06:28:33.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f3dffb640 1 -- 172.21.15.38:0/2681025540 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48010780 con 0x563e092711b0 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 -- 172.21.15.38:0/2681025540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 msgr2=0x563e09641be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f567fc640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 0x7f1f400b8c10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f58107950 tx=0x7f1f4c0046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800cc20 tx=0x7f1f4800e720 comp rx=0 tx=0).stop 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 -- 172.21.15.38:0/2681025540 shutdown_connections 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09642120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09641be0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 --2- 172.21.15.38:0/2681025540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e096416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.365+0000 7f1f63f47740 1 -- 172.21.15.38:0/2681025540 >> 172.21.15.38:0/2681025540 conn(0x563e0928e460 msgr2=0x563e0963f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 -- 172.21.15.38:0/2681025540 shutdown_connections 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 -- 172.21.15.38:0/2681025540 wait complete. 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 -- start start 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 Processor -- start 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e0964cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.366+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0964d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f63f47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563e09408700 con 0x563e0929a070 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f63f47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563e09542160 con 0x563e09279390 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f63f47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563e0964fe80 con 0x563e092711b0 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f63f47740 10 client.0 _ll_register_callbacks cb 0x563e0955b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35796/0 (socket says 172.21.15.38:35796) 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 -- 172.21.15.38:0/1109883064 learned_addr learned my addr 172.21.15.38:0/1109883064 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e0964cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f567fc640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0964d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 -- 172.21.15.38:0/1109883064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 msgr2=0x563e0964cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e0964cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 -- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 msgr2=0x563e0964d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0964d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 -- 172.21.15.38:0/1109883064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0956fc90 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f567fc640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0964d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1f500ce6c0 tx=0x7f1f500ca920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e76e3ca84efcf1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.367+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500d8150 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1f500d3210 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f480047a0 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1f500ce4d0 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 10 client.17850 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e0965bb80 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f480047a0 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1f500e4b70 con 0x563e0929a070 2024-09-21T06:28:33.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 10 client.17850 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 10 client.17850 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 20 client.17850 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e092589f0 0x563e0965f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 4 client.17850 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.368+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e095b9df0 con 0x563e092589f0 2024-09-21T06:28:33.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.369+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e092589f0 0x563e0965f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.369+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e092589f0 0x563e0965f070 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f86c192ba0249bad server_cookie=d3b6623e07018993 in_seq=0 out_seq=0 2024-09-21T06:28:33.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.369+0000 7f1f36ffd640 10 client.17850 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:33.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1109883064 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e095b9df0 con 0x563e092589f0 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f36ffd640 10 client.17850 handle_command_reply: tid=0 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 client.17850 shutdown 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 msgr2=0x563e0964d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1f500ce6c0 tx=0x7f1f500ca920 comp rx=0 tx=0).stop 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 shutdown_connections 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e092589f0 0x563e0965f070 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e0964d800 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0964d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1109883064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e0964cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 >> 172.21.15.38:0/1109883064 conn(0x563e0928e460 msgr2=0x563e09644830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f36ffd640 0 client.17850 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 shutdown_connections 2024-09-21T06:28:33.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 1 -- 172.21.15.38:0/1109883064 wait complete. 2024-09-21T06:28:33.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.370+0000 7f1f63f47740 20 client.17850 trim_cache size 0 max 16384 2024-09-21T06:28:33.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 Processor -- start 2024-09-21T06:28:33.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 -- start start 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0963f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e09642de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581b3ff0 con 0x563e092711b0 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581b18c0 con 0x563e09279390 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f63f47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581af730 con 0x563e0929a070 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35798/0 (socket says 172.21.15.38:35798) 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 -- 172.21.15.38:0/3567657620 learned_addr learned my addr 172.21.15.38:0/3567657620 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f567fc640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0963f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 -- 172.21.15.38:0/3567657620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 msgr2=0x563e09642de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f577fe640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e09642de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e09642de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 -- 172.21.15.38:0/3567657620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 msgr2=0x563e0963f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0963f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f56ffd640 1 -- 172.21.15.38:0/3567657620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0964fd60 con 0x563e092711b0 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f567fc640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0963f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.384+0000 7f1f577fe640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e09642de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c9b0 tx=0x7f1f4800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d975c8d5a1d4ff69 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f3d7fa640 1 -- 172.21.15.38:0/3567657620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48031070 con 0x563e092711b0 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f3d7fa640 1 -- 172.21.15.38:0/3567657620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f4802cb00 con 0x563e092711b0 2024-09-21T06:28:33.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f3d7fa640 1 -- 172.21.15.38:0/3567657620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48014040 con 0x563e092711b0 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f63f47740 1 -- 172.21.15.38:0/3567657620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 msgr2=0x563e09648560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.385+0000 7f1f63f47740 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c9b0 tx=0x7f1f4800c730 comp rx=0 tx=0).stop 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 -- 172.21.15.38:0/3567657620 shutdown_connections 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e0929a070 0x563e09642de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e0963f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 --2- 172.21.15.38:0/3567657620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e092711b0 0x563e09648560 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 -- 172.21.15.38:0/3567657620 >> 172.21.15.38:0/3567657620 conn(0x563e0928e460 msgr2=0x563e096426d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 -- 172.21.15.38:0/3567657620 shutdown_connections 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 -- 172.21.15.38:0/3567657620 wait complete. 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 -- start start 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.386+0000 7f1f63f47740 1 Processor -- start 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e096558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09650d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581afd80 con 0x563e0929a070 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581b11f0 con 0x563e09279390 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581b0450 con 0x563e092711b0 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f63f47740 10 client.0 _ll_register_callbacks cb 0x7f1f500095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35806/0 (socket says 172.21.15.38:35806) 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 -- 172.21.15.38:0/1377767300 learned_addr learned my addr 172.21.15.38:0/1377767300 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e096558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f567fc640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09650d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 -- 172.21.15.38:0/1377767300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 msgr2=0x563e096558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e096558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 -- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 msgr2=0x563e09650d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09650d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 -- 172.21.15.38:0/1377767300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e09640350 con 0x563e0929a070 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f577fe640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1f500ce950 tx=0x7f1f5002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d752420d58f3c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.387+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500e9060 con 0x563e0929a070 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1f500e4b70 con 0x563e0929a070 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4802cb00 con 0x563e0929a070 2024-09-21T06:28:33.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1f500ee050 con 0x563e0929a070 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 10 client.17856 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e096c96d0 con 0x563e0929a070 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f4802cb00 con 0x563e0929a070 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1f50004b40 con 0x563e0929a070 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 10 client.17856 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 10 client.17856 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 20 client.17856 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e0922dda0 0x563e096cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 4 client.17856 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e0963a9e0 con 0x563e0922dda0 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.388+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e0922dda0 0x563e096cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f56ffd640 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e0922dda0 0x563e096cbd20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9ced237ab5e8a09 server_cookie=7d7be51f2c112291 in_seq=0 out_seq=0 2024-09-21T06:28:33.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f36ffd640 10 client.17856 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f36ffd640 1 -- 172.21.15.38:0/1377767300 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e0963a9e0 con 0x563e0922dda0 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f36ffd640 10 client.17856 handle_command_reply: tid=0 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 client.17856 shutdown 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 msgr2=0x563e096512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1f500ce950 tx=0x7f1f5002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 shutdown_connections 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x563e0922dda0 0x563e096cbd20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563e0929a070 0x563e096512c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e09279390 0x563e09650d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 --2- 172.21.15.38:0/1377767300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e092711b0 0x563e096558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 >> 172.21.15.38:0/1377767300 conn(0x563e0928e460 msgr2=0x563e09642e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f36ffd640 0 client.17856 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 shutdown_connections 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.389+0000 7f1f63f47740 1 -- 172.21.15.38:0/1377767300 wait complete. 2024-09-21T06:28:33.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f63f47740 20 client.17856 trim_cache size 0 max 16384 2024-09-21T06:28:33.397 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:33.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 msgr2=0x7f1f400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 0x7f1f400b8c10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f58107950 tx=0x7f1f4c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 msgr2=0x7f1f58110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1f50005e30 tx=0x7f1f50003f90 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 shutdown_connections 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1f400b6700 0x7f1f400b8c10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1f58108d20 0x7f1f58110a60 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f581083d0 0x7f1f58110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 --2- 172.21.15.38:0/3567232450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f58102a90 0x7f1f5810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 >> 172.21.15.38:0/3567232450 conn(0x7f1f58079750 msgr2=0x7f1f58104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 shutdown_connections 2024-09-21T06:28:33.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:33.390+0000 7f1f5d9d3640 1 -- 172.21.15.38:0/3567232450 wait complete. 2024-09-21T06:28:33.694 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:33 smithi038 ceph-mon[31215]: pgmap v591: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:28:33.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:33 smithi174 ceph-mon[34815]: pgmap v591: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:28:33.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:33 smithi044 ceph-mon[34369]: pgmap v591: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:28:34.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:28:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 -- 172.21.15.38:0/1504679643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338103b90 msgr2=0x7f9338103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 --2- 172.21.15.38:0/1504679643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338103b90 0x7f9338103fa0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9328009900 tx=0x7f932802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 -- 172.21.15.38:0/1504679643 shutdown_connections 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 --2- 172.21.15.38:0/1504679643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9338109e20 0x7f9338110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 --2- 172.21.15.38:0/1504679643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93381094d0 0x7f93381098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 --2- 172.21.15.38:0/1504679643 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338103b90 0x7f9338103fa0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 -- 172.21.15.38:0/1504679643 >> 172.21.15.38:0/1504679643 conn(0x7f93380ff600 msgr2=0x7f9338101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 -- 172.21.15.38:0/1504679643 shutdown_connections 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.815+0000 7f933e999640 1 -- 172.21.15.38:0/1504679643 wait complete. 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.816+0000 7f933e999640 1 Processor -- start 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.816+0000 7f933e999640 1 -- start start 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9338103b90 0x7f933819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93381094d0 0x7f933819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113c20 con 0x7f9338109e20 2024-09-21T06:28:34.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113aa0 con 0x7f93381094d0 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933e999640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113da0 con 0x7f9338103b90 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35832/0 (socket says 172.21.15.38:35832) 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 -- 172.21.15.38:0/1129371435 learned_addr learned my addr 172.21.15.38:0/1129371435 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f93377fe640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93381094d0 0x7f933819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f9337fff640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9338103b90 0x7f933819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 -- 172.21.15.38:0/1129371435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9338103b90 msgr2=0x7f933819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9338103b90 0x7f933819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 -- 172.21.15.38:0/1129371435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93381094d0 msgr2=0x7f933819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93381094d0 0x7f933819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 -- 172.21.15.38:0/1129371435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93381a0580 con 0x7f9338109e20 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.817+0000 7f933cf36640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f933000eaa0 tx=0x7f933000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.818+0000 7f93357fa640 1 -- 172.21.15.38:0/1129371435 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000cdb0 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.818+0000 7f93357fa640 1 -- 172.21.15.38:0/1129371435 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9330005020 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.818+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93381a0870 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.818+0000 7f93357fa640 1 -- 172.21.15.38:0/1129371435 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300116d0 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.818+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381a6fd0 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.820+0000 7f9344f0d740 1 Processor -- start 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.820+0000 7f93357fa640 1 -- 172.21.15.38:0/1129371435 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9330011870 con 0x7f9338109e20 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.820+0000 7f9344f0d740 1 -- start start 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d30070 0x5619750d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d0f390 0x5619750d8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56197504dea0 con 0x561974d071b0 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56197503d2d0 con 0x561974d0f390 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9344f0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5619750410e0 con 0x561974d30070 2024-09-21T06:28:34.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35842/0 (socket says 172.21.15.38:35842) 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 -- 172.21.15.38:0/3483969895 learned_addr learned my addr 172.21.15.38:0/3483969895 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f93377fe640 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d0f390 0x5619750d8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f93377fe640 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d30070 0x5619750d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 -- 172.21.15.38:0/3483969895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d30070 msgr2=0x5619750d76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d30070 0x5619750d76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 -- 172.21.15.38:0/3483969895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d0f390 msgr2=0x5619750d8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d0f390 0x5619750d8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 -- 172.21.15.38:0/3483969895 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561974d9b650 con 0x561974d071b0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f93357fa640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 0x7f93200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f93377fe640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 0x7f93200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.821+0000 7f9337fff640 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9328009900 tx=0x7f9328031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988a13bc40059200 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.822+0000 7f93357fa640 1 -- 172.21.15.38:0/1129371435 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f93300e7840 con 0x7f9338109e20 2024-09-21T06:28:34.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.822+0000 7f931e7fc640 1 -- 172.21.15.38:0/3483969895 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328040070 con 0x561974d071b0 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.822+0000 7f931e7fc640 1 -- 172.21.15.38:0/3483969895 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9328031710 con 0x561974d071b0 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.822+0000 7f931e7fc640 1 -- 172.21.15.38:0/3483969895 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328035040 con 0x561974d071b0 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- 172.21.15.38:0/3483969895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 msgr2=0x5619750d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f93377fe640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 0x7f93200b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f932c005d00 tx=0x7f932c005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9328009900 tx=0x7f9328031bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- 172.21.15.38:0/3483969895 shutdown_connections 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d0f390 0x5619750d8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d071b0 0x5619750d7be0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 --2- 172.21.15.38:0/3483969895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d30070 0x5619750d76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- 172.21.15.38:0/3483969895 >> 172.21.15.38:0/3483969895 conn(0x561974d24460 msgr2=0x5619750d5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- 172.21.15.38:0/3483969895 shutdown_connections 2024-09-21T06:28:34.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- 172.21.15.38:0/3483969895 wait complete. 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.823+0000 7f9344f0d740 1 -- start start 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 Processor -- start 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561974e9e700 con 0x561974d30070 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561974fd8160 con 0x561974d071b0 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5619750e5e20 con 0x561974d0f390 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9344f0d740 10 client.0 _ll_register_callbacks cb 0x561974ff19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35858/0 (socket says 172.21.15.38:35858) 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 -- 172.21.15.38:0/1492911848 learned_addr learned my addr 172.21.15.38:0/1492911848 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f9337fff640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f93377fe640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 -- 172.21.15.38:0/1492911848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 msgr2=0x5619750e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 -- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 msgr2=0x5619750e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.824+0000 7f933cf36640 1 -- 172.21.15.38:0/1492911848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561975005c90 con 0x561974d30070 2024-09-21T06:28:34.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f933cf36640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f93300e5040 tx=0x7f93300a9c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d94ebfe61d0251f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933001f030 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f93300acbf0 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9328031710 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f93300b7100 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f9344f0d740 10 client.17868 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5619750f1a60 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9328031710 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f933000f040 con 0x561974d30070 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f9344f0d740 10 client.17868 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.825+0000 7f9344f0d740 10 client.17868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9344f0d740 20 client.17868 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974cee9f0 0x5619750f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9344f0d740 4 client.17868 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56197504fdf0 con 0x561974cee9f0 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9337fff640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974cee9f0 0x5619750f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f93177fe640 10 client.17868 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.826+0000 7f9337fff640 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974cee9f0 0x5619750f4fc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6ac51f77bff1bc server_cookie=6a3cf5e46774b6c5 in_seq=0 out_seq=0 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f93177fe640 1 -- 172.21.15.38:0/1492911848 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56197504fdf0 con 0x561974cee9f0 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f93177fe640 10 client.17868 handle_command_reply: tid=0 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 client.17868 shutdown 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 msgr2=0x5619750e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f93300e5040 tx=0x7f93300a9c80 comp rx=0 tx=0).stop 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 shutdown_connections 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d30070 0x5619750e36e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974cee9f0 0x5619750f4fc0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f93177fe640 0 client.17868 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:34.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1492911848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.827+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 >> 172.21.15.38:0/1492911848 conn(0x561974d24460 msgr2=0x5619750da830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.828+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 shutdown_connections 2024-09-21T06:28:34.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.828+0000 7f9344f0d740 1 -- 172.21.15.38:0/1492911848 wait complete. 2024-09-21T06:28:34.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.828+0000 7f9344f0d740 20 client.17868 trim_cache size 0 max 16384 2024-09-21T06:28:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 Processor -- start 2024-09-21T06:28:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 -- start start 2024-09-21T06:28:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 0x5619750d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f93381b1fe0 con 0x561974cee9f0 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93381af8b0 con 0x561974d071b0 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9344f0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93381ad720 con 0x561974d0f390 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 0x5619750d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f93377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f93377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:45838/0 (socket says 172.21.15.38:45838) 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.842+0000 7f9337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 0x5619750d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35870/0 (socket says 172.21.15.38:35870) 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 -- 172.21.15.38:0/2397396152 learned_addr learned my addr 172.21.15.38:0/2397396152 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f933cf36640 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 -- 172.21.15.38:0/2397396152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 msgr2=0x5619750d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 -- 172.21.15.38:0/2397396152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 msgr2=0x5619750d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 0x5619750d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 -- 172.21.15.38:0/2397396152 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619750d5aa0 con 0x561974d071b0 2024-09-21T06:28:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f93377fe640 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f932c011680 tx=0x7f932c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9719d339e4c8cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f931dffb640 1 -- 172.21.15.38:0/2397396152 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c004220 con 0x561974d071b0 2024-09-21T06:28:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f931dffb640 1 -- 172.21.15.38:0/2397396152 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f932c0043c0 con 0x561974d071b0 2024-09-21T06:28:34.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.843+0000 7f931dffb640 1 -- 172.21.15.38:0/2397396152 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c023be0 con 0x561974d071b0 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 -- 172.21.15.38:0/2397396152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 msgr2=0x5619750e4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f932c011680 tx=0x7f932c004730 comp rx=0 tx=0).stop 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 -- 172.21.15.38:0/2397396152 shutdown_connections 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974d0f390 0x5619750d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750e4890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 --2- 172.21.15.38:0/2397396152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974cee9f0 0x5619750d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 -- 172.21.15.38:0/2397396152 >> 172.21.15.38:0/2397396152 conn(0x561974d24460 msgr2=0x5619750e4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 -- 172.21.15.38:0/2397396152 shutdown_connections 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.844+0000 7f9344f0d740 1 -- 172.21.15.38:0/2397396152 wait complete. 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 -- start start 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 Processor -- start 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974cee9f0 0x5619750eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d0f390 0x5619751589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f93381add70 con 0x561974d0f390 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93381af1e0 con 0x561974d071b0 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93381ae440 con 0x561974cee9f0 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.845+0000 7f9344f0d740 10 client.0 _ll_register_callbacks cb 0x7f93300a9de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f933cf36640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d0f390 0x5619751589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:45852/0 (socket says 172.21.15.38:45852) 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 -- 172.21.15.38:0/1131751843 learned_addr learned my addr 172.21.15.38:0/1131751843 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:34.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f9337fff640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974cee9f0 0x5619750eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 -- 172.21.15.38:0/1131751843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974cee9f0 msgr2=0x5619750eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974cee9f0 0x5619750eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 -- 172.21.15.38:0/1131751843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d0f390 msgr2=0x5619751589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d0f390 0x5619751589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 -- 172.21.15.38:0/1131751843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619750ebc50 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93377fe640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f932c023800 tx=0x7f932c023860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b80ca7d5b0ba37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.846+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c038020 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f932c0043c0 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f932c021440 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f932c021640 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 10 client.27218 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5619751640b0 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f932c0043c0 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f932c033030 con 0x561974d071b0 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 10 client.27218 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 10 client.27218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 20 client.27218 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974d30070 0x561975166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 4 client.27218 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.847+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56197504b8a0 con 0x561974d30070 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f9337fff640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974d30070 0x561975166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f9337fff640 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974d30070 0x561975166790 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c3632114374d0b server_cookie=bb4acfd4ebfcdfe0 in_seq=0 out_seq=0 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f93177fe640 10 client.27218 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f93177fe640 1 -- 172.21.15.38:0/1131751843 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56197504b8a0 con 0x561974d30070 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f93177fe640 10 client.27218 handle_command_reply: tid=0 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.848+0000 7f9344f0d740 1 client.27218 shutdown 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 msgr2=0x5619750eb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f932c023800 tx=0x7f932c023860 comp rx=0 tx=0).stop 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 shutdown_connections 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561974d0f390 0x5619751589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561974d071b0 0x5619750eb5e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561974d30070 0x561975166790 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 --2- 172.21.15.38:0/1131751843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561974cee9f0 0x5619750eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f93177fe640 0 client.27218 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 >> 172.21.15.38:0/1131751843 conn(0x561974d24460 msgr2=0x5619750e4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 shutdown_connections 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 1 -- 172.21.15.38:0/1131751843 wait complete. 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f9344f0d740 20 client.27218 trim_cache size 0 max 16384 2024-09-21T06:28:34.854 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 msgr2=0x7f93200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.849+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 0x7f93200b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f932c005d00 tx=0x7f932c005c90 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 msgr2=0x7f933819fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f933000eaa0 tx=0x7f933000ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 shutdown_connections 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93200b6680 0x7f93200b8b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9338109e20 0x7f933819fe50 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93381094d0 0x7f933819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 --2- 172.21.15.38:0/1129371435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9338103b90 0x7f933819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 >> 172.21.15.38:0/1129371435 conn(0x7f93380ff600 msgr2=0x7f9338108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 shutdown_connections 2024-09-21T06:28:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:34.850+0000 7f933e999640 1 -- 172.21.15.38:0/1129371435 wait complete. 2024-09-21T06:28:35.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:35 smithi038 ceph-mon[31215]: pgmap v592: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:28:35.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:35 smithi174 ceph-mon[34815]: pgmap v592: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:28:35.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:35 smithi044 ceph-mon[34369]: pgmap v592: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:28:36.494 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:28:36.494 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:28:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:37.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 -- 172.21.15.38:0/540386557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 msgr2=0x7fbb70102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 --2- 172.21.15.38:0/540386557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb70102ef0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009900 tx=0x7fbb6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:37.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 -- 172.21.15.38:0/540386557 shutdown_connections 2024-09-21T06:28:37.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 --2- 172.21.15.38:0/540386557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 0x7fbb7010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 --2- 172.21.15.38:0/540386557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb701087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 --2- 172.21.15.38:0/540386557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb70102ef0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 -- 172.21.15.38:0/540386557 >> 172.21.15.38:0/540386557 conn(0x7fbb70079760 msgr2=0x7fbb70079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 -- 172.21.15.38:0/540386557 shutdown_connections 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.245+0000 7fbb77e06640 1 -- 172.21.15.38:0/540386557 wait complete. 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 Processor -- start 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 -- start start 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb70199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 0x7fbb7019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70112b80 con 0x7fbb70102ae0 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70112a00 con 0x7fbb701083d0 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.246+0000 7fbb77e06640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70112d00 con 0x7fbb70108d20 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35906/0 (socket says 172.21.15.38:35906) 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 -- 172.21.15.38:0/2625540222 learned_addr learned my addr 172.21.15.38:0/2625540222 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:37.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb753a1640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb70199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb763a3640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 0x7fbb7019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 -- 172.21.15.38:0/2625540222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 msgr2=0x7fbb7019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 0x7fbb7019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 -- 172.21.15.38:0/2625540222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 msgr2=0x7fbb70199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb70199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 -- 172.21.15.38:0/2625540222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7019f380 con 0x7fbb70102ae0 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb753a1640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb70199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006010 tx=0x7fbb6c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb66ffd640 1 -- 172.21.15.38:0/2625540222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c03f070 con 0x7fbb70102ae0 2024-09-21T06:28:37.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb66ffd640 1 -- 172.21.15.38:0/2625540222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb6c031df0 con 0x7fbb70102ae0 2024-09-21T06:28:37.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7019f610 con 0x7fbb70102ae0 2024-09-21T06:28:37.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb66ffd640 1 -- 172.21.15.38:0/2625540222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c035030 con 0x7fbb70102ae0 2024-09-21T06:28:37.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.247+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701a5e90 con 0x7fbb70102ae0 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 Processor -- start 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 -- start start 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb66ffd640 1 -- 172.21.15.38:0/2625540222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbb6c042070 con 0x7fbb70102ae0 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df8631c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f54670 0x55df8631ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55df86292e60 con 0x55df85f75350 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55df86282290 con 0x55df85f54670 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.250+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55df862860a0 con 0x55df85f4c490 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35912/0 (socket says 172.21.15.38:35912) 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 -- 172.21.15.38:0/439497658 learned_addr learned my addr 172.21.15.38:0/439497658 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb753a1640 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f54670 0x55df8631ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df8631c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 -- 172.21.15.38:0/439497658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 msgr2=0x55df8631c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df8631c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 -- 172.21.15.38:0/439497658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f54670 msgr2=0x55df8631ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f54670 0x55df8631ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 -- 172.21.15.38:0/439497658 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df85fe0930 con 0x55df85f75350 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb66ffd640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 0x7fbb5c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb763a3640 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbb68007e50 tx=0x7fbb6800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b883415482d77a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.251+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 0x7fbb5c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.252+0000 7fbb5bfff640 1 -- 172.21.15.38:0/439497658 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68014070 con 0x55df85f75350 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.252+0000 7fbb66ffd640 1 -- 172.21.15.38:0/2625540222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbb6c1081a0 con 0x7fbb70102ae0 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.252+0000 7fbb5bfff640 1 -- 172.21.15.38:0/439497658 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb6800ee90 con 0x55df85f75350 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.252+0000 7fbb5bfff640 1 -- 172.21.15.38:0/439497658 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68005440 con 0x55df85f75350 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- 172.21.15.38:0/439497658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 msgr2=0x55df8631c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb75ba2640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 0x7fbb5c0b8bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c1059f0 tx=0x7fbb6c10bcf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbb68007e50 tx=0x7fbb6800e720 comp rx=0 tx=0).stop 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- 172.21.15.38:0/439497658 shutdown_connections 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f54670 0x55df8631ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df8631c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/439497658 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f75350 0x55df8631c430 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- 172.21.15.38:0/439497658 >> 172.21.15.38:0/439497658 conn(0x55df85f69740 msgr2=0x55df8631a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- 172.21.15.38:0/439497658 shutdown_connections 2024-09-21T06:28:37.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- 172.21.15.38:0/439497658 wait complete. 2024-09-21T06:28:37.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 -- start start 2024-09-21T06:28:37.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.253+0000 7fbb7e37a740 1 Processor -- start 2024-09-21T06:28:37.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86328000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86333f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55df860e3890 con 0x55df85f54670 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55df8621cd40 con 0x55df85f75350 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55df8632ac10 con 0x55df85f4c490 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb7e37a740 10 client.0 _ll_register_callbacks cb 0x55df86280c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35922/0 (socket says 172.21.15.38:35922) 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 -- 172.21.15.38:0/1549296080 learned_addr learned my addr 172.21.15.38:0/1549296080 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:37.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb763a3640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86328000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb763a3640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86333f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 -- 172.21.15.38:0/1549296080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 msgr2=0x55df86328000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86328000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 -- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 msgr2=0x55df86333f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86333f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.254+0000 7fbb753a1640 1 -- 172.21.15.38:0/1549296080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df863344f0 con 0x55df85f54670 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb753a1640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbb600126e0 tx=0x7fbb60012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805d18bbbe9367e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:37.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010dd0 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbb6001a3e0 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb6800ee90 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb6001a5e0 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb7e37a740 10 client.17886 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df86336e60 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb6800ee90 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbb60019070 con 0x55df85f54670 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.255+0000 7fbb7e37a740 10 client.17886 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb7e37a740 10 client.17886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb7e37a740 20 client.17886 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:37.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f33cd0 0x55df8633a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb7e37a740 4 client.17886 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df86294db0 con 0x55df85f33cd0 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb763a3640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f33cd0 0x55df8633a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb597fa640 10 client.17886 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.256+0000 7fbb763a3640 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f33cd0 0x55df8633a480 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffad880534c7fa7d server_cookie=c7b3d8adc1e0c7fc in_seq=0 out_seq=0 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.257+0000 7fbb597fa640 1 -- 172.21.15.38:0/1549296080 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df86294db0 con 0x55df85f33cd0 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.257+0000 7fbb597fa640 10 client.17886 handle_command_reply: tid=0 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.257+0000 7fbb7e37a740 1 client.17886 shutdown 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.257+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 msgr2=0x55df86328540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.257+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbb600126e0 tx=0x7fbb60012ba0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 shutdown_connections 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86333f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86328540 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f33cd0 0x55df8633a480 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/1549296080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86328000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb597fa640 0 client.17886 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 >> 172.21.15.38:0/1549296080 conn(0x55df85f69740 msgr2=0x55df8631f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 shutdown_connections 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 1 -- 172.21.15.38:0/1549296080 wait complete. 2024-09-21T06:28:37.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.258+0000 7fbb7e37a740 20 client.17886 trim_cache size 0 max 16384 2024-09-21T06:28:37.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.275+0000 7fbb7e37a740 1 Processor -- start 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.275+0000 7fbb7e37a740 1 -- start start 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.275+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86322550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86324ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701afd90 con 0x55df85f54670 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701ad660 con 0x55df85f75350 2024-09-21T06:28:37.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701ab4d0 con 0x55df85f4c490 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35924/0 (socket says 172.21.15.38:35924) 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 -- 172.21.15.38:0/794187016 learned_addr learned my addr 172.21.15.38:0/794187016 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb763a3640 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86322550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb763a3640 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86324ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 -- 172.21.15.38:0/794187016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 msgr2=0x55df86322550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86322550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 -- 172.21.15.38:0/794187016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 msgr2=0x55df86324ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86324ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 -- 172.21.15.38:0/794187016 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df86314520 con 0x55df85f54670 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb753a1640 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbb60007700 tx=0x7fbb60006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63c81b043dde8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.276+0000 7fbb5b7fe640 1 -- 172.21.15.38:0/794187016 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60028070 con 0x55df85f54670 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb5b7fe640 1 -- 172.21.15.38:0/794187016 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb600107b0 con 0x55df85f54670 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb5b7fe640 1 -- 172.21.15.38:0/794187016 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6001a9a0 con 0x55df85f54670 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 -- 172.21.15.38:0/794187016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 msgr2=0x55df86333e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbb60007700 tx=0x7fbb60006ab0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 -- 172.21.15.38:0/794187016 shutdown_connections 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f75350 0x55df86324ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df86333e00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/794187016 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f4c490 0x55df86322550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 -- 172.21.15.38:0/794187016 >> 172.21.15.38:0/794187016 conn(0x55df85f69740 msgr2=0x55df86326680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 -- 172.21.15.38:0/794187016 shutdown_connections 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.277+0000 7fbb7e37a740 1 -- 172.21.15.38:0/794187016 wait complete. 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 -- start start 2024-09-21T06:28:37.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 Processor -- start 2024-09-21T06:28:37.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 0x55df8632c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f75350 0x55df8632ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701abb20 con 0x55df85f54670 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701acf90 con 0x55df85f4c490 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701ac1f0 con 0x55df85f75350 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb7e37a740 10 client.0 _ll_register_callbacks cb 0x7fbb60007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.278+0000 7fbb753a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35934/0 (socket says 172.21.15.38:35934) 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 -- 172.21.15.38:0/3245761926 learned_addr learned my addr 172.21.15.38:0/3245761926 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:37.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb763a3640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f75350 0x55df8632ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb763a3640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 0x55df8632c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 -- 172.21.15.38:0/3245761926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f75350 msgr2=0x55df8632ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f75350 0x55df8632ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 -- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 msgr2=0x55df8632c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 0x55df8632c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 -- 172.21.15.38:0/3245761926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df863a83b0 con 0x55df85f54670 2024-09-21T06:28:37.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb763a3640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 0x55df8632c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb753a1640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001bbb0 tx=0x7fbb6001b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac146d7131eb335d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb597fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60028070 con 0x55df85f54670 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbb6001ab90 con 0x55df85f54670 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb600107b0 con 0x55df85f54670 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb6001a3e0 con 0x55df85f54670 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb7e37a740 10 client.17892 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:37.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.279+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df863a9670 con 0x55df85f54670 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb600107b0 con 0x55df85f54670 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbb60019070 con 0x55df85f54670 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 10 client.17892 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 10 client.17892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 20 client.17892 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f09080 0x55df863abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 4 client.17892 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:28:37.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55df86290860 con 0x55df85f09080 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.280+0000 7fbb763a3640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f09080 0x55df863abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.281+0000 7fbb763a3640 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f09080 0x55df863abcf0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a2626be74e09ef server_cookie=cb89909b3ac67f12 in_seq=0 out_seq=0 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.281+0000 7fbb597fa640 10 client.17892 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.282+0000 7fbb597fa640 1 -- 172.21.15.38:0/3245761926 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55df86290860 con 0x55df85f09080 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.282+0000 7fbb597fa640 10 client.17892 handle_command_reply: tid=0 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.282+0000 7fbb7e37a740 1 client.17892 shutdown 2024-09-21T06:28:37.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 msgr2=0x55df8632c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001bbb0 tx=0x7fbb6001b6f0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 shutdown_connections 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55df85f09080 0x55df863abcf0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df85f75350 0x55df8632ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55df85f54670 0x55df8632c540 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb597fa640 0 client.17892 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 --2- 172.21.15.38:0/3245761926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55df85f4c490 0x55df8632c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 >> 172.21.15.38:0/3245761926 conn(0x55df85f69740 msgr2=0x55df8631d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 shutdown_connections 2024-09-21T06:28:37.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 1 -- 172.21.15.38:0/3245761926 wait complete. 2024-09-21T06:28:37.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb7e37a740 20 client.17892 trim_cache size 0 max 16384 2024-09-21T06:28:37.294 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:37.294 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:28:37.295 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "1709a48e-fb32-45cb-a7dd-e37e839a45a5", 2024-09-21T06:28:37.295 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:28:37.295 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:37.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 msgr2=0x7fbb5c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 0x7fbb5c0b8bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c1059f0 tx=0x7fbb6c10bcf0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 msgr2=0x7fbb701994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.283+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c006010 tx=0x7fbb6c003d50 comp rx=0 tx=0).stop 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 shutdown_connections 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbb5c0b66b0 0x7fbb5c0b8bc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb70108d20 0x7fbb7019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb701083d0 0x7fbb70199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 --2- 172.21.15.38:0/2625540222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbb70102ae0 0x7fbb701994d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 >> 172.21.15.38:0/2625540222 conn(0x7fbb70079760 msgr2=0x7fbb701013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 shutdown_connections 2024-09-21T06:28:37.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:37.284+0000 7fbb77e06640 1 -- 172.21.15.38:0/2625540222 wait complete. 2024-09-21T06:28:37.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:37 smithi038 ceph-mon[31215]: pgmap v593: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:37.876 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:37.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:37 smithi174 ceph-mon[34815]: pgmap v593: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:37.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:37 smithi044 ceph-mon[34369]: pgmap v593: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:38.135 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:38.508 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:38 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:28:38.508 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:38 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.509 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:38 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:28:38.509 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:38 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.509 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:38 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 -- 172.21.15.38:0/578178255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae810de10 msgr2=0x7f8ae8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 --2- 172.21.15.38:0/578178255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae810de10 0x7f8ae8110300 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009ca0 tx=0x7f8ae002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 -- 172.21.15.38:0/578178255 shutdown_connections 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 --2- 172.21.15.38:0/578178255 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae810de10 0x7f8ae8110300 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 --2- 172.21.15.38:0/578178255 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae8105300 0x7f8ae810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 --2- 172.21.15.38:0/578178255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae81049b0 0x7f8ae8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 -- 172.21.15.38:0/578178255 >> 172.21.15.38:0/578178255 conn(0x7f8ae8079730 msgr2=0x7f8ae8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 -- 172.21.15.38:0/578178255 shutdown_connections 2024-09-21T06:28:38.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.601+0000 7f8aef992640 1 -- 172.21.15.38:0/578178255 wait complete. 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 Processor -- start 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 -- start start 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 0x7f8ae819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 0x7f8ae819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8113bd0 con 0x7f8ae81049b0 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8113a50 con 0x7f8ae8105300 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aef992640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae8113d50 con 0x7f8ae810de10 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aed72e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aed72e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35952/0 (socket says 172.21.15.38:35952) 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.602+0000 7f8aed72e640 1 -- 172.21.15.38:0/1884224638 learned_addr learned my addr 172.21.15.38:0/1884224638 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 0x7f8ae819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 0x7f8ae819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 -- 172.21.15.38:0/1884224638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 msgr2=0x7f8ae819fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 0x7f8ae819fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 -- 172.21.15.38:0/1884224638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 msgr2=0x7f8ae819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 0x7f8ae819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 -- 172.21.15.38:0/1884224638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae81a0590 con 0x7f8ae81049b0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 0x7f8ae819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 0x7f8ae819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400d950 tx=0x7f8ae400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8ade7fc640 1 -- 172.21.15.38:0/1884224638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4017020 con 0x7f8ae81049b0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8ade7fc640 1 -- 172.21.15.38:0/1884224638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ae4009c30 con 0x7f8ae81049b0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae81a0880 con 0x7f8ae81049b0 2024-09-21T06:28:38.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8ade7fc640 1 -- 172.21.15.38:0/1884224638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae400f740 con 0x7f8ae81049b0 2024-09-21T06:28:38.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.603+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae81a6fe0 con 0x7f8ae81049b0 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.606+0000 7f8af5f06740 1 Processor -- start 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.606+0000 7f8af5f06740 1 -- start start 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8ade7fc640 1 -- 172.21.15.38:0/1884224638 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8ae401a020 con 0x7f8ae81049b0 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836df4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836df50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b836d6ae50 con 0x55b836a4d070 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b836d5a280 con 0x55b836a2c390 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8af5f06740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b836d5e090 con 0x55b836a241b0 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35968/0 (socket says 172.21.15.38:35968) 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 -- 172.21.15.38:0/1651335765 learned_addr learned my addr 172.21.15.38:0/1651335765 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:38.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836df50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836df4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 -- 172.21.15.38:0/1651335765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 msgr2=0x55b836df4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836df4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 -- 172.21.15.38:0/1651335765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 msgr2=0x55b836df50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836df50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.607+0000 7f8aedf2f640 1 -- 172.21.15.38:0/1651335765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b836ab8650 con 0x55b836a4d070 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8ade7fc640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 0x7f8ad40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009880 tx=0x7f8ae00098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c14b7c4783f54a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 0x7f8ad40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8ade7fc640 1 -- 172.21.15.38:0/1884224638 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8ae40e75f0 con 0x7f8ae81049b0 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8ad37fe640 1 -- 172.21.15.38:0/1651335765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0031dc0 con 0x55b836a4d070 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8ad37fe640 1 -- 172.21.15.38:0/1651335765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ae003f070 con 0x55b836a4d070 2024-09-21T06:28:38.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.608+0000 7f8ad37fe640 1 -- 172.21.15.38:0/1651335765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00043c0 con 0x55b836a4d070 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- 172.21.15.38:0/1651335765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 msgr2=0x55b836df4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8aed72e640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 0x7f8ad40b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40e4e40 tx=0x7f8ae40ed550 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009880 tx=0x7f8ae00098b0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- 172.21.15.38:0/1651335765 shutdown_connections 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836df50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836df4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 --2- 172.21.15.38:0/1651335765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df4650 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- 172.21.15.38:0/1651335765 >> 172.21.15.38:0/1651335765 conn(0x55b836a41460 msgr2=0x55b836df2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- 172.21.15.38:0/1651335765 shutdown_connections 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- 172.21.15.38:0/1651335765 wait complete. 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.609+0000 7f8af5f06740 1 -- start start 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 Processor -- start 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836e04130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836e04670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b836bbb700 con 0x55b836a4d070 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b836cf5110 con 0x55b836a2c390 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b836e07100 con 0x55b836a241b0 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8af5f06740 10 client.0 _ll_register_callbacks cb 0x55b836d0e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35972/0 (socket says 172.21.15.38:35972) 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8aedf2f640 1 -- 172.21.15.38:0/448724130 learned_addr learned my addr 172.21.15.38:0/448724130 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:38.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836e04130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.610+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836e04670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 -- 172.21.15.38:0/448724130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 msgr2=0x55b836e04130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836e04130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 -- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 msgr2=0x55b836e04670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836e04670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 -- 172.21.15.38:0/448724130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b836d22c40 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x55b836e06980 tx=0x7f8ae0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f8ce394973c6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8ad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae004d040 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8ae0003da0 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ae003f070 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8ae0004140 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8af5f06740 10 client.17904 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.611+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b836e12e90 con 0x55b836a4d070 2024-09-21T06:28:38.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ae003f070 con 0x55b836a4d070 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8ae002fcb0 con 0x55b836a4d070 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 10 client.17904 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 10 client.17904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 20 client.17904 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b836a0b9f0 0x55b836e161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 4 client.17904 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b836d6cda0 con 0x55b836a0b9f0 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.612+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b836a0b9f0 0x55b836e161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.613+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b836a0b9f0 0x55b836e161f0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b327ea5f367b6311 server_cookie=30f2559ea7dd90d2 in_seq=0 out_seq=0 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.613+0000 7f8ad0ff9640 10 client.17904 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.613+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/448724130 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b836d6cda0 con 0x55b836a0b9f0 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.613+0000 7f8ad0ff9640 10 client.17904 handle_command_reply: tid=0 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.613+0000 7f8af5f06740 1 client.17904 shutdown 2024-09-21T06:28:38.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 msgr2=0x55b836e10460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x55b836e06980 tx=0x7f8ae0031a20 comp rx=0 tx=0).stop 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 shutdown_connections 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e10460 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a2c390 0x55b836e04670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b836a0b9f0 0x55b836e161f0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 --2- 172.21.15.38:0/448724130 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a241b0 0x55b836e04130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8ad0ff9640 0 client.17904 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 >> 172.21.15.38:0/448724130 conn(0x55b836a41460 msgr2=0x55b836df77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 shutdown_connections 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 1 -- 172.21.15.38:0/448724130 wait complete. 2024-09-21T06:28:38.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.614+0000 7f8af5f06740 20 client.17904 trim_cache size 0 max 16384 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.631+0000 7f8af5f06740 1 Processor -- start 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 -- start start 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e06120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836df1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81afe10 con 0x55b836a4d070 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ad6e0 con 0x55b836a241b0 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8af5f06740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ab550 con 0x55b836a2c390 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35976/0 (socket says 172.21.15.38:35976) 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 -- 172.21.15.38:0/578280311 learned_addr learned my addr 172.21.15.38:0/578280311 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e06120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 -- 172.21.15.38:0/578280311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 msgr2=0x55b836df1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836df1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 -- 172.21.15.38:0/578280311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 msgr2=0x55b836e06120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e06120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 -- 172.21.15.38:0/578280311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b836df7450 con 0x55b836a4d070 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.632+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0033ff0 tx=0x7f8ae003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d768d452ec8b47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8ad2ffd640 1 -- 172.21.15.38:0/578280311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0031760 con 0x55b836a4d070 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8ad2ffd640 1 -- 172.21.15.38:0/578280311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ae003f040 con 0x55b836a4d070 2024-09-21T06:28:38.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8ad2ffd640 1 -- 172.21.15.38:0/578280311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0004da0 con 0x55b836a4d070 2024-09-21T06:28:38.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 -- 172.21.15.38:0/578280311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 msgr2=0x55b836df20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0033ff0 tx=0x7f8ae003d040 comp rx=0 tx=0).stop 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 -- 172.21.15.38:0/578280311 shutdown_connections 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836df20b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836df1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 --2- 172.21.15.38:0/578280311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e06120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 -- 172.21.15.38:0/578280311 >> 172.21.15.38:0/578280311 conn(0x55b836a41460 msgr2=0x55b836df6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 -- 172.21.15.38:0/578280311 shutdown_connections 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.633+0000 7f8af5f06740 1 -- 172.21.15.38:0/578280311 wait complete. 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 -- start start 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 Processor -- start 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836e16fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81abba0 con 0x55b836a4d070 2024-09-21T06:28:38.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ad010 con 0x55b836a241b0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81ac270 con 0x55b836a2c390 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.634+0000 7f8af5f06740 10 client.0 _ll_register_callbacks cb 0x7f8ad800c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35984/0 (socket says 172.21.15.38:35984) 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 -- 172.21.15.38:0/431619257 learned_addr learned my addr 172.21.15.38:0/431619257 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836e16fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 -- 172.21.15.38:0/431619257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 msgr2=0x55b836e16fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836e16fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 -- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 msgr2=0x55b836e19b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e19b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 -- 172.21.15.38:0/431619257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b836e17d90 con 0x55b836a4d070 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8aedf2f640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0031ae0 tx=0x7f8ae0003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dfc5a2acd2a30d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:38.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8ad0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0063060 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8ae0004d50 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.635+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ae003f040 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8ae0009880 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 10 client.17910 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b836e809c0 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ae003f040 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8ae002f710 con 0x55b836a4d070 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 10 client.17910 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 10 client.17910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 20 client.17910 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:38.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b8369e0da0 0x55b836e82ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 4 client.17910 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b836d68850 con 0x55b8369e0da0 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.636+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b8369e0da0 0x55b836e82ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8aecf2d640 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b8369e0da0 0x55b836e82ea0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc572c118cc38688 server_cookie=78f23af6ea3334b4 in_seq=0 out_seq=0 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8ad0ff9640 10 client.17910 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8ad0ff9640 1 -- 172.21.15.38:0/431619257 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x55b836d68850 con 0x55b8369e0da0 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8ad0ff9640 10 client.17910 handle_command_reply: tid=0 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 client.17910 shutdown 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 msgr2=0x55b836e17600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0031ae0 tx=0x7f8ae0003d20 comp rx=0 tx=0).stop 2024-09-21T06:28:38.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 shutdown_connections 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b836a4d070 0x55b836e17600 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55b8369e0da0 0x55b836e82ea0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b836a2c390 0x55b836e16fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 --2- 172.21.15.38:0/431619257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b836a241b0 0x55b836e19b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 >> 172.21.15.38:0/431619257 conn(0x55b836a41460 msgr2=0x55b836df6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.637+0000 7f8ad0ff9640 0 client.17910 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 shutdown_connections 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8af5f06740 1 -- 172.21.15.38:0/431619257 wait complete. 2024-09-21T06:28:38.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8af5f06740 20 client.17910 trim_cache size 0 max 16384 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:28:38.645 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.647 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.648 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.649 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:28:38.650 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:28:38.651 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.652 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.653 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.655 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:38.656 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 msgr2=0x7f8ad40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 0x7f8ad40b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40e4e40 tx=0x7f8ae40ed550 comp rx=0 tx=0).stop 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 msgr2=0x7f8ae819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.638+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400d950 tx=0x7f8ae400de10 comp rx=0 tx=0).stop 2024-09-21T06:28:38.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 shutdown_connections 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8ad40b6700 0x7f8ad40b8c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae810de10 0x7f8ae819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ae8105300 0x7f8ae819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 --2- 172.21.15.38:0/1884224638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ae81049b0 0x7f8ae819a620 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 >> 172.21.15.38:0/1884224638 conn(0x7f8ae8079730 msgr2=0x7f8ae8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 shutdown_connections 2024-09-21T06:28:38.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:38.639+0000 7f8aef992640 1 -- 172.21.15.38:0/1884224638 wait complete. 2024-09-21T06:28:38.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:38 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:28:38.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:38 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:38 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:28:38.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:38 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:38 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:28:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:38 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:28:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:38 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:38 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:28:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:38 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:38.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:38 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:28:39.415 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:39.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:39.676 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:39.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:39 smithi038 ceph-mon[31215]: pgmap v594: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:39.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:39 smithi174 ceph-mon[34815]: pgmap v594: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:39.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:39 smithi044 ceph-mon[34369]: pgmap v594: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 -- 172.21.15.38:0/3644609101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 msgr2=0x7f7dbc110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/3644609101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc110640 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009900 tx=0x7f7db402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 -- 172.21.15.38:0/3644609101 shutdown_connections 2024-09-21T06:28:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/3644609101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc110640 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/3644609101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc1094c0 0x7f7dbc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/3644609101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc103b80 0x7f7dbc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 -- 172.21.15.38:0/3644609101 >> 172.21.15.38:0/3644609101 conn(0x7f7dbc0ff610 msgr2=0x7f7dbc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:40.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 -- 172.21.15.38:0/3644609101 shutdown_connections 2024-09-21T06:28:40.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.134+0000 7f7dc0b23640 1 -- 172.21.15.38:0/3644609101 wait complete. 2024-09-21T06:28:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 Processor -- start 2024-09-21T06:28:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 -- start start 2024-09-21T06:28:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc103b80 0x7f7dbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:40.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc1094c0 0x7f7dbc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc113c70 con 0x7f7dbc109e10 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc113af0 con 0x7f7dbc103b80 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.135+0000 7f7dc0b23640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc113df0 con 0x7f7dbc1094c0 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35424/0 (socket says 172.21.15.38:35424) 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 -- 172.21.15.38:0/1555630400 learned_addr learned my addr 172.21.15.38:0/1555630400 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dba59c640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc103b80 0x7f7dbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7db9d9b640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc1094c0 0x7f7dbc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 -- 172.21.15.38:0/1555630400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc1094c0 msgr2=0x7f7dbc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc1094c0 0x7f7dbc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 -- 172.21.15.38:0/1555630400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc103b80 msgr2=0x7f7dbc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc103b80 0x7f7dbc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 -- 172.21.15.38:0/1555630400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc1a8860 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dbad9d640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005ab0 tx=0x7f7db40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db403f030 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7db4003cd0 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4035070 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.136+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc1a8af0 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.137+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc1a9020 con 0x7f7dbc109e10 2024-09-21T06:28:40.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.137+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc104e00 con 0x7f7dbc109e10 2024-09-21T06:28:40.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.140+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7db4042030 con 0x7f7dbc109e10 2024-09-21T06:28:40.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.141+0000 7f7dab7fe640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 0x7f7da40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:40.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.141+0000 7f7dba59c640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 0x7f7da40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:40.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.141+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f7db41080f0 con 0x7f7dbc109e10 2024-09-21T06:28:40.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.141+0000 7f7dba59c640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 0x7f7da40b8c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc077160 tx=0x7f7dac009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:40.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.144+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7db40ce630 con 0x7f7dbc109e10 2024-09-21T06:28:40.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.368+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dbc076a10 con 0x7f7dbc109e10 2024-09-21T06:28:40.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.368+0000 7f7dab7fe640 1 -- 172.21.15.38:0/1555630400 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f7db40d2a10 con 0x7f7dbc109e10 2024-09-21T06:28:40.370 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:28:40.370 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:28:40.370 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:28:40.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.370+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 msgr2=0x7f7da40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.370+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 0x7f7da40b8c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc077160 tx=0x7f7dac009680 comp rx=0 tx=0).stop 2024-09-21T06:28:40.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 msgr2=0x7f7dbc076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7db4005ab0 tx=0x7f7db40042f0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 shutdown_connections 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7da40b6700 0x7f7da40b8c10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dbc109e10 0x7f7dbc076190 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dbc1094c0 0x7f7dbc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 --2- 172.21.15.38:0/1555630400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dbc103b80 0x7f7dbc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 >> 172.21.15.38:0/1555630400 conn(0x7f7dbc0ff610 msgr2=0x7f7dbc108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 shutdown_connections 2024-09-21T06:28:40.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:40.371+0000 7f7dc0b23640 1 -- 172.21.15.38:0/1555630400 wait complete. 2024-09-21T06:28:40.722 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:40 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1555630400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:40.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:40 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1555630400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:40.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:40 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1555630400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:41.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:28:41.276 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:41.701 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:41 smithi038 ceph-mon[31215]: pgmap v595: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 -- 172.21.15.38:0/373196349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 msgr2=0x7f13381087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 --2- 172.21.15.38:0/373196349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f13381087d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1320009900 tx=0x7f132002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 -- 172.21.15.38:0/373196349 shutdown_connections 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 --2- 172.21.15.38:0/373196349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338108d10 0x7f133810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 --2- 172.21.15.38:0/373196349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f13381087d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 --2- 172.21.15.38:0/373196349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338102a80 0x7f1338102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 -- 172.21.15.38:0/373196349 >> 172.21.15.38:0/373196349 conn(0x7f1338079740 msgr2=0x7f1338079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 -- 172.21.15.38:0/373196349 shutdown_connections 2024-09-21T06:28:41.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.726+0000 7f133e947640 1 -- 172.21.15.38:0/373196349 wait complete. 2024-09-21T06:28:41.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.727+0000 7f133e947640 1 Processor -- start 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.727+0000 7f133e947640 1 -- start start 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102a80 0x7f133819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338108d10 0x7f133819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112aa0 con 0x7f13381083c0 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112920 con 0x7f1338102a80 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133e947640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1338112c20 con 0x7f1338108d10 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35446/0 (socket says 172.21.15.38:35446) 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 -- 172.21.15.38:0/2135722179 learned_addr learned my addr 172.21.15.38:0/2135722179 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f1337fff640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102a80 0x7f133819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f133cee4640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338108d10 0x7f133819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 -- 172.21.15.38:0/2135722179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338108d10 msgr2=0x7f133819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338108d10 0x7f133819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 -- 172.21.15.38:0/2135722179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102a80 msgr2=0x7f133819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102a80 0x7f133819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 -- 172.21.15.38:0/2135722179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13381a6560 con 0x7f13381083c0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f132ffff640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1320005940 tx=0x7f1320004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.728+0000 7f1335ffb640 1 -- 172.21.15.38:0/2135722179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132003f030 con 0x7f13381083c0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.729+0000 7f1335ffb640 1 -- 172.21.15.38:0/2135722179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1320003cd0 con 0x7f13381083c0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.729+0000 7f1335ffb640 1 -- 172.21.15.38:0/2135722179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320035070 con 0x7f13381083c0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.729+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381a67f0 con 0x7f13381083c0 2024-09-21T06:28:41.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.729+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13381a6d20 con 0x7f13381083c0 2024-09-21T06:28:41.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.731+0000 7f1344ebb740 1 Processor -- start 2024-09-21T06:28:41.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.731+0000 7f1344ebb740 1 -- start start 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1335ffb640 1 -- 172.21.15.38:0/2135722179 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1320042030 con 0x7f13381083c0 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccac76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccac8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0cca3dea0 con 0x55d0cc6f71b0 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d0cca2d2d0 con 0x55d0cc720070 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1344ebb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d0cca310e0 con 0x55d0cc6ff390 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35454/0 (socket says 172.21.15.38:35454) 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 -- 172.21.15.38:0/372668261 learned_addr learned my addr 172.21.15.38:0/372668261 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f133cee4640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccac76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f132ffff640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccac8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 -- 172.21.15.38:0/372668261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 msgr2=0x55d0ccac8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccac8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 -- 172.21.15.38:0/372668261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 msgr2=0x55d0ccac76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccac76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f1337fff640 1 -- 172.21.15.38:0/372668261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0cc78b650 con 0x55d0cc6f71b0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.732+0000 7f133cee4640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccac76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f1337fff640 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f132800ac80 tx=0x7f132800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83e67a2f115cc6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f1335ffb640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 0x7f13240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f133cee4640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 0x7f13240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f132e7fc640 1 -- 172.21.15.38:0/372668261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132801d070 con 0x55d0cc6f71b0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f132e7fc640 1 -- 172.21.15.38:0/372668261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1328018b10 con 0x55d0cc6f71b0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f132e7fc640 1 -- 172.21.15.38:0/372668261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328010bf0 con 0x55d0cc6f71b0 2024-09-21T06:28:41.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.733+0000 7f1335ffb640 1 -- 172.21.15.38:0/2135722179 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1320107d60 con 0x7f13381083c0 2024-09-21T06:28:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- 172.21.15.38:0/372668261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 msgr2=0x55d0ccac7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f133cee4640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 0x7f13240b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1330011490 tx=0x7f13300085f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f132800ac80 tx=0x7f132800f790 comp rx=0 tx=0).stop 2024-09-21T06:28:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- 172.21.15.38:0/372668261 shutdown_connections 2024-09-21T06:28:41.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccac8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccac7be0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 --2- 172.21.15.38:0/372668261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccac76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- 172.21.15.38:0/372668261 >> 172.21.15.38:0/372668261 conn(0x55d0cc714460 msgr2=0x55d0ccac5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- 172.21.15.38:0/372668261 shutdown_connections 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- 172.21.15.38:0/372668261 wait complete. 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.734+0000 7f1344ebb740 1 -- start start 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 Processor -- start 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccad3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccadf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d0cc88e700 con 0x55d0cc6f71b0 2024-09-21T06:28:41.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d0cc9c8160 con 0x55d0cc720070 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d0ccad5e80 con 0x55d0cc6ff390 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1344ebb740 10 client.0 _ll_register_callbacks cb 0x55d0cc9e19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1337fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35468/0 (socket says 172.21.15.38:35468) 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f1337fff640 1 -- 172.21.15.38:0/332423141 learned_addr learned my addr 172.21.15.38:0/332423141 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f133cee4640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccadf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.735+0000 7f132ffff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccad3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 -- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 msgr2=0x55d0ccad3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccad3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 -- 172.21.15.38:0/332423141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 msgr2=0x55d0ccadf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccadf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 -- 172.21.15.38:0/332423141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0cc9f5c90 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1337fff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f132800a560 tx=0x7f1328018ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba49ed97ae0fe71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f13177fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328027020 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1328010e00 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1328018b10 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1328032050 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1344ebb740 10 client.17928 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.736+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d0ccae1b90 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1328018b10 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13280046c0 con 0x55d0cc6f71b0 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 10 client.17928 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:41.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 10 client.17928 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 20 client.17928 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6de9f0 0x55d0ccae4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 4 client.17928 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0cca3fdf0 con 0x55d0cc6de9f0 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.737+0000 7f132ffff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6de9f0 0x55d0ccae4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.738+0000 7f132ffff640 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6de9f0 0x55d0ccae4fa0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9ce6926757c781f server_cookie=84103aaa7ab98e7 in_seq=0 out_seq=0 2024-09-21T06:28:41.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.738+0000 7f13177fe640 10 client.17928 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:41.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.738+0000 7f13177fe640 1 -- 172.21.15.38:0/332423141 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0cca3fdf0 con 0x55d0cc6de9f0 2024-09-21T06:28:41.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.738+0000 7f13177fe640 10 client.17928 handle_command_reply: tid=0 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.738+0000 7f1344ebb740 1 client.17928 shutdown 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 msgr2=0x55d0ccad2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f132800a560 tx=0x7f1328018ed0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 shutdown_connections 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6de9f0 0x55d0ccae4fa0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccadf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6ff390 0x55d0ccad3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 --2- 172.21.15.38:0/332423141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad2dc0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 >> 172.21.15.38:0/332423141 conn(0x55d0cc714460 msgr2=0x55d0ccaca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f13177fe640 0 client.17928 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 shutdown_connections 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 1 -- 172.21.15.38:0/332423141 wait complete. 2024-09-21T06:28:41.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.739+0000 7f1344ebb740 20 client.17928 trim_cache size 0 max 16384 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.752+0000 7f1344ebb740 1 Processor -- start 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.752+0000 7f1344ebb740 1 -- start start 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc720070 0x55d0ccacffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13381b1ec0 con 0x55d0cc6ff390 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13381af790 con 0x55d0cc6f71b0 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1344ebb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13381ad600 con 0x55d0cc720070 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f1337fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35476/0 (socket says 172.21.15.38:35476) 2024-09-21T06:28:41.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 -- 172.21.15.38:0/1583813810 learned_addr learned my addr 172.21.15.38:0/1583813810 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f133cee4640 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc720070 0x55d0ccacffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 -- 172.21.15.38:0/1583813810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc720070 msgr2=0x55d0ccacffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc720070 0x55d0ccacffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 -- 172.21.15.38:0/1583813810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc6f71b0 msgr2=0x55d0ccad1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 -- 172.21.15.38:0/1583813810 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ccad3c50 con 0x55d0cc6ff390 2024-09-21T06:28:41.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132ffff640 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1320105b00 tx=0x7f132010a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6682a5707c98a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.753+0000 7f132dffb640 1 -- 172.21.15.38:0/1583813810 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320049040 con 0x55d0cc6ff390 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f132dffb640 1 -- 172.21.15.38:0/1583813810 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1320005de0 con 0x55d0cc6ff390 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f132dffb640 1 -- 172.21.15.38:0/1583813810 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13200ce300 con 0x55d0cc6ff390 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 -- 172.21.15.38:0/1583813810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 msgr2=0x55d0ccacaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1320105b00 tx=0x7f132010a270 comp rx=0 tx=0).stop 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 -- 172.21.15.38:0/1583813810 shutdown_connections 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc720070 0x55d0ccacffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccacaeb0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1583813810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc6f71b0 0x55d0ccad1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 -- 172.21.15.38:0/1583813810 >> 172.21.15.38:0/1583813810 conn(0x55d0cc714460 msgr2=0x55d0ccaca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 -- 172.21.15.38:0/1583813810 shutdown_connections 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.754+0000 7f1344ebb740 1 -- 172.21.15.38:0/1583813810 wait complete. 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 -- start start 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 Processor -- start 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6f71b0 0x55d0ccae6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccae6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f13381adc50 con 0x55d0cc6ff390 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13381af0c0 con 0x55d0cc720070 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.755+0000 7f1344ebb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13381ae320 con 0x55d0cc6f71b0 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f1344ebb740 10 client.0 _ll_register_callbacks cb 0x7f132801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35492/0 (socket says 172.21.15.38:35492) 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 -- 172.21.15.38:0/1338996067 learned_addr learned my addr 172.21.15.38:0/1338996067 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f1337fff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6f71b0 0x55d0ccae6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f133cee4640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccae6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 -- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6f71b0 msgr2=0x55d0ccae6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6f71b0 0x55d0ccae6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 -- 172.21.15.38:0/1338996067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 msgr2=0x55d0ccae6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccae6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 -- 172.21.15.38:0/1338996067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ccb4e7f0 con 0x55d0cc6ff390 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f133cee4640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccae6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f132ffff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f13200cdb90 tx=0x7f132002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6129a52665c3f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f13177fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320049030 con 0x55d0cc6ff390 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f132003bcc0 con 0x55d0cc6ff390 2024-09-21T06:28:41.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.756+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0ccac09e0 con 0x55d0cc6ff390 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13200cd550 con 0x55d0cc6ff390 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 10 client.17934 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d0ccb4fa70 con 0x55d0cc6ff390 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55d0ccac09e0 con 0x55d0cc6ff390 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13200f10b0 con 0x55d0cc6ff390 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 10 client.17934 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 10 client.17934 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 20 client.17934 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6b3da0 0x55d0ccb52040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 4 client.17934 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0cca3b8a0 con 0x55d0cc6b3da0 2024-09-21T06:28:41.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.757+0000 7f1337fff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6b3da0 0x55d0ccb52040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f13177fe640 10 client.17934 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:41.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1337fff640 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6b3da0 0x55d0ccb52040 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c117a7a8ebb7bf2 server_cookie=330c9aca34db15b3 in_seq=0 out_seq=0 2024-09-21T06:28:41.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f13177fe640 1 -- 172.21.15.38:0/1338996067 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0cca3b8a0 con 0x55d0cc6b3da0 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f13177fe640 10 client.17934 handle_command_reply: tid=0 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 client.17934 shutdown 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 msgr2=0x55d0ccae65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f13200cdb90 tx=0x7f132002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 shutdown_connections 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55d0cc6b3da0 0x55d0ccb52040 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d0cc720070 0x55d0ccae6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d0cc6ff390 0x55d0ccae65d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 --2- 172.21.15.38:0/1338996067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0cc6f71b0 0x55d0ccae6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 >> 172.21.15.38:0/1338996067 conn(0x55d0cc714460 msgr2=0x55d0ccac86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f13177fe640 0 client.17934 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 shutdown_connections 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.758+0000 7f1344ebb740 1 -- 172.21.15.38:0/1338996067 wait complete. 2024-09-21T06:28:41.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f1344ebb740 20 client.17934 trim_cache size 0 max 16384 2024-09-21T06:28:41.765 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:41.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 msgr2=0x7f13240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 0x7f13240b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1330011490 tx=0x7f13300085f0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 msgr2=0x7f133819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1320005940 tx=0x7f1320004360 comp rx=0 tx=0).stop 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 shutdown_connections 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f13240b6700 0x7f13240b8c10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1338108d10 0x7f133819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f13381083c0 0x7f133819b870 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 --2- 172.21.15.38:0/2135722179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1338102a80 0x7f133819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 >> 172.21.15.38:0/2135722179 conn(0x7f1338079740 msgr2=0x7f13381043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 shutdown_connections 2024-09-21T06:28:41.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:41.759+0000 7f133e947640 1 -- 172.21.15.38:0/2135722179 wait complete. 2024-09-21T06:28:41.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:41 smithi174 ceph-mon[34815]: pgmap v595: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:41.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:41 smithi044 ceph-mon[34369]: pgmap v595: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:42.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:28:42.701 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 -- 172.21.15.38:0/2782280876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c102a80 msgr2=0x7f7c4c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 --2- 172.21.15.38:0/2782280876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c102a80 0x7f7c4c102e90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009900 tx=0x7f7c3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 -- 172.21.15.38:0/2782280876 shutdown_connections 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 --2- 172.21.15.38:0/2782280876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c108d10 0x7f7c4c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 --2- 172.21.15.38:0/2782280876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c1083c0 0x7f7c4c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 --2- 172.21.15.38:0/2782280876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c102a80 0x7f7c4c102e90 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 -- 172.21.15.38:0/2782280876 >> 172.21.15.38:0/2782280876 conn(0x7f7c4c079740 msgr2=0x7f7c4c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 -- 172.21.15.38:0/2782280876 shutdown_connections 2024-09-21T06:28:43.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.185+0000 7f7c51f60640 1 -- 172.21.15.38:0/2782280876 wait complete. 2024-09-21T06:28:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 Processor -- start 2024-09-21T06:28:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 -- start start 2024-09-21T06:28:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c102a80 0x7f7c4c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c1083c0 0x7f7c4c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c112ac0 con 0x7f7c4c108d10 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c112940 con 0x7f7c4c1083c0 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c51f60640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c112c40 con 0x7f7c4c102a80 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35508/0 (socket says 172.21.15.38:35508) 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c4bfff640 1 -- 172.21.15.38:0/362033062 learned_addr learned my addr 172.21.15.38:0/362033062 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.186+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c102a80 0x7f7c4c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4affd640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c1083c0 0x7f7c4c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 -- 172.21.15.38:0/362033062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c102a80 msgr2=0x7f7c4c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c102a80 0x7f7c4c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 -- 172.21.15.38:0/362033062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c1083c0 msgr2=0x7f7c4c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c1083c0 0x7f7c4c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 -- 172.21.15.38:0/362033062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1a6640 con 0x7f7c4c108d10 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400eaa0 tx=0x7f7c4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c48ff9640 1 -- 172.21.15.38:0/362033062 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400cdb0 con 0x7f7c4c108d10 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1a6930 con 0x7f7c4c108d10 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c48ff9640 1 -- 172.21.15.38:0/362033062 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c44005020 con 0x7f7c4c108d10 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c48ff9640 1 -- 172.21.15.38:0/362033062 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c440116d0 con 0x7f7c4c108d10 2024-09-21T06:28:43.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.187+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a6e20 con 0x7f7c4c108d10 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 Processor -- start 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c48ff9640 1 -- 172.21.15.38:0/362033062 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7c440051d0 con 0x7f7c4c108d10 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 -- start start 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b5e070 0x5615a1f052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f05d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5615a1e7bea0 con 0x5615a1b351b0 2024-09-21T06:28:43.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5615a1e6b2d0 con 0x5615a1b3d390 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c584d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5615a1e6f0e0 con 0x5615a1b5e070 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.190+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35518/0 (socket says 172.21.15.38:35518) 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b5e070 0x5615a1f052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/1668438801 learned_addr learned my addr 172.21.15.38:0/1668438801 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:43.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4affd640 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f05d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c48ff9640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 0x7f7c340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/1668438801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b5e070 msgr2=0x5615a1f052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b5e070 0x5615a1f052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/1668438801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 msgr2=0x5615a1f05d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f05d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/1668438801 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a1bc9650 con 0x5615a1b351b0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 0x7f7c340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c48ff9640 1 -- 172.21.15.38:0/362033062 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f7c440e78c0 con 0x7f7c4c108d10 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.191+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c02a930 tx=0x7f7c3c031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4803422e7bcffbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c31ffb640 1 -- 172.21.15.38:0/1668438801 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c040070 con 0x5615a1b351b0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c31ffb640 1 -- 172.21.15.38:0/1668438801 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c3c004020 con 0x5615a1b351b0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c31ffb640 1 -- 172.21.15.38:0/1668438801 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c035040 con 0x5615a1b351b0 2024-09-21T06:28:43.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c584d4740 1 -- 172.21.15.38:0/1668438801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 msgr2=0x5615a1f05800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c02a930 tx=0x7f7c3c031bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.192+0000 7f7c4bfff640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 0x7f7c340b8bc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009270 tx=0x7f7c44058e10 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 -- 172.21.15.38:0/1668438801 shutdown_connections 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f05d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b351b0 0x5615a1f05800 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1668438801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b5e070 0x5615a1f052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 -- 172.21.15.38:0/1668438801 >> 172.21.15.38:0/1668438801 conn(0x5615a1b52460 msgr2=0x5615a1f031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 -- 172.21.15.38:0/1668438801 shutdown_connections 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 -- 172.21.15.38:0/1668438801 wait complete. 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 -- start start 2024-09-21T06:28:43.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.193+0000 7f7c584d4740 1 Processor -- start 2024-09-21T06:28:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b351b0 0x5615a1f108e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f10e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5615a1ccc700 con 0x5615a1b5e070 2024-09-21T06:28:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5615a1e06160 con 0x5615a1b3d390 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5615a1f13a40 con 0x5615a1b351b0 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c584d4740 10 client.0 _ll_register_callbacks cb 0x5615a1e1f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35530/0 (socket says 172.21.15.38:35530) 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f10e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4affd640 1 -- 172.21.15.38:0/2299249112 learned_addr learned my addr 172.21.15.38:0/2299249112 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4affd640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b351b0 0x5615a1f108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/2299249112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b351b0 msgr2=0x5615a1f108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b351b0 0x5615a1f108e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/2299249112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 msgr2=0x5615a1f11360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 -- 172.21.15.38:0/2299249112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a1e33c90 con 0x5615a1b3d390 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4affd640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:43.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f10e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5615a1f03f40 tx=0x7f7c3c005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b3cd671618ddcf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.194+0000 7f7c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c040030 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f7c3c031510 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c3c004020 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c3c056050 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c584d4740 10 client.27281 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5615a1f1f680 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c3c004020 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.195+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c3c004780 con 0x5615a1b3d390 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 10 client.27281 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 10 client.27281 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 20 client.27281 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b1c9f0 0x5615a1f229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 4 client.27281 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:43.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615a1e7ddf0 con 0x5615a1b1c9f0 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c4affd640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b1c9f0 0x5615a1f229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c4affd640 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b1c9f0 0x5615a1f229e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7b70af68588bc83 server_cookie=c6170e3a8ef56817 in_seq=0 out_seq=0 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.196+0000 7f7c2affd640 10 client.27281 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c2affd640 1 -- 172.21.15.38:0/2299249112 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615a1e7ddf0 con 0x5615a1b1c9f0 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c2affd640 10 client.27281 handle_command_reply: tid=0 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c584d4740 1 client.27281 shutdown 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 msgr2=0x5615a1f10e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f10e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5615a1f03f40 tx=0x7f7c3c005e60 comp rx=0 tx=0).stop 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.197+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 shutdown_connections 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b1c9f0 0x5615a1f229e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b5e070 0x5615a1f11360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b3d390 0x5615a1f10e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c2affd640 0 client.27281 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 --2- 172.21.15.38:0/2299249112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b351b0 0x5615a1f108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 >> 172.21.15.38:0/2299249112 conn(0x5615a1b52460 msgr2=0x5615a1f08450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 shutdown_connections 2024-09-21T06:28:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 1 -- 172.21.15.38:0/2299249112 wait complete. 2024-09-21T06:28:43.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.198+0000 7f7c584d4740 20 client.27281 trim_cache size 0 max 16384 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 Processor -- start 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 -- start start 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f0e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b3d390 0x5615a1f062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1b1f40 con 0x5615a1b1c9f0 2024-09-21T06:28:43.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1af810 con 0x5615a1b351b0 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c584d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1ad680 con 0x5615a1b3d390 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35540/0 (socket says 172.21.15.38:35540) 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 -- 172.21.15.38:0/3223221620 learned_addr learned my addr 172.21.15.38:0/3223221620 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f0e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 -- 172.21.15.38:0/3223221620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b3d390 msgr2=0x5615a1f062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b3d390 0x5615a1f062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 -- 172.21.15.38:0/3223221620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 msgr2=0x5615a1f0e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f0e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4affd640 1 -- 172.21.15.38:0/3223221620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a1f13660 con 0x5615a1b1c9f0 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.211+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f0e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:43.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.212+0000 7f7c4affd640 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c540 tx=0x7f7c40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96a36b4b2b5ded3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.212+0000 7f7c317fa640 1 -- 172.21.15.38:0/3223221620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40005220 con 0x5615a1b1c9f0 2024-09-21T06:28:43.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.212+0000 7f7c317fa640 1 -- 172.21.15.38:0/3223221620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c400047a0 con 0x5615a1b1c9f0 2024-09-21T06:28:43.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.212+0000 7f7c317fa640 1 -- 172.21.15.38:0/3223221620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000f8d0 con 0x5615a1b1c9f0 2024-09-21T06:28:43.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- 172.21.15.38:0/3223221620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 msgr2=0x5615a1f0dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c540 tx=0x7f7c40004730 comp rx=0 tx=0).stop 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- 172.21.15.38:0/3223221620 shutdown_connections 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b3d390 0x5615a1f062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f0e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 --2- 172.21.15.38:0/3223221620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b1c9f0 0x5615a1f0dad0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- 172.21.15.38:0/3223221620 >> 172.21.15.38:0/3223221620 conn(0x5615a1b52460 msgr2=0x5615a1f0f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- 172.21.15.38:0/3223221620 shutdown_connections 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- 172.21.15.38:0/3223221620 wait complete. 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 -- start start 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.213+0000 7f7c584d4740 1 Processor -- start 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b1c9f0 0x5615a1f25f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f23460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1adcd0 con 0x5615a1b3d390 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1af140 con 0x5615a1b351b0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1ae3a0 con 0x5615a1b1c9f0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c584d4740 10 client.0 _ll_register_callbacks cb 0x7f7c4000ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f23460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35554/0 (socket says 172.21.15.38:35554) 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 -- 172.21.15.38:0/1425232641 learned_addr learned my addr 172.21.15.38:0/1425232641 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b1c9f0 0x5615a1f25f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 -- 172.21.15.38:0/1425232641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b1c9f0 msgr2=0x5615a1f25f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b1c9f0 0x5615a1f25f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 -- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 msgr2=0x5615a1f23460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f23460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 -- 172.21.15.38:0/1425232641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a1f23ee0 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f23460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c4affd640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x5615a1f03ec0 tx=0x7f7c4000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ebf8d1548b3767 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.214+0000 7f7c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40032040 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c400047a0 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f7c40005200 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c40005400 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 10 client.17952 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5615a1f8ce30 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c400047a0 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c40022470 con 0x5615a1b3d390 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 10 client.17952 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 10 client.17952 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:43.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 20 client.17952 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:43.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b5e070 0x5615a1f8f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 4 client.17952 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:43.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.215+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615a1e798a0 con 0x5615a1b5e070 2024-09-21T06:28:43.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b5e070 0x5615a1f8f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c2affd640 10 client.17952 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c4b7fe640 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b5e070 0x5615a1f8f400 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd14a49d383803c3 server_cookie=fc2fc8f1d9a7c0c5 in_seq=0 out_seq=0 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c2affd640 1 -- 172.21.15.38:0/1425232641 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615a1e798a0 con 0x5615a1b5e070 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c2affd640 10 client.17952 handle_command_reply: tid=0 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.216+0000 7f7c584d4740 1 client.17952 shutdown 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 msgr2=0x5615a1f239a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x5615a1f03ec0 tx=0x7f7c4000f510 comp rx=0 tx=0).stop 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 shutdown_connections 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5615a1b5e070 0x5615a1f8f400 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5615a1b3d390 0x5615a1f239a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5615a1b351b0 0x5615a1f23460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 --2- 172.21.15.38:0/1425232641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5615a1b1c9f0 0x5615a1f25f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 >> 172.21.15.38:0/1425232641 conn(0x5615a1b52460 msgr2=0x5615a1f062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c2affd640 0 client.17952 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 shutdown_connections 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 1 -- 172.21.15.38:0/1425232641 wait complete. 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c584d4740 20 client.17952 trim_cache size 0 max 16384 2024-09-21T06:28:43.223 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 msgr2=0x7f7c340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 0x7f7c340b8bc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009270 tx=0x7f7c44058e10 comp rx=0 tx=0).stop 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 msgr2=0x7f7c4c19be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400eaa0 tx=0x7f7c4400ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 shutdown_connections 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7c340b66b0 0x7f7c340b8bc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c4c108d10 0x7f7c4c19be30 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c4c1083c0 0x7f7c4c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 --2- 172.21.15.38:0/362033062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4c102a80 0x7f7c4c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.217+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 >> 172.21.15.38:0/362033062 conn(0x7f7c4c079740 msgr2=0x7f7c4c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.218+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 shutdown_connections 2024-09-21T06:28:43.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:43.218+0000 7f7c51f60640 1 -- 172.21.15.38:0/362033062 wait complete. 2024-09-21T06:28:43.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:43 smithi174 ceph-mon[34815]: pgmap v596: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:43.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:43 smithi044 ceph-mon[34369]: pgmap v596: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:43.932 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:43 smithi038 ceph-mon[31215]: pgmap v596: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:43.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:28:44.227 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/356768146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf01094a0 msgr2=0x7ffbf01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/356768146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf01094a0 0x7ffbf01098b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009900 tx=0x7ffbe402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/356768146 shutdown_connections 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/356768146 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0109df0 0x7ffbf0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/356768146 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf01094a0 0x7ffbf01098b0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/356768146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf0103b60 0x7ffbf0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/356768146 >> 172.21.15.38:0/356768146 conn(0x7ffbf007b850 msgr2=0x7ffbf007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/356768146 shutdown_connections 2024-09-21T06:28:44.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.704+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/356768146 wait complete. 2024-09-21T06:28:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 Processor -- start 2024-09-21T06:28:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 -- start start 2024-09-21T06:28:44.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0103b60 0x7ffbf019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 0x7ffbf019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0113bd0 con 0x7ffbf0109df0 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0113a50 con 0x7ffbf0103b60 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf6a7d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0113d50 con 0x7ffbf01094a0 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf501a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf501a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35578/0 (socket says 172.21.15.38:35578) 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.705+0000 7ffbf501a640 1 -- 172.21.15.38:0/850498041 learned_addr learned my addr 172.21.15.38:0/850498041 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbeffff640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 0x7ffbf019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf4819640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0103b60 0x7ffbf019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 -- 172.21.15.38:0/850498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 msgr2=0x7ffbf019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 0x7ffbf019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 -- 172.21.15.38:0/850498041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0103b60 msgr2=0x7ffbf019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0103b60 0x7ffbf019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 -- 172.21.15.38:0/850498041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf01a0470 con 0x7ffbf0109df0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbeffff640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 0x7ffbf019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf501a640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800cce0 tx=0x7ffbe800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbedffb640 1 -- 172.21.15.38:0/850498041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe800f450 con 0x7ffbf0109df0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbedffb640 1 -- 172.21.15.38:0/850498041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe800fac0 con 0x7ffbf0109df0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf01a0760 con 0x7ffbf0109df0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbedffb640 1 -- 172.21.15.38:0/850498041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8018be0 con 0x7ffbf0109df0 2024-09-21T06:28:44.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.706+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a6f80 con 0x7ffbf0109df0 2024-09-21T06:28:44.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.709+0000 7ffbfcff1740 1 Processor -- start 2024-09-21T06:28:44.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.709+0000 7ffbedffb640 1 -- 172.21.15.38:0/850498041 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ffbe800fc70 con 0x7ffbf0109df0 2024-09-21T06:28:44.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.709+0000 7ffbfcff1740 1 -- start start 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e663339800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663339d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e6632afea0 con 0x55e662f92070 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e66329f2d0 con 0x55e662f691b0 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e6632a30e0 con 0x55e662f71390 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35588/0 (socket says 172.21.15.38:35588) 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 -- 172.21.15.38:0/3090340630 learned_addr learned my addr 172.21.15.38:0/3090340630 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbf4819640 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e663339800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663339d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 -- 172.21.15.38:0/3090340630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 msgr2=0x55e663339d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663339d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 -- 172.21.15.38:0/3090340630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 msgr2=0x55e663339800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e663339800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 -- 172.21.15.38:0/3090340630 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e662ffd650 con 0x55e662f92070 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbedffb640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 0x7ffbd80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4005ab0 tx=0x7ffbe4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3def754d703f53bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.710+0000 7ffbf4819640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 0x7ffbd80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.711+0000 7ffbedffb640 1 -- 172.21.15.38:0/850498041 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ffbe80e7dd0 con 0x7ffbf0109df0 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.711+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3090340630 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4043020 con 0x55e662f92070 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.711+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3090340630 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe4031940 con 0x55e662f92070 2024-09-21T06:28:44.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.711+0000 7ffbd6ffd640 1 -- 172.21.15.38:0/3090340630 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4035050 con 0x55e662f92070 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3090340630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 msgr2=0x55e6633392c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4005ab0 tx=0x7ffbe4009560 comp rx=0 tx=0).stop 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbf4819640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 0x7ffbd80b8c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55e663337f40 tx=0x7ffbe000c430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3090340630 shutdown_connections 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663339d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e663339800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3090340630 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f92070 0x55e6633392c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3090340630 >> 172.21.15.38:0/3090340630 conn(0x55e662f86460 msgr2=0x55e6633371b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3090340630 shutdown_connections 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3090340630 wait complete. 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 -- start start 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.712+0000 7ffbfcff1740 1 Processor -- start 2024-09-21T06:28:44.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663349260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f92070 0x55e6633497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e663100700 con 0x55e662f691b0 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e66323a160 con 0x55e662f92070 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e66334bda0 con 0x55e662f71390 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35604/0 (socket says 172.21.15.38:35604) 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 -- 172.21.15.38:0/4058572376 learned_addr learned my addr 172.21.15.38:0/4058572376 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbfcff1740 10 client.0 _ll_register_callbacks cb 0x55e6632539e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbeffff640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663349260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf501a640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f92070 0x55e6633497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 -- 172.21.15.38:0/4058572376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 msgr2=0x55e663349260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663349260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 -- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f92070 msgr2=0x55e6633497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f92070 0x55e6633497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.713+0000 7ffbf4819640 1 -- 172.21.15.38:0/4058572376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e663267c90 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbf4819640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001cdd0 tx=0x7ffbe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c995eabffc8232d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0029060 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ffbe000cd40 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe4031940 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffbe002e460 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbfcff1740 10 client.17964 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e663357b00 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe4031940 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.714+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe0018040 con 0x55e662f691b0 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 10 client.17964 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:44.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 10 client.17964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 20 client.17964 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f509f0 0x55e66335b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 4 client.17964 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6632b1df0 con 0x55e662f509f0 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbeffff640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f509f0 0x55e66335b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbeffff640 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f509f0 0x55e66335b030 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=705f311031a11a22 server_cookie=d8b1595563fe01fa in_seq=0 out_seq=0 2024-09-21T06:28:44.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.715+0000 7ffbcffff640 10 client.17964 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbcffff640 1 -- 172.21.15.38:0/4058572376 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6632b1df0 con 0x55e662f509f0 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbcffff640 10 client.17964 handle_command_reply: tid=0 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 client.17964 shutdown 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 msgr2=0x55e663348d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001cdd0 tx=0x7ffbe00046c0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 shutdown_connections 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f92070 0x55e6633497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f509f0 0x55e66335b030 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f71390 0x55e663349260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/4058572376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e663348d20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 >> 172.21.15.38:0/4058572376 conn(0x55e662f86460 msgr2=0x55e663335750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbcffff640 0 client.17964 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.716+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 shutdown_connections 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.717+0000 7ffbfcff1740 1 -- 172.21.15.38:0/4058572376 wait complete. 2024-09-21T06:28:44.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.717+0000 7ffbfcff1740 20 client.17964 trim_cache size 0 max 16384 2024-09-21T06:28:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 Processor -- start 2024-09-21T06:28:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 -- start start 2024-09-21T06:28:44.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 0x55e663346120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e663346660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01afbb0 con 0x55e662f691b0 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ad480 con 0x55e662f71390 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ab2f0 con 0x55e662f92070 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35610/0 (socket says 172.21.15.38:35610) 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 -- 172.21.15.38:0/3733237362 learned_addr learned my addr 172.21.15.38:0/3733237362 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 0x55e663346120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf501a640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e663346660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 -- 172.21.15.38:0/3733237362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 msgr2=0x55e663346660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e663346660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 -- 172.21.15.38:0/3733237362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 msgr2=0x55e663346120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 0x55e663346120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbf4819640 1 -- 172.21.15.38:0/3733237362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66333b5b0 con 0x55e662f691b0 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.730+0000 7ffbeffff640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 0x55e663346120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.731+0000 7ffbf4819640 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001c820 tx=0x7ffbe0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c4149d2d3d018e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.731+0000 7ffbd67fc640 1 -- 172.21.15.38:0/3733237362 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0019920 con 0x55e662f691b0 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.731+0000 7ffbd67fc640 1 -- 172.21.15.38:0/3733237362 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe002e600 con 0x55e662f691b0 2024-09-21T06:28:44.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.731+0000 7ffbd67fc640 1 -- 172.21.15.38:0/3733237362 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe001a680 con 0x55e662f691b0 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3733237362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 msgr2=0x55e6633491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ffbe001c820 tx=0x7ffbe0004730 comp rx=0 tx=0).stop 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3733237362 shutdown_connections 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e663346660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f71390 0x55e663346120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/3733237362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f691b0 0x55e6633491e0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3733237362 >> 172.21.15.38:0/3733237362 conn(0x55e662f86460 msgr2=0x55e663348ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3733237362 shutdown_connections 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- 172.21.15.38:0/3733237362 wait complete. 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 -- start start 2024-09-21T06:28:44.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.732+0000 7ffbfcff1740 1 Processor -- start 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e66334cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e66334da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ab940 con 0x55e662f71390 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01acdb0 con 0x55e662f691b0 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf01ac010 con 0x55e662f92070 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbfcff1740 10 client.0 _ll_register_callbacks cb 0x7ffbe001ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35612/0 (socket says 172.21.15.38:35612) 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 -- 172.21.15.38:0/2635528659 learned_addr learned my addr 172.21.15.38:0/2635528659 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbf501a640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e66334da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbf4819640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e66334cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 -- 172.21.15.38:0/2635528659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 msgr2=0x55e66334da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e66334da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 -- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 msgr2=0x55e66334cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e66334cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.733+0000 7ffbeffff640 1 -- 172.21.15.38:0/2635528659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e663355030 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbeffff640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009900 tx=0x7ffbe4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df31eeb11197493e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4043040 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7ffbe403a800 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe002e600 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffbe405d050 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbfcff1740 10 client.17970 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e6633c5a30 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffbe002e600 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.734+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffbe403d8a0 con 0x55e662f71390 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 10 client.17970 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:44.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 10 client.17970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 20 client.17970 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f25da0 0x55e6633c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 4 client.17970 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6632ad8a0 con 0x55e662f25da0 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbf4819640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f25da0 0x55e6633c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbf4819640 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f25da0 0x55e6633c7d80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a77e82c027a0ab5 server_cookie=89cb00e2b62481db in_seq=0 out_seq=0 2024-09-21T06:28:44.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.735+0000 7ffbcffff640 10 client.17970 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbcffff640 1 -- 172.21.15.38:0/2635528659 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6632ad8a0 con 0x55e662f25da0 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbcffff640 10 client.17970 handle_command_reply: tid=0 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 client.17970 shutdown 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 msgr2=0x55e66334d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009900 tx=0x7ffbe4005a20 comp rx=0 tx=0).stop 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 shutdown_connections 2024-09-21T06:28:44.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55e662f25da0 0x55e6633c7d80 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e662f92070 0x55e66334da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e662f71390 0x55e66334d4f0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 --2- 172.21.15.38:0/2635528659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e662f691b0 0x55e66334cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 >> 172.21.15.38:0/2635528659 conn(0x55e662f86460 msgr2=0x55e663346120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbcffff640 0 client.17970 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 shutdown_connections 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 1 -- 172.21.15.38:0/2635528659 wait complete. 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.736+0000 7ffbfcff1740 20 client.17970 trim_cache size 0 max 16384 2024-09-21T06:28:44.742 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 msgr2=0x7ffbd80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 0x7ffbd80b8c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55e663337f40 tx=0x7ffbe000c430 comp rx=0 tx=0).stop 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 msgr2=0x7ffbf019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800cce0 tx=0x7ffbe800a620 comp rx=0 tx=0).stop 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 shutdown_connections 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffbd80b6730 0x7ffbd80b8c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbf0109df0 0x7ffbf019fe00 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffbf01094a0 0x7ffbf019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 --2- 172.21.15.38:0/850498041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf0103b60 0x7ffbf019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 >> 172.21.15.38:0/850498041 conn(0x7ffbf007b850 msgr2=0x7ffbf0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 shutdown_connections 2024-09-21T06:28:44.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:44.737+0000 7ffbf6a7d640 1 -- 172.21.15.38:0/850498041 wait complete. 2024-09-21T06:28:45.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:45 smithi174 ceph-mon[34815]: pgmap v597: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:45.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:45 smithi044 ceph-mon[34369]: pgmap v597: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:45.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:45 smithi038 ceph-mon[31215]: pgmap v597: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:46.522 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:28:46.522 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:28:46.791 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 -- 172.21.15.38:0/853783624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30102a80 msgr2=0x7f5d30102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 --2- 172.21.15.38:0/853783624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30102a80 0x7f5d30102e90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009900 tx=0x7f5d2002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 -- 172.21.15.38:0/853783624 shutdown_connections 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 --2- 172.21.15.38:0/853783624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30108d10 0x7f5d3010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 --2- 172.21.15.38:0/853783624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 0x7f5d301087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 --2- 172.21.15.38:0/853783624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30102a80 0x7f5d30102e90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.272+0000 7f5d366db640 1 -- 172.21.15.38:0/853783624 >> 172.21.15.38:0/853783624 conn(0x7f5d30079740 msgr2=0x7f5d30079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.273+0000 7f5d366db640 1 -- 172.21.15.38:0/853783624 shutdown_connections 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.273+0000 7f5d366db640 1 -- 172.21.15.38:0/853783624 wait complete. 2024-09-21T06:28:47.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.273+0000 7f5d366db640 1 Processor -- start 2024-09-21T06:28:47.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.273+0000 7f5d366db640 1 -- start start 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 0x7f5d30199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 0x7f5d301998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30112ba0 con 0x7f5d30108d10 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30112a20 con 0x7f5d30102a80 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d366db640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30112d20 con 0x7f5d301083c0 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35634/0 (socket says 172.21.15.38:35634) 2024-09-21T06:28:47.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 -- 172.21.15.38:0/1473324217 learned_addr learned my addr 172.21.15.38:0/1473324217 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 0x7f5d301998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 0x7f5d30199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 -- 172.21.15.38:0/1473324217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 msgr2=0x7f5d301998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 0x7f5d301998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 -- 172.21.15.38:0/1473324217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 msgr2=0x7f5d30199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 0x7f5d30199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d34c78640 1 -- 172.21.15.38:0/1473324217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d301a8a10 con 0x7f5d30108d10 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.274+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 0x7f5d30199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d34c78640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b970 tx=0x7f5d2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d2d7fa640 1 -- 172.21.15.38:0/1473324217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28019070 con 0x7f5d30108d10 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d301a8d00 con 0x7f5d30108d10 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d2d7fa640 1 -- 172.21.15.38:0/1473324217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d28014440 con 0x7f5d30108d10 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d2d7fa640 1 -- 172.21.15.38:0/1473324217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280075d0 con 0x7f5d30108d10 2024-09-21T06:28:47.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.275+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301a9190 con 0x7f5d30108d10 2024-09-21T06:28:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.277+0000 7f5d3cc4f740 1 Processor -- start 2024-09-21T06:28:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.277+0000 7f5d2d7fa640 1 -- 172.21.15.38:0/1473324217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5d2801c070 con 0x7f5d30108d10 2024-09-21T06:28:47.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 -- start start 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c62430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c62970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563923bd8e60 con 0x56392389a670 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563923bc8290 con 0x563923892490 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563923bcc0a0 con 0x5639238bb350 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35642/0 (socket says 172.21.15.38:35642) 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/867628684 learned_addr learned my addr 172.21.15.38:0/867628684 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c62970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.278+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c62430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/867628684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 msgr2=0x563923c62430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2d7fa640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 0x7f5d180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c62430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/867628684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 msgr2=0x563923c62970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c62970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/867628684 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563923926930 con 0x56392389a670 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d34c78640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 0x7f5d180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5d24017700 tx=0x7f5d240094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857bc55febc98237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d2d7fa640 1 -- 172.21.15.38:0/1473324217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5d280e6bf0 con 0x7f5d30108d10 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d167fc640 1 -- 172.21.15.38:0/867628684 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24015760 con 0x56392389a670 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d167fc640 1 -- 172.21.15.38:0/867628684 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d2401d070 con 0x56392389a670 2024-09-21T06:28:47.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.279+0000 7f5d167fc640 1 -- 172.21.15.38:0/867628684 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240189e0 con 0x56392389a670 2024-09-21T06:28:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/867628684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 msgr2=0x563923c62eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5d24017700 tx=0x7f5d240094d0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d34c78640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 0x7f5d180b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d280e4440 tx=0x7f5d2800cd80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/867628684 shutdown_connections 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56392389a670 0x563923c62eb0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c62970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/867628684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c62430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/867628684 >> 172.21.15.38:0/867628684 conn(0x5639238af740 msgr2=0x563923c60320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/867628684 shutdown_connections 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.280+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/867628684 wait complete. 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 -- start start 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 Processor -- start 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56392389a670 0x563923c6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x563923a29890 con 0x563923892490 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563923b62d40 con 0x56392389a670 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563923c70bb0 con 0x5639238bb350 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d3cc4f740 10 client.0 _ll_register_callbacks cb 0x563923bc6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35654/0 (socket says 172.21.15.38:35654) 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.281+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3310230213 learned_addr learned my addr 172.21.15.38:0/3310230213 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56392389a670 0x563923c6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3310230213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 msgr2=0x563923c79ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c79ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56392389a670 msgr2=0x563923c6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56392389a670 0x563923c6e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3310230213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563923c7a460 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006cd0 tx=0x7f5d24018660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4652097fce944c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24015da0 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2401d070 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5d24018760 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d24018960 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d3cc4f740 10 client.17982 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.282+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563923c7cd90 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d2401d070 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5d240239c0 con 0x563923892490 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 10 client.17982 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 20 client.17982 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:47.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563923879cd0 0x563923c801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 4 client.17982 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563923bdadb0 con 0x563923879cd0 2024-09-21T06:28:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.283+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563923879cd0 0x563923c801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.284+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563923879cd0 0x563923c801a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3687fc2b5959e24f server_cookie=fe3645e9417a88e4 in_seq=0 out_seq=0 2024-09-21T06:28:47.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.284+0000 7f5d0f7fe640 10 client.17982 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.284+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/3310230213 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563923bdadb0 con 0x563923879cd0 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.284+0000 7f5d0f7fe640 10 client.17982 handle_command_reply: tid=0 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.284+0000 7f5d3cc4f740 1 client.17982 shutdown 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 msgr2=0x563923c6dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006cd0 tx=0x7f5d24018660 comp rx=0 tx=0).stop 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 shutdown_connections 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x563923879cd0 0x563923c801a0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639238bb350 0x563923c79ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56392389a670 0x563923c6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3310230213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c6dfe0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 >> 172.21.15.38:0/3310230213 conn(0x5639238af740 msgr2=0x563923c655c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d0f7fe640 0 client.17982 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 shutdown_connections 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3310230213 wait complete. 2024-09-21T06:28:47.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.285+0000 7f5d3cc4f740 20 client.17982 trim_cache size 0 max 16384 2024-09-21T06:28:47.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.302+0000 7f5d3cc4f740 1 Processor -- start 2024-09-21T06:28:47.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 -- start start 2024-09-21T06:28:47.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c69590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c79e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301b42a0 con 0x5639238bb350 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301b1b70 con 0x563923892490 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301af9e0 con 0x56392389a670 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35658/0 (socket says 172.21.15.38:35658) 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3411827300 learned_addr learned my addr 172.21.15.38:0/3411827300 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c69590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c79e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3411827300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 msgr2=0x563923c79e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c79e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3411827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 msgr2=0x563923c69590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c69590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/3411827300 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563923c65070 con 0x5639238bb350 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.303+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c79e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:47.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009530 tx=0x7f5d24009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594f6e9ff6933c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d15ffb640 1 -- 172.21.15.38:0/3411827300 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d240186d0 con 0x5639238bb350 2024-09-21T06:28:47.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d15ffb640 1 -- 172.21.15.38:0/3411827300 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d2401d040 con 0x5639238bb350 2024-09-21T06:28:47.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d15ffb640 1 -- 172.21.15.38:0/3411827300 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24022a60 con 0x5639238bb350 2024-09-21T06:28:47.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3411827300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 msgr2=0x563923c6d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009530 tx=0x7f5d24009800 comp rx=0 tx=0).stop 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.304+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3411827300 shutdown_connections 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5639238bb350 0x563923c6d670 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c79e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/3411827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563923892490 0x563923c69590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3411827300 >> 172.21.15.38:0/3411827300 conn(0x5639238af740 msgr2=0x563923c63410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3411827300 shutdown_connections 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/3411827300 wait complete. 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 -- start start 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 Processor -- start 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.305+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c80d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d3cc4f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639238bb350 0x563923c81280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301b0030 con 0x563923892490 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301b14a0 con 0x5639238bb350 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d3cc4f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301b0700 con 0x56392389a670 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d3cc4f740 10 client.0 _ll_register_callbacks cb 0x7f5d20009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35674/0 (socket says 172.21.15.38:35674) 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/2674621549 learned_addr learned my addr 172.21.15.38:0/2674621549 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c80d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639238bb350 0x563923c81280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/2674621549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 msgr2=0x563923c80d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c80d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639238bb350 msgr2=0x563923c81280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639238bb350 0x563923c81280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 -- 172.21.15.38:0/2674621549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563923c818c0 con 0x563923892490 2024-09-21T06:28:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d2f7fe640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009e30 tx=0x7f5d24015e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be118563e87b7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.306+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24047060 con 0x563923892490 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5d24018b00 con 0x563923892490 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2401d040 con 0x563923892490 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d24027040 con 0x563923892490 2024-09-21T06:28:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 10 client.17988 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563923cea6c0 con 0x563923892490 2024-09-21T06:28:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d2401d040 con 0x563923892490 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5d24023410 con 0x563923892490 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 10 client.17988 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 10 client.17988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 20 client.17988 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56392384f080 0x563923cecbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 4 client.17988 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563923bd6860 con 0x56392384f080 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.307+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56392384f080 0x563923cecbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.308+0000 7f5d2ffff640 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56392384f080 0x563923cecbe0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f6927cee3f1b13 server_cookie=90ec58e6d5d247f9 in_seq=0 out_seq=0 2024-09-21T06:28:47.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.308+0000 7f5d0f7fe640 10 client.17988 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:47.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.310+0000 7f5d0f7fe640 1 -- 172.21.15.38:0/2674621549 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563923bd6860 con 0x56392384f080 2024-09-21T06:28:47.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.310+0000 7f5d0f7fe640 10 client.17988 handle_command_reply: tid=0 2024-09-21T06:28:47.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.310+0000 7f5d3cc4f740 1 client.17988 shutdown 2024-09-21T06:28:47.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.310+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 msgr2=0x563923c83870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.310+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009e30 tx=0x7f5d24015e70 comp rx=0 tx=0).stop 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 shutdown_connections 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5639238bb350 0x563923c81280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56392384f080 0x563923cecbe0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56392389a670 0x563923c80d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 --2- 172.21.15.38:0/2674621549 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x563923892490 0x563923c83870 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 >> 172.21.15.38:0/2674621549 conn(0x5639238af740 msgr2=0x563923c63b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d0f7fe640 0 client.17988 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 shutdown_connections 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 1 -- 172.21.15.38:0/2674621549 wait complete. 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d3cc4f740 20 client.17988 trim_cache size 0 max 16384 2024-09-21T06:28:47.316 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:47.317 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:28:47.317 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d", 2024-09-21T06:28:47.317 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:28:47.317 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:47.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 msgr2=0x7f5d180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 0x7f5d180b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5d280e4440 tx=0x7f5d2800cd80 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 msgr2=0x7f5d30199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.311+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b970 tx=0x7f5d2800bd70 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 shutdown_connections 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d180b6680 0x7f5d180b8b90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d30108d10 0x7f5d30199de0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d301083c0 0x7f5d301998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 --2- 172.21.15.38:0/1473324217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d30102a80 0x7f5d30199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 >> 172.21.15.38:0/1473324217 conn(0x7f5d30079740 msgr2=0x7f5d301014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 shutdown_connections 2024-09-21T06:28:47.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:47.312+0000 7f5d366db640 1 -- 172.21.15.38:0/1473324217 wait complete. 2024-09-21T06:28:47.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:47 smithi174 ceph-mon[34815]: pgmap v598: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:47.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:47 smithi044 ceph-mon[34369]: pgmap v598: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:47.932 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:47 smithi038 ceph-mon[31215]: pgmap v598: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:47.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:48.223 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:48.644 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:48 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:28:48.645 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:48 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.645 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:48 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:28:48.645 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:48 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.645 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:48 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 -- 172.21.15.38:0/1010559417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e01094a0 msgr2=0x7fe2e01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/1010559417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e01094a0 0x7fe2e01098b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009900 tx=0x7fe2c802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 -- 172.21.15.38:0/1010559417 shutdown_connections 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/1010559417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e0109df0 0x7fe2e0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/1010559417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e01094a0 0x7fe2e01098b0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/1010559417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0103b60 0x7fe2e0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 -- 172.21.15.38:0/1010559417 >> 172.21.15.38:0/1010559417 conn(0x7fe2e007b850 msgr2=0x7fe2e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 -- 172.21.15.38:0/1010559417 shutdown_connections 2024-09-21T06:28:48.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.737+0000 7fe2e49b5640 1 -- 172.21.15.38:0/1010559417 wait complete. 2024-09-21T06:28:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 Processor -- start 2024-09-21T06:28:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 -- start start 2024-09-21T06:28:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e01094a0 0x7fe2e019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0109df0 0x7fe2e019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0113bd0 con 0x7fe2e0103b60 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0113a50 con 0x7fe2e0109df0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.738+0000 7fe2e49b5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e0113d50 con 0x7fe2e01094a0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35694/0 (socket says 172.21.15.38:35694) 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2ded9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0109df0 0x7fe2e019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 -- 172.21.15.38:0/266083139 learned_addr learned my addr 172.21.15.38:0/266083139 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e01094a0 0x7fe2e019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 -- 172.21.15.38:0/266083139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e01094a0 msgr2=0x7fe2e019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e01094a0 0x7fe2e019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 -- 172.21.15.38:0/266083139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0109df0 msgr2=0x7fe2e019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0109df0 0x7fe2e019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 -- 172.21.15.38:0/266083139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e01a0550 con 0x7fe2e0103b60 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2de59c640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d950 tx=0x7fe2d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2d77fe640 1 -- 172.21.15.38:0/266083139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0017070 con 0x7fe2e0103b60 2024-09-21T06:28:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2d77fe640 1 -- 172.21.15.38:0/266083139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2d0009c30 con 0x7fe2e0103b60 2024-09-21T06:28:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e01a0840 con 0x7fe2e0103b60 2024-09-21T06:28:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2d77fe640 1 -- 172.21.15.38:0/266083139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000f6b0 con 0x7fe2e0103b60 2024-09-21T06:28:48.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.739+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e01a6fa0 con 0x7fe2e0103b60 2024-09-21T06:28:48.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.742+0000 7fe2d77fe640 1 -- 172.21.15.38:0/266083139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe2d00109c0 con 0x7fe2e0103b60 2024-09-21T06:28:48.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.742+0000 7fe2eaf29740 1 Processor -- start 2024-09-21T06:28:48.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.742+0000 7fe2eaf29740 1 -- start start 2024-09-21T06:28:48.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665aff9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665affa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55665af6fe50 con 0x55665ac291b0 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55665af5f280 con 0x55665ac52070 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55665af63090 con 0x55665ac31390 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35704/0 (socket says 172.21.15.38:35704) 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2de59c640 1 -- 172.21.15.38:0/1574737292 learned_addr learned my addr 172.21.15.38:0/1574737292 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665affa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665aff9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2d77fe640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 0x7fe2cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2de59c640 1 -- 172.21.15.38:0/1574737292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 msgr2=0x55665affa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.743+0000 7fe2de59c640 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665affa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2de59c640 1 -- 172.21.15.38:0/1574737292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 msgr2=0x55665aff9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2de59c640 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665aff9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2de59c640 1 -- 172.21.15.38:0/1574737292 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665acbd650 con 0x55665ac291b0 2024-09-21T06:28:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 0x7fe2cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2d77fe640 1 -- 172.21.15.38:0/266083139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fe2d00e7390 con 0x7fe2e0103b60 2024-09-21T06:28:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2de59c640 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00e4a40 tx=0x7fe2d00ad3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dde2f65147c6d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2d4ff9640 1 -- 172.21.15.38:0/1574737292 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0020070 con 0x55665ac291b0 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2d4ff9640 1 -- 172.21.15.38:0/1574737292 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2d00acce0 con 0x55665ac291b0 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.744+0000 7fe2d4ff9640 1 -- 172.21.15.38:0/1574737292 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00acb20 con 0x55665ac291b0 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 -- 172.21.15.38:0/1574737292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 msgr2=0x55665aff9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 0x7fe2cc0b8b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098b0 tx=0x7fe2d8004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00e4a40 tx=0x7fe2d00ad3c0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 -- 172.21.15.38:0/1574737292 shutdown_connections 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665affa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff9b90 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/1574737292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665aff9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 -- 172.21.15.38:0/1574737292 >> 172.21.15.38:0/1574737292 conn(0x55665ac46460 msgr2=0x55665aff7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 -- 172.21.15.38:0/1574737292 shutdown_connections 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.745+0000 7fe2eaf29740 1 -- 172.21.15.38:0/1574737292 wait complete. 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 -- start start 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 Processor -- start 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac291b0 0x55665b004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55665adc0700 con 0x55665ac52070 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55665aefa110 con 0x55665ac291b0 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55665b007dd0 con 0x55665ac31390 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2eaf29740 10 client.0 _ll_register_callbacks cb 0x55665af13990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2ded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2ded9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35708/0 (socket says 172.21.15.38:35708) 2024-09-21T06:28:48.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2ded9d640 1 -- 172.21.15.38:0/2300652777 learned_addr learned my addr 172.21.15.38:0/2300652777 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2de59c640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac291b0 0x55665b004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.746+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 -- 172.21.15.38:0/2300652777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 msgr2=0x55665b0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 -- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac291b0 msgr2=0x55665b004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac291b0 0x55665b004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 -- 172.21.15.38:0/2300652777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665af27c40 con 0x55665ac52070 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8013a20 tx=0x7fe2d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6b7adb0af19fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d801ed70 con 0x55665ac52070 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fe2d801f450 con 0x55665ac52070 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2d00acce0 con 0x55665ac52070 2024-09-21T06:28:48.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe2d801f650 con 0x55665ac52070 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2eaf29740 10 client.18000 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.747+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55665b013b80 con 0x55665ac52070 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2d00acce0 con 0x55665ac52070 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe2d800f040 con 0x55665ac52070 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 10 client.18000 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 10 client.18000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 20 client.18000 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665ac109f0 0x55665b017090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 4 client.18000 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665af71da0 con 0x55665ac109f0 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.748+0000 7fe2de59c640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665ac109f0 0x55665b017090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.749+0000 7fe2c5ffb640 10 client.18000 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:48.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.749+0000 7fe2de59c640 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665ac109f0 0x55665b017090 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221f2f11d21a35db server_cookie=1137a510f38dbd3a in_seq=0 out_seq=0 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.749+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/2300652777 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55665af71da0 con 0x55665ac109f0 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.749+0000 7fe2c5ffb640 10 client.18000 handle_command_reply: tid=0 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.749+0000 7fe2eaf29740 1 client.18000 shutdown 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 msgr2=0x55665b0110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8013a20 tx=0x7fe2d8004ab0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 shutdown_connections 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac52070 0x55665b0110f0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665ac109f0 0x55665b017090 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2c5ffb640 0 client.18000 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b0052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/2300652777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac291b0 0x55665b004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 >> 172.21.15.38:0/2300652777 conn(0x55665ac46460 msgr2=0x55665affc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 shutdown_connections 2024-09-21T06:28:48.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 1 -- 172.21.15.38:0/2300652777 wait complete. 2024-09-21T06:28:48.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.750+0000 7fe2eaf29740 20 client.18000 trim_cache size 0 max 16384 2024-09-21T06:28:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 Processor -- start 2024-09-21T06:28:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 -- start start 2024-09-21T06:28:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac31390 0x55665b010ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 0x55665affc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01b20f0 con 0x55665ac291b0 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01af9c0 con 0x55665ac31390 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01ad830 con 0x55665ac52070 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35722/0 (socket says 172.21.15.38:35722) 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 -- 172.21.15.38:0/623524020 learned_addr learned my addr 172.21.15.38:0/623524020 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 0x55665affc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 -- 172.21.15.38:0/623524020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 msgr2=0x55665affc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 0x55665affc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 -- 172.21.15.38:0/623524020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac31390 msgr2=0x55665b010ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac31390 0x55665b010ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2de59c640 1 -- 172.21.15.38:0/623524020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665b003280 con 0x55665ac291b0 2024-09-21T06:28:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.768+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 0x55665affc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2de59c640 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00e7300 tx=0x7fe2d0010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4edce8d3da89d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2c7fff640 1 -- 172.21.15.38:0/623524020 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0020040 con 0x55665ac291b0 2024-09-21T06:28:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2c7fff640 1 -- 172.21.15.38:0/623524020 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2d00acce0 con 0x55665ac291b0 2024-09-21T06:28:48.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2c7fff640 1 -- 172.21.15.38:0/623524020 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00ac940 con 0x55665ac291b0 2024-09-21T06:28:48.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2eaf29740 1 -- 172.21.15.38:0/623524020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 msgr2=0x55665aff75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00e7300 tx=0x7fe2d0010d60 comp rx=0 tx=0).stop 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.769+0000 7fe2eaf29740 1 -- 172.21.15.38:0/623524020 shutdown_connections 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac52070 0x55665affc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac31390 0x55665b010ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/623524020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665aff75b0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- 172.21.15.38:0/623524020 >> 172.21.15.38:0/623524020 conn(0x55665ac46460 msgr2=0x55665aff6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- 172.21.15.38:0/623524020 shutdown_connections 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- 172.21.15.38:0/623524020 wait complete. 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- start start 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 Processor -- start 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b009880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665b080a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01ade80 con 0x55665ac291b0 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01af2f0 con 0x55665ac52070 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01ae550 con 0x55665ac31390 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.770+0000 7fe2eaf29740 10 client.0 _ll_register_callbacks cb 0x7fe2d8013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35738/0 (socket says 172.21.15.38:35738) 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 -- 172.21.15.38:0/3783063840 learned_addr learned my addr 172.21.15.38:0/3783063840 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b009880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665b080a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 -- 172.21.15.38:0/3783063840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 msgr2=0x55665b009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b009880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 -- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 msgr2=0x55665b080a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:48.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665b080a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 -- 172.21.15.38:0/3783063840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665b00a120 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2ded9d640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665b080a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2de59c640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00a9280 tx=0x7fe2d0005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5268eecb84bb094 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0020050 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fe2d00eac10 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2d00acce0 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe2d00ac940 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2eaf29740 10 client.18006 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.771+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55665b081f60 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2d00acce0 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe2d00e4d50 con 0x55665ac291b0 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 10 client.18006 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:48.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 20 client.18006 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665abe5da0 0x55665b0841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 4 client.18006 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55665af6d850 con 0x55665abe5da0 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.772+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665abe5da0 0x55665b0841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2ddd9b640 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665abe5da0 0x55665b0841c0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d39757299ded13 server_cookie=d7979e69e7e77646 in_seq=0 out_seq=0 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2c5ffb640 10 client.18006 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2c5ffb640 1 -- 172.21.15.38:0/3783063840 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6622 (crc 0 0 0) 0x55665af6d850 con 0x55665abe5da0 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2c5ffb640 10 client.18006 handle_command_reply: tid=0 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 client.18006 shutdown 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 msgr2=0x55665b009340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00a9280 tx=0x7fe2d0005f70 comp rx=0 tx=0).stop 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 shutdown_connections 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55665ac52070 0x55665b080a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55665abe5da0 0x55665b0841c0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55665ac31390 0x55665b009880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 --2- 172.21.15.38:0/3783063840 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55665ac291b0 0x55665b009340 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 >> 172.21.15.38:0/3783063840 conn(0x55665ac46460 msgr2=0x55665affc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2c5ffb640 0 client.18006 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 shutdown_connections 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 1 -- 172.21.15.38:0/3783063840 wait complete. 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.773+0000 7fe2eaf29740 20 client.18006 trim_cache size 0 max 16384 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:28:48.780 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.781 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.782 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:28:48.783 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.784 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.786 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.787 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.788 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:28:48.789 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.790 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.791 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.792 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 msgr2=0x7fe2cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 0x7fe2cc0b8b90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098b0 tx=0x7fe2d8004a40 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 msgr2=0x7fe2e019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d950 tx=0x7fe2d000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 shutdown_connections 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe2cc0b6680 0x7fe2cc0b8b90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2e0109df0 0x7fe2e019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e01094a0 0x7fe2e019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 --2- 172.21.15.38:0/266083139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2e0103b60 0x7fe2e019a5e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 >> 172.21.15.38:0/266083139 conn(0x7fe2e007b850 msgr2=0x7fe2e0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 shutdown_connections 2024-09-21T06:28:48.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:48.774+0000 7fe2e49b5640 1 -- 172.21.15.38:0/266083139 wait complete. 2024-09-21T06:28:48.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:48 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:28:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:48 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:48 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:28:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:48 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:48 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:28:48.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:48 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:28:48.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:48 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:48 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:28:48.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:48 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:48.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:48 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:28:49.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:49.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:49.702 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:49 smithi038 ceph-mon[31215]: pgmap v599: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:49.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:49 smithi174 ceph-mon[34815]: pgmap v599: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:49.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:49 smithi044 ceph-mon[34369]: pgmap v599: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:28:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3888851684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 msgr2=0x7fa5c4109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3888851684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c4109900 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009900 tx=0x7fa5b802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3888851684 shutdown_connections 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3888851684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 0x7fa5c4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3888851684 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c4109900 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3888851684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3888851684 >> 172.21.15.38:0/3888851684 conn(0x7fa5c40ff600 msgr2=0x7fa5c4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3888851684 shutdown_connections 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.135+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3888851684 wait complete. 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 Processor -- start 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 -- start start 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 0x7fa5c419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4113c20 con 0x7fa5c41094f0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4113aa0 con 0x7fa5c4109e40 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5cb34a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4113da0 con 0x7fa5c4103bb0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5c88e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5c88e5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35056/0 (socket says 172.21.15.38:35056) 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.136+0000 7fa5c88e5640 1 -- 172.21.15.38:0/3415043766 learned_addr learned my addr 172.21.15.38:0/3415043766 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c98e7640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 0x7fa5c419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c90e6640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 -- 172.21.15.38:0/3415043766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 msgr2=0x7fa5c419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 -- 172.21.15.38:0/3415043766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 msgr2=0x7fa5c419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 0x7fa5c419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 -- 172.21.15.38:0/3415043766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c41a0500 con 0x7fa5c41094f0 2024-09-21T06:28:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c90e6640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c88e5640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8005940 tx=0x7fa5b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b803f030 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c41a0790 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5b8031910 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8035070 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.137+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c41a6f50 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.138+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c4104e30 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.140+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa5b8042030 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.141+0000 7fa5c27fc640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 0x7fa5ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.141+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fa5b8107dd0 con 0x7fa5c41094f0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.141+0000 7fa5c90e6640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 0x7fa5ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.141+0000 7fa5c90e6640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 0x7fa5ac0b8b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4005c40 tx=0x7fa5b40082f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:50.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.144+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5b80ce370 con 0x7fa5c41094f0 2024-09-21T06:28:50.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.368+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5c4103fc0 con 0x7fa5c41094f0 2024-09-21T06:28:50.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.369+0000 7fa5c27fc640 1 -- 172.21.15.38:0/3415043766 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fa5b80e3e20 con 0x7fa5c41094f0 2024-09-21T06:28:50.371 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:28:50.371 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:28:50.371 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 msgr2=0x7fa5ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 0x7fa5ac0b8b90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4005c40 tx=0x7fa5b40082f0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 msgr2=0x7fa5c419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8005940 tx=0x7fa5b80042f0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 shutdown_connections 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa5ac0b6680 0x7fa5ac0b8b90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5c4109e40 0x7fa5c419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5c41094f0 0x7fa5c419ab30 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 --2- 172.21.15.38:0/3415043766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c4103bb0 0x7fa5c419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 >> 172.21.15.38:0/3415043766 conn(0x7fa5c40ff600 msgr2=0x7fa5c4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:50.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 shutdown_connections 2024-09-21T06:28:50.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:50.371+0000 7fa5cb34a640 1 -- 172.21.15.38:0/3415043766 wait complete. 2024-09-21T06:28:50.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:50 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3415043766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:50.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:50 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3415043766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:50.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:50 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3415043766' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:28:51.022 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:28:51.283 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:51.662 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:51 smithi038 ceph-mon[31215]: pgmap v600: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:51.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.755+0000 7fdecfa93640 1 -- 172.21.15.38:0/3285703010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8102650 msgr2=0x7fdec8102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.755+0000 7fdecfa93640 1 --2- 172.21.15.38:0/3285703010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8102650 0x7fdec8102a60 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009900 tx=0x7fdec402a480 comp rx=0 tx=0).stop 2024-09-21T06:28:51.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 -- 172.21.15.38:0/3285703010 shutdown_connections 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 --2- 172.21.15.38:0/3285703010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8110200 0x7fdec8112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 --2- 172.21.15.38:0/3285703010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102fa0 0x7fdec810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 --2- 172.21.15.38:0/3285703010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8102650 0x7fdec8102a60 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 -- 172.21.15.38:0/3285703010 >> 172.21.15.38:0/3285703010 conn(0x7fdec8079760 msgr2=0x7fdec8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 -- 172.21.15.38:0/3285703010 shutdown_connections 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 -- 172.21.15.38:0/3285703010 wait complete. 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 Processor -- start 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.756+0000 7fdecfa93640 1 -- start start 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102650 0x7fdec819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8102fa0 0x7fdec819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8115e80 con 0x7fdec8110200 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8115d00 con 0x7fdec8102fa0 2024-09-21T06:28:51.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecfa93640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8116000 con 0x7fdec8102650 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35066/0 (socket says 172.21.15.38:35066) 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 -- 172.21.15.38:0/470305849 learned_addr learned my addr 172.21.15.38:0/470305849 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecd02e640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8102fa0 0x7fdec819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdecd82f640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102650 0x7fdec819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 -- 172.21.15.38:0/470305849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102650 msgr2=0x7fdec819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102650 0x7fdec819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 -- 172.21.15.38:0/470305849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8102fa0 msgr2=0x7fdec819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8102fa0 0x7fdec819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 -- 172.21.15.38:0/470305849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec81a2880 con 0x7fdec8110200 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdece030640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fdec000b970 tx=0x7fdec000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.757+0000 7fdebeffd640 1 -- 172.21.15.38:0/470305849 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0019070 con 0x7fdec8110200 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.758+0000 7fdebeffd640 1 -- 172.21.15.38:0/470305849 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdec0014440 con 0x7fdec8110200 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.758+0000 7fdebeffd640 1 -- 172.21.15.38:0/470305849 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec00075d0 con 0x7fdec8110200 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.758+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec81a2b70 con 0x7fdec8110200 2024-09-21T06:28:51.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.758+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec81a92d0 con 0x7fdec8110200 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.760+0000 7fded6007740 1 Processor -- start 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.760+0000 7fdebeffd640 1 -- 172.21.15.38:0/470305849 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdec001c070 con 0x7fdec8110200 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 -- start start 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 0x555919c6c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c6cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555919be2ea0 con 0x5559198c5070 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555919bd22d0 con 0x5559198a4390 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fded6007740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555919bd60e0 con 0x55591989c1b0 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35082/0 (socket says 172.21.15.38:35082) 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd02e640 1 -- 172.21.15.38:0/2545547975 learned_addr learned my addr 172.21.15.38:0/2545547975 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd02e640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c6cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd82f640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 0x555919c6c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.761+0000 7fdecd02e640 1 -- 172.21.15.38:0/2545547975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 msgr2=0x555919c6c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd02e640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 0x555919c6c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd02e640 1 -- 172.21.15.38:0/2545547975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 msgr2=0x555919c6cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd02e640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c6cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd02e640 1 -- 172.21.15.38:0/2545547975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555919930650 con 0x5559198c5070 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd82f640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 0x555919c6c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdebeffd640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 0x7fdeb40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd02e640 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80101f0 tx=0x7fdeb80095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e1667c149ac59e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdecd82f640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 0x7fdeb40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdebeffd640 1 -- 172.21.15.38:0/470305849 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fdec00e6b60 con 0x7fdec8110200 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdeb3fff640 1 -- 172.21.15.38:0/2545547975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8017610 con 0x5559198c5070 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdeb3fff640 1 -- 172.21.15.38:0/2545547975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdeb801c070 con 0x5559198c5070 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.762+0000 7fdeb3fff640 1 -- 172.21.15.38:0/2545547975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80159b0 con 0x5559198c5070 2024-09-21T06:28:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 -- 172.21.15.38:0/2545547975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 msgr2=0x555919c6c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fdecd82f640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 0x7fdeb40b8c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x555919c6af40 tx=0x7fdec4005e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80101f0 tx=0x7fdeb80095d0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 -- 172.21.15.38:0/2545547975 shutdown_connections 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c6cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55591989c1b0 0x555919c6c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 --2- 172.21.15.38:0/2545547975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c6c2c0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 -- 172.21.15.38:0/2545547975 >> 172.21.15.38:0/2545547975 conn(0x5559198b9460 msgr2=0x555919c6a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 -- 172.21.15.38:0/2545547975 shutdown_connections 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.763+0000 7fded6007740 1 -- 172.21.15.38:0/2545547975 wait complete. 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 -- start start 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 Processor -- start 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 0x555919c77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555919a33700 con 0x5559198c5070 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555919b6d160 con 0x55591989c1b0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555919c7aa40 con 0x5559198a4390 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fded6007740 10 client.0 _ll_register_callbacks cb 0x555919b869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fdece030640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fdece030640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35096/0 (socket says 172.21.15.38:35096) 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.764+0000 7fdece030640 1 -- 172.21.15.38:0/3002833860 learned_addr learned my addr 172.21.15.38:0/3002833860 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 0x555919c77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdecd02e640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 -- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 msgr2=0x555919c77e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c77e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 -- 172.21.15.38:0/3002833860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 msgr2=0x555919c77950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 0x555919c77950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 -- 172.21.15.38:0/3002833860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555919b9ac90 con 0x5559198c5070 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 0x555919c77950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdece030640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdec0016000 tx=0x7fdec0014cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae88e35c8022ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0014800 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fdec000caa0 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeb801c070 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdec00ad100 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fded6007740 10 client.18024 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555919c866b0 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdeb801c070 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.765+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdec00c2bb0 con 0x5559198c5070 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 10 client.18024 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 10 client.18024 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 20 client.18024 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198839f0 0x555919c89c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 4 client.18024 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555919be4df0 con 0x5559198839f0 2024-09-21T06:28:51.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198839f0 0x555919c89c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198839f0 0x555919c89c00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5fff236fcee3f771 server_cookie=5bbb258a48501e3a in_seq=0 out_seq=0 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.766+0000 7fdeb17fa640 10 client.18024 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3002833860 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555919be4df0 con 0x5559198839f0 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fdeb17fa640 10 client.18024 handle_command_reply: tid=0 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 client.18024 shutdown 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 msgr2=0x555919c78410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fdec0016000 tx=0x7fdec0014cc0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 shutdown_connections 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198839f0 0x555919c89c00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5559198c5070 0x555919c78410 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c77e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fdeb17fa640 0 client.18024 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:51.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 --2- 172.21.15.38:0/3002833860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55591989c1b0 0x555919c77950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.767+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 >> 172.21.15.38:0/3002833860 conn(0x5559198b9460 msgr2=0x555919c6f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.768+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 shutdown_connections 2024-09-21T06:28:51.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.768+0000 7fded6007740 1 -- 172.21.15.38:0/3002833860 wait complete. 2024-09-21T06:28:51.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.768+0000 7fded6007740 20 client.18024 trim_cache size 0 max 16384 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 Processor -- start 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 -- start start 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 0x555919c6dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c69760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81b4270 con 0x55591989c1b0 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81b1b40 con 0x5559198839f0 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fded6007740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81af9b0 con 0x5559198a4390 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35112/0 (socket says 172.21.15.38:35112) 2024-09-21T06:28:51.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.781+0000 7fdecd02e640 1 -- 172.21.15.38:0/1513934715 learned_addr learned my addr 172.21.15.38:0/1513934715 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd82f640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 0x555919c6dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdece030640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c69760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 -- 172.21.15.38:0/1513934715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 msgr2=0x555919c69760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c69760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 -- 172.21.15.38:0/1513934715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 msgr2=0x555919c6dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 0x555919c6dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 -- 172.21.15.38:0/1513934715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555919c78c10 con 0x55591989c1b0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdece030640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c69760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd82f640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 0x555919c6dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdecd02e640 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009150 tx=0x7fdeb8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dd9ca60f39e9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdeb37fe640 1 -- 172.21.15.38:0/1513934715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8017410 con 0x55591989c1b0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdeb37fe640 1 -- 172.21.15.38:0/1513934715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdeb801c040 con 0x55591989c1b0 2024-09-21T06:28:51.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.782+0000 7fdeb37fe640 1 -- 172.21.15.38:0/1513934715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8028ad0 con 0x55591989c1b0 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- 172.21.15.38:0/1513934715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 msgr2=0x555919c79580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009150 tx=0x7fdeb8010f40 comp rx=0 tx=0).stop 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- 172.21.15.38:0/1513934715 shutdown_connections 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198a4390 0x555919c69760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c79580 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 --2- 172.21.15.38:0/1513934715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198839f0 0x555919c6dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- 172.21.15.38:0/1513934715 >> 172.21.15.38:0/1513934715 conn(0x5559198b9460 msgr2=0x555919c78e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- 172.21.15.38:0/1513934715 shutdown_connections 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- 172.21.15.38:0/1513934715 wait complete. 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.783+0000 7fded6007740 1 -- start start 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 Processor -- start 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198839f0 0x555919c80630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c7c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81b0000 con 0x55591989c1b0 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81b1470 con 0x5559198a4390 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81b06d0 con 0x5559198839f0 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fded6007740 10 client.0 _ll_register_callbacks cb 0x7fdec00a8e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fdecd02e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35122/0 (socket says 172.21.15.38:35122) 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fdecd02e640 1 -- 172.21.15.38:0/3432989178 learned_addr learned my addr 172.21.15.38:0/3432989178 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.784+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198839f0 0x555919c80630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdece030640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c7c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 -- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198839f0 msgr2=0x555919c80630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198839f0 0x555919c80630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 -- 172.21.15.38:0/3432989178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 msgr2=0x555919c7c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c7c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 -- 172.21.15.38:0/3432989178 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555919c7c910 con 0x55591989c1b0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdece030640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c7c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdecd02e640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8006b90 tx=0x7fdeb80286a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60973d47d014f87d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdeb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8035060 con 0x55591989c1b0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeb801c040 con 0x55591989c1b0 2024-09-21T06:28:51.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fdeb8028ce0 con 0x55591989c1b0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdeb8017410 con 0x55591989c1b0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fded6007740 10 client.18030 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.785+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555919cf4630 con 0x55591989c1b0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdeb801c040 con 0x55591989c1b0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdeb8020810 con 0x55591989c1b0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 10 client.18030 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 10 client.18030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 20 client.18030 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198c5070 0x555919cf6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 4 client.18030 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555919c73500 con 0x5559198c5070 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.786+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198c5070 0x555919cf6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fdecd82f640 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198c5070 0x555919cf6a80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9895ed96d428978 server_cookie=8fa40dee788f7153 in_seq=0 out_seq=0 2024-09-21T06:28:51.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fdeb17fa640 10 client.18030 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fdeb17fa640 1 -- 172.21.15.38:0/3432989178 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555919c73500 con 0x5559198c5070 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fdeb17fa640 10 client.18030 handle_command_reply: tid=0 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 client.18030 shutdown 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 msgr2=0x555919c7bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8006b90 tx=0x7fdeb80286a0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 shutdown_connections 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5559198c5070 0x555919cf6a80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5559198a4390 0x555919c7c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55591989c1b0 0x555919c7bae0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fdeb17fa640 0 client.18030 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 --2- 172.21.15.38:0/3432989178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5559198839f0 0x555919c80630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 >> 172.21.15.38:0/3432989178 conn(0x5559198b9460 msgr2=0x555919c78de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 shutdown_connections 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 1 -- 172.21.15.38:0/3432989178 wait complete. 2024-09-21T06:28:51.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.787+0000 7fded6007740 20 client.18030 trim_cache size 0 max 16384 2024-09-21T06:28:51.794 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:51.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 msgr2=0x7fdeb40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 0x7fdeb40b8c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x555919c6af40 tx=0x7fdec4005e60 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 msgr2=0x7fdec81a2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fdec000b970 tx=0x7fdec000bd70 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 shutdown_connections 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdeb40b6700 0x7fdeb40b8c10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdec8110200 0x7fdec81a2150 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdec8102fa0 0x7fdec819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 --2- 172.21.15.38:0/470305849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdec8102650 0x7fdec819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 >> 172.21.15.38:0/470305849 conn(0x7fdec8079760 msgr2=0x7fdec8109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 shutdown_connections 2024-09-21T06:28:51.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:51.788+0000 7fdecfa93640 1 -- 172.21.15.38:0/470305849 wait complete. 2024-09-21T06:28:51.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:51 smithi174 ceph-mon[34815]: pgmap v600: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:51.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:51 smithi044 ceph-mon[34369]: pgmap v600: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:52.382 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:28:52.643 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 -- 172.21.15.38:0/77757033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500107360 msgr2=0x7f9500107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 --2- 172.21.15.38:0/77757033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500107360 0x7f9500107770 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009900 tx=0x7f94f402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 -- 172.21.15.38:0/77757033 shutdown_connections 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 --2- 172.21.15.38:0/77757033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107cb0 0x7f95001106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 --2- 172.21.15.38:0/77757033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500107360 0x7f9500107770 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 --2- 172.21.15.38:0/77757033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500102160 0x7f9500102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 -- 172.21.15.38:0/77757033 >> 172.21.15.38:0/77757033 conn(0x7f9500079ea0 msgr2=0x7f950007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 -- 172.21.15.38:0/77757033 shutdown_connections 2024-09-21T06:28:53.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.114+0000 7f9508049640 1 -- 172.21.15.38:0/77757033 wait complete. 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 Processor -- start 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 -- start start 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107360 0x7f950019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500107cb0 0x7f950019fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9500113c80 con 0x7f9500102160 2024-09-21T06:28:53.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9500113b00 con 0x7f9500107360 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9508049640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9500113e00 con 0x7f9500107cb0 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9505de5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9505de5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35146/0 (socket says 172.21.15.38:35146) 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f9505de5640 1 -- 172.21.15.38:0/1419994128 learned_addr learned my addr 172.21.15.38:0/1419994128 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f95065e6640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500107cb0 0x7f950019fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.115+0000 7f95055e4640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107360 0x7f950019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 -- 172.21.15.38:0/1419994128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500107cb0 msgr2=0x7f950019fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500107cb0 0x7f950019fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 -- 172.21.15.38:0/1419994128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107360 msgr2=0x7f950019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107360 0x7f950019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 -- 172.21.15.38:0/1419994128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95001a0500 con 0x7f9500102160 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9505de5640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f94f800d770 tx=0x7f94f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f94feffd640 1 -- 172.21.15.38:0/1419994128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8017070 con 0x7f9500102160 2024-09-21T06:28:53.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f94feffd640 1 -- 172.21.15.38:0/1419994128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94f80054f0 con 0x7f9500102160 2024-09-21T06:28:53.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95001a07f0 con 0x7f9500102160 2024-09-21T06:28:53.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f94feffd640 1 -- 172.21.15.38:0/1419994128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8004de0 con 0x7f9500102160 2024-09-21T06:28:53.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.116+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95001a7010 con 0x7f9500102160 2024-09-21T06:28:53.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f950e5bd740 1 Processor -- start 2024-09-21T06:28:53.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f950e5bd740 1 -- start start 2024-09-21T06:28:53.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f94feffd640 1 -- 172.21.15.38:0/1419994128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f94f8004f80 con 0x7f9500102160 2024-09-21T06:28:53.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.119+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f950e5bd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d08f7bea0 con 0x559d08c5e070 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f950e5bd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d08f6b2d0 con 0x559d08c351b0 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f950e5bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d08f6f0e0 con 0x559d08c3d390 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35152/0 (socket says 172.21.15.38:35152) 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 -- 172.21.15.38:0/3966836774 learned_addr learned my addr 172.21.15.38:0/3966836774 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f9505de5640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95055e4640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 -- 172.21.15.38:0/3966836774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 msgr2=0x559d09006120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09006120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 -- 172.21.15.38:0/3966836774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 msgr2=0x559d09005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 -- 172.21.15.38:0/3966836774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d08cc9650 con 0x559d08c5e070 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95055e4640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09006120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f95065e6640 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007f40 tx=0x7f94f000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44553cc05ebb1c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.121+0000 7f94feffd640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 0x7f94e80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.120+0000 7f94e7fff640 1 -- 172.21.15.38:0/3966836774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0010840 con 0x559d08c5e070 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.121+0000 7f94e7fff640 1 -- 172.21.15.38:0/3966836774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94f00183f0 con 0x559d08c5e070 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.121+0000 7f94e7fff640 1 -- 172.21.15.38:0/3966836774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0017600 con 0x559d08c5e070 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.121+0000 7f9505de5640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 0x7f94e80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.121+0000 7f94feffd640 1 -- 172.21.15.38:0/1419994128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f94f80e7100 con 0x7f9500102160 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- 172.21.15.38:0/3966836774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 msgr2=0x559d090056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f9505de5640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 0x7f94e80b8c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f94f80e4950 tx=0x7f94f8094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007f40 tx=0x7f94f000f850 comp rx=0 tx=0).stop 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- 172.21.15.38:0/3966836774 shutdown_connections 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09006120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09005be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3966836774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d090056a0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- 172.21.15.38:0/3966836774 >> 172.21.15.38:0/3966836774 conn(0x559d08c52460 msgr2=0x559d09003590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- 172.21.15.38:0/3966836774 shutdown_connections 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- 172.21.15.38:0/3966836774 wait complete. 2024-09-21T06:28:53.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 -- start start 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.122+0000 7f950e5bd740 1 Processor -- start 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c351b0 0x559d090150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c3d390 0x559d09015620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559d08dcc700 con 0x559d08c5e070 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559d08f06160 con 0x559d08c3d390 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559d090181e0 con 0x559d08c351b0 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f950e5bd740 10 client.0 _ll_register_callbacks cb 0x559d08f1f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35168/0 (socket says 172.21.15.38:35168) 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 -- 172.21.15.38:0/3058315113 learned_addr learned my addr 172.21.15.38:0/3058315113 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95055e4640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c3d390 0x559d09015620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c351b0 0x559d090150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 -- 172.21.15.38:0/3058315113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c351b0 msgr2=0x559d090150e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c351b0 0x559d090150e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 -- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c3d390 msgr2=0x559d09015620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c3d390 0x559d09015620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.123+0000 7f95065e6640 1 -- 172.21.15.38:0/3058315113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d08f33c90 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f95065e6640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007cd0 tx=0x7f94f0012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25243c64482ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0017990 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f94f0017b30 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f00183f0 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f94f0035050 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f950e5bd740 10 client.18042 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d09023e10 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94f00183f0 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f94f0024040 con 0x559d08c5e070 2024-09-21T06:28:53.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f950e5bd740 10 client.18042 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.124+0000 7f950e5bd740 10 client.18042 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f950e5bd740 20 client.18042 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c1c9f0 0x559d09027220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f950e5bd740 4 client.18042 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d08f7ddf0 con 0x559d08c1c9f0 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f95055e4640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c1c9f0 0x559d09027220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f95055e4640 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c1c9f0 0x559d09027220 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39d7e853b44ce2ea server_cookie=5701db6119cd6ce2 in_seq=0 out_seq=0 2024-09-21T06:28:53.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.125+0000 7f94e57fa640 10 client.18042 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.126+0000 7f94e57fa640 1 -- 172.21.15.38:0/3058315113 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d08f7ddf0 con 0x559d08c1c9f0 2024-09-21T06:28:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.126+0000 7f94e57fa640 10 client.18042 handle_command_reply: tid=0 2024-09-21T06:28:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.126+0000 7f950e5bd740 1 client.18042 shutdown 2024-09-21T06:28:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 msgr2=0x559d09015b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007cd0 tx=0x7f94f0012040 comp rx=0 tx=0).stop 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 shutdown_connections 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c1c9f0 0x559d09027220 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c5e070 0x559d09015b60 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c3d390 0x559d09015620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f94e57fa640 0 client.18042 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3058315113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c351b0 0x559d090150e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 >> 172.21.15.38:0/3058315113 conn(0x559d08c52460 msgr2=0x559d09001bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 shutdown_connections 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 1 -- 172.21.15.38:0/3058315113 wait complete. 2024-09-21T06:28:53.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.127+0000 7f950e5bd740 20 client.18042 trim_cache size 0 max 16384 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.140+0000 7f950e5bd740 1 Processor -- start 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.140+0000 7f950e5bd740 1 -- start start 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c1c9f0 0x559d09016d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09012810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f95001afdf0 con 0x559d08c351b0 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95001ad6c0 con 0x559d08c1c9f0 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f950e5bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95001ab530 con 0x559d08c3d390 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35180/0 (socket says 172.21.15.38:35180) 2024-09-21T06:28:53.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 -- 172.21.15.38:0/3862619833 learned_addr learned my addr 172.21.15.38:0/3862619833 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95065e6640 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c1c9f0 0x559d09016d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 -- 172.21.15.38:0/3862619833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 msgr2=0x559d09012810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95065e6640 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09012810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09012810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 -- 172.21.15.38:0/3862619833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c1c9f0 msgr2=0x559d09016d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c1c9f0 0x559d09016d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 -- 172.21.15.38:0/3862619833 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d090163a0 con 0x559d08c351b0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f95055e4640 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f94f4005ab0 tx=0x7f94f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972e3832da20be5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f94e77fe640 1 -- 172.21.15.38:0/3862619833 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4035040 con 0x559d08c351b0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f94e77fe640 1 -- 172.21.15.38:0/3862619833 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94f4048070 con 0x559d08c351b0 2024-09-21T06:28:53.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.141+0000 7f94e77fe640 1 -- 172.21.15.38:0/3862619833 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4005570 con 0x559d08c351b0 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 -- 172.21.15.38:0/3862619833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 msgr2=0x559d090122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f94f4005ab0 tx=0x7f94f4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 -- 172.21.15.38:0/3862619833 shutdown_connections 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d09012810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c351b0 0x559d090122d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 --2- 172.21.15.38:0/3862619833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c1c9f0 0x559d09016d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 -- 172.21.15.38:0/3862619833 >> 172.21.15.38:0/3862619833 conn(0x559d08c52460 msgr2=0x559d09016600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 -- 172.21.15.38:0/3862619833 shutdown_connections 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.142+0000 7f950e5bd740 1 -- 172.21.15.38:0/3862619833 wait complete. 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 -- start start 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 Processor -- start 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09028bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d090909a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f95001abb80 con 0x559d08c1c9f0 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95001acff0 con 0x559d08c351b0 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95001ac250 con 0x559d08c3d390 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f950e5bd740 10 client.0 _ll_register_callbacks cb 0x7f94f80eab20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f95065e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35190/0 (socket says 172.21.15.38:35190) 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f95065e6640 1 -- 172.21.15.38:0/780882126 learned_addr learned my addr 172.21.15.38:0/780882126 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.143+0000 7f95055e4640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09028bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 -- 172.21.15.38:0/780882126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 msgr2=0x559d090909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d090909a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 -- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 msgr2=0x559d09028bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09028bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 -- 172.21.15.38:0/780882126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d09090ee0 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f95065e6640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007e60 tx=0x7f94f0017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6bde71f4067909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f94e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f00183f0 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f94f0018ae0 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f4048070 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f94f0048050 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f950e5bd740 10 client.18048 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.144+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d09092000 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94f4048070 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f94f0017790 con 0x559d08c1c9f0 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 10 client.18048 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 10 client.18048 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 20 client.18048 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c5e070 0x559d09094790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 4 client.18048 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:53.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d08f798a0 con 0x559d08c5e070 2024-09-21T06:28:53.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.145+0000 7f95055e4640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c5e070 0x559d09094790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f95055e4640 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c5e070 0x559d09094790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a05b886cb147a68a server_cookie=7b12f54246fdb336 in_seq=0 out_seq=0 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f94e57fa640 10 client.18048 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f94e57fa640 1 -- 172.21.15.38:0/780882126 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d08f798a0 con 0x559d08c5e070 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f94e57fa640 10 client.18048 handle_command_reply: tid=0 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 client.18048 shutdown 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 msgr2=0x559d09028670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f94f0007e60 tx=0x7f94f0017f50 comp rx=0 tx=0).stop 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 shutdown_connections 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x559d08c5e070 0x559d09094790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559d08c3d390 0x559d090909a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f94e57fa640 0 client.18048 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:28:53.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559d08c351b0 0x559d09028bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 --2- 172.21.15.38:0/780882126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559d08c1c9f0 0x559d09028670 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 >> 172.21.15.38:0/780882126 conn(0x559d08c52460 msgr2=0x559d090204a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 shutdown_connections 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 1 -- 172.21.15.38:0/780882126 wait complete. 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.146+0000 7f950e5bd740 20 client.18048 trim_cache size 0 max 16384 2024-09-21T06:28:53.152 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 msgr2=0x7f94e80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 0x7f94e80b8c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f94f80e4950 tx=0x7f94f8094040 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 msgr2=0x7f950019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f94f800d770 tx=0x7f94f800dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 shutdown_connections 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f94e80b6730 0x7f94e80b8c40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9500107cb0 0x7f950019fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9500107360 0x7f950019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 --2- 172.21.15.38:0/1419994128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9500102160 0x7f950019a650 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 >> 172.21.15.38:0/1419994128 conn(0x7f9500079ea0 msgr2=0x7f95001061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 shutdown_connections 2024-09-21T06:28:53.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:53.147+0000 7f9508049640 1 -- 172.21.15.38:0/1419994128 wait complete. 2024-09-21T06:28:53.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:28:53.802 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:53 smithi038 ceph-mon[31215]: pgmap v601: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:53.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:53 smithi174 ceph-mon[34815]: pgmap v601: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:53.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:53 smithi044 ceph-mon[34369]: pgmap v601: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:28:54.040 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 -- 172.21.15.38:0/3217579555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 msgr2=0x7f108c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 --2- 172.21.15.38:0/3217579555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c110620 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1084009900 tx=0x7f108402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 -- 172.21.15.38:0/3217579555 shutdown_connections 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 --2- 172.21.15.38:0/3217579555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c110620 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 --2- 172.21.15.38:0/3217579555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 --2- 172.21.15.38:0/3217579555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 0x7f108c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 -- 172.21.15.38:0/3217579555 >> 172.21.15.38:0/3217579555 conn(0x7f108c07b850 msgr2=0x7f108c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 -- 172.21.15.38:0/3217579555 shutdown_connections 2024-09-21T06:28:54.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.499+0000 7f1093fe0640 1 -- 172.21.15.38:0/3217579555 wait complete. 2024-09-21T06:28:54.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.500+0000 7f1093fe0640 1 Processor -- start 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.500+0000 7f1093fe0640 1 -- start start 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 0x7f108c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f108c113bd0 con 0x7f108c109df0 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f108c113a50 con 0x7f108c1094a0 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1093fe0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f108c113d50 con 0x7f108c103b60 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35212/0 (socket says 172.21.15.38:35212) 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 -- 172.21.15.38:0/4170104296 learned_addr learned my addr 172.21.15.38:0/4170104296 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109157b640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f1091d7c640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 0x7f108c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 -- 172.21.15.38:0/4170104296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 msgr2=0x7f108c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 0x7f108c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 -- 172.21.15.38:0/4170104296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 msgr2=0x7f108c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 -- 172.21.15.38:0/4170104296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c1a0390 con 0x7f108c109df0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109157b640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.501+0000 7f109257d640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1084009230 tx=0x7f1084004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.502+0000 7f108affd640 1 -- 172.21.15.38:0/4170104296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108403f030 con 0x7f108c109df0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.502+0000 7f108affd640 1 -- 172.21.15.38:0/4170104296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1084003cd0 con 0x7f108c109df0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.502+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1a0620 con 0x7f108c109df0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.502+0000 7f108affd640 1 -- 172.21.15.38:0/4170104296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084035070 con 0x7f108c109df0 2024-09-21T06:28:54.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.502+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c1a0b50 con 0x7f108c109df0 2024-09-21T06:28:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.504+0000 7f109a554740 1 Processor -- start 2024-09-21T06:28:54.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.504+0000 7f108affd640 1 -- 172.21.15.38:0/4170104296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1084031b40 con 0x7f108c109df0 2024-09-21T06:28:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 -- start start 2024-09-21T06:28:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927dea91b0 0x55927e279800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e279d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55927e1efea0 con 0x55927ded2070 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55927e1df2d0 con 0x55927dea91b0 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109a554740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55927e1e30e0 con 0x55927deb1390 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109157b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109157b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35228/0 (socket says 172.21.15.38:35228) 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109157b640 1 -- 172.21.15.38:0/2341873094 learned_addr learned my addr 172.21.15.38:0/2341873094 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f1091d7c640 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927dea91b0 0x55927e279800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.505+0000 7f109157b640 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e279d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 -- 172.21.15.38:0/2341873094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 msgr2=0x55927e279d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e279d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 -- 172.21.15.38:0/2341873094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927dea91b0 msgr2=0x55927e279800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927dea91b0 0x55927e279800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 -- 172.21.15.38:0/2341873094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927df3d650 con 0x55927ded2070 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f108affd640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 0x7f10740b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f1091d7c640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 0x7f10740b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f109157b640 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fc0 tx=0x7f1080007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904e3441bb5c88f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f108affd640 1 -- 172.21.15.38:0/4170104296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f1084108040 con 0x7f108c109df0 2024-09-21T06:28:54.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f1073fff640 1 -- 172.21.15.38:0/2341873094 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080018030 con 0x55927ded2070 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f1073fff640 1 -- 172.21.15.38:0/2341873094 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10800108f0 con 0x55927ded2070 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.506+0000 7f1073fff640 1 -- 172.21.15.38:0/2341873094 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080005440 con 0x55927ded2070 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 -- 172.21.15.38:0/2341873094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 msgr2=0x55927e2792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f1091d7c640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 0x7f10740b8c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55927e277f40 tx=0x7f107c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fc0 tx=0x7f1080007870 comp rx=0 tx=0).stop 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 -- 172.21.15.38:0/2341873094 shutdown_connections 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e279d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927dea91b0 0x55927e279800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 --2- 172.21.15.38:0/2341873094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927ded2070 0x55927e2792c0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 -- 172.21.15.38:0/2341873094 >> 172.21.15.38:0/2341873094 conn(0x55927dec6460 msgr2=0x55927e2771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 -- 172.21.15.38:0/2341873094 shutdown_connections 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.507+0000 7f109a554740 1 -- 172.21.15.38:0/2341873094 wait complete. 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 -- start start 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 Processor -- start 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e284e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e2853d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55927e040700 con 0x55927dea91b0 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55927e17a160 con 0x55927ded2070 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.508+0000 7f109a554740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55927e287aa0 con 0x55927deb1390 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35244/0 (socket says 172.21.15.38:35244) 2024-09-21T06:28:54.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 -- 172.21.15.38:0/2572937530 learned_addr learned my addr 172.21.15.38:0/2572937530 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f109a554740 10 client.0 _ll_register_callbacks cb 0x55927e1939e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f109157b640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e284e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f109257d640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e2853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 -- 172.21.15.38:0/2572937530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 msgr2=0x55927e284e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e284e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 -- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 msgr2=0x55927e2853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e2853d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 -- 172.21.15.38:0/2572937530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927e1a7c90 con 0x55927dea91b0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f1091d7c640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f107c01cc10 tx=0x7f107c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8274c57e76d3236d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f10717fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c02c060 con 0x55927dea91b0 2024-09-21T06:28:54.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f107c016030 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.509+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10800108f0 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f107c00ae70 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 10 client.18060 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55927e293790 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10800108f0 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f107c01a7e0 con 0x55927dea91b0 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 10 client.18060 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 10 client.18060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 20 client.18060 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de909f0 0x55927e296ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 4 client.18060 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:54.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55927e1f1df0 con 0x55927de909f0 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.510+0000 7f109157b640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de909f0 0x55927e296ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.511+0000 7f109157b640 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de909f0 0x55927e296ce0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9ec6a9f190d549 server_cookie=2237f4d00673da86 in_seq=0 out_seq=0 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.511+0000 7f10717fa640 10 client.18060 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f10717fa640 1 -- 172.21.15.38:0/2572937530 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55927e1f1df0 con 0x55927de909f0 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f10717fa640 10 client.18060 handle_command_reply: tid=0 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 client.18060 shutdown 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 msgr2=0x55927e284930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f107c01cc10 tx=0x7f107c004730 comp rx=0 tx=0).stop 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 shutdown_connections 2024-09-21T06:28:54.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e2853d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de909f0 0x55927e296ce0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e284e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 --2- 172.21.15.38:0/2572937530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e284930 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f10717fa640 0 client.18060 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 >> 172.21.15.38:0/2572937530 conn(0x55927dec6460 msgr2=0x55927e27c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 shutdown_connections 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 1 -- 172.21.15.38:0/2572937530 wait complete. 2024-09-21T06:28:54.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.512+0000 7f109a554740 20 client.18060 trim_cache size 0 max 16384 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.525+0000 7f109a554740 1 Processor -- start 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.525+0000 7f109a554740 1 -- start start 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927dea91b0 0x55927e284df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e282060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1b1e90 con 0x55927deb1390 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1af760 con 0x55927ded2070 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109a554740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1ad5d0 con 0x55927dea91b0 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35248/0 (socket says 172.21.15.38:35248) 2024-09-21T06:28:54.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 -- 172.21.15.38:0/3934474224 learned_addr learned my addr 172.21.15.38:0/3934474224 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f1091d7c640 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927dea91b0 0x55927e284df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109257d640 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e282060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 -- 172.21.15.38:0/3934474224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927dea91b0 msgr2=0x55927e284df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927dea91b0 0x55927e284df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 -- 172.21.15.38:0/3934474224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 msgr2=0x55927e282060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e282060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 -- 172.21.15.38:0/3934474224 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927e271460 con 0x55927deb1390 2024-09-21T06:28:54.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.526+0000 7f109157b640 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f1080010740 tx=0x7f1080007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b01342a6c146c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f10737fe640 1 -- 172.21.15.38:0/3934474224 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080018040 con 0x55927deb1390 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f10737fe640 1 -- 172.21.15.38:0/3934474224 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1080019040 con 0x55927deb1390 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f10737fe640 1 -- 172.21.15.38:0/3934474224 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10800053b0 con 0x55927deb1390 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 -- 172.21.15.38:0/3934474224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 msgr2=0x55927e281b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f1080010740 tx=0x7f1080007f40 comp rx=0 tx=0).stop 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 -- 172.21.15.38:0/3934474224 shutdown_connections 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e282060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927deb1390 0x55927e281b20 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 --2- 172.21.15.38:0/3934474224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927dea91b0 0x55927e284df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.527+0000 7f109a554740 1 -- 172.21.15.38:0/3934474224 >> 172.21.15.38:0/3934474224 conn(0x55927dec6460 msgr2=0x55927e2846e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- 172.21.15.38:0/3934474224 shutdown_connections 2024-09-21T06:28:54.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- 172.21.15.38:0/3934474224 wait complete. 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- start start 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 Processor -- start 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e289670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e3006a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1adc20 con 0x55927dea91b0 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1af090 con 0x55927ded2070 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.528+0000 7f109a554740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1ae2f0 con 0x55927deb1390 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f109a554740 10 client.0 _ll_register_callbacks cb 0x7f107c00a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35256/0 (socket says 172.21.15.38:35256) 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 -- 172.21.15.38:0/3444323638 learned_addr learned my addr 172.21.15.38:0/3444323638 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f109257d640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e3006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f109157b640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e289670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 -- 172.21.15.38:0/3444323638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 msgr2=0x55927e289670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e289670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 -- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 msgr2=0x55927e3006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e3006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 -- 172.21.15.38:0/3444323638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927e290cc0 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f1091d7c640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f107c000c00 tx=0x7f107c01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51078935c765a553 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f10717fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c01c7c0 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f107c00f7f0 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.529+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1080019040 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f107c00e3b0 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 10 client.18066 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55927e301b90 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1080019040 con 0x55927dea91b0 2024-09-21T06:28:54.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f107c03a020 con 0x55927dea91b0 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 10 client.18066 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 20 client.18066 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de65da0 0x55927e304330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 4 client.18066 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55927e1ed8a0 con 0x55927de65da0 2024-09-21T06:28:54.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.530+0000 7f109157b640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de65da0 0x55927e304330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109157b640 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de65da0 0x55927e304330 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d50442acc177e37 server_cookie=952d02f6a7896350 in_seq=0 out_seq=0 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f10717fa640 10 client.18066 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f10717fa640 1 -- 172.21.15.38:0/3444323638 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55927e1ed8a0 con 0x55927de65da0 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f10717fa640 10 client.18066 handle_command_reply: tid=0 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 client.18066 shutdown 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 msgr2=0x55927e2890f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f107c000c00 tx=0x7f107c01aaf0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 shutdown_connections 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927ded2070 0x55927e3006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55927de65da0 0x55927e304330 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927deb1390 0x55927e289670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 --2- 172.21.15.38:0/3444323638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927dea91b0 0x55927e2890f0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f10717fa640 0 client.18066 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.531+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 >> 172.21.15.38:0/3444323638 conn(0x55927dec6460 msgr2=0x55927e28fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 shutdown_connections 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f109a554740 1 -- 172.21.15.38:0/3444323638 wait complete. 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f109a554740 20 client.18066 trim_cache size 0 max 16384 2024-09-21T06:28:54.537 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 msgr2=0x7f10740b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 0x7f10740b8c40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55927e277f40 tx=0x7f107c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 msgr2=0x7f108c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1084009230 tx=0x7f1084004360 comp rx=0 tx=0).stop 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 shutdown_connections 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f10740b6730 0x7f10740b8c40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f108c109df0 0x7f108c19fd20 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f108c1094a0 0x7f108c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 --2- 172.21.15.38:0/4170104296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f108c103b60 0x7f108c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 >> 172.21.15.38:0/4170104296 conn(0x7f108c07b850 msgr2=0x7f108c107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 shutdown_connections 2024-09-21T06:28:54.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:54.532+0000 7f1093fe0640 1 -- 172.21.15.38:0/4170104296 wait complete. 2024-09-21T06:28:55.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:55 smithi174 ceph-mon[34815]: pgmap v602: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:55.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:55 smithi044 ceph-mon[34369]: pgmap v602: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:55.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:55 smithi038 ceph-mon[31215]: pgmap v602: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:28:56.173 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:28:56.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:28:56.445 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 -- 172.21.15.38:0/2188142107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4128105340 msgr2=0x7f412810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 --2- 172.21.15.38:0/2188142107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4128105340 0x7f412810d890 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f411c009900 tx=0x7f411c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 -- 172.21.15.38:0/2188142107 shutdown_connections 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 --2- 172.21.15.38:0/2188142107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f412810de50 0x7f4128110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 --2- 172.21.15.38:0/2188142107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4128105340 0x7f412810d890 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 --2- 172.21.15.38:0/2188142107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41281049f0 0x7f4128104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 -- 172.21.15.38:0/2188142107 >> 172.21.15.38:0/2188142107 conn(0x7f4128079750 msgr2=0x7f4128079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 -- 172.21.15.38:0/2188142107 shutdown_connections 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.907+0000 7f412db52640 1 -- 172.21.15.38:0/2188142107 wait complete. 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.908+0000 7f412db52640 1 Processor -- start 2024-09-21T06:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.908+0000 7f412db52640 1 -- start start 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 0x7f412819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 0x7f412819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4128113bd0 con 0x7f412810de50 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4128113a50 con 0x7f41281049f0 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f412db52640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4128113d50 con 0x7f4128105340 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f41277fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 0x7f412819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f41277fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 0x7f412819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56240/0 (socket says 172.21.15.38:56240) 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35264/0 (socket says 172.21.15.38:35264) 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f41277fe640 1 -- 172.21.15.38:0/3049694418 learned_addr learned my addr 172.21.15.38:0/3049694418 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4126ffd640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 0x7f412819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 -- 172.21.15.38:0/3049694418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 msgr2=0x7f412819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 0x7f412819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 -- 172.21.15.38:0/3049694418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 msgr2=0x7f412819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 0x7f412819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4127fff640 1 -- 172.21.15.38:0/3049694418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281a0610 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.909+0000 7f4126ffd640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 0x7f412819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f4127fff640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f412000ca30 tx=0x7f412000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f4124ff9640 1 -- 172.21.15.38:0/3049694418 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120007d90 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281a0900 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f4124ff9640 1 -- 172.21.15.38:0/3049694418 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4120005020 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f4124ff9640 1 -- 172.21.15.38:0/3049694418 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412000f740 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.910+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281a7060 con 0x7f412810de50 2024-09-21T06:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f4124ff9640 1 -- 172.21.15.38:0/3049694418 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4120004a00 con 0x7f412810de50 2024-09-21T06:28:56.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f41340c6740 1 Processor -- start 2024-09-21T06:28:56.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f41340c6740 1 -- start start 2024-09-21T06:28:56.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f4124ff9640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 0x7f41100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f41340c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f41340c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7bb490 0x56177eb8b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.913+0000 7f41340c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4124ff9640 1 -- 172.21.15.38:0/3049694418 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f41200e7550 con 0x7f412810de50 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f41340c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56177eb01e60 con 0x56177e7c3670 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f41340c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56177eaf1290 con 0x56177e7e4350 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f41340c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56177eaf50a0 con 0x56177e7bb490 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4126ffd640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 0x7f41100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35270/0 (socket says 172.21.15.38:35270) 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 -- 172.21.15.38:0/210093889 learned_addr learned my addr 172.21.15.38:0/210093889 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f41277fe640 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4126ffd640 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7bb490 0x56177eb8b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 -- 172.21.15.38:0/210093889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7bb490 msgr2=0x56177eb8b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7bb490 0x56177eb8b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 -- 172.21.15.38:0/210093889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 msgr2=0x56177eb8b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb8b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 -- 172.21.15.38:0/210093889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177e84f930 con 0x56177e7c3670 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4126ffd640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 0x7f41100b8a70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f411c009230 tx=0x7f411c005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.914+0000 7f4127fff640 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f41200ad380 tx=0x7f41200adbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dc9acd08fe700b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f410dffb640 1 -- 172.21.15.38:0/210093889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412001d070 con 0x56177e7c3670 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f410dffb640 1 -- 172.21.15.38:0/210093889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f41200a9660 con 0x56177e7c3670 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f410dffb640 1 -- 172.21.15.38:0/210093889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200a7d30 con 0x56177e7c3670 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f41340c6740 1 -- 172.21.15.38:0/210093889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 msgr2=0x56177eb8beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f41340c6740 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f41200ad380 tx=0x7f41200adbb0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.915+0000 7f41340c6740 1 -- 172.21.15.38:0/210093889 shutdown_connections 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7c3670 0x56177eb8beb0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7bb490 0x56177eb8b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 --2- 172.21.15.38:0/210093889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb8b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 -- 172.21.15.38:0/210093889 >> 172.21.15.38:0/210093889 conn(0x56177e7d8740 msgr2=0x56177eb89320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 -- 172.21.15.38:0/210093889 shutdown_connections 2024-09-21T06:28:56.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 -- 172.21.15.38:0/210093889 wait complete. 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 -- start start 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.916+0000 7f41340c6740 1 Processor -- start 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb9b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eba71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56177e952890 con 0x56177e7bb490 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56177ea8bd40 con 0x56177e7e4350 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56177eb9deb0 con 0x56177e7c3670 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 10 client.0 _ll_register_callbacks cb 0x56177eaefc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35278/0 (socket says 172.21.15.38:35278) 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 -- 172.21.15.38:0/1908263964 learned_addr learned my addr 172.21.15.38:0/1908263964 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:56.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f4127fff640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eba71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f4126ffd640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb9b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 -- 172.21.15.38:0/1908263964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 msgr2=0x56177eb9b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb9b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 -- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 msgr2=0x56177eba71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eba71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 -- 172.21.15.38:0/1908263964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177eba7750 con 0x56177e7bb490 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41277fe640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f41180116f0 tx=0x7f4118011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8961765895f748d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f4106ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411801f060 con 0x56177e7bb490 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41200a9660 con 0x56177e7bb490 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.917+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f4118010b40 con 0x56177e7bb490 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4118010d40 con 0x56177e7bb490 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 10 client.18078 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:56.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56177ebaa0e0 con 0x56177e7bb490 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f41200a9660 con 0x56177e7bb490 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4118011ce0 con 0x56177e7bb490 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 10 client.18078 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 20 client.18078 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e7a2cd0 0x56177ebad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 4 client.18078 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56177eb03db0 con 0x56177e7a2cd0 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.918+0000 7f4126ffd640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e7a2cd0 0x56177ebad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.919+0000 7f4106ffd640 10 client.18078 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.919+0000 7f4126ffd640 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e7a2cd0 0x56177ebad640 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=955ad5ea27baf862 server_cookie=42954fefa711f4a0 in_seq=0 out_seq=0 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f4106ffd640 1 -- 172.21.15.38:0/1908263964 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56177eb03db0 con 0x56177e7a2cd0 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f4106ffd640 10 client.18078 handle_command_reply: tid=0 2024-09-21T06:28:56.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 client.18078 shutdown 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 msgr2=0x56177eb9b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f41180116f0 tx=0x7f4118011bb0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 shutdown_connections 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eba71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e7a2cd0 0x56177ebad640 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb9b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 --2- 172.21.15.38:0/1908263964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb9b3d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 >> 172.21.15.38:0/1908263964 conn(0x56177e7d8740 msgr2=0x56177eb87850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f4106ffd640 0 client.18078 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 shutdown_connections 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 1 -- 172.21.15.38:0/1908263964 wait complete. 2024-09-21T06:28:56.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.920+0000 7f41340c6740 20 client.18078 trim_cache size 0 max 16384 2024-09-21T06:28:56.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 Processor -- start 2024-09-21T06:28:56.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 -- start start 2024-09-21T06:28:56.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb983c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb98900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f41281afbd0 con 0x56177e7bb490 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41281ad4a0 con 0x56177e7e4350 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41340c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41281ab310 con 0x56177e7c3670 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41277fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35288/0 (socket says 172.21.15.38:35288) 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.938+0000 7f41277fe640 1 -- 172.21.15.38:0/2184659714 learned_addr learned my addr 172.21.15.38:0/2184659714 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 -- 172.21.15.38:0/2184659714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 msgr2=0x56177eb983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 -- 172.21.15.38:0/2184659714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 msgr2=0x56177eb98900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb98900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 -- 172.21.15.38:0/2184659714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177eb8c220 con 0x56177e7bb490 2024-09-21T06:28:56.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f41277fe640 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4118000c00 tx=0x7f4118010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a2b34a20c7b06e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f410d7fa640 1 -- 172.21.15.38:0/2184659714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411800bbe0 con 0x56177e7bb490 2024-09-21T06:28:56.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f410d7fa640 1 -- 172.21.15.38:0/2184659714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4118005510 con 0x56177e7bb490 2024-09-21T06:28:56.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.939+0000 7f410d7fa640 1 -- 172.21.15.38:0/2184659714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118004660 con 0x56177e7bb490 2024-09-21T06:28:56.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- 172.21.15.38:0/2184659714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 msgr2=0x56177eb87f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4118000c00 tx=0x7f4118010cd0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- 172.21.15.38:0/2184659714 shutdown_connections 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7e4350 0x56177eb98900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eb983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 --2- 172.21.15.38:0/2184659714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7bb490 0x56177eb87f60 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- 172.21.15.38:0/2184659714 >> 172.21.15.38:0/2184659714 conn(0x56177e7d8740 msgr2=0x56177eb87850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- 172.21.15.38:0/2184659714 shutdown_connections 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- 172.21.15.38:0/2184659714 wait complete. 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 -- start start 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.940+0000 7f41340c6740 1 Processor -- start 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7bb490 0x56177eba35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eba3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f41281ab960 con 0x56177e7e4350 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41281acdd0 con 0x56177e7bb490 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41281ac030 con 0x56177e7c3670 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41340c6740 10 client.0 _ll_register_callbacks cb 0x7f411800b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35296/0 (socket says 172.21.15.38:35296) 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 -- 172.21.15.38:0/3376420896 learned_addr learned my addr 172.21.15.38:0/3376420896 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f41277fe640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7bb490 0x56177eba35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4126ffd640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eba3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 -- 172.21.15.38:0/3376420896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 msgr2=0x56177eba3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eba3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 -- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7bb490 msgr2=0x56177eba35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7bb490 0x56177eba35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.941+0000 7f4127fff640 1 -- 172.21.15.38:0/3376420896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177eb9ea60 con 0x56177e7e4350 2024-09-21T06:28:56.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4127fff640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f41200059c0 tx=0x7f41200a9890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86716c64e74359a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412001d040 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f4120094b30 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4118005510 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f41200a9290 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 10 client.18084 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56177ec18c60 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4118005510 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4120020060 con 0x56177e7e4350 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 10 client.18084 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.942+0000 7f41340c6740 20 client.18084 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e778080 0x56177ec1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:56.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f41340c6740 4 client.18084 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:28:56.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56177eaff860 con 0x56177e778080 2024-09-21T06:28:56.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f41277fe640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e778080 0x56177ec1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f41277fe640 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e778080 0x56177ec1b010 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4df5fd9fe9e586d1 server_cookie=22aaea37fb43030c in_seq=0 out_seq=0 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.943+0000 7f4106ffd640 10 client.18084 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f4106ffd640 1 -- 172.21.15.38:0/3376420896 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56177eaff860 con 0x56177e778080 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f4106ffd640 10 client.18084 handle_command_reply: tid=0 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 client.18084 shutdown 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 msgr2=0x56177eb9e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f41200059c0 tx=0x7f41200a9890 comp rx=0 tx=0).stop 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 shutdown_connections 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56177e7e4350 0x56177eb9e2d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56177e778080 0x56177ec1b010 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56177e7c3670 0x56177eba3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f4106ffd640 0 client.18084 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 --2- 172.21.15.38:0/3376420896 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56177e7bb490 0x56177eba35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 >> 172.21.15.38:0/3376420896 conn(0x56177e7d8740 msgr2=0x56177eb99650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 shutdown_connections 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 1 -- 172.21.15.38:0/3376420896 wait complete. 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.945+0000 7f41340c6740 20 client.18084 trim_cache size 0 max 16384 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "866bb5c6-3cde-4cbd-958a-7d308dc68dac", 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:28:56.950 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 msgr2=0x7f41100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 0x7f41100b8a70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f411c009230 tx=0x7f411c005ea0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 msgr2=0x7f412819fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f412000ca30 tx=0x7f412000cef0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 shutdown_connections 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f41100b6560 0x7f41100b8a70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f412810de50 0x7f412819fee0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4128105340 0x7f412819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 --2- 172.21.15.38:0/3049694418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41281049f0 0x7f412819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:56.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 >> 172.21.15.38:0/3049694418 conn(0x7f4128079750 msgr2=0x7f4128100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:56.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 shutdown_connections 2024-09-21T06:28:56.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:56.946+0000 7f412db52640 1 -- 172.21.15.38:0/3049694418 wait complete. 2024-09-21T06:28:57.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:28:57.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:57 smithi174 ceph-mon[34815]: pgmap v603: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:57 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:28:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:57 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:57 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:28:57.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:57 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:57 smithi044 ceph-mon[34369]: pgmap v603: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:57 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:28:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:57 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:57 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:28:57.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:57 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:57.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:57 smithi038 ceph-mon[31215]: pgmap v603: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:28:57.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:57 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:28:57.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:57 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:57.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:57 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:28:57.987 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:57 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:28:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 -- 172.21.15.38:0/3529209984 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f815010de30 msgr2=0x7f8150110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 --2- 172.21.15.38:0/3529209984 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f815010de30 0x7f8150110320 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 -- 172.21.15.38:0/3529209984 shutdown_connections 2024-09-21T06:28:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 --2- 172.21.15.38:0/3529209984 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f815010de30 0x7f8150110320 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 --2- 172.21.15.38:0/3529209984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 --2- 172.21.15.38:0/3529209984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81501049d0 0x7f8150104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 -- 172.21.15.38:0/3529209984 >> 172.21.15.38:0/3529209984 conn(0x7f8150079740 msgr2=0x7f8150079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 -- 172.21.15.38:0/3529209984 shutdown_connections 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 -- 172.21.15.38:0/3529209984 wait complete. 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.449+0000 7f815592f640 1 Processor -- start 2024-09-21T06:28:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 -- start start 2024-09-21T06:28:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 0x7f815019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8150113c30 con 0x7f81501049d0 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8150113ab0 con 0x7f815010de30 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f815592f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8150113db0 con 0x7f8150105320 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f814effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f814effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35312/0 (socket says 172.21.15.38:35312) 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f814effd640 1 -- 172.21.15.38:0/1642848204 learned_addr learned my addr 172.21.15.38:0/1642848204 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 0x7f815019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.450+0000 7f814e7fc640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 -- 172.21.15.38:0/1642848204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 msgr2=0x7f815019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 -- 172.21.15.38:0/1642848204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 msgr2=0x7f815019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 0x7f815019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 -- 172.21.15.38:0/1642848204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81501a04d0 con 0x7f81501049d0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 0x7f815019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814e7fc640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f814effd640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f814000d950 tx=0x7f814000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f815492d640 1 -- 172.21.15.38:0/1642848204 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140017020 con 0x7f81501049d0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f815492d640 1 -- 172.21.15.38:0/1642848204 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8140009c30 con 0x7f81501049d0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81501a07c0 con 0x7f81501049d0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f815492d640 1 -- 172.21.15.38:0/1642848204 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814000f740 con 0x7f81501049d0 2024-09-21T06:28:58.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.451+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81501a6f20 con 0x7f81501049d0 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 Processor -- start 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 -- start start 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815492d640 1 -- 172.21.15.38:0/1642848204 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f814001a020 con 0x7f81501049d0 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ed61b0 0x555a622a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555a6221ce50 con 0x555a61ede390 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a6220c280 con 0x555a61eff070 2024-09-21T06:28:58.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f815bea3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a62210090 con 0x555a61ed61b0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f814e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f814e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35324/0 (socket says 172.21.15.38:35324) 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f814e7fc640 1 -- 172.21.15.38:0/3084473597 learned_addr learned my addr 172.21.15.38:0/3084473597 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f814f7fe640 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.454+0000 7f814effd640 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ed61b0 0x555a622a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 -- 172.21.15.38:0/3084473597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ed61b0 msgr2=0x555a622a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ed61b0 0x555a622a6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 -- 172.21.15.38:0/3084473597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 msgr2=0x555a622a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 -- 172.21.15.38:0/3084473597 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a61f6a650 con 0x555a61ede390 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f815492d640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 0x7f81380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814e7fc640 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8144007f20 tx=0x7f814400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b68a61d19581c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 0x7f81380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f8135ffb640 1 -- 172.21.15.38:0/3084473597 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144014070 con 0x555a61ede390 2024-09-21T06:28:58.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f815492d640 1 -- 172.21.15.38:0/1642848204 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f81400e7720 con 0x7f81501049d0 2024-09-21T06:28:58.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f8135ffb640 1 -- 172.21.15.38:0/3084473597 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f814400fd20 con 0x555a61ede390 2024-09-21T06:28:58.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.455+0000 7f8135ffb640 1 -- 172.21.15.38:0/3084473597 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400ed70 con 0x555a61ede390 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 0x7f81380b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81480096c0 tx=0x7f8148031440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 -- 172.21.15.38:0/3084473597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 msgr2=0x555a622a70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8144007f20 tx=0x7f814400c750 comp rx=0 tx=0).stop 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 -- 172.21.15.38:0/3084473597 shutdown_connections 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ede390 0x555a622a70d0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ed61b0 0x555a622a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 --2- 172.21.15.38:0/3084473597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 -- 172.21.15.38:0/3084473597 >> 172.21.15.38:0/3084473597 conn(0x555a61ef3460 msgr2=0x555a622a4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 -- 172.21.15.38:0/3084473597 shutdown_connections 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.456+0000 7f815bea3740 1 -- 172.21.15.38:0/3084473597 wait complete. 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 -- start start 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 Processor -- start 2024-09-21T06:28:58.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555a6206d700 con 0x555a61eff070 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a621a7110 con 0x555a61ed61b0 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a622b9240 con 0x555a61ede390 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.457+0000 7f815bea3740 10 client.0 _ll_register_callbacks cb 0x555a621c0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35338/0 (socket says 172.21.15.38:35338) 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 -- 172.21.15.38:0/1710346403 learned_addr learned my addr 172.21.15.38:0/1710346403 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814e7fc640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814effd640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 -- 172.21.15.38:0/1710346403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 msgr2=0x555a622b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 -- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 msgr2=0x555a622b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 -- 172.21.15.38:0/1710346403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a621d4c40 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814e7fc640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f814f7fe640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8148033000 tx=0x7f814802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750f6e673bf6a0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f812effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814804c070 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8148004310 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.458+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f814400fd20 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8148058050 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 10 client.18096 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555a622c4e50 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f814400fd20 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f814803c600 con 0x555a61eff070 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 10 client.18096 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 10 client.18096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 20 client.18096 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61ebd9f0 0x555a622c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 4 client.18096 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a6221eda0 con 0x555a61ebd9f0 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.459+0000 7f814effd640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61ebd9f0 0x555a622c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.460+0000 7f814effd640 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61ebd9f0 0x555a622c8390 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecae9987c30c7c94 server_cookie=139af380f565bc0d in_seq=0 out_seq=0 2024-09-21T06:28:58.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.460+0000 7f812effd640 10 client.18096 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:58.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f812effd640 1 -- 172.21.15.38:0/1710346403 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a6221eda0 con 0x555a61ebd9f0 2024-09-21T06:28:58.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f812effd640 10 client.18096 handle_command_reply: tid=0 2024-09-21T06:28:58.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 client.18096 shutdown 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 msgr2=0x555a622b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8148033000 tx=0x7f814802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 shutdown_connections 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622b2690 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61ebd9f0 0x555a622c8390 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 --2- 172.21.15.38:0/1710346403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 >> 172.21.15.38:0/1710346403 conn(0x555a61ef3460 msgr2=0x555a622a97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f812effd640 0 client.18096 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 shutdown_connections 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 1 -- 172.21.15.38:0/1710346403 wait complete. 2024-09-21T06:28:58.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.461+0000 7f815bea3740 20 client.18096 trim_cache size 0 max 16384 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 Processor -- start 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 -- start start 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81501afe20 con 0x555a61ed61b0 2024-09-21T06:28:58.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81501ad6f0 con 0x555a61eff070 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f815bea3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81501ab540 con 0x555a61ede390 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f814effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f814effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35354/0 (socket says 172.21.15.38:35354) 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f814effd640 1 -- 172.21.15.38:0/843360859 learned_addr learned my addr 172.21.15.38:0/843360859 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.479+0000 7f814e7fc640 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 -- 172.21.15.38:0/843360859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 msgr2=0x555a622b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 -- 172.21.15.38:0/843360859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 msgr2=0x555a622c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 -- 172.21.15.38:0/843360859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a622b2ed0 con 0x555a61ed61b0 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814e7fc640 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:58.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f814effd640 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f81400e54c0 tx=0x7f8140010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504ae6770996dc5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f81357fa640 1 -- 172.21.15.38:0/843360859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140009de0 con 0x555a61ed61b0 2024-09-21T06:28:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f81357fa640 1 -- 172.21.15.38:0/843360859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81400adcc0 con 0x555a61ed61b0 2024-09-21T06:28:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.480+0000 7f81357fa640 1 -- 172.21.15.38:0/843360859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81400b62a0 con 0x555a61ed61b0 2024-09-21T06:28:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- 172.21.15.38:0/843360859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 msgr2=0x555a622a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f81400e54c0 tx=0x7f8140010e20 comp rx=0 tx=0).stop 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- 172.21.15.38:0/843360859 shutdown_connections 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61eff070 0x555a622c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 --2- 172.21.15.38:0/843360859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61ed61b0 0x555a622a8150 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- 172.21.15.38:0/843360859 >> 172.21.15.38:0/843360859 conn(0x555a61ef3460 msgr2=0x555a622b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- 172.21.15.38:0/843360859 shutdown_connections 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- 172.21.15.38:0/843360859 wait complete. 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 -- start start 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.481+0000 7f815bea3740 1 Processor -- start 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622beac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f81501abbb0 con 0x555a61eff070 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81501ad020 con 0x555a61ed61b0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81501ac280 con 0x555a61ede390 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f815bea3740 10 client.0 _ll_register_callbacks cb 0x7f8148040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35370/0 (socket says 172.21.15.38:35370) 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 -- 172.21.15.38:0/2796319490 learned_addr learned my addr 172.21.15.38:0/2796319490 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814effd640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814e7fc640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 -- 172.21.15.38:0/2796319490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 msgr2=0x555a622b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 -- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 msgr2=0x555a622beac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622beac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.482+0000 7f814f7fe640 1 -- 172.21.15.38:0/2796319490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a622baa70 con 0x555a61eff070 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f814f7fe640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f81480045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20322bc4fae6d89f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:58.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814804c040 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f8148005040 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81400adcc0 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f814806a050 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 10 client.18102 fetch_fsmap learned FSMap version 34 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555a62332a20 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81400adcc0 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f81480035f0 con 0x555a61eff070 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 10 client.18102 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 20 client.18102 populate_metadata read hostname 'smithi038' 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.483+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61e92da0 0x555a623351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.484+0000 7f815bea3740 4 client.18102 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:28:58.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.484+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a6221a850 con 0x555a61e92da0 2024-09-21T06:28:58.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.484+0000 7f814effd640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61e92da0 0x555a623351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.484+0000 7f814effd640 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61e92da0 0x555a623351d0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f810ceae4ebc7f6 server_cookie=4fca90c3b8a483c in_seq=0 out_seq=0 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.484+0000 7f812effd640 10 client.18102 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f812effd640 1 -- 172.21.15.38:0/2796319490 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6906 (crc 0 0 0) 0x555a6221a850 con 0x555a61e92da0 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f812effd640 10 client.18102 handle_command_reply: tid=0 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 client.18102 shutdown 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 msgr2=0x555a622ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f81480045c0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 shutdown_connections 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555a61eff070 0x555a622ba4b0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555a61e92da0 0x555a623351d0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a61ede390 0x555a622b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 --2- 172.21.15.38:0/2796319490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a61ed61b0 0x555a622beac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f812effd640 0 client.18102 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 >> 172.21.15.38:0/2796319490 conn(0x555a61ef3460 msgr2=0x555a622b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 shutdown_connections 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 1 -- 172.21.15.38:0/2796319490 wait complete. 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.485+0000 7f815bea3740 20 client.18102 trim_cache size 0 max 16384 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:28:58.491 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.492 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.493 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:28:58.494 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.496 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.497 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.503 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.504 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.505 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:28:58.506 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 msgr2=0x7f81380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 0x7f81380b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81480096c0 tx=0x7f8148031440 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 msgr2=0x7f815019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f814000d950 tx=0x7f814000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 shutdown_connections 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f81380b6680 0x7f81380b8b90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f815010de30 0x7f815019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8150105320 0x7f815019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 --2- 172.21.15.38:0/1642848204 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f81501049d0 0x7f815019a560 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 >> 172.21.15.38:0/1642848204 conn(0x7f8150079740 msgr2=0x7f81500ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 shutdown_connections 2024-09-21T06:28:58.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:28:58.486+0000 7f815592f640 1 -- 172.21.15.38:0/1642848204 wait complete. 2024-09-21T06:28:58.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:58 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:28:58.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:58 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:28:58.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:58 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:28:59.288 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:28:59.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:28:59.565 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:59.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:59 smithi174 ceph-mon[34815]: pgmap v604: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:28:59.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:28:59 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:59.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:59 smithi044 ceph-mon[34369]: pgmap v604: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:28:59.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:28:59 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:59.910 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:59 smithi038 ceph-mon[31215]: pgmap v604: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-09-21T06:28:59.910 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:28:59 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 -- 172.21.15.38:0/4294019345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224109df0 msgr2=0x7fd224110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 --2- 172.21.15.38:0/4294019345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224109df0 0x7fd224110620 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009ca0 tx=0x7fd21c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 -- 172.21.15.38:0/4294019345 shutdown_connections 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 --2- 172.21.15.38:0/4294019345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224109df0 0x7fd224110620 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 --2- 172.21.15.38:0/4294019345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2241094a0 0x7fd2241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 --2- 172.21.15.38:0/4294019345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd224103b60 0x7fd224103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 -- 172.21.15.38:0/4294019345 >> 172.21.15.38:0/4294019345 conn(0x7fd22407b850 msgr2=0x7fd22407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:00.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 -- 172.21.15.38:0/4294019345 shutdown_connections 2024-09-21T06:29:00.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.004+0000 7fd229dcc640 1 -- 172.21.15.38:0/4294019345 wait complete. 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 Processor -- start 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 -- start start 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2241094a0 0x7fd22419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224109df0 0x7fd22419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113bf0 con 0x7fd224103b60 2024-09-21T06:29:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113a70 con 0x7fd2241094a0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.005+0000 7fd229dcc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113d70 con 0x7fd224109df0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54918/0 (socket says 172.21.15.38:54918) 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 -- 172.21.15.38:0/2645185889 learned_addr learned my addr 172.21.15.38:0/2645185889 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd222ffd640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2241094a0 0x7fd22419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd223fff640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224109df0 0x7fd22419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 -- 172.21.15.38:0/2645185889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224109df0 msgr2=0x7fd22419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224109df0 0x7fd22419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 -- 172.21.15.38:0/2645185889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2241094a0 msgr2=0x7fd22419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2241094a0 0x7fd22419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 -- 172.21.15.38:0/2645185889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a04f0 con 0x7fd224103b60 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd2237fe640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d950 tx=0x7fd21400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.006+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017030 con 0x7fd224103b60 2024-09-21T06:29:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.007+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a07e0 con 0x7fd224103b60 2024-09-21T06:29:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.007+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd214004020 con 0x7fd224103b60 2024-09-21T06:29:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.007+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140047a0 con 0x7fd224103b60 2024-09-21T06:29:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.007+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2240755f0 con 0x7fd224103b60 2024-09-21T06:29:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.008+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd224103f70 con 0x7fd224103b60 2024-09-21T06:29:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.009+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd2140041d0 con 0x7fd224103b60 2024-09-21T06:29:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.010+0000 7fd220ff9640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 0x7fd20c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.010+0000 7fd222ffd640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 0x7fd20c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.010+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd2140e76d0 con 0x7fd224103b60 2024-09-21T06:29:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.011+0000 7fd222ffd640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 0x7fd20c0b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd224109170 tx=0x7fd218005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.013+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2140adc70 con 0x7fd224103b60 2024-09-21T06:29:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.243+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd22419b6b0 con 0x7fd224103b60 2024-09-21T06:29:00.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.244+0000 7fd220ff9640 1 -- 172.21.15.38:0/2645185889 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fd2140b2050 con 0x7fd224103b60 2024-09-21T06:29:00.245 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:29:00.246 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:29:00.246 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 msgr2=0x7fd20c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 0x7fd20c0b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd224109170 tx=0x7fd218005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 msgr2=0x7fd22419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d950 tx=0x7fd21400de10 comp rx=0 tx=0).stop 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 shutdown_connections 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd20c0b6680 0x7fd20c0b8b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224109df0 0x7fd22419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2241094a0 0x7fd22419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 --2- 172.21.15.38:0/2645185889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd224103b60 0x7fd22419a580 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.246+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 >> 172.21.15.38:0/2645185889 conn(0x7fd22407b850 msgr2=0x7fd224107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.247+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 shutdown_connections 2024-09-21T06:29:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:00.247+0000 7fd229dcc640 1 -- 172.21.15.38:0/2645185889 wait complete. 2024-09-21T06:29:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:29:00.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:00 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2645185889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:29:00.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:00 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2645185889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:00.922 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:00.922 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:00.923 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:29:00.923 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:00 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2645185889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:00.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:01.207 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:01.643 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:01 smithi038 ceph-mon[31215]: pgmap v605: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-09-21T06:29:01.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 -- 172.21.15.38:0/4103748701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 msgr2=0x7fb044103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/4103748701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044103f70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb034009ca0 tx=0x7fb03402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 -- 172.21.15.38:0/4103748701 shutdown_connections 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/4103748701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb044109df0 0x7fb044110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/4103748701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0441094a0 0x7fb0441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/4103748701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044103f70 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 -- 172.21.15.38:0/4103748701 >> 172.21.15.38:0/4103748701 conn(0x7fb04407b850 msgr2=0x7fb04407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 -- 172.21.15.38:0/4103748701 shutdown_connections 2024-09-21T06:29:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.663+0000 7fb04ac4f640 1 -- 172.21.15.38:0/4103748701 wait complete. 2024-09-21T06:29:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 Processor -- start 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 -- start start 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0441094a0 0x7fb044075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb044109df0 0x7fb044076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb044113bf0 con 0x7fb044103b60 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb044113a70 con 0x7fb044109df0 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.664+0000 7fb04ac4f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb044113d70 con 0x7fb0441094a0 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54948/0 (socket says 172.21.15.38:54948) 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 -- 172.21.15.38:0/819719199 learned_addr learned my addr 172.21.15.38:0/819719199 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb043fff640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0441094a0 0x7fb044075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0491ec640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb044109df0 0x7fb044076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 -- 172.21.15.38:0/819719199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0441094a0 msgr2=0x7fb044075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0441094a0 0x7fb044075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 -- 172.21.15.38:0/819719199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb044109df0 msgr2=0x7fb044076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb044109df0 0x7fb044076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 -- 172.21.15.38:0/819719199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0441a8810 con 0x7fb044103b60 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb0489eb640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb034006010 tx=0x7fb034003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb041ffb640 1 -- 172.21.15.38:0/819719199 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0340316d0 con 0x7fb044103b60 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb041ffb640 1 -- 172.21.15.38:0/819719199 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb034031870 con 0x7fb044103b60 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0441a8aa0 con 0x7fb044103b60 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.665+0000 7fb041ffb640 1 -- 172.21.15.38:0/819719199 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03402fc90 con 0x7fb044103b60 2024-09-21T06:29:01.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.666+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0441a8fe0 con 0x7fb044103b60 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 Processor -- start 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 -- start start 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb041ffb640 1 -- 172.21.15.38:0/819719199 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb034004040 con 0x7fb044103b60 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de1802c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de180800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b0de0f6ea0 con 0x55b0dddb8390 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b0de0e62d0 con 0x55b0dddb01b0 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0511c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0de0ea0e0 con 0x55b0dddd9070 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54958/0 (socket says 172.21.15.38:54958) 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 -- 172.21.15.38:0/247683085 learned_addr learned my addr 172.21.15.38:0/247683085 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0489eb640 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de180800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb0491ec640 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de1802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 -- 172.21.15.38:0/247683085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 msgr2=0x55b0de1802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de1802c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 -- 172.21.15.38:0/247683085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 msgr2=0x55b0de180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.669+0000 7fb043fff640 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de180800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb043fff640 1 -- 172.21.15.38:0/247683085 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dde44650 con 0x55b0dddb8390 2024-09-21T06:29:01.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb043fff640 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00ac30 tx=0x7fb02c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef9cf5489513ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb041ffb640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 0x7fb0300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb03affd640 1 -- 172.21.15.38:0/247683085 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c01d070 con 0x55b0dddb8390 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb03affd640 1 -- 172.21.15.38:0/247683085 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb02c018b10 con 0x55b0dddb8390 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb03affd640 1 -- 172.21.15.38:0/247683085 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c010be0 con 0x55b0dddb8390 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb041ffb640 1 -- 172.21.15.38:0/819719199 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fb0341089c0 con 0x7fb044103b60 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.670+0000 7fb0491ec640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 0x7fb0300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 -- 172.21.15.38:0/247683085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 msgr2=0x55b0de180d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0491ec640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 0x7fb0300b8b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b650 tx=0x7fb03c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00ac30 tx=0x7fb02c00f790 comp rx=0 tx=0).stop 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 -- 172.21.15.38:0/247683085 shutdown_connections 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de180d40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de180800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 --2- 172.21.15.38:0/247683085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de1802c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 -- 172.21.15.38:0/247683085 >> 172.21.15.38:0/247683085 conn(0x55b0dddcd460 msgr2=0x55b0de17e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 -- 172.21.15.38:0/247683085 shutdown_connections 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.671+0000 7fb0511c3740 1 -- 172.21.15.38:0/247683085 wait complete. 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 -- start start 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 Processor -- start 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb01b0 0x55b0de18b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb8390 0x55b0de18bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55b0ddf47700 con 0x55b0dddd9070 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b0de081160 con 0x55b0dddb8390 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0de18eaa0 con 0x55b0dddb01b0 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0511c3740 10 client.0 _ll_register_callbacks cb 0x55b0de09a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0491ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0491ec640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54970/0 (socket says 172.21.15.38:54970) 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0491ec640 1 -- 172.21.15.38:0/1048142714 learned_addr learned my addr 172.21.15.38:0/1048142714 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb043fff640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb8390 0x55b0de18bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.672+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb01b0 0x55b0de18b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 -- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb01b0 msgr2=0x55b0de18b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb01b0 0x55b0de18b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 -- 172.21.15.38:0/1048142714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb8390 msgr2=0x55b0de18bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb8390 0x55b0de18bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 -- 172.21.15.38:0/1048142714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0de0aec90 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004470 tx=0x7fb03c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4c6057a1614332 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb023fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c01b660 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fb03c01b800 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb02c018b10 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb03c01ba00 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0511c3740 10 client.18120 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.673+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b0de19a810 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb02c018b10 con 0x55b0dddd9070 2024-09-21T06:29:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb03c024070 con 0x55b0dddd9070 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 10 client.18120 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 10 client.18120 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 20 client.18120 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd979f0 0x55b0de19dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 4 client.18120 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0de0f8df0 con 0x55b0ddd979f0 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.674+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd979f0 0x55b0de19dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.675+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd979f0 0x55b0de19dd80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1735569b00f6663 server_cookie=6aa3ed8935f17a3b in_seq=0 out_seq=0 2024-09-21T06:29:01.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.675+0000 7fb023fff640 10 client.18120 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.675+0000 7fb023fff640 1 -- 172.21.15.38:0/1048142714 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0de0f8df0 con 0x55b0ddd979f0 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.675+0000 7fb023fff640 10 client.18120 handle_command_reply: tid=0 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.675+0000 7fb0511c3740 1 client.18120 shutdown 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 msgr2=0x55b0de197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004470 tx=0x7fb03c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 shutdown_connections 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd979f0 0x55b0de19dd80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddd9070 0x55b0de197d90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb8390 0x55b0de18bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1048142714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb01b0 0x55b0de18b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 >> 172.21.15.38:0/1048142714 conn(0x55b0dddcd460 msgr2=0x55b0de183450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb023fff640 0 client.18120 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 shutdown_connections 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 1 -- 172.21.15.38:0/1048142714 wait complete. 2024-09-21T06:29:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.676+0000 7fb0511c3740 20 client.18120 trim_cache size 0 max 16384 2024-09-21T06:29:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 Processor -- start 2024-09-21T06:29:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 -- start start 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb8390 0x55b0de197c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddd9070 0x55b0de17ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441b4150 con 0x55b0dddb01b0 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441b1a20 con 0x55b0dddd9070 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0511c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441af890 con 0x55b0dddb8390 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0489eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0489eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54978/0 (socket says 172.21.15.38:54978) 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.689+0000 7fb0489eb640 1 -- 172.21.15.38:0/1159366411 learned_addr learned my addr 172.21.15.38:0/1159366411 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 -- 172.21.15.38:0/1159366411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb8390 msgr2=0x55b0de197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb8390 0x55b0de197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddd9070 0x55b0de17ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 -- 172.21.15.38:0/1159366411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddd9070 msgr2=0x55b0de17ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddd9070 0x55b0de17ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 -- 172.21.15.38:0/1159366411 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0de1825b0 con 0x55b0dddb01b0 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb0340cbad0 tx=0x7fb03402f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc792799ba4d368 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb03a7fc640 1 -- 172.21.15.38:0/1159366411 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0340d3020 con 0x55b0dddb01b0 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb03a7fc640 1 -- 172.21.15.38:0/1159366411 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb034036040 con 0x55b0dddb01b0 2024-09-21T06:29:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.690+0000 7fb03a7fc640 1 -- 172.21.15.38:0/1159366411 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0340d3340 con 0x55b0dddb01b0 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- 172.21.15.38:0/1159366411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 msgr2=0x55b0de18d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb0340cbad0 tx=0x7fb03402f760 comp rx=0 tx=0).stop 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- 172.21.15.38:0/1159366411 shutdown_connections 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddd9070 0x55b0de17ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddb8390 0x55b0de197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1159366411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb01b0 0x55b0de18d860 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- 172.21.15.38:0/1159366411 >> 172.21.15.38:0/1159366411 conn(0x55b0dddcd460 msgr2=0x55b0de17c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- 172.21.15.38:0/1159366411 shutdown_connections 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- 172.21.15.38:0/1159366411 wait complete. 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 -- start start 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.691+0000 7fb0511c3740 1 Processor -- start 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de18fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de190840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441afee0 con 0x55b0dddb8390 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441b1350 con 0x55b0dddb01b0 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb0441b05b0 con 0x55b0dddd9070 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0511c3740 10 client.0 _ll_register_callbacks cb 0x7fb03c0042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:01.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54984/0 (socket says 172.21.15.38:54984) 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 -- 172.21.15.38:0/1605733027 learned_addr learned my addr 172.21.15.38:0/1605733027 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de18fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de190840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 -- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 msgr2=0x55b0de190840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de190840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 -- 172.21.15.38:0/1605733027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 msgr2=0x55b0de18fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de18fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.692+0000 7fb043fff640 1 -- 172.21.15.38:0/1605733027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0de207880 con 0x55b0dddb8390 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb0491ec640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de190840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb043fff640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb02c010810 tx=0x7fb02c010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a84758b72a50a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb023fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c028070 con 0x55b0dddb8390 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fb02c010ab0 con 0x55b0dddb8390 2024-09-21T06:29:01.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb034036040 con 0x55b0dddb8390 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb02c034050 con 0x55b0dddb8390 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb0511c3740 10 client.18126 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b0de208b00 con 0x55b0dddb8390 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.693+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb034036040 con 0x55b0dddb8390 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb02c004710 con 0x55b0dddb8390 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 10 client.18126 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 10 client.18126 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 20 client.18126 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd6cda0 0x55b0de20aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 4 client.18126 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0de0f48a0 con 0x55b0ddd6cda0 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd6cda0 0x55b0de20aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb023fff640 10 client.18126 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.694+0000 7fb0489eb640 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd6cda0 0x55b0de20aff0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8086b83e973b8cf2 server_cookie=b7da8dc1fbba09db in_seq=0 out_seq=0 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb023fff640 1 -- 172.21.15.38:0/1605733027 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0de0f48a0 con 0x55b0ddd6cda0 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb023fff640 10 client.18126 handle_command_reply: tid=0 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 client.18126 shutdown 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 msgr2=0x55b0de190300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb02c010810 tx=0x7fb02c010660 comp rx=0 tx=0).stop 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 shutdown_connections 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55b0ddd6cda0 0x55b0de20aff0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dddd9070 0x55b0de190840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b0dddb8390 0x55b0de190300 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb023fff640 0 client.18126 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 --2- 172.21.15.38:0/1605733027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0dddb01b0 0x55b0de18fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 >> 172.21.15.38:0/1605733027 conn(0x55b0dddcd460 msgr2=0x55b0de18d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 shutdown_connections 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 1 -- 172.21.15.38:0/1605733027 wait complete. 2024-09-21T06:29:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.695+0000 7fb0511c3740 20 client.18126 trim_cache size 0 max 16384 2024-09-21T06:29:01.702 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 msgr2=0x7fb0300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 0x7fb0300b8b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b650 tx=0x7fb03c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 msgr2=0x7fb044075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb034006010 tx=0x7fb034003f10 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 shutdown_connections 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb0300b6680 0x7fb0300b8b90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb044109df0 0x7fb044076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb0441094a0 0x7fb044075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 --2- 172.21.15.38:0/819719199 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb044103b60 0x7fb044075710 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 >> 172.21.15.38:0/819719199 conn(0x7fb04407b850 msgr2=0x7fb0441074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 shutdown_connections 2024-09-21T06:29:01.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:01.696+0000 7fb04ac4f640 1 -- 172.21.15.38:0/819719199 wait complete. 2024-09-21T06:29:01.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:01 smithi174 ceph-mon[34815]: pgmap v605: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-09-21T06:29:01.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:01 smithi044 ceph-mon[34369]: pgmap v605: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6 op/s 2024-09-21T06:29:02.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:02.703 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 -- 172.21.15.38:0/1937306445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041048c0 msgr2=0x7f6604104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 --2- 172.21.15.38:0/1937306445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041048c0 0x7f6604104cd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009900 tx=0x7f65f402a410 comp rx=0 tx=0).stop 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 -- 172.21.15.38:0/1937306445 shutdown_connections 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 --2- 172.21.15.38:0/1937306445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f660410de70 0x7f6604110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 --2- 172.21.15.38:0/1937306445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66041052f0 0x7f660410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.150+0000 7f660a46e640 1 --2- 172.21.15.38:0/1937306445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041048c0 0x7f6604104cd0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.151+0000 7f660a46e640 1 -- 172.21.15.38:0/1937306445 >> 172.21.15.38:0/1937306445 conn(0x7f6604079770 msgr2=0x7f6604079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.151+0000 7f660a46e640 1 -- 172.21.15.38:0/1937306445 shutdown_connections 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.151+0000 7f660a46e640 1 -- 172.21.15.38:0/1937306445 wait complete. 2024-09-21T06:29:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.151+0000 7f660a46e640 1 Processor -- start 2024-09-21T06:29:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.151+0000 7f660a46e640 1 -- start start 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66041048c0 0x7f66041027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f660410de70 0x7f6604103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6604113ca0 con 0x7f66041052f0 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6604113b20 con 0x7f66041048c0 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f660a46e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6604113e20 con 0x7f660410de70 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55000/0 (socket says 172.21.15.38:55000) 2024-09-21T06:29:03.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 -- 172.21.15.38:0/1712546206 learned_addr learned my addr 172.21.15.38:0/1712546206 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f6608a0b640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f660410de70 0x7f6604103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f6603fff640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66041048c0 0x7f66041027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 -- 172.21.15.38:0/1712546206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f660410de70 msgr2=0x7f6604103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f660410de70 0x7f6604103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 -- 172.21.15.38:0/1712546206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66041048c0 msgr2=0x7f66041027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66041048c0 0x7f66041027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.152+0000 7f66037fe640 1 -- 172.21.15.38:0/1712546206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66041a88d0 con 0x7f66041052f0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f66037fe640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c970 tx=0x7f65f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f66017fa640 1 -- 172.21.15.38:0/1712546206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8004220 con 0x7f66041052f0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f66017fa640 1 -- 172.21.15.38:0/1712546206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65f80043c0 con 0x7f66041052f0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66041a8bc0 con 0x7f66041052f0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f66017fa640 1 -- 172.21.15.38:0/1712546206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8004a00 con 0x7f66041052f0 2024-09-21T06:29:03.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.153+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041a90b0 con 0x7f66041052f0 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 Processor -- start 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 -- start start 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66017fa640 1 -- 172.21.15.38:0/1712546206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f65f80050b0 con 0x7f66041052f0 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f55800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f55d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5557d5ecbea0 con 0x5557d5bae070 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5557d5ebb2d0 con 0x5557d5b8d390 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f66109e2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5557d5ebf0e0 con 0x5557d5b851b0 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f6608a0b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f6608a0b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55004/0 (socket says 172.21.15.38:55004) 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.156+0000 7f6608a0b640 1 -- 172.21.15.38:0/4080776835 learned_addr learned my addr 172.21.15.38:0/4080776835 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f66037fe640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f55d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6603fff640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f55800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 -- 172.21.15.38:0/4080776835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 msgr2=0x5557d5f55800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f55800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 -- 172.21.15.38:0/4080776835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 msgr2=0x5557d5f55d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f55d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 -- 172.21.15.38:0/4080776835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d5c19650 con 0x5557d5bae070 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f66037fe640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f55d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6608a0b640 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0039f0 tx=0x7f65fc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a883338bd99a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f66017fa640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 0x7f65ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f65ea7fc640 1 -- 172.21.15.38:0/4080776835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc01a470 con 0x5557d5bae070 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f65ea7fc640 1 -- 172.21.15.38:0/4080776835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65fc015070 con 0x5557d5bae070 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f65ea7fc640 1 -- 172.21.15.38:0/4080776835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc010940 con 0x5557d5bae070 2024-09-21T06:29:03.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f6603fff640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 0x7f65ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.157+0000 7f66017fa640 1 -- 172.21.15.38:0/1712546206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f65f80e7300 con 0x7f66041052f0 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f6603fff640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 0x7f65ec0b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6604104220 tx=0x7f65f4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 -- 172.21.15.38:0/4080776835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 msgr2=0x5557d5f552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0039f0 tx=0x7f65fc003eb0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 -- 172.21.15.38:0/4080776835 shutdown_connections 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f55d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f55800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 --2- 172.21.15.38:0/4080776835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f552c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 -- 172.21.15.38:0/4080776835 >> 172.21.15.38:0/4080776835 conn(0x5557d5ba2460 msgr2=0x5557d5f531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 -- 172.21.15.38:0/4080776835 shutdown_connections 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.158+0000 7f66109e2740 1 -- 172.21.15.38:0/4080776835 wait complete. 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 -- start start 2024-09-21T06:29:03.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 Processor -- start 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f60990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f60ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5557d5d1c700 con 0x5557d5bae070 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5557d5e56160 con 0x5557d5b8d390 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.159+0000 7f66109e2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5557d5f63aa0 con 0x5557d5b851b0 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f66109e2740 10 client.0 _ll_register_callbacks cb 0x5557d5e6f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55018/0 (socket says 172.21.15.38:55018) 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 -- 172.21.15.38:0/2419178536 learned_addr learned my addr 172.21.15.38:0/2419178536 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6603fff640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f60990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f66037fe640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f60ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 -- 172.21.15.38:0/2419178536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 msgr2=0x5557d5f60990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f60990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 -- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 msgr2=0x5557d5f60ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f60ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 -- 172.21.15.38:0/2419178536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d5e83c90 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f6608a0b640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0105e0 tx=0x7f65fc004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3e89adf68a2fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f65e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc011710 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc015070 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.160+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f65fc0118b0 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65fc011ab0 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 10 client.18138 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557d5f6f810 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65fc015070 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65fc01a590 con 0x5557d5bae070 2024-09-21T06:29:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 10 client.18138 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 10 client.18138 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 20 client.18138 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5b6c9f0 0x5557d5f72bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 4 client.18138 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557d5ecddf0 con 0x5557d5b6c9f0 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.161+0000 7f6603fff640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5b6c9f0 0x5557d5f72bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.162+0000 7f6603fff640 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5b6c9f0 0x5557d5f72bd0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91ff7eb4f1b3a09f server_cookie=612e16bb2cf5eefb in_seq=0 out_seq=0 2024-09-21T06:29:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.162+0000 7f65e37fe640 10 client.18138 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f65e37fe640 1 -- 172.21.15.38:0/2419178536 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557d5ecddf0 con 0x5557d5b6c9f0 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f65e37fe640 10 client.18138 handle_command_reply: tid=0 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 client.18138 shutdown 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 msgr2=0x5557d5f6cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0105e0 tx=0x7f65fc004970 comp rx=0 tx=0).stop 2024-09-21T06:29:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 shutdown_connections 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5b6c9f0 0x5557d5f72bd0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5bae070 0x5557d5f6cd90 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f65e37fe640 0 client.18138 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5f60ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 --2- 172.21.15.38:0/2419178536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f60990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 >> 172.21.15.38:0/2419178536 conn(0x5557d5ba2460 msgr2=0x5557d5f584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 shutdown_connections 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 1 -- 172.21.15.38:0/2419178536 wait complete. 2024-09-21T06:29:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.163+0000 7f66109e2740 20 client.18138 trim_cache size 0 max 16384 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.176+0000 7f66109e2740 1 Processor -- start 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.176+0000 7f66109e2740 1 -- start start 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b851b0 0x5557d5f6cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 0x5557d5f5db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66041b4230 con 0x5557d5b6c9f0 2024-09-21T06:29:03.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66041b1b00 con 0x5557d5b851b0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f66109e2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66041af970 con 0x5557d5b8d390 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55026/0 (socket says 172.21.15.38:55026) 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 -- 172.21.15.38:0/4026043989 learned_addr learned my addr 172.21.15.38:0/4026043989 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 -- 172.21.15.38:0/4026043989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 msgr2=0x5557d5f5db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6608a0b640 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 0x5557d5f5db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 0x5557d5f5db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 -- 172.21.15.38:0/4026043989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b851b0 msgr2=0x5557d5f6cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b851b0 0x5557d5f6cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 -- 172.21.15.38:0/4026043989 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d5f575b0 con 0x5557d5b6c9f0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6608a0b640 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 0x5557d5f5db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f6603fff640 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009900 tx=0x7f65f403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ced25ed770dd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.177+0000 7f65e9ffb640 1 -- 172.21.15.38:0/4026043989 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4035040 con 0x5557d5b6c9f0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f65e9ffb640 1 -- 172.21.15.38:0/4026043989 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65f4057070 con 0x5557d5b6c9f0 2024-09-21T06:29:03.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f65e9ffb640 1 -- 172.21.15.38:0/4026043989 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4031e60 con 0x5557d5b6c9f0 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 -- 172.21.15.38:0/4026043989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 msgr2=0x5557d5f62870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009900 tx=0x7f65f403d000 comp rx=0 tx=0).stop 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 -- 172.21.15.38:0/4026043989 shutdown_connections 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b8d390 0x5557d5f5db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b851b0 0x5557d5f6cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 --2- 172.21.15.38:0/4026043989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f62870 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 -- 172.21.15.38:0/4026043989 >> 172.21.15.38:0/4026043989 conn(0x5557d5ba2460 msgr2=0x5557d5f60db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.178+0000 7f66109e2740 1 -- 172.21.15.38:0/4026043989 shutdown_connections 2024-09-21T06:29:03.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.179+0000 7f66109e2740 1 -- 172.21.15.38:0/4026043989 wait complete. 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.179+0000 7f66109e2740 1 -- start start 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.179+0000 7f66109e2740 1 Processor -- start 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.179+0000 7f66109e2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5fdc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f66041affc0 con 0x5557d5b6c9f0 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66041b1430 con 0x5557d5b8d390 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f66041b0690 con 0x5557d5b851b0 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66109e2740 10 client.0 _ll_register_callbacks cb 0x7f65fc009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55042/0 (socket says 172.21.15.38:55042) 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 -- 172.21.15.38:0/2508396764 learned_addr learned my addr 172.21.15.38:0/2508396764 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6608a0b640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5fdc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f66037fe640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 -- 172.21.15.38:0/2508396764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 msgr2=0x5557d5f744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 -- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 msgr2=0x5557d5fdc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5fdc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 -- 172.21.15.38:0/2508396764 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d5fdc890 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f6603fff640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f65f4031ca0 tx=0x7f65f4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bbc2eb0505fb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f65e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.180+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4060060 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f65f4003b20 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f4057070 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65f4035070 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 10 client.18144 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557d5fdd8f0 con 0x5557d5b6c9f0 2024-09-21T06:29:03.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f65f4057070 con 0x5557d5b6c9f0 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65f403c900 con 0x5557d5b6c9f0 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 10 client.18144 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 10 client.18144 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 20 client.18144 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5bae070 0x5557d5fe0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 4 client.18144 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.181+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557d5ec98a0 con 0x5557d5bae070 2024-09-21T06:29:03.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66037fe640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5bae070 0x5557d5fe0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:03.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f65e37fe640 10 client.18144 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:03.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66037fe640 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5bae070 0x5557d5fe0060 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5dcca4615546cf7f server_cookie=723d1ccbcb687465 in_seq=0 out_seq=0 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f65e37fe640 1 -- 172.21.15.38:0/2508396764 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557d5ec98a0 con 0x5557d5bae070 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f65e37fe640 10 client.18144 handle_command_reply: tid=0 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 client.18144 shutdown 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 msgr2=0x5557d5f73fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f65f4031ca0 tx=0x7f65f4005fd0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 shutdown_connections 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5557d5bae070 0x5557d5fe0060 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557d5b8d390 0x5557d5fdc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557d5b851b0 0x5557d5f744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 --2- 172.21.15.38:0/2508396764 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557d5b6c9f0 0x5557d5f73fb0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 >> 172.21.15.38:0/2508396764 conn(0x5557d5ba2460 msgr2=0x5557d5f56280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.182+0000 7f65e37fe640 0 client.18144 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 shutdown_connections 2024-09-21T06:29:03.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f66109e2740 1 -- 172.21.15.38:0/2508396764 wait complete. 2024-09-21T06:29:03.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f66109e2740 20 client.18144 trim_cache size 0 max 16384 2024-09-21T06:29:03.190 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:03.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 msgr2=0x7f65ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 0x7f65ec0b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6604104220 tx=0x7f65f4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 msgr2=0x7f6604102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c970 tx=0x7f65f800ce30 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 shutdown_connections 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f65ec0b6680 0x7f65ec0b8b90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f660410de70 0x7f6604103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f66041052f0 0x7f6604102d10 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 --2- 172.21.15.38:0/1712546206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66041048c0 0x7f66041027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 >> 172.21.15.38:0/1712546206 conn(0x7f6604079770 msgr2=0x7f66041079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 shutdown_connections 2024-09-21T06:29:03.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:03.183+0000 7f660a46e640 1 -- 172.21.15.38:0/1712546206 wait complete. 2024-09-21T06:29:03.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:03 smithi174 ceph-mon[34815]: pgmap v606: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:29:03.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:03 smithi044 ceph-mon[34369]: pgmap v606: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:29:03.925 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:03 smithi038 ceph-mon[31215]: pgmap v606: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T06:29:03.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 -- 172.21.15.38:0/2970765359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc108cf0 msgr2=0x7fbcfc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 --2- 172.21.15.38:0/2970765359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc10f520 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009ca0 tx=0x7fbcf402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 -- 172.21.15.38:0/2970765359 shutdown_connections 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 --2- 172.21.15.38:0/2970765359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc10f520 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 --2- 172.21.15.38:0/2970765359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 --2- 172.21.15.38:0/2970765359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc102a60 0x7fbcfc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 -- 172.21.15.38:0/2970765359 >> 172.21.15.38:0/2970765359 conn(0x7fbcfc079730 msgr2=0x7fbcfc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 -- 172.21.15.38:0/2970765359 shutdown_connections 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.687+0000 7fbd032ef640 1 -- 172.21.15.38:0/2970765359 wait complete. 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.688+0000 7fbd032ef640 1 Processor -- start 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.688+0000 7fbd032ef640 1 -- start start 2024-09-21T06:29:04.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc102a60 0x7fbcfc199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc112a80 con 0x7fbcfc1083a0 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc112900 con 0x7fbcfc102a60 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd032ef640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc112c00 con 0x7fbcfc108cf0 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55066/0 (socket says 172.21.15.38:55066) 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 -- 172.21.15.38:0/4265380535 learned_addr learned my addr 172.21.15.38:0/4265380535 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0108b640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc102a60 0x7fbcfc199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0188c640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 -- 172.21.15.38:0/4265380535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc108cf0 msgr2=0x7fbcfc19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 -- 172.21.15.38:0/4265380535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc102a60 msgr2=0x7fbcfc199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc102a60 0x7fbcfc199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 -- 172.21.15.38:0/4265380535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc19f3c0 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.689+0000 7fbd0088a640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009860 tx=0x7fbcf8009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.690+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4265380535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf801d070 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.690+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4265380535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf8007c70 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.690+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4265380535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8018de0 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.690+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc19f6b0 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.690+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc06ae60 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.693+0000 7fbd09863740 1 Processor -- start 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.693+0000 7fbd09863740 1 -- start start 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add964dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4265380535 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbcf8020070 con 0x7fbcfc1083a0 2024-09-21T06:29:04.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add964e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55add95c3ea0 con 0x55add92a6070 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55add95b32d0 con 0x55add9285390 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd09863740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55add95b70e0 con 0x55add927d1b0 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55070/0 (socket says 172.21.15.38:55070) 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 -- 172.21.15.38:0/1026460888 learned_addr learned my addr 172.21.15.38:0/1026460888 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0108b640 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add964dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0088a640 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add964e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 -- 172.21.15.38:0/1026460888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 msgr2=0x55add964dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add964dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 -- 172.21.15.38:0/1026460888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 msgr2=0x55add964e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add964e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 -- 172.21.15.38:0/1026460888 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add9311650 con 0x55add92a6070 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.694+0000 7fbd0188c640 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4005cc0 tx=0x7fbcf402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc7ff7bf38db4a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbce77fe640 1 -- 172.21.15.38:0/1026460888 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4031d40 con 0x55add92a6070 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbce77fe640 1 -- 172.21.15.38:0/1026460888 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf4036040 con 0x55add92a6070 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbce77fe640 1 -- 172.21.15.38:0/1026460888 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40042a0 con 0x55add92a6070 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbcee7fc640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 0x7fbce80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbd0108b640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 0x7fbce80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.695+0000 7fbcee7fc640 1 -- 172.21.15.38:0/4265380535 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbcf80e8860 con 0x7fbcfc1083a0 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- 172.21.15.38:0/1026460888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 msgr2=0x55add964d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4005cc0 tx=0x7fbcf402f420 comp rx=0 tx=0).stop 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd0108b640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 0x7fbce80b8b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55add964c320 tx=0x7fbcf0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- 172.21.15.38:0/1026460888 shutdown_connections 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add964e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add964dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 --2- 172.21.15.38:0/1026460888 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add964d6a0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- 172.21.15.38:0/1026460888 >> 172.21.15.38:0/1026460888 conn(0x55add929a460 msgr2=0x55add964b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- 172.21.15.38:0/1026460888 shutdown_connections 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- 172.21.15.38:0/1026460888 wait complete. 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 -- start start 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.696+0000 7fbd09863740 1 Processor -- start 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add9285390 0x55add9659300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add92a6070 0x55add9665140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55add9414700 con 0x55add927d1b0 2024-09-21T06:29:04.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55add954e160 con 0x55add92a6070 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55add965be20 con 0x55add9285390 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd09863740 10 client.0 _ll_register_callbacks cb 0x55add95679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55082/0 (socket says 172.21.15.38:55082) 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 -- 172.21.15.38:0/900580360 learned_addr learned my addr 172.21.15.38:0/900580360 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0088a640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add9285390 0x55add9659300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0188c640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add92a6070 0x55add9665140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 -- 172.21.15.38:0/900580360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add9285390 msgr2=0x55add9659300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add9285390 0x55add9659300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 -- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add92a6070 msgr2=0x55add9665140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add92a6070 0x55add9665140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 -- 172.21.15.38:0/900580360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add957bc90 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbd0108b640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00045f0 tx=0x7fbcf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dac1d8ec72353 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.697+0000 7fbce4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf001f640 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbcf001f7e0 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf4036040 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbcf001f9e0 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 10 client.18156 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55add9667bc0 con 0x55add927d1b0 2024-09-21T06:29:04.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf4036040 con 0x55add927d1b0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbcf0027070 con 0x55add927d1b0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 10 client.18156 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 10 client.18156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 20 client.18156 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add92649f0 0x55add966b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 4 client.18156 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.698+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55add95c5df0 con 0x55add92649f0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.699+0000 7fbd0088a640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add92649f0 0x55add966b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.699+0000 7fbd0088a640 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add92649f0 0x55add966b190 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e54d1dd2c214ab server_cookie=773d856ef315772 in_seq=0 out_seq=0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.699+0000 7fbce4ff9640 10 client.18156 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbce4ff9640 1 -- 172.21.15.38:0/900580360 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55add95c5df0 con 0x55add92649f0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbce4ff9640 10 client.18156 handle_command_reply: tid=0 2024-09-21T06:29:04.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 client.18156 shutdown 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 msgr2=0x55add9658dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00045f0 tx=0x7fbcf0004730 comp rx=0 tx=0).stop 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 shutdown_connections 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add92a6070 0x55add9665140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add92649f0 0x55add966b190 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add9285390 0x55add9659300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 --2- 172.21.15.38:0/900580360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9658dc0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 >> 172.21.15.38:0/900580360 conn(0x55add929a460 msgr2=0x55add9650850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.700+0000 7fbce4ff9640 0 client.18156 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.701+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 shutdown_connections 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.701+0000 7fbd09863740 1 -- 172.21.15.38:0/900580360 wait complete. 2024-09-21T06:29:04.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.701+0000 7fbd09863740 20 client.18156 trim_cache size 0 max 16384 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 Processor -- start 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 -- start start 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add9665040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add92a6070 0x55add96507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1afe20 con 0x55add927d1b0 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1ad6f0 con 0x55add9285390 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd09863740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1ab560 con 0x55add92a6070 2024-09-21T06:29:04.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd0108b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd0108b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55084/0 (socket says 172.21.15.38:55084) 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd0108b640 1 -- 172.21.15.38:0/3798169448 learned_addr learned my addr 172.21.15.38:0/3798169448 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.714+0000 7fbd0088a640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add9665040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0188c640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add92a6070 0x55add96507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 -- 172.21.15.38:0/3798169448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add92a6070 msgr2=0x55add96507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add92a6070 0x55add96507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 -- 172.21.15.38:0/3798169448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 msgr2=0x55add9665040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add9665040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 -- 172.21.15.38:0/3798169448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add96572c0 con 0x55add927d1b0 2024-09-21T06:29:04.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0088a640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add9665040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbd0108b640 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbcf002aff0 tx=0x7fbcf0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccc749dd2c8eba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbce6ffd640 1 -- 172.21.15.38:0/3798169448 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0036030 con 0x55add927d1b0 2024-09-21T06:29:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbce6ffd640 1 -- 172.21.15.38:0/3798169448 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf001f640 con 0x55add927d1b0 2024-09-21T06:29:04.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.715+0000 7fbce6ffd640 1 -- 172.21.15.38:0/3798169448 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf001d540 con 0x55add927d1b0 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- 172.21.15.38:0/3798169448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 msgr2=0x55add9659280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbcf002aff0 tx=0x7fbcf0005e50 comp rx=0 tx=0).stop 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- 172.21.15.38:0/3798169448 shutdown_connections 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add92a6070 0x55add96507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add9665040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 --2- 172.21.15.38:0/3798169448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add927d1b0 0x55add9659280 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- 172.21.15.38:0/3798169448 >> 172.21.15.38:0/3798169448 conn(0x55add929a460 msgr2=0x55add9658b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- 172.21.15.38:0/3798169448 shutdown_connections 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- 172.21.15.38:0/3798169448 wait complete. 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 -- start start 2024-09-21T06:29:04.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.716+0000 7fbd09863740 1 Processor -- start 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add9661660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add965cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1abbb0 con 0x55add92a6070 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1ad020 con 0x55add9285390 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1ac280 con 0x55add927d1b0 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd09863740 10 client.0 _ll_register_callbacks cb 0x7fbcf0009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55098/0 (socket says 172.21.15.38:55098) 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 -- 172.21.15.38:0/945123953 learned_addr learned my addr 172.21.15.38:0/945123953 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0108b640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add9661660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0088a640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add965cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 -- 172.21.15.38:0/945123953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 msgr2=0x55add9661660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add9661660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.717+0000 7fbd0188c640 1 -- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 msgr2=0x55add965cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd0188c640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add965cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd0188c640 1 -- 172.21.15.38:0/945123953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add965d5c0 con 0x55add92a6070 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd0088a640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add965cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd0188c640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fbcf402a900 tx=0x7fbcf4009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4dabf757772198 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbce4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4052020 con 0x55add92a6070 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fbcf4031d40 con 0x55add92a6070 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf001f640 con 0x55add92a6070 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbcf405d050 con 0x55add92a6070 2024-09-21T06:29:04.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd09863740 10 client.18162 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55add96d58b0 con 0x55add92a6070 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.718+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcf001f640 con 0x55add92a6070 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbcf404d030 con 0x55add92a6070 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 10 client.18162 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 20 client.18162 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add9239da0 0x55add96d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 4 client.18162 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55add95c18a0 con 0x55add9239da0 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd0108b640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add9239da0 0x55add96d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbce4ff9640 10 client.18162 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:04.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.719+0000 7fbd0108b640 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add9239da0 0x55add96d7be0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa9e8e6194ebc0b server_cookie=62bb4019dbef4163 in_seq=0 out_seq=0 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbce4ff9640 1 -- 172.21.15.38:0/945123953 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55add95c18a0 con 0x55add9239da0 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbce4ff9640 10 client.18162 handle_command_reply: tid=0 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 client.18162 shutdown 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 msgr2=0x55add965d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fbcf402a900 tx=0x7fbcf4009980 comp rx=0 tx=0).stop 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 shutdown_connections 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55add92a6070 0x55add965d050 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55add9285390 0x55add965cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55add9239da0 0x55add96d7be0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 --2- 172.21.15.38:0/945123953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55add927d1b0 0x55add9661660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 >> 172.21.15.38:0/945123953 conn(0x55add929a460 msgr2=0x55add96507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbce4ff9640 0 client.18162 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:04.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 shutdown_connections 2024-09-21T06:29:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 1 -- 172.21.15.38:0/945123953 wait complete. 2024-09-21T06:29:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.720+0000 7fbd09863740 20 client.18162 trim_cache size 0 max 16384 2024-09-21T06:29:04.729 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:04.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 msgr2=0x7fbce80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 0x7fbce80b8b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55add964c320 tx=0x7fbcf0005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 msgr2=0x7fbcfc1999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009860 tx=0x7fbcf8009d20 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 shutdown_connections 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fbce80b6680 0x7fbce80b8b90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbcfc108cf0 0x7fbcfc19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbcfc1083a0 0x7fbcfc1999f0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 --2- 172.21.15.38:0/4265380535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcfc102a60 0x7fbcfc199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 >> 172.21.15.38:0/4265380535 conn(0x7fbcfc079730 msgr2=0x7fbcfc104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 shutdown_connections 2024-09-21T06:29:04.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:04.721+0000 7fbd032ef640 1 -- 172.21.15.38:0/4265380535 wait complete. 2024-09-21T06:29:05.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:05 smithi038 ceph-mon[31215]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:29:05.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:05 smithi174 ceph-mon[34815]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:29:05.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:05 smithi044 ceph-mon[34369]: pgmap v607: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:29:06.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:06.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:06.765 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 -- 172.21.15.38:0/960928465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168108d20 msgr2=0x7f916810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 --2- 172.21.15.38:0/960928465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168108d20 0x7f916810f550 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9160009ca0 tx=0x7f916002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 -- 172.21.15.38:0/960928465 shutdown_connections 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 --2- 172.21.15.38:0/960928465 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168108d20 0x7f916810f550 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 --2- 172.21.15.38:0/960928465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f91681087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 --2- 172.21.15.38:0/960928465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168102ae0 0x7f9168102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 -- 172.21.15.38:0/960928465 >> 172.21.15.38:0/960928465 conn(0x7f91680797b0 msgr2=0x7f9168079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 -- 172.21.15.38:0/960928465 shutdown_connections 2024-09-21T06:29:07.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.181+0000 7f916ef69640 1 -- 172.21.15.38:0/960928465 wait complete. 2024-09-21T06:29:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 Processor -- start 2024-09-21T06:29:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 -- start start 2024-09-21T06:29:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f916819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 0x7f916819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9168112b20 con 0x7f9168102ae0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91681129a0 con 0x7f91681083d0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916ef69640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9168112ca0 con 0x7f9168108d20 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916cd05640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916cd05640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55110/0 (socket says 172.21.15.38:55110) 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.182+0000 7f916cd05640 1 -- 172.21.15.38:0/147368655 learned_addr learned my addr 172.21.15.38:0/147368655 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916d506640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 0x7f916819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f9167fff640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f916819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 -- 172.21.15.38:0/147368655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 msgr2=0x7f916819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 0x7f916819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 -- 172.21.15.38:0/147368655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 msgr2=0x7f916819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f916819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 -- 172.21.15.38:0/147368655 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91681a0430 con 0x7f9168102ae0 2024-09-21T06:29:07.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916d506640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 0x7f916819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f9167fff640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f916819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916cd05640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f915800c970 tx=0x7f915800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f9165ffb640 1 -- 172.21.15.38:0/147368655 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158007bb0 con 0x7f9168102ae0 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f9165ffb640 1 -- 172.21.15.38:0/147368655 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9158007d50 con 0x7f9168102ae0 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f9165ffb640 1 -- 172.21.15.38:0/147368655 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800f450 con 0x7f9168102ae0 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91681a0720 con 0x7f9168102ae0 2024-09-21T06:29:07.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.183+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91681a6f40 con 0x7f9168102ae0 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.186+0000 7f9165ffb640 1 -- 172.21.15.38:0/147368655 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f91580046c0 con 0x7f9168102ae0 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.186+0000 7f91754dd740 1 Processor -- start 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.186+0000 7f91754dd740 1 -- start start 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927714b490 0x55927751b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x55927751beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559277491e60 con 0x559277174350 2024-09-21T06:29:07.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559277481290 con 0x559277153670 2024-09-21T06:29:07.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f91754dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592774850a0 con 0x55927714b490 2024-09-21T06:29:07.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55118/0 (socket says 172.21.15.38:55118) 2024-09-21T06:29:07.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 -- 172.21.15.38:0/2991420959 learned_addr learned my addr 172.21.15.38:0/2991420959 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:07.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f9167fff640 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x55927751beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916cd05640 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927714b490 0x55927751b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 -- 172.21.15.38:0/2991420959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927714b490 msgr2=0x55927751b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927714b490 0x55927751b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 -- 172.21.15.38:0/2991420959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 msgr2=0x55927751beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x55927751beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f9165ffb640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 0x7f91540b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 -- 172.21.15.38:0/2991420959 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592771df930 con 0x559277174350 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f916d506640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 0x7f91540b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.187+0000 7f9165ffb640 1 -- 172.21.15.38:0/147368655 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f91580e74c0 con 0x7f9168102ae0 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.188+0000 7f916d506640 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f916002f500 tx=0x7f9160009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976ae7d9f98df9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.188+0000 7f915effd640 1 -- 172.21.15.38:0/2991420959 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916004c070 con 0x559277174350 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.188+0000 7f915effd640 1 -- 172.21.15.38:0/2991420959 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9160036070 con 0x559277174350 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.188+0000 7f915effd640 1 -- 172.21.15.38:0/2991420959 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916002f8c0 con 0x559277174350 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- 172.21.15.38:0/2991420959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 msgr2=0x55927751b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f916d506640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 0x7f91540b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9160049000 tx=0x7f916004a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f916002f500 tx=0x7f9160009a20 comp rx=0 tx=0).stop 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- 172.21.15.38:0/2991420959 shutdown_connections 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x55927751beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55927714b490 0x55927751b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 --2- 172.21.15.38:0/2991420959 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x55927751b430 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- 172.21.15.38:0/2991420959 >> 172.21.15.38:0/2991420959 conn(0x559277168740 msgr2=0x559277519320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- 172.21.15.38:0/2991420959 shutdown_connections 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- 172.21.15.38:0/2991420959 wait complete. 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 -- start start 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.189+0000 7f91754dd740 1 Processor -- start 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927714b490 0x559277526fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277153670 0x559277527510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5592772e2890 con 0x559277174350 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55927741bd40 con 0x55927714b490 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559277529c10 con 0x559277153670 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f91754dd740 10 client.0 _ll_register_callbacks cb 0x55927747fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55132/0 (socket says 172.21.15.38:55132) 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 -- 172.21.15.38:0/2699243122 learned_addr learned my addr 172.21.15.38:0/2699243122 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916cd05640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927714b490 0x559277526fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f9167fff640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277153670 0x559277527510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 -- 172.21.15.38:0/2699243122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277153670 msgr2=0x559277527510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277153670 0x559277527510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 -- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927714b490 msgr2=0x559277526fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927714b490 0x559277526fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.190+0000 7f916d506640 1 -- 172.21.15.38:0/2699243122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592775334c0 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f916d506640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f916002f340 tx=0x7f916002afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5042931f462181 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f9147fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916004c050 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f916002f660 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9160036070 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9160004b40 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f91754dd740 10 client.18174 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559277535df0 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.191+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9160036070 con 0x559277174350 2024-09-21T06:29:07.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9160042070 con 0x559277174350 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 10 client.18174 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 10 client.18174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 20 client.18174 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277132cd0 0x559277539150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 4 client.18174 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559277493db0 con 0x559277132cd0 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f916cd05640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277132cd0 0x559277539150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f9147fff640 10 client.18174 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.192+0000 7f916cd05640 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277132cd0 0x559277539150 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20fbe143ed154d24 server_cookie=1e6a44d92bf39439 in_seq=0 out_seq=0 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f9147fff640 1 -- 172.21.15.38:0/2699243122 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559277493db0 con 0x559277132cd0 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f9147fff640 10 client.18174 handle_command_reply: tid=0 2024-09-21T06:29:07.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 client.18174 shutdown 2024-09-21T06:29:07.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 msgr2=0x559277532f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f916002f340 tx=0x7f916002afc0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 shutdown_connections 2024-09-21T06:29:07.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x559277174350 0x559277532f00 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277132cd0 0x559277539150 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f9147fff640 0 client.18174 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277153670 0x559277527510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 --2- 172.21.15.38:0/2699243122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55927714b490 0x559277526fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.193+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 >> 172.21.15.38:0/2699243122 conn(0x559277168740 msgr2=0x55927751e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.194+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 shutdown_connections 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.194+0000 7f91754dd740 1 -- 172.21.15.38:0/2699243122 wait complete. 2024-09-21T06:29:07.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.194+0000 7f91754dd740 20 client.18174 trim_cache size 0 max 16384 2024-09-21T06:29:07.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.211+0000 7f91754dd740 1 Processor -- start 2024-09-21T06:29:07.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.211+0000 7f91754dd740 1 -- start start 2024-09-21T06:29:07.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x559277522580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91681b1f70 con 0x55927714b490 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91681af840 con 0x559277153670 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f91754dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91681ad6b0 con 0x559277132cd0 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55138/0 (socket says 172.21.15.38:55138) 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 -- 172.21.15.38:0/1317346228 learned_addr learned my addr 172.21.15.38:0/1317346228 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f916cd05640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x559277522580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f916d506640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 -- 172.21.15.38:0/1317346228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 msgr2=0x559277522580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x559277522580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 -- 172.21.15.38:0/1317346228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 msgr2=0x5592775212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 -- 172.21.15.38:0/1317346228 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559277513520 con 0x55927714b490 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f916cd05640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x559277522580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f916d506640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f9167fff640 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9150009c40 tx=0x7f9150010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ea34aa4ca943a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.212+0000 7f915e7fc640 1 -- 172.21.15.38:0/1317346228 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915001a420 con 0x55927714b490 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f915e7fc640 1 -- 172.21.15.38:0/1317346228 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f915000f8f0 con 0x55927714b490 2024-09-21T06:29:07.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f915e7fc640 1 -- 172.21.15.38:0/1317346228 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150019940 con 0x55927714b490 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 -- 172.21.15.38:0/1317346228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 msgr2=0x559277528a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9150009c40 tx=0x7f9150010800 comp rx=0 tx=0).stop 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 -- 172.21.15.38:0/1317346228 shutdown_connections 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x559277528a00 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 --2- 172.21.15.38:0/1317346228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x559277522580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 -- 172.21.15.38:0/1317346228 >> 172.21.15.38:0/1317346228 conn(0x559277168740 msgr2=0x5592775282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 -- 172.21.15.38:0/1317346228 shutdown_connections 2024-09-21T06:29:07.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.213+0000 7f91754dd740 1 -- 172.21.15.38:0/1317346228 wait complete. 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 -- start start 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 Processor -- start 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x55927759b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f91681add00 con 0x55927714b490 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91681af170 con 0x559277153670 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.214+0000 7f91754dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91681ae3d0 con 0x559277132cd0 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f91754dd740 10 client.0 _ll_register_callbacks cb 0x7f916004a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55142/0 (socket says 172.21.15.38:55142) 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 -- 172.21.15.38:0/3733815128 learned_addr learned my addr 172.21.15.38:0/3733815128 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:07.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f916d506640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f916cd05640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x55927759b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 -- 172.21.15.38:0/3733815128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 msgr2=0x55927759b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x55927759b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 -- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 msgr2=0x5592775a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 -- 172.21.15.38:0/3733815128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592775a1170 con 0x55927714b490 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f916d506640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9167fff640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f91500194a0 tx=0x7f9150009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a269e3dfa239f0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9147fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915001f040 con 0x55927714b490 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f9150005040 con 0x55927714b490 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.215+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f915000f8f0 con 0x55927714b490 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9150005240 con 0x55927714b490 2024-09-21T06:29:07.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 10 client.18180 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5592775a8510 con 0x55927714b490 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f915000f8f0 con 0x55927714b490 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9150022070 con 0x55927714b490 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 10 client.18180 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 10 client.18180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 20 client.18180 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277174350 0x5592775aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 4 client.18180 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55927748f860 con 0x559277174350 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.216+0000 7f916cd05640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277174350 0x5592775aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.217+0000 7f916cd05640 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277174350 0x5592775aac40 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f9f7ba7e062714e server_cookie=fd282d66bcdcaa96 in_seq=0 out_seq=0 2024-09-21T06:29:07.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.217+0000 7f9147fff640 10 client.18180 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:07.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f9147fff640 1 -- 172.21.15.38:0/3733815128 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55927748f860 con 0x559277174350 2024-09-21T06:29:07.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f9147fff640 10 client.18180 handle_command_reply: tid=0 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 client.18180 shutdown 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 msgr2=0x55927759bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f91500194a0 tx=0x7f9150009fd0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 shutdown_connections 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559277153670 0x5592775a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55927714b490 0x55927759bae0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x559277174350 0x5592775aac40 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 --2- 172.21.15.38:0/3733815128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559277132cd0 0x55927759b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f9147fff640 0 client.18180 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 >> 172.21.15.38:0/3733815128 conn(0x559277168740 msgr2=0x5592775259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 shutdown_connections 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 1 -- 172.21.15.38:0/3733815128 wait complete. 2024-09-21T06:29:07.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.219+0000 7f91754dd740 20 client.18180 trim_cache size 0 max 16384 2024-09-21T06:29:07.226 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:07.226 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:29:07.226 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a879a378-0472-405a-9891-3e8f77e97d82", 2024-09-21T06:29:07.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:29:07.226 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 msgr2=0x7f91540b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 0x7f91540b8bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9160049000 tx=0x7f916004a000 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 msgr2=0x7f916819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f915800c970 tx=0x7f915800ce30 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 shutdown_connections 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f91540b66b0 0x7f91540b8bc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9168108d20 0x7f916819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91681083d0 0x7f916819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 --2- 172.21.15.38:0/147368655 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9168102ae0 0x7f916819a580 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 >> 172.21.15.38:0/147368655 conn(0x7f91680797b0 msgr2=0x7f9168101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:07.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 shutdown_connections 2024-09-21T06:29:07.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:07.220+0000 7f916ef69640 1 -- 172.21.15.38:0/147368655 wait complete. 2024-09-21T06:29:07.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:07 smithi038 ceph-mon[31215]: pgmap v608: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:29:07.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:07 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:29:07.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:07 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:07.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:07 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:29:07.871 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:07 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:07 smithi174 ceph-mon[34815]: pgmap v608: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:29:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:07 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:29:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:07 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:07 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:29:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:07 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:07 smithi044 ceph-mon[34369]: pgmap v608: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:29:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:07 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:29:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:07 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:07 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:29:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:07 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:08.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:08.293 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:08.681 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:08 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 -- 172.21.15.38:0/1867383876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 msgr2=0x7f5d8c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 --2- 172.21.15.38:0/1867383876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c1087d0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009900 tx=0x7f5d8002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 -- 172.21.15.38:0/1867383876 shutdown_connections 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 --2- 172.21.15.38:0/1867383876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 0x7f5d8c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 --2- 172.21.15.38:0/1867383876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c1087d0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 --2- 172.21.15.38:0/1867383876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 -- 172.21.15.38:0/1867383876 >> 172.21.15.38:0/1867383876 conn(0x7f5d8c079740 msgr2=0x7f5d8c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 -- 172.21.15.38:0/1867383876 shutdown_connections 2024-09-21T06:29:08.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.775+0000 7f5d91127640 1 -- 172.21.15.38:0/1867383876 wait complete. 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.776+0000 7f5d91127640 1 Processor -- start 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.776+0000 7f5d91127640 1 -- start start 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 0x7f5d8c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113bc0 con 0x7f5d8c1083c0 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113a40 con 0x7f5d8c108d10 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d91127640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113d40 con 0x7f5d8c102a80 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55158/0 (socket says 172.21.15.38:55158) 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8a59c640 1 -- 172.21.15.38:0/1521095892 learned_addr learned my addr 172.21.15.38:0/1521095892 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 0x7f5d8c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1521095892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 msgr2=0x7f5d8c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 0x7f5d8c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 msgr2=0x7f5d8c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1521095892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c1a04c0 con 0x7f5d8c102a80 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.777+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c19a550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9f0 tx=0x7f5d7c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d73fff640 1 -- 172.21.15.38:0/1521095892 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00ccc0 con 0x7f5d8c102a80 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c1a07b0 con 0x7f5d8c102a80 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d73fff640 1 -- 172.21.15.38:0/1521095892 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d7c010900 con 0x7f5d8c102a80 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d73fff640 1 -- 172.21.15.38:0/1521095892 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c018920 con 0x7f5d8c102a80 2024-09-21T06:29:08.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.778+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1a6f10 con 0x7f5d8c102a80 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 Processor -- start 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 -- start start 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d73fff640 1 -- 172.21.15.38:0/1521095892 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5d7c018ac0 con 0x7f5d8c102a80 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277e3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6274131b0 0x55a6277e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a627759e50 con 0x55a62741b390 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a627749280 con 0x55a6274131b0 2024-09-21T06:29:08.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d9769b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a62774d090 con 0x55a62743c070 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55160/0 (socket says 172.21.15.38:55160) 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d8b59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d8a59c640 1 -- 172.21.15.38:0/1858104873 learned_addr learned my addr 172.21.15.38:0/1858104873 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.781+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6274131b0 0x55a6277e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 -- 172.21.15.38:0/1858104873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 msgr2=0x55a6277e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 -- 172.21.15.38:0/1858104873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6274131b0 msgr2=0x55a6277e3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6274131b0 0x55a6277e3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 -- 172.21.15.38:0/1858104873 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6274a7650 con 0x55a62741b390 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d73fff640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 0x7f5d740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5d80006010 tx=0x7f5d80005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c9d000afc96e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 0x7f5d740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d717fa640 1 -- 172.21.15.38:0/1858104873 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035040 con 0x55a62741b390 2024-09-21T06:29:08.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d73fff640 1 -- 172.21.15.38:0/1521095892 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f5d7c0e7a00 con 0x7f5d8c102a80 2024-09-21T06:29:08.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d717fa640 1 -- 172.21.15.38:0/1858104873 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d80031790 con 0x55a62741b390 2024-09-21T06:29:08.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.782+0000 7f5d717fa640 1 -- 172.21.15.38:0/1858104873 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80004a00 con 0x55a62741b390 2024-09-21T06:29:08.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 -- 172.21.15.38:0/1858104873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 msgr2=0x55a6277e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 0x7f5d740b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d84009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5d80006010 tx=0x7f5d80005dd0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 -- 172.21.15.38:0/1858104873 shutdown_connections 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a62741b390 0x55a6277e40d0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6274131b0 0x55a6277e3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1858104873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 -- 172.21.15.38:0/1858104873 >> 172.21.15.38:0/1858104873 conn(0x55a627430460 msgr2=0x55a6277e1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 -- 172.21.15.38:0/1858104873 shutdown_connections 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.783+0000 7f5d9769b740 1 -- 172.21.15.38:0/1858104873 wait complete. 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 -- start start 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 Processor -- start 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277ef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55a6275aa700 con 0x55a6274131b0 2024-09-21T06:29:08.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a6276e4110 con 0x55a62741b390 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a6277f1dd0 con 0x55a62743c070 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d9769b740 10 client.0 _ll_register_callbacks cb 0x55a6276fd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.784+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55176/0 (socket says 172.21.15.38:55176) 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1506877179 learned_addr learned my addr 172.21.15.38:0/1506877179 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1506877179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 msgr2=0x55a6277fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 msgr2=0x55a6277ef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277ef230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1506877179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a627711c40 con 0x55a6274131b0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0aab90 tx=0x7f5d7c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7152e20c2be081f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0a97c0 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f5d7c0a9270 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d80031790 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d7c0ad090 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.785+0000 7f5d9769b740 10 client.18192 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a6277fdac0 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d80031790 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5d7c0b0ce0 con 0x55a6274131b0 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 10 client.18192 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 10 client.18192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 20 client.18192 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a6273fa9f0 0x55a627800f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 4 client.18192 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:08.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a62775bda0 con 0x55a6273fa9f0 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.786+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a6273fa9f0 0x55a627800f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a6273fa9f0 0x55a627800f20 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619732381468d889 server_cookie=7d6c4e53ad65692e in_seq=0 out_seq=0 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d6eff5640 10 client.18192 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d6eff5640 1 -- 172.21.15.38:0/1506877179 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a62775bda0 con 0x55a6273fa9f0 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d6eff5640 10 client.18192 handle_command_reply: tid=0 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d9769b740 1 client.18192 shutdown 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 msgr2=0x55a6277eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.787+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0aab90 tx=0x7f5d7c00cec0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 shutdown_connections 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a6273fa9f0 0x55a627800f20 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62743c070 0x55a6277fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d6eff5640 0 client.18192 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277ef230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1506877179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277eecf0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 >> 172.21.15.38:0/1506877179 conn(0x55a627430460 msgr2=0x55a6277e67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 shutdown_connections 2024-09-21T06:29:08.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 1 -- 172.21.15.38:0/1506877179 wait complete. 2024-09-21T06:29:08.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.788+0000 7f5d9769b740 20 client.18192 trim_cache size 0 max 16384 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.805+0000 7f5d9769b740 1 Processor -- start 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.805+0000 7f5d9769b740 1 -- start start 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 0x55a6277e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1afe10 con 0x55a6273fa9f0 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1ad6e0 con 0x55a62741b390 2024-09-21T06:29:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d9769b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1ab550 con 0x55a6274131b0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55188/0 (socket says 172.21.15.38:55188) 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1697767372 learned_addr learned my addr 172.21.15.38:0/1697767372 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 0x55a6277e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1697767372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 msgr2=0x55a6277e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 0x55a6277e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1697767372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 msgr2=0x55a6277e10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277e10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 -- 172.21.15.38:0/1697767372 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6277e5940 con 0x55a6273fa9f0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 0x55a6277e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277e10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c023040 tx=0x7f5d7c0e5260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d9b4765a4a3686 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.806+0000 7f5d70ff9640 1 -- 172.21.15.38:0/1697767372 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0ad270 con 0x55a6273fa9f0 2024-09-21T06:29:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d70ff9640 1 -- 172.21.15.38:0/1697767372 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d7c0ad430 con 0x55a6273fa9f0 2024-09-21T06:29:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d70ff9640 1 -- 172.21.15.38:0/1697767372 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0ad6f0 con 0x55a6273fa9f0 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 -- 172.21.15.38:0/1697767372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 msgr2=0x55a6277ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c023040 tx=0x7f5d7c0e5260 comp rx=0 tx=0).stop 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 -- 172.21.15.38:0/1697767372 shutdown_connections 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a62741b390 0x55a6277e10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a6274131b0 0x55a6277e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 --2- 172.21.15.38:0/1697767372 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6273fa9f0 0x55a6277ef1b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 -- 172.21.15.38:0/1697767372 >> 172.21.15.38:0/1697767372 conn(0x55a627430460 msgr2=0x55a6277eeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.807+0000 7f5d9769b740 1 -- 172.21.15.38:0/1697767372 shutdown_connections 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 -- 172.21.15.38:0/1697767372 wait complete. 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 -- start start 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 Processor -- start 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6273fa9f0 0x55a6277f3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 0x55a62786a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1abba0 con 0x55a6274131b0 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1ad010 con 0x55a6273fa9f0 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1ac270 con 0x55a62741b390 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d9769b740 10 client.0 _ll_register_callbacks cb 0x7f5d7c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d8a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55190/0 (socket says 172.21.15.38:55190) 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.808+0000 7f5d8a59c640 1 -- 172.21.15.38:0/3909743720 learned_addr learned my addr 172.21.15.38:0/3909743720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 0x55a62786a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6273fa9f0 0x55a6277f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 -- 172.21.15.38:0/3909743720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 msgr2=0x55a62786a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 0x55a62786a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 -- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6273fa9f0 msgr2=0x55a6277f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6273fa9f0 0x55a6277f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 -- 172.21.15.38:0/3909743720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a62786afa0 con 0x55a6274131b0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8b59e640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 0x55a62786a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d8a59c640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5d80032fd0 tx=0x7f5d80005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5c9a6555c859a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d6eff5640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035040 con 0x55a6274131b0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f5d80031790 con 0x55a6274131b0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d7c0ad430 con 0x55a6274131b0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d80004040 con 0x55a6274131b0 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d9769b740 10 client.18198 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a62786c180 con 0x55a6274131b0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.809+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d7c0ad430 con 0x55a6274131b0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5d80063020 con 0x55a6274131b0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 10 client.18198 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 10 client.18198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 20 client.18198 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a62743c070 0x55a62786e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 4 client.18198 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a627757850 con 0x55a62743c070 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a62743c070 0x55a62786e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d8ad9d640 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a62743c070 0x55a62786e4a0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33674e05b8ca57c3 server_cookie=640b3a472a12dc63 in_seq=0 out_seq=0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.810+0000 7f5d6eff5640 10 client.18198 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d6eff5640 1 -- 172.21.15.38:0/3909743720 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7190 (crc 0 0 0) 0x55a627757850 con 0x55a62743c070 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d6eff5640 10 client.18198 handle_command_reply: tid=0 2024-09-21T06:29:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 client.18198 shutdown 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 msgr2=0x55a6277f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5d80032fd0 tx=0x7f5d80005ec0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 shutdown_connections 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55a62743c070 0x55a62786e4a0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a62741b390 0x55a62786a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a6274131b0 0x55a6277f3e00 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 --2- 172.21.15.38:0/3909743720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a6273fa9f0 0x55a6277f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 >> 172.21.15.38:0/3909743720 conn(0x55a627430460 msgr2=0x55a6277e4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d6eff5640 0 client.18198 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 shutdown_connections 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 1 -- 172.21.15.38:0/3909743720 wait complete. 2024-09-21T06:29:08.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.811+0000 7f5d9769b740 20 client.18198 trim_cache size 0 max 16384 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.819 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.820 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:29:08.821 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "a879a378-0472-405a-9891-3e8f77e97d82": { 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:07.217872+0000", 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.822 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.823 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.824 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.825 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.826 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:29:08.827 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:29:08.828 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.829 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.830 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.831 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:29:08.832 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:08.833 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:08.833 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:08.833 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:08.833 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 msgr2=0x7f5d740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 0x7f5d740b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d84009500 comp rx=0 tx=0).stop 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 msgr2=0x7f5d8c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c19a550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9f0 tx=0x7f5d7c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 shutdown_connections 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f5d740b6680 0x7f5d740b8b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d8c108d10 0x7f5d8c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d8c1083c0 0x7f5d8c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 --2- 172.21.15.38:0/1521095892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d8c102a80 0x7f5d8c19a550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:08.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 >> 172.21.15.38:0/1521095892 conn(0x7f5d8c079740 msgr2=0x7f5d8c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:08.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 shutdown_connections 2024-09-21T06:29:08.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:08.812+0000 7f5d91127640 1 -- 172.21.15.38:0/1521095892 wait complete. 2024-09-21T06:29:08.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:08 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:29:08.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:08 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:29:09.564 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:29:09.564 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:29:09.822 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:09.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:09 smithi174 ceph-mon[34815]: pgmap v609: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:29:09.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:09 smithi174 ceph-mon[34815]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:29:09.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:09 smithi044 ceph-mon[34369]: pgmap v609: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:29:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:09 smithi044 ceph-mon[34369]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:29:09.944 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:09 smithi038 ceph-mon[31215]: pgmap v609: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:29:09.944 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:09 smithi038 ceph-mon[31215]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.286+0000 7f6325f17640 1 -- 172.21.15.38:0/2310564826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6320103b60 msgr2=0x7f6320103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.286+0000 7f6325f17640 1 --2- 172.21.15.38:0/2310564826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6320103b60 0x7f6320103f70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6310009900 tx=0x7f631002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 -- 172.21.15.38:0/2310564826 shutdown_connections 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 --2- 172.21.15.38:0/2310564826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320109df0 0x7f6320110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 --2- 172.21.15.38:0/2310564826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63201094a0 0x7f63201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 --2- 172.21.15.38:0/2310564826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6320103b60 0x7f6320103f70 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 -- 172.21.15.38:0/2310564826 >> 172.21.15.38:0/2310564826 conn(0x7f632007b850 msgr2=0x7f632007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:10.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 -- 172.21.15.38:0/2310564826 shutdown_connections 2024-09-21T06:29:10.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 -- 172.21.15.38:0/2310564826 wait complete. 2024-09-21T06:29:10.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.287+0000 7f6325f17640 1 Processor -- start 2024-09-21T06:29:10.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 -- start start 2024-09-21T06:29:10.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 0x7f6320075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:10.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:10.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6320109df0 0x7f6320076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:10.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6320113bd0 con 0x7f63201094a0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6320113a50 con 0x7f6320103b60 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f6325f17640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6320113d50 con 0x7f6320109df0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f631effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f631effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56480/0 (socket says 172.21.15.38:56480) 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f631effd640 1 -- 172.21.15.38:0/3152851857 learned_addr learned my addr 172.21.15.38:0/3152851857 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f631ffff640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6320109df0 0x7f6320076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.288+0000 7f631f7fe640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 0x7f6320075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 -- 172.21.15.38:0/3152851857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6320109df0 msgr2=0x7f6320076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6320109df0 0x7f6320076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 -- 172.21.15.38:0/3152851857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 msgr2=0x7f6320075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 0x7f6320075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 -- 172.21.15.38:0/3152851857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63201a8830 con 0x7f63201094a0 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631f7fe640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 0x7f6320075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:10.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631effd640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f631400c8c0 tx=0x7f631400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314007bb0 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6314007d50 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63201a8b20 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140188c0 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.289+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201a9060 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.290+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6320103f70 con 0x7f63201094a0 2024-09-21T06:29:10.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.292+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f631400fb60 con 0x7f63201094a0 2024-09-21T06:29:10.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.292+0000 7f631cff9640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 0x7f63080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:10.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.293+0000 7f631f7fe640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 0x7f63080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:10.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.293+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f63140e7800 con 0x7f63201094a0 2024-09-21T06:29:10.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.293+0000 7f631f7fe640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 0x7f63080b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:10.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.297+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6314014030 con 0x7f63201094a0 2024-09-21T06:29:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.523+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f632002e640 con 0x7f63201094a0 2024-09-21T06:29:10.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.524+0000 7f631cff9640 1 -- 172.21.15.38:0/3152851857 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f63140add70 con 0x7f63201094a0 2024-09-21T06:29:10.527 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:29:10.527 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:29:10.527 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 msgr2=0x7f63080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 0x7f63080b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310005de0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 msgr2=0x7f6320075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f631400c8c0 tx=0x7f631400cd80 comp rx=0 tx=0).stop 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 shutdown_connections 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f63080b6680 0x7f63080b8b90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6320109df0 0x7f6320076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63201094a0 0x7f6320075c50 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 --2- 172.21.15.38:0/3152851857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6320103b60 0x7f6320075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.526+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 >> 172.21.15.38:0/3152851857 conn(0x7f632007b850 msgr2=0x7f6320107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:10.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.527+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 shutdown_connections 2024-09-21T06:29:10.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:10.527+0000 7f6325f17640 1 -- 172.21.15.38:0/3152851857 wait complete. 2024-09-21T06:29:10.868 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:10 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3152851857' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:10.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:10 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3152851857' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:10.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:10 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3152851857' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:11.251 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:11.512 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:11.852 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:11 smithi038 ceph-mon[31215]: pgmap v611: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:29:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:11 smithi174 ceph-mon[34815]: pgmap v611: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:29:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:11 smithi044 ceph-mon[34369]: pgmap v611: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:29:12.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 -- 172.21.15.38:0/2746881093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8109e40 msgr2=0x7f28e8110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2746881093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8109e40 0x7f28e8110670 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009ca0 tx=0x7f28e002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 -- 172.21.15.38:0/2746881093 shutdown_connections 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2746881093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8109e40 0x7f28e8110670 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2746881093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 0x7f28e8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2746881093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8103bb0 0x7f28e8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 -- 172.21.15.38:0/2746881093 >> 172.21.15.38:0/2746881093 conn(0x7f28e80ff600 msgr2=0x7f28e8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 -- 172.21.15.38:0/2746881093 shutdown_connections 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.939+0000 7f28f02d8640 1 -- 172.21.15.38:0/2746881093 wait complete. 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 Processor -- start 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 -- start start 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 0x7f28e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8109e40 0x7f28e8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f28e8113c40 con 0x7f28e8103bb0 2024-09-21T06:29:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28e8113ac0 con 0x7f28e81094f0 2024-09-21T06:29:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.940+0000 7f28f02d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28e8113dc0 con 0x7f28e8109e40 2024-09-21T06:29:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ed873640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 0x7f28e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56502/0 (socket says 172.21.15.38:56502) 2024-09-21T06:29:12.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 -- 172.21.15.38:0/2058553259 learned_addr learned my addr 172.21.15.38:0/2058553259 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:12.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee875640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8109e40 0x7f28e8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 -- 172.21.15.38:0/2058553259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8109e40 msgr2=0x7f28e8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8109e40 0x7f28e8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 -- 172.21.15.38:0/2058553259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 msgr2=0x7f28e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 0x7f28e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 -- 172.21.15.38:0/2058553259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e81a87f0 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28ee074640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f28e400d770 tx=0x7f28e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28df7fe640 1 -- 172.21.15.38:0/2058553259 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4017070 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28df7fe640 1 -- 172.21.15.38:0/2058553259 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28e40054f0 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28df7fe640 1 -- 172.21.15.38:0/2058553259 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4004de0 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e81a8ae0 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.941+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e81a8fd0 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.944+0000 7f28f684c740 1 Processor -- start 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.944+0000 7f28f684c740 1 -- start start 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.944+0000 7f28df7fe640 1 -- 172.21.15.38:0/2058553259 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f28e4004f80 con 0x7f28e8103bb0 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec6733800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec636b390 0x562ec6733d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562ec66a9ea0 con 0x562ec638c070 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec66992d0 con 0x562ec636b390 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28f684c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562ec669d0e0 con 0x562ec63631b0 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56516/0 (socket says 172.21.15.38:56516) 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 -- 172.21.15.38:0/505181261 learned_addr learned my addr 172.21.15.38:0/505181261 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ed873640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec636b390 0x562ec6733d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee074640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec6733800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 -- 172.21.15.38:0/505181261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 msgr2=0x562ec6733800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec6733800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 -- 172.21.15.38:0/505181261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec636b390 msgr2=0x562ec6733d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec636b390 0x562ec6733d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 -- 172.21.15.38:0/505181261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec63f7650 con 0x562ec638c070 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee074640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec6733800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28df7fe640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 0x7f28d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.945+0000 7f28ee875640 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f28e00098b0 tx=0x7f28e00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e2a02d817bf9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.946+0000 7f28ee074640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 0x7f28d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.946+0000 7f28dcd9a640 1 -- 172.21.15.38:0/505181261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0031d40 con 0x562ec638c070 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.946+0000 7f28df7fe640 1 -- 172.21.15.38:0/2058553259 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f28e40e70e0 con 0x7f28e8103bb0 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.946+0000 7f28dcd9a640 1 -- 172.21.15.38:0/505181261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28e0036030 con 0x562ec638c070 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.946+0000 7f28dcd9a640 1 -- 172.21.15.38:0/505181261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00042a0 con 0x562ec638c070 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- 172.21.15.38:0/505181261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 msgr2=0x562ec67332c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28ee074640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 0x7f28d40b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e49a0 tx=0x7f28e4009c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f28e00098b0 tx=0x7f28e00098e0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- 172.21.15.38:0/505181261 shutdown_connections 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec636b390 0x562ec6733d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec6733800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 --2- 172.21.15.38:0/505181261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec638c070 0x562ec67332c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- 172.21.15.38:0/505181261 >> 172.21.15.38:0/505181261 conn(0x562ec6380460 msgr2=0x562ec67311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- 172.21.15.38:0/505181261 shutdown_connections 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- 172.21.15.38:0/505181261 wait complete. 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 -- start start 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.947+0000 7f28f684c740 1 Processor -- start 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec638c070 0x562ec674abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562ec64fa700 con 0x562ec636b390 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ec6634160 con 0x562ec638c070 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562ec67418c0 con 0x562ec63631b0 2024-09-21T06:29:12.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 10 client.0 _ll_register_callbacks cb 0x562ec664d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56526/0 (socket says 172.21.15.38:56526) 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 -- 172.21.15.38:0/765845721 learned_addr learned my addr 172.21.15.38:0/765845721 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ee875640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 -- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 msgr2=0x562ec673e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 -- 172.21.15.38:0/765845721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec638c070 msgr2=0x562ec674abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec638c070 0x562ec674abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 -- 172.21.15.38:0/765845721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec6661c90 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ee875640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28ed873640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f28d800bad0 tx=0x7f28d800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223067fca734eadb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8003e00 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f28d8011440 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.948+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e0036030 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28d8011680 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 10 client.18216 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562ec674d670 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28e0036030 con 0x562ec636b390 2024-09-21T06:29:12.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f28d8022070 con 0x562ec636b390 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 10 client.18216 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 10 client.18216 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 20 client.18216 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec634a9f0 0x562ec6750c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 4 client.18216 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.949+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ec66abdf0 con 0x562ec634a9f0 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.950+0000 7f28ee875640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec634a9f0 0x562ec6750c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.950+0000 7f28ee875640 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec634a9f0 0x562ec6750c00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b4152ba2e386b8e server_cookie=52f8f1e4dfbf76e7 in_seq=0 out_seq=0 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.950+0000 7f28d1ffb640 10 client.18216 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28d1ffb640 1 -- 172.21.15.38:0/765845721 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ec66abdf0 con 0x562ec634a9f0 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28d1ffb640 10 client.18216 handle_command_reply: tid=0 2024-09-21T06:29:12.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 client.18216 shutdown 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 msgr2=0x562ec673eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f28d800bad0 tx=0x7f28d800bf90 comp rx=0 tx=0).stop 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 shutdown_connections 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec634a9f0 0x562ec6750c00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec638c070 0x562ec674abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec636b390 0x562ec673eed0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28d1ffb640 0 client.18216 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 --2- 172.21.15.38:0/765845721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 >> 172.21.15.38:0/765845721 conn(0x562ec6380460 msgr2=0x562ec67364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 shutdown_connections 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 1 -- 172.21.15.38:0/765845721 wait complete. 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.951+0000 7f28f684c740 20 client.18216 trim_cache size 0 max 16384 2024-09-21T06:29:12.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.964+0000 7f28f684c740 1 Processor -- start 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 -- start start 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 0x562ec674aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81b4120 con 0x562ec6380460 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81b19f0 con 0x562ec634a9f0 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28f684c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81af860 con 0x562ec63631b0 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56540/0 (socket says 172.21.15.38:56540) 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 -- 172.21.15.38:0/454921447 learned_addr learned my addr 172.21.15.38:0/454921447 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ed873640 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 0x562ec674aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 -- 172.21.15.38:0/454921447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 msgr2=0x562ec673bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 -- 172.21.15.38:0/454921447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 msgr2=0x562ec674aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 0x562ec674aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 -- 172.21.15.38:0/454921447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ec67313e0 con 0x562ec6380460 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ed873640 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 0x562ec674aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.965+0000 7f28ee875640 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f28e0002230 tx=0x7f28e002ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5f0ca616f4a373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28d3fff640 1 -- 172.21.15.38:0/454921447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e005c070 con 0x562ec6380460 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28d3fff640 1 -- 172.21.15.38:0/454921447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28e0036070 con 0x562ec6380460 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28d3fff640 1 -- 172.21.15.38:0/454921447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00042a0 con 0x562ec6380460 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 -- 172.21.15.38:0/454921447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 msgr2=0x562ec673ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f28e0002230 tx=0x7f28e002ae60 comp rx=0 tx=0).stop 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 -- 172.21.15.38:0/454921447 shutdown_connections 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec63631b0 0x562ec673bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec634a9f0 0x562ec674aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 --2- 172.21.15.38:0/454921447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec6380460 0x562ec673ee50 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 -- 172.21.15.38:0/454921447 >> 172.21.15.38:0/454921447 conn(0x562ec6750f70 msgr2=0x562ec673e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.966+0000 7f28f684c740 1 -- 172.21.15.38:0/454921447 shutdown_connections 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 -- 172.21.15.38:0/454921447 wait complete. 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 -- start start 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 Processor -- start 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec634a9f0 0x562ec6742ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec6380460 0x562ec67ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81afeb0 con 0x562ec63631b0 2024-09-21T06:29:12.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81b1320 con 0x562ec6380460 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81b0580 con 0x562ec634a9f0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28f684c740 10 client.0 _ll_register_callbacks cb 0x7f28d8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28ed873640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28ed873640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56546/0 (socket says 172.21.15.38:56546) 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.967+0000 7f28ed873640 1 -- 172.21.15.38:0/1638168011 learned_addr learned my addr 172.21.15.38:0/1638168011 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ee875640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec6380460 0x562ec67ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ee875640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec634a9f0 0x562ec6742ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 -- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec634a9f0 msgr2=0x562ec6742ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec634a9f0 0x562ec6742ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 -- 172.21.15.38:0/1638168011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec6380460 msgr2=0x562ec67ba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec6380460 0x562ec67ba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 -- 172.21.15.38:0/1638168011 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ec67bab20 con 0x562ec63631b0 2024-09-21T06:29:12.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28ed873640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f28d800baa0 tx=0x7f28d80115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcc887f5af915a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8028040 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f28d80042c0 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e0036070 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28d8011820 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28f684c740 10 client.18222 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562ec67bbc40 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.968+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28e0036070 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f28d8022070 con 0x562ec63631b0 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 10 client.18222 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 10 client.18222 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 20 client.18222 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec636b390 0x562ec67be450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 4 client.18222 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:12.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ec66a78a0 con 0x562ec636b390 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28ee875640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec636b390 0x562ec67be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28ee875640 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec636b390 0x562ec67be450 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53dc089455ffd50b server_cookie=2cc273107117657b in_seq=0 out_seq=0 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.969+0000 7f28d1ffb640 10 client.18222 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28d1ffb640 1 -- 172.21.15.38:0/1638168011 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ec66a78a0 con 0x562ec636b390 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28d1ffb640 10 client.18222 handle_command_reply: tid=0 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 client.18222 shutdown 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 msgr2=0x562ec6743430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f28d800baa0 tx=0x7f28d80115c0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 shutdown_connections 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x562ec636b390 0x562ec67be450 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ec6380460 0x562ec67ba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562ec63631b0 0x562ec6743430 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28d1ffb640 0 client.18222 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 --2- 172.21.15.38:0/1638168011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562ec634a9f0 0x562ec6742ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 >> 172.21.15.38:0/1638168011 conn(0x562ec6750f70 msgr2=0x562ec67342f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 shutdown_connections 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 1 -- 172.21.15.38:0/1638168011 wait complete. 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f684c740 20 client.18222 trim_cache size 0 max 16384 2024-09-21T06:29:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 msgr2=0x7f28d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 0x7f28d40b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e49a0 tx=0x7f28e4009c80 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 msgr2=0x7f28e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.970+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f28e400d770 tx=0x7f28e400dc30 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 shutdown_connections 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f28d40b6680 0x7f28d40b8b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28e8109e40 0x7f28e8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28e81094f0 0x7f28e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 --2- 172.21.15.38:0/2058553259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28e8103bb0 0x7f28e8075710 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 >> 172.21.15.38:0/2058553259 conn(0x7f28e80ff600 msgr2=0x7f28e8106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 shutdown_connections 2024-09-21T06:29:12.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:11.971+0000 7f28f02d8640 1 -- 172.21.15.38:0/2058553259 wait complete. 2024-09-21T06:29:12.804 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:13.066 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:13.577 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:13 smithi044 ceph-mon[34369]: pgmap v612: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-21T06:29:13.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:13 smithi174 ceph-mon[34815]: pgmap v612: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-21T06:29:13.577 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:13 smithi038 ceph-mon[31215]: pgmap v612: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 24 op/s 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 -- 172.21.15.38:0/1551863042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc01083a0 msgr2=0x7f8bc01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/1551863042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc01083a0 0x7f8bc01087b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009ca0 tx=0x7f8bb802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 -- 172.21.15.38:0/1551863042 shutdown_connections 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/1551863042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0108cf0 0x7f8bc010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/1551863042 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc01083a0 0x7f8bc01087b0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/1551863042 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc0102a60 0x7f8bc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 -- 172.21.15.38:0/1551863042 >> 172.21.15.38:0/1551863042 conn(0x7f8bc0079730 msgr2=0x7f8bc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 -- 172.21.15.38:0/1551863042 shutdown_connections 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.559+0000 7f8bc5caf640 1 -- 172.21.15.38:0/1551863042 wait complete. 2024-09-21T06:29:13.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.560+0000 7f8bc5caf640 1 Processor -- start 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 -- start start 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0102a60 0x7f8bc01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc01083a0 0x7f8bc0199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0112a80 con 0x7f8bc0108cf0 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0112900 con 0x7f8bc0102a60 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bc5caf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0112c00 con 0x7f8bc01083a0 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56564/0 (socket says 172.21.15.38:56564) 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 -- 172.21.15.38:0/3406249271 learned_addr learned my addr 172.21.15.38:0/3406249271 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0102a60 0x7f8bc01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc01083a0 0x7f8bc0199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 -- 172.21.15.38:0/3406249271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc01083a0 msgr2=0x7f8bc0199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc01083a0 0x7f8bc0199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 -- 172.21.15.38:0/3406249271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0102a60 msgr2=0x7f8bc01994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0102a60 0x7f8bc01994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.561+0000 7f8bbffff640 1 -- 172.21.15.38:0/3406249271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc019f440 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bbffff640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009860 tx=0x7f8bb0009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bbcff9640 1 -- 172.21.15.38:0/3406249271 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0005020 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc019f730 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bbcff9640 1 -- 172.21.15.38:0/3406249271 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb00047a0 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bbcff9640 1 -- 172.21.15.38:0/3406249271 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007b40 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.562+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc006ae60 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.564+0000 7f8bcc223740 1 Processor -- start 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bbcff9640 1 -- 172.21.15.38:0/3406249271 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8bb0007ce0 con 0x7f8bc0108cf0 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 -- start start 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 0x5585d4e13be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e14120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5585d4d89ea0 con 0x5585d4a4b390 2024-09-21T06:29:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585d4d792d0 con 0x5585d4a431b0 2024-09-21T06:29:13.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.565+0000 7f8bcc223740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585d4d7d0e0 con 0x5585d4a6c070 2024-09-21T06:29:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 0x5585d4e13be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:46270/0 (socket says 172.21.15.38:46270) 2024-09-21T06:29:13.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2771581220 learned_addr learned my addr 172.21.15.38:0/2771581220 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:13.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbcff9640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 0x7f8bac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2771581220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 msgr2=0x5585d4e13be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 0x5585d4e13be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2771581220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 msgr2=0x5585d4e14120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e14120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2771581220 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d4ad7650 con 0x5585d4a6c070 2024-09-21T06:29:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 0x5585d4e13be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbffff640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 0x7f8bac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bc006aaa0 tx=0x7f8bb8009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6944791777c3bb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.566+0000 7f8bbcff9640 1 -- 172.21.15.38:0/3406249271 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f8bb00e8a60 con 0x7f8bc0108cf0 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.567+0000 7f8bb5ffb640 1 -- 172.21.15.38:0/2771581220 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8045070 con 0x5585d4a6c070 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.567+0000 7f8bb5ffb640 1 -- 172.21.15.38:0/2771581220 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb8036050 con 0x5585d4a6c070 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.567+0000 7f8bb5ffb640 1 -- 172.21.15.38:0/2771581220 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8004290 con 0x5585d4a6c070 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- 172.21.15.38:0/2771581220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 msgr2=0x5585d4e136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bc006aaa0 tx=0x7f8bb8009360 comp rx=0 tx=0).stop 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bbffff640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 0x7f8bac0b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00e6280 tx=0x7f8bb0009f70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- 172.21.15.38:0/2771581220 shutdown_connections 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e14120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a431b0 0x5585d4e13be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2771581220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e136a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- 172.21.15.38:0/2771581220 >> 172.21.15.38:0/2771581220 conn(0x5585d4a60460 msgr2=0x5585d4e11590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- 172.21.15.38:0/2771581220 shutdown_connections 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- 172.21.15.38:0/2771581220 wait complete. 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 -- start start 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.568+0000 7f8bcc223740 1 Processor -- start 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e1ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e1f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5585d4bda700 con 0x5585d4a6c070 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5585d4d14160 con 0x5585d4a4b390 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5585d4e21ca0 con 0x5585d4a431b0 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bcc223740 10 client.0 _ll_register_callbacks cb 0x5585d4d2d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e1f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56590/0 (socket says 172.21.15.38:56590) 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e1f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:34964/0 (socket says 172.21.15.38:34964) 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2468164721 learned_addr learned my addr 172.21.15.38:0/2468164721 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e1ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2468164721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 msgr2=0x5585d4e1ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e1ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 msgr2=0x5585d4e1f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e1f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.569+0000 7f8bbeffd640 1 -- 172.21.15.38:0/2468164721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d4d41c90 con 0x5585d4a6c070 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80094e0 tx=0x7f8bb8031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ea6fe0e505308a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8056070 con 0x5585d4a6c070 2024-09-21T06:29:13.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f8bb802f660 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb8036050 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8bb8045040 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 10 client.18234 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5585d4e2d980 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb8036050 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8bb80308c0 con 0x5585d4a6c070 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 10 client.18234 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 10 client.18234 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 20 client.18234 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d4a2a9f0 0x5585d4e30ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 4 client.18234 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.570+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585d4d8bdf0 con 0x5585d4a2a9f0 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.571+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d4a2a9f0 0x5585d4e30ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.571+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d4a2a9f0 0x5585d4e30ce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3486e354358b597 server_cookie=c3176c42e12eab53 in_seq=0 out_seq=0 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.571+0000 7f8b9effd640 10 client.18234 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8b9effd640 1 -- 172.21.15.38:0/2468164721 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585d4d8bdf0 con 0x5585d4a2a9f0 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8b9effd640 10 client.18234 handle_command_reply: tid=0 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 client.18234 shutdown 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 msgr2=0x5585d4e2af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80094e0 tx=0x7f8bb8031910 comp rx=0 tx=0).stop 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 shutdown_connections 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d4a2a9f0 0x5585d4e30ce0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a6c070 0x5585d4e2af90 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e1f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 --2- 172.21.15.38:0/2468164721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e1ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 >> 172.21.15.38:0/2468164721 conn(0x5585d4a60460 msgr2=0x5585d4e16830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8b9effd640 0 client.18234 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 shutdown_connections 2024-09-21T06:29:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 1 -- 172.21.15.38:0/2468164721 wait complete. 2024-09-21T06:29:13.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.572+0000 7f8bcc223740 20 client.18234 trim_cache size 0 max 16384 2024-09-21T06:29:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.585+0000 7f8bcc223740 1 Processor -- start 2024-09-21T06:29:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 -- start start 2024-09-21T06:29:13.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a6c070 0x5585d4e2af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01afeb0 con 0x5585d4a4b390 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01ad780 con 0x5585d4a6c070 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bcc223740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01ab5f0 con 0x5585d4a431b0 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56594/0 (socket says 172.21.15.38:56594) 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 -- 172.21.15.38:0/1520391279 learned_addr learned my addr 172.21.15.38:0/1520391279 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a6c070 0x5585d4e2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 -- 172.21.15.38:0/1520391279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 msgr2=0x5585d4e15090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e15090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 -- 172.21.15.38:0/1520391279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a6c070 msgr2=0x5585d4e2af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a6c070 0x5585d4e2af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbf7fe640 1 -- 172.21.15.38:0/1520391279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585d4e15990 con 0x5585d4a4b390 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.586+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800bae0 tx=0x7f8ba80058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b96f2ad57d2a542 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bb57fa640 1 -- 172.21.15.38:0/1520391279 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8005020 con 0x5585d4a4b390 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bb57fa640 1 -- 172.21.15.38:0/1520391279 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ba80047a0 con 0x5585d4a4b390 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bb57fa640 1 -- 172.21.15.38:0/1520391279 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80246d0 con 0x5585d4a4b390 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bcc223740 1 -- 172.21.15.38:0/1520391279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 msgr2=0x5585d4e20960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800bae0 tx=0x7f8ba80058f0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bcc223740 1 -- 172.21.15.38:0/1520391279 shutdown_connections 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.587+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a6c070 0x5585d4e2af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a4b390 0x5585d4e20960 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1520391279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a431b0 0x5585d4e15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- 172.21.15.38:0/1520391279 >> 172.21.15.38:0/1520391279 conn(0x5585d4a60460 msgr2=0x5585d4e20250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- 172.21.15.38:0/1520391279 shutdown_connections 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- 172.21.15.38:0/1520391279 wait complete. 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- start start 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 Processor -- start 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e32730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01abc40 con 0x5585d4a431b0 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01ad0b0 con 0x5585d4a4b390 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.588+0000 7f8bcc223740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01ac310 con 0x5585d4a6c070 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bcc223740 10 client.0 _ll_register_callbacks cb 0x7f8bb8009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56610/0 (socket says 172.21.15.38:56610) 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 -- 172.21.15.38:0/1546409452 learned_addr learned my addr 172.21.15.38:0/1546409452 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e32730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 -- 172.21.15.38:0/1546409452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 msgr2=0x5585d4e32730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e32730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 -- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 msgr2=0x5585d4e321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 -- 172.21.15.38:0/1546409452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585d4e9a460 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bbeffd640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8006010 tx=0x7f8bb8031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a796c8b49a4d1ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8b9effd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8056040 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7f8bb8003b80 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.589+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba80047a0 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8bb8070050 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 10 client.18240 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5585d4e9b620 con 0x5585d4a431b0 2024-09-21T06:29:13.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8ba80047a0 con 0x5585d4a431b0 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8bb802fb50 con 0x5585d4a431b0 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 10 client.18240 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 10 client.18240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 20 client.18240 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d49ffda0 0x5585d4e9dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 4 client.18240 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585d4e1f620 con 0x5585d49ffda0 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.590+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d49ffda0 0x5585d4e9dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bbf7fe640 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d49ffda0 0x5585d4e9dd30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ec6ea1e8f4fa650 server_cookie=6620d6be5362fdec in_seq=0 out_seq=0 2024-09-21T06:29:13.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8b9effd640 10 client.18240 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8b9effd640 1 -- 172.21.15.38:0/1546409452 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585d4e1f620 con 0x5585d49ffda0 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8b9effd640 10 client.18240 handle_command_reply: tid=0 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 client.18240 shutdown 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 msgr2=0x5585d4e31cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8006010 tx=0x7f8bb8031870 comp rx=0 tx=0).stop 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 shutdown_connections 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5585d49ffda0 0x5585d4e9dd30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585d4a6c070 0x5585d4e32730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585d4a4b390 0x5585d4e321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 --2- 172.21.15.38:0/1546409452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585d4a431b0 0x5585d4e31cb0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 >> 172.21.15.38:0/1546409452 conn(0x5585d4a60460 msgr2=0x5585d4e1ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8b9effd640 0 client.18240 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.591+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 shutdown_connections 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bcc223740 1 -- 172.21.15.38:0/1546409452 wait complete. 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bcc223740 20 client.18240 trim_cache size 0 max 16384 2024-09-21T06:29:13.611 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:13.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 msgr2=0x7f8bac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 0x7f8bac0b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00e6280 tx=0x7f8bb0009f70 comp rx=0 tx=0).stop 2024-09-21T06:29:13.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 msgr2=0x7f8bc019ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009860 tx=0x7f8bb0009d20 comp rx=0 tx=0).stop 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 shutdown_connections 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f8bac0b6680 0x7f8bac0b8b90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8bc0108cf0 0x7f8bc019ed10 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8bc01083a0 0x7f8bc0199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 --2- 172.21.15.38:0/3406249271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bc0102a60 0x7f8bc01994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 >> 172.21.15.38:0/3406249271 conn(0x7f8bc0079730 msgr2=0x7f8bc01013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 shutdown_connections 2024-09-21T06:29:13.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:13.592+0000 7f8bc5caf640 1 -- 172.21.15.38:0/3406249271 wait complete. 2024-09-21T06:29:14.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:14.643 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:15.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 -- 172.21.15.38:0/1887592007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 msgr2=0x7fdf5c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1887592007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c1087c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009900 tx=0x7fdf4c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 -- 172.21.15.38:0/1887592007 shutdown_connections 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1887592007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c108d00 0x7fdf5c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1887592007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c1087c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1887592007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c102a70 0x7fdf5c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.075+0000 7fdf642c4640 1 -- 172.21.15.38:0/1887592007 >> 172.21.15.38:0/1887592007 conn(0x7fdf5c079710 msgr2=0x7fdf5c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.076+0000 7fdf642c4640 1 -- 172.21.15.38:0/1887592007 shutdown_connections 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.076+0000 7fdf642c4640 1 -- 172.21.15.38:0/1887592007 wait complete. 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.076+0000 7fdf642c4640 1 Processor -- start 2024-09-21T06:29:15.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.076+0000 7fdf642c4640 1 -- start start 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c102a70 0x7fdf5c0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 0x7fdf5c100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c112ae0 con 0x7fdf5c1083b0 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c112960 con 0x7fdf5c102a70 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf642c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c112c60 con 0x7fdf5c108d00 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56626/0 (socket says 172.21.15.38:56626) 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 -- 172.21.15.38:0/1013484868 learned_addr learned my addr 172.21.15.38:0/1013484868 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:15.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf62060640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c102a70 0x7fdf5c0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf62861640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 0x7fdf5c100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 -- 172.21.15.38:0/1013484868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 msgr2=0x7fdf5c100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 0x7fdf5c100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 -- 172.21.15.38:0/1013484868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c102a70 msgr2=0x7fdf5c0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c102a70 0x7fdf5c0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 -- 172.21.15.38:0/1013484868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c1a8860 con 0x7fdf5c1083b0 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf62861640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 0x7fdf5c100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005940 tx=0x7fdf4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.077+0000 7fdf537fe640 1 -- 172.21.15.38:0/1013484868 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c03f030 con 0x7fdf5c1083b0 2024-09-21T06:29:15.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.078+0000 7fdf537fe640 1 -- 172.21.15.38:0/1013484868 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf4c031910 con 0x7fdf5c1083b0 2024-09-21T06:29:15.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.078+0000 7fdf537fe640 1 -- 172.21.15.38:0/1013484868 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c035070 con 0x7fdf5c1083b0 2024-09-21T06:29:15.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.078+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c1a8af0 con 0x7fdf5c1083b0 2024-09-21T06:29:15.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.078+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c1a9020 con 0x7fdf5c1083b0 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.080+0000 7fdf6a838740 1 Processor -- start 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 -- start start 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf537fe640 1 -- 172.21.15.38:0/1013484868 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdf4c042030 con 0x7fdf5c1083b0 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 0x5580fb020be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb021120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5580faf96ea0 con 0x5580fac58390 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5580faf862d0 con 0x5580fac501b0 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6a838740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5580faf8a0e0 con 0x5580fac79070 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb021120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf62861640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf62861640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:46322/0 (socket says 172.21.15.38:46322) 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb021120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56638/0 (socket says 172.21.15.38:56638) 2024-09-21T06:29:15.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf62060640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 0x5580fb020be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.081+0000 7fdf62861640 1 -- 172.21.15.38:0/4069770906 learned_addr learned my addr 172.21.15.38:0/4069770906 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 -- 172.21.15.38:0/4069770906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 msgr2=0x5580fb0206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 -- 172.21.15.38:0/4069770906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 msgr2=0x5580fb021120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb021120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 -- 172.21.15.38:0/4069770906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580face4650 con 0x5580fac501b0 2024-09-21T06:29:15.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62861640 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf537fe640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 0x7fdf480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62060640 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 0x5580fb020be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005fd0 tx=0x7fdf5800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f96987e5191842e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf62861640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 0x7fdf480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf537fe640 1 -- 172.21.15.38:0/1013484868 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7fdf4c107b60 con 0x7fdf5c1083b0 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf50d9a640 1 -- 172.21.15.38:0/4069770906 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003bd0 con 0x5580fac501b0 2024-09-21T06:29:15.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf50d9a640 1 -- 172.21.15.38:0/4069770906 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf58015070 con 0x5580fac501b0 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.082+0000 7fdf50d9a640 1 -- 172.21.15.38:0/4069770906 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58004e60 con 0x5580fac501b0 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 -- 172.21.15.38:0/4069770906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 msgr2=0x5580fb020be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf62861640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 0x7fdf480b8c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf540126a0 tx=0x7fdf54009790 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 0x5580fb020be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005fd0 tx=0x7fdf5800bb20 comp rx=0 tx=0).stop 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 -- 172.21.15.38:0/4069770906 shutdown_connections 2024-09-21T06:29:15.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb021120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac501b0 0x5580fb020be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 --2- 172.21.15.38:0/4069770906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb0206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 -- 172.21.15.38:0/4069770906 >> 172.21.15.38:0/4069770906 conn(0x5580fac6d460 msgr2=0x5580fb01e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 -- 172.21.15.38:0/4069770906 shutdown_connections 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.083+0000 7fdf6a838740 1 -- 172.21.15.38:0/4069770906 wait complete. 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 -- start start 2024-09-21T06:29:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 Processor -- start 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 0x5580fb02bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5580fade7700 con 0x5580fac58390 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5580faf21160 con 0x5580fac79070 2024-09-21T06:29:15.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5580fb02ee80 con 0x5580fac501b0 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6a838740 10 client.0 _ll_register_callbacks cb 0x5580faf3a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6185f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56642/0 (socket says 172.21.15.38:56642) 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf62060640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 0x5580fb02bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.084+0000 7fdf6185f640 1 -- 172.21.15.38:0/2907741083 learned_addr learned my addr 172.21.15.38:0/2907741083 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf62861640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 -- 172.21.15.38:0/2907741083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 msgr2=0x5580fb02bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 0x5580fb02bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 -- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 msgr2=0x5580fb0381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 -- 172.21.15.38:0/2907741083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580faf4ec90 con 0x5580fac58390 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf62060640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 0x5580fb02bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6185f640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c1057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a45c7c84d9e139 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c049070 con 0x5580fac58390 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7fdf4c0d7160 con 0x5580fac58390 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf58015070 con 0x5580fac58390 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdf4c0ca020 con 0x5580fac58390 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6a838740 10 client.18252 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:15.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.085+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5580fb03abb0 con 0x5580fac58390 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf58015070 con 0x5580fac58390 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdf4c0d2080 con 0x5580fac58390 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 10 client.18252 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 10 client.18252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 20 client.18252 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:15.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac379f0 0x5580fb03e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 4 client.18252 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580faf98df0 con 0x5580fac379f0 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.086+0000 7fdf62060640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac379f0 0x5580fb03e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.087+0000 7fdf45ffb640 10 client.18252 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.087+0000 7fdf62060640 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac379f0 0x5580fb03e050 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2239f9398f8553c server_cookie=5ed045287b991f0f in_seq=0 out_seq=0 2024-09-21T06:29:15.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.087+0000 7fdf45ffb640 1 -- 172.21.15.38:0/2907741083 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580faf98df0 con 0x5580fac379f0 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.087+0000 7fdf45ffb640 10 client.18252 handle_command_reply: tid=0 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.087+0000 7fdf6a838740 1 client.18252 shutdown 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 msgr2=0x5580fb02c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c00 tx=0x7fdf4c1057d0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 shutdown_connections 2024-09-21T06:29:15.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac58390 0x5580fb02c260 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac379f0 0x5580fb03e050 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 --2- 172.21.15.38:0/2907741083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac501b0 0x5580fb02bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 >> 172.21.15.38:0/2907741083 conn(0x5580fac6d460 msgr2=0x5580fb023830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf45ffb640 0 client.18252 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 shutdown_connections 2024-09-21T06:29:15.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 1 -- 172.21.15.38:0/2907741083 wait complete. 2024-09-21T06:29:15.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.088+0000 7fdf6a838740 20 client.18252 trim_cache size 0 max 16384 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 Processor -- start 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 -- start start 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 0x5580fb01dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb01e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b41d0 con 0x5580fac501b0 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b1aa0 con 0x5580fac58390 2024-09-21T06:29:15.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6a838740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1af910 con 0x5580fac79070 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56648/0 (socket says 172.21.15.38:56648) 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 -- 172.21.15.38:0/3940862876 learned_addr learned my addr 172.21.15.38:0/3940862876 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6185f640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 0x5580fb01dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62861640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb01e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 -- 172.21.15.38:0/3940862876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 msgr2=0x5580fb01e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb01e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 -- 172.21.15.38:0/3940862876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 msgr2=0x5580fb01dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 0x5580fb01dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 -- 172.21.15.38:0/3940862876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580fb0269d0 con 0x5580fac501b0 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf6185f640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 0x5580fb01dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf62060640 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x5580fb01f320 tx=0x7fdf58004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63564f69e1979f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf47fff640 1 -- 172.21.15.38:0/3940862876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003dd0 con 0x5580fac501b0 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf47fff640 1 -- 172.21.15.38:0/3940862876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf58015040 con 0x5580fac501b0 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.102+0000 7fdf47fff640 1 -- 172.21.15.38:0/3940862876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58019680 con 0x5580fac501b0 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 -- 172.21.15.38:0/3940862876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 msgr2=0x5580fb021de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x5580fb01f320 tx=0x7fdf58004560 comp rx=0 tx=0).stop 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 -- 172.21.15.38:0/3940862876 shutdown_connections 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac79070 0x5580fb01e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac58390 0x5580fb01dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 --2- 172.21.15.38:0/3940862876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb021de0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 -- 172.21.15.38:0/3940862876 >> 172.21.15.38:0/3940862876 conn(0x5580fac6d460 msgr2=0x5580fb0216d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 -- 172.21.15.38:0/3940862876 shutdown_connections 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.103+0000 7fdf6a838740 1 -- 172.21.15.38:0/3940862876 wait complete. 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 -- start start 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 Processor -- start 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac58390 0x5580fb02fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0302a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1aff60 con 0x5580fac501b0 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b13d0 con 0x5580fac79070 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c1b0630 con 0x5580fac58390 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6a838740 10 client.0 _ll_register_callbacks cb 0x7fdf4c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf62060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf62060640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56656/0 (socket says 172.21.15.38:56656) 2024-09-21T06:29:15.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf62060640 1 -- 172.21.15.38:0/1792647913 learned_addr learned my addr 172.21.15.38:0/1792647913 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac58390 0x5580fb02fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.104+0000 7fdf62861640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 -- 172.21.15.38:0/1792647913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac58390 msgr2=0x5580fb02fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac58390 0x5580fb02fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 -- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 msgr2=0x5580fb0302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0302a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 -- 172.21.15.38:0/1792647913 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580fb0309e0 con 0x5580fac501b0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf62060640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b3f0 tx=0x7fdf58003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7956aed06f4f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5803a060 con 0x5580fac501b0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8485+0+0 (secure 0 0 0) 0x7fdf58011640 con 0x5580fac501b0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf58015040 con 0x5580fac501b0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdf58011860 con 0x5580fac501b0 2024-09-21T06:29:15.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf6a838740 10 client.18258 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.105+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5580fb0a88b0 con 0x5580fac501b0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf58015040 con 0x5580fac501b0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdf58019420 con 0x5580fac501b0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 10 client.18258 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 20 client.18258 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac0cda0 0x5580fb0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 4 client.18258 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5580faf948a0 con 0x5580fac0cda0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac0cda0 0x5580fb0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf45ffb640 10 client.18258 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.106+0000 7fdf6185f640 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac0cda0 0x5580fb0aae20 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43df281ad0087360 server_cookie=da797c0b51d45f in_seq=0 out_seq=0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf45ffb640 1 -- 172.21.15.38:0/1792647913 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5580faf948a0 con 0x5580fac0cda0 2024-09-21T06:29:15.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf45ffb640 10 client.18258 handle_command_reply: tid=0 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 client.18258 shutdown 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 msgr2=0x5580fb0348b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800b3f0 tx=0x7fdf58003b70 comp rx=0 tx=0).stop 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 shutdown_connections 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5580fac79070 0x5580fb0302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x5580fac0cda0 0x5580fb0aae20 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5580fac58390 0x5580fb02fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 --2- 172.21.15.38:0/1792647913 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5580fac501b0 0x5580fb0348b0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 >> 172.21.15.38:0/1792647913 conn(0x5580fac6d460 msgr2=0x5580fb021f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf45ffb640 0 client.18258 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 shutdown_connections 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 1 -- 172.21.15.38:0/1792647913 wait complete. 2024-09-21T06:29:15.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.107+0000 7fdf6a838740 20 client.18258 trim_cache size 0 max 16384 2024-09-21T06:29:15.123 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:15.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 msgr2=0x7fdf480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 0x7fdf480b8c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf540126a0 tx=0x7fdf54009790 comp rx=0 tx=0).stop 2024-09-21T06:29:15.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 msgr2=0x7fdf5c0ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c005940 tx=0x7fdf4c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 shutdown_connections 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fdf480b6700 0x7fdf480b8c10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf5c108d00 0x7fdf5c100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf5c1083b0 0x7fdf5c0ffb30 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 --2- 172.21.15.38:0/1013484868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf5c102a70 0x7fdf5c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 >> 172.21.15.38:0/1013484868 conn(0x7fdf5c079710 msgr2=0x7fdf5c101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 shutdown_connections 2024-09-21T06:29:15.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:15.108+0000 7fdf642c4640 1 -- 172.21.15.38:0/1013484868 wait complete. 2024-09-21T06:29:15.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:15 smithi174 ceph-mon[34815]: pgmap v613: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 22 op/s 2024-09-21T06:29:15.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:15 smithi044 ceph-mon[34369]: pgmap v613: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 22 op/s 2024-09-21T06:29:15.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:15 smithi038 ceph-mon[31215]: pgmap v613: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 22 op/s 2024-09-21T06:29:16.898 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:16.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:17.171 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:17.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:17 smithi038 ceph-mon[31215]: pgmap v614: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:17.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:17 smithi044 ceph-mon[34369]: pgmap v614: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:17.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 -- 172.21.15.38:0/3105778194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf8108d20 msgr2=0x7f0cf810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 --2- 172.21.15.38:0/3105778194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf8108d20 0x7f0cf810f550 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009900 tx=0x7f0cf002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:17.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 -- 172.21.15.38:0/3105778194 shutdown_connections 2024-09-21T06:29:17.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 --2- 172.21.15.38:0/3105778194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf8108d20 0x7f0cf810f550 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 --2- 172.21.15.38:0/3105778194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf81083d0 0x7f0cf81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 --2- 172.21.15.38:0/3105778194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102ae0 0x7f0cf8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 -- 172.21.15.38:0/3105778194 >> 172.21.15.38:0/3105778194 conn(0x7f0cf80797b0 msgr2=0x7f0cf8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.579+0000 7f0d004c5640 1 -- 172.21.15.38:0/3105778194 shutdown_connections 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.580+0000 7f0d004c5640 1 -- 172.21.15.38:0/3105778194 wait complete. 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.580+0000 7f0d004c5640 1 Processor -- start 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.580+0000 7f0d004c5640 1 -- start start 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.580+0000 7f0d004c5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8102ae0 0x7f0cf80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8108d20 0x7f0cf81000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8112b20 con 0x7f0cf81083d0 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81129a0 con 0x7f0cf8108d20 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8112ca0 con 0x7f0cf8102ae0 2024-09-21T06:29:17.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56660/0 (socket says 172.21.15.38:56660) 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 -- 172.21.15.38:0/787700621 learned_addr learned my addr 172.21.15.38:0/787700621 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfe261640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8102ae0 0x7f0cf80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfea62640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8108d20 0x7f0cf81000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 -- 172.21.15.38:0/787700621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8102ae0 msgr2=0x7f0cf80ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8102ae0 0x7f0cf80ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 -- 172.21.15.38:0/787700621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8108d20 msgr2=0x7f0cf81000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8108d20 0x7f0cf81000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 -- 172.21.15.38:0/787700621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf81a8840 con 0x7f0cf81083d0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cfda60640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800d750 tx=0x7f0ce800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cef7fe640 1 -- 172.21.15.38:0/787700621 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8017070 con 0x7f0cf81083d0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf81a8b30 con 0x7f0cf81083d0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.581+0000 7f0cef7fe640 1 -- 172.21.15.38:0/787700621 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ce80054f0 con 0x7f0cf81083d0 2024-09-21T06:29:17.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.582+0000 7f0cef7fe640 1 -- 172.21.15.38:0/787700621 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8004d90 con 0x7f0cf81083d0 2024-09-21T06:29:17.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.582+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf81a9020 con 0x7f0cf81083d0 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.585+0000 7f0d06a39740 1 Processor -- start 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.585+0000 7f0d06a39740 1 -- start start 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba06430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba06eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56100b97ce60 con 0x56100b63e670 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56100b96c290 con 0x56100b65f350 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0d06a39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56100b9700a0 con 0x56100b636490 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:46378/0 (socket says 172.21.15.38:46378) 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 -- 172.21.15.38:0/1612936705 learned_addr learned my addr 172.21.15.38:0/1612936705 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfea62640 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba06430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cef7fe640 1 -- 172.21.15.38:0/787700621 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0ce8010460 con 0x7f0cf81083d0 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 -- 172.21.15.38:0/1612936705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 msgr2=0x56100ba06430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba06430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 -- 172.21.15.38:0/1612936705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 msgr2=0x56100ba06eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba06eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.586+0000 7f0cfe261640 1 -- 172.21.15.38:0/1612936705 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100b6ca930 con 0x56100b636490 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.587+0000 7f0cfe261640 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009fd0 tx=0x7f0cf4003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480b1c5582b741b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.587+0000 7f0cecd9a640 1 -- 172.21.15.38:0/1612936705 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4012450 con 0x56100b636490 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.587+0000 7f0cecd9a640 1 -- 172.21.15.38:0/1612936705 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cf4012ac0 con 0x56100b636490 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.587+0000 7f0cecd9a640 1 -- 172.21.15.38:0/1612936705 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf401ab50 con 0x56100b636490 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.587+0000 7f0cef7fe640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 0x7f0ce40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0cfea62640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 0x7f0ce40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0cef7fe640 1 -- 172.21.15.38:0/787700621 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ce80e70a0 con 0x7f0cf81083d0 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0cfea62640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 0x7f0ce40b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0006010 tx=0x7f0cf0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 -- 172.21.15.38:0/1612936705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 msgr2=0x56100ba06970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009fd0 tx=0x7f0cf4003e80 comp rx=0 tx=0).stop 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 -- 172.21.15.38:0/1612936705 shutdown_connections 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba06eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba06970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1612936705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba06430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 -- 172.21.15.38:0/1612936705 >> 172.21.15.38:0/1612936705 conn(0x56100b653740 msgr2=0x56100ba04320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 -- 172.21.15.38:0/1612936705 shutdown_connections 2024-09-21T06:29:17.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.588+0000 7f0d06a39740 1 -- 172.21.15.38:0/1612936705 wait complete. 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 -- start start 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 Processor -- start 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba12050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b65f350 0x56100ba1df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x56100b7cd890 con 0x56100b63e670 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56100b906d40 con 0x56100b636490 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56100ba14c10 con 0x56100b65f350 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0d06a39740 10 client.0 _ll_register_callbacks cb 0x56100b96ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56680/0 (socket says 172.21.15.38:56680) 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.589+0000 7f0cfda60640 1 -- 172.21.15.38:0/248817291 learned_addr learned my addr 172.21.15.38:0/248817291 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfe261640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba12050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfea62640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b65f350 0x56100ba1df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 -- 172.21.15.38:0/248817291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b65f350 msgr2=0x56100ba1df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b65f350 0x56100ba1df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 -- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 msgr2=0x56100ba12050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba12050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 -- 172.21.15.38:0/248817291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100ba1e570 con 0x56100b63e670 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfe261640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba12050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0cfda60640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80e48a0 tx=0x7f0ce8009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3980383fbbd9c0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0ce1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8020070 con 0x56100b63e670 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ce80e90d0 con 0x56100b63e670 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf4012ac0 con 0x56100b63e670 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ce80b1a20 con 0x56100b63e670 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0d06a39740 10 client.18267 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:17.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.590+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56100ba20ea0 con 0x56100b63e670 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cf4012ac0 con 0x56100b63e670 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce80a8a60 con 0x56100b63e670 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 10 client.18267 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 10 client.18267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 20 client.18267 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b61dcd0 0x56100ba242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 4 client.18267 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56100b97edb0 con 0x56100b61dcd0 2024-09-21T06:29:17.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.591+0000 7f0cfe261640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b61dcd0 0x56100ba242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.592+0000 7f0ce1ffb640 10 client.18267 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:17.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.592+0000 7f0cfe261640 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b61dcd0 0x56100ba242c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1172069864564521 server_cookie=8b7535224a141c6b in_seq=0 out_seq=0 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/248817291 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56100b97edb0 con 0x56100b61dcd0 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0ce1ffb640 10 client.18267 handle_command_reply: tid=0 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 client.18267 shutdown 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 msgr2=0x56100ba125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80e48a0 tx=0x7f0ce8009ef0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 shutdown_connections 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b61dcd0 0x56100ba242c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b65f350 0x56100ba1df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba125f0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0ce1ffb640 0 client.18267 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 --2- 172.21.15.38:0/248817291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba12050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 >> 172.21.15.38:0/248817291 conn(0x56100b653740 msgr2=0x56100ba095c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 shutdown_connections 2024-09-21T06:29:17.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 1 -- 172.21.15.38:0/248817291 wait complete. 2024-09-21T06:29:17.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.593+0000 7f0d06a39740 20 client.18267 trim_cache size 0 max 16384 2024-09-21T06:29:17.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 Processor -- start 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 -- start start 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba0b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba0f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81b4140 con 0x56100b63e670 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81b1a10 con 0x56100b65f350 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0d06a39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81af880 con 0x56100b636490 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0cfda60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56686/0 (socket says 172.21.15.38:56686) 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.611+0000 7f0cfda60640 1 -- 172.21.15.38:0/1670091852 learned_addr learned my addr 172.21.15.38:0/1670091852 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfe261640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba0b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfea62640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba0f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 -- 172.21.15.38:0/1670091852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 msgr2=0x56100ba0b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba0b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 -- 172.21.15.38:0/1670091852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 msgr2=0x56100ba0f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba0f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 -- 172.21.15.38:0/1670091852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100ba08720 con 0x56100b63e670 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfea62640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba0f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0cfda60640 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80047e0 tx=0x7f0ce8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16306d6031f857cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0ce3fff640 1 -- 172.21.15.38:0/1670091852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8020070 con 0x56100b63e670 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0ce3fff640 1 -- 172.21.15.38:0/1670091852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ce80abe80 con 0x56100b63e670 2024-09-21T06:29:17.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.612+0000 7f0ce3fff640 1 -- 172.21.15.38:0/1670091852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80a8ba0 con 0x56100b63e670 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- 172.21.15.38:0/1670091852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 msgr2=0x56100ba0ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80047e0 tx=0x7f0ce8009f90 comp rx=0 tx=0).stop 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- 172.21.15.38:0/1670091852 shutdown_connections 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b65f350 0x56100ba0f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b63e670 0x56100ba0ba80 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 --2- 172.21.15.38:0/1670091852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b636490 0x56100ba0b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- 172.21.15.38:0/1670091852 >> 172.21.15.38:0/1670091852 conn(0x56100b653740 msgr2=0x56100ba106d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- 172.21.15.38:0/1670091852 shutdown_connections 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- 172.21.15.38:0/1670091852 wait complete. 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.613+0000 7f0d06a39740 1 -- start start 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 Processor -- start 2024-09-21T06:29:17.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba165e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 0x56100ba16b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81afed0 con 0x56100b65f350 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81b1340 con 0x56100b636490 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81b05a0 con 0x56100b63e670 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0d06a39740 10 client.0 _ll_register_callbacks cb 0x7f0ce800de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56698/0 (socket says 172.21.15.38:56698) 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 -- 172.21.15.38:0/842088079 learned_addr learned my addr 172.21.15.38:0/842088079 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfe261640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfda60640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 0x56100ba16b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 -- 172.21.15.38:0/842088079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 msgr2=0x56100ba16b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 0x56100ba16b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 -- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 msgr2=0x56100ba165e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba165e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfea62640 1 -- 172.21.15.38:0/842088079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100ba8e120 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.614+0000 7f0cfda60640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 0x56100ba16b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0cfea62640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0031a20 tx=0x7f0cf0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a873095b8f1dec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0ce1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0035040 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0cf0005240 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ce80abe80 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0cf0005440 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0d06a39740 10 client.18273 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56100ba8f330 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.615+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ce80abe80 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0cf00038f0 con 0x56100b65f350 2024-09-21T06:29:17.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 10 client.18273 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 20 client.18273 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b5f3080 0x56100ba91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 4 client.18273 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56100b97a860 con 0x56100b5f3080 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0cfe261640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b5f3080 0x56100ba91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0cfe261640 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b5f3080 0x56100ba91b00 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621b522056edca20 server_cookie=ed3dc4832f6d9c5a in_seq=0 out_seq=0 2024-09-21T06:29:17.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.616+0000 7f0ce1ffb640 10 client.18273 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0ce1ffb640 1 -- 172.21.15.38:0/842088079 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56100b97a860 con 0x56100b5f3080 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0ce1ffb640 10 client.18273 handle_command_reply: tid=0 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 client.18273 shutdown 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 msgr2=0x56100ba8dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0031a20 tx=0x7f0cf0009260 comp rx=0 tx=0).stop 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 shutdown_connections 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56100b65f350 0x56100ba8dbe0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x56100b5f3080 0x56100ba91b00 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56100b63e670 0x56100ba16b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 --2- 172.21.15.38:0/842088079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56100b636490 0x56100ba165e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 >> 172.21.15.38:0/842088079 conn(0x56100b653740 msgr2=0x56100ba10310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.618+0000 7f0ce1ffb640 0 client.18273 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 shutdown_connections 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d06a39740 1 -- 172.21.15.38:0/842088079 wait complete. 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d06a39740 20 client.18273 trim_cache size 0 max 16384 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:29:17.623 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "75a9e3b9-81b4-4dfc-92ed-38f82ef0a592", 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 msgr2=0x7f0ce40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 0x7f0ce40b8b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0006010 tx=0x7f0cf0005d50 comp rx=0 tx=0).stop 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 msgr2=0x7f0cf80ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:17.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800d750 tx=0x7f0ce800dc10 comp rx=0 tx=0).stop 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 shutdown_connections 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ce40b6680 0x7f0ce40b8b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8108d20 0x7f0cf81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0cf81083d0 0x7f0cf80ffbb0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 --2- 172.21.15.38:0/787700621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cf8102ae0 0x7f0cf80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 >> 172.21.15.38:0/787700621 conn(0x7f0cf80797b0 msgr2=0x7f0cf8101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 shutdown_connections 2024-09-21T06:29:17.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:17.619+0000 7f0d004c5640 1 -- 172.21.15.38:0/787700621 wait complete. 2024-09-21T06:29:17.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:17 smithi174 ceph-mon[34815]: pgmap v614: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:18.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:18 smithi038 ceph-mon[31215]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:29:18.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:18.639 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:18.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:18 smithi174 ceph-mon[34815]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:29:18.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:18 smithi044 ceph-mon[34369]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.053+0000 7f7917fc9640 1 -- 172.21.15.38:0/3078358172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 msgr2=0x7f7910102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.053+0000 7f7917fc9640 1 --2- 172.21.15.38:0/3078358172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f7910102ef0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f790c009900 tx=0x7f790c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 -- 172.21.15.38:0/3078358172 shutdown_connections 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 --2- 172.21.15.38:0/3078358172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 0x7f791010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 --2- 172.21.15.38:0/3078358172 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 0x7f79101087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 --2- 172.21.15.38:0/3078358172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f7910102ef0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 -- 172.21.15.38:0/3078358172 >> 172.21.15.38:0/3078358172 conn(0x7f7910079760 msgr2=0x7f7910079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 -- 172.21.15.38:0/3078358172 shutdown_connections 2024-09-21T06:29:19.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.054+0000 7f7917fc9640 1 -- 172.21.15.38:0/3078358172 wait complete. 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 Processor -- start 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 -- start start 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 0x7f791019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 0x7f791019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112ab0 con 0x7f7910102ae0 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112930 con 0x7f7910108d20 2024-09-21T06:29:19.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7917fc9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7910112c30 con 0x7f79101083d0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7915d65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7915d65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56710/0 (socket says 172.21.15.38:56710) 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7915d65640 1 -- 172.21.15.38:0/635844907 learned_addr learned my addr 172.21.15.38:0/635844907 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7915564640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 0x7f791019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.055+0000 7f7916566640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 0x7f791019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 -- 172.21.15.38:0/635844907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 msgr2=0x7f791019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 0x7f791019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 -- 172.21.15.38:0/635844907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 msgr2=0x7f791019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 0x7f791019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 -- 172.21.15.38:0/635844907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79101a65e0 con 0x7f7910102ae0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7915d65640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f790c005ab0 tx=0x7f790c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7906ffd640 1 -- 172.21.15.38:0/635844907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c03f030 con 0x7f7910102ae0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7906ffd640 1 -- 172.21.15.38:0/635844907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f790c003ac0 con 0x7f7910102ae0 2024-09-21T06:29:19.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79101a6870 con 0x7f7910102ae0 2024-09-21T06:29:19.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7906ffd640 1 -- 172.21.15.38:0/635844907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c035070 con 0x7f7910102ae0 2024-09-21T06:29:19.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.056+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101a6da0 con 0x7f7910102ae0 2024-09-21T06:29:19.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f791e53d740 1 Processor -- start 2024-09-21T06:29:19.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f791e53d740 1 -- start start 2024-09-21T06:29:19.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f7906ffd640 1 -- 172.21.15.38:0/635844907 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f790c042030 con 0x7f7910102ae0 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f791e53d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d702270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f791e53d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d7027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.059+0000 7f791e53d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f791e53d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55861d678e50 con 0x55861d33a390 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f791e53d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55861d668280 con 0x55861d35b070 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f791e53d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55861d66c090 con 0x55861d3321b0 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56714/0 (socket says 172.21.15.38:56714) 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 -- 172.21.15.38:0/675947837 learned_addr learned my addr 172.21.15.38:0/675947837 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7916566640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d702270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915d65640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d7027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 -- 172.21.15.38:0/675947837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 msgr2=0x55861d7027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d7027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 -- 172.21.15.38:0/675947837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 msgr2=0x55861d702270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d702270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 -- 172.21.15.38:0/675947837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55861d3c6650 con 0x55861d33a390 2024-09-21T06:29:19.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7916566640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d702270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7915564640 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f7900009c60 tx=0x7f7900011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bdd5374efcc67c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.060+0000 7f7906ffd640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 0x7f78fc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.061+0000 7f7916566640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 0x7f78fc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.061+0000 7f78fbfff640 1 -- 172.21.15.38:0/675947837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900004230 con 0x55861d33a390 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.061+0000 7f7906ffd640 1 -- 172.21.15.38:0/635844907 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f790c107dc0 con 0x7f7910102ae0 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.061+0000 7f78fbfff640 1 -- 172.21.15.38:0/675947837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79000043d0 con 0x55861d33a390 2024-09-21T06:29:19.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.061+0000 7f78fbfff640 1 -- 172.21.15.38:0/675947837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900004de0 con 0x55861d33a390 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- 172.21.15.38:0/675947837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 msgr2=0x55861d702cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f7916566640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 0x7f78fc0b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fd0 tx=0x7f7908009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f7900009c60 tx=0x7f7900011810 comp rx=0 tx=0).stop 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- 172.21.15.38:0/675947837 shutdown_connections 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d702cf0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d7027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 --2- 172.21.15.38:0/675947837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d702270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- 172.21.15.38:0/675947837 >> 172.21.15.38:0/675947837 conn(0x55861d34f460 msgr2=0x55861d700160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- 172.21.15.38:0/675947837 shutdown_connections 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- 172.21.15.38:0/675947837 wait complete. 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 -- start start 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.062+0000 7f791e53d740 1 Processor -- start 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d70e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55861d4c9700 con 0x55861d33a390 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55861d603110 con 0x55861d35b070 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55861d714e60 con 0x55861d3321b0 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f791e53d740 10 client.0 _ll_register_callbacks cb 0x55861d61c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56722/0 (socket says 172.21.15.38:56722) 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 -- 172.21.15.38:0/1925444236 learned_addr learned my addr 172.21.15.38:0/1925444236 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7916566640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d70e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915d65640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 -- 172.21.15.38:0/1925444236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 msgr2=0x55861d70d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 -- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 msgr2=0x55861d70e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d70e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915564640 1 -- 172.21.15.38:0/1925444236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55861d630c40 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.063+0000 7f7915d65640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f7915564640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f7900019b00 tx=0x7f7900019b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f755d752a26e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900024620 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79000043d0 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f79000247c0 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7900032050 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f791e53d740 10 client.18285 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55861d720ae0 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79000043d0 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.064+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7900018070 con 0x55861d33a390 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 10 client.18285 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 20 client.18285 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d3199f0 0x55861d723ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 4 client.18285 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55861d67ada0 con 0x55861d3199f0 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f7915d65640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d3199f0 0x55861d723ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f7915d65640 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d3199f0 0x55861d723ea0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab39ae6c0306fd2 server_cookie=3a3d8fc6d65f2390 in_seq=0 out_seq=0 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.065+0000 7f78f97fa640 10 client.18285 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.066+0000 7f78f97fa640 1 -- 172.21.15.38:0/1925444236 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55861d67ada0 con 0x55861d3199f0 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.066+0000 7f78f97fa640 10 client.18285 handle_command_reply: tid=0 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.066+0000 7f791e53d740 1 client.18285 shutdown 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.066+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 msgr2=0x55861d70ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.066+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f7900019b00 tx=0x7f7900019b30 comp rx=0 tx=0).stop 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 shutdown_connections 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d70e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d33a390 0x55861d70ddd0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d3199f0 0x55861d723ea0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 --2- 172.21.15.38:0/1925444236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f78f97fa640 0 client.18285 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:19.073 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 >> 172.21.15.38:0/1925444236 conn(0x55861d34f460 msgr2=0x55861d705450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 shutdown_connections 2024-09-21T06:29:19.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 1 -- 172.21.15.38:0/1925444236 wait complete. 2024-09-21T06:29:19.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.067+0000 7f791e53d740 20 client.18285 trim_cache size 0 max 16384 2024-09-21T06:29:19.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.084+0000 7f791e53d740 1 Processor -- start 2024-09-21T06:29:19.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.084+0000 7f791e53d740 1 -- start start 2024-09-21T06:29:19.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d33a390 0x55861d7039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79101afd20 con 0x55861d35b070 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ad5f0 con 0x55861d33a390 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f791e53d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ab460 con 0x55861d3321b0 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56728/0 (socket says 172.21.15.38:56728) 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 -- 172.21.15.38:0/1573837261 learned_addr learned my addr 172.21.15.38:0/1573837261 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7915564640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d33a390 0x55861d7039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7915d65640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 -- 172.21.15.38:0/1573837261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 msgr2=0x55861d70f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 -- 172.21.15.38:0/1573837261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d33a390 msgr2=0x55861d7039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d33a390 0x55861d7039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 -- 172.21.15.38:0/1573837261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55861d7103c0 con 0x55861d35b070 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7915d65640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:19.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f7916566640 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f79080109a0 tx=0x7f7908019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fba5be368e69af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.085+0000 7f78fb7fe640 1 -- 172.21.15.38:0/1573837261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790801e9a0 con 0x55861d35b070 2024-09-21T06:29:19.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f78fb7fe640 1 -- 172.21.15.38:0/1573837261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7908003e40 con 0x55861d35b070 2024-09-21T06:29:19.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f78fb7fe640 1 -- 172.21.15.38:0/1573837261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908004720 con 0x55861d35b070 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 -- 172.21.15.38:0/1573837261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 msgr2=0x55861d6ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f79080109a0 tx=0x7f7908019000 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 -- 172.21.15.38:0/1573837261 shutdown_connections 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d35b070 0x55861d6ff710 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d33a390 0x55861d7039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 --2- 172.21.15.38:0/1573837261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d3321b0 0x55861d70f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 -- 172.21.15.38:0/1573837261 >> 172.21.15.38:0/1573837261 conn(0x55861d34f460 msgr2=0x55861d7032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 -- 172.21.15.38:0/1573837261 shutdown_connections 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.086+0000 7f791e53d740 1 -- 172.21.15.38:0/1573837261 wait complete. 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 -- start start 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 Processor -- start 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d33a390 0x55861d715f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d716670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f79101abab0 con 0x55861d3321b0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79101acf20 con 0x55861d35b070 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ac180 con 0x55861d33a390 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f7915d65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f791e53d740 10 client.0 _ll_register_callbacks cb 0x7f79080099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.087+0000 7f7915d65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:56740/0 (socket says 172.21.15.38:56740) 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 -- 172.21.15.38:0/363446485 learned_addr learned my addr 172.21.15.38:0/363446485 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7916566640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d716670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915564640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d33a390 0x55861d715f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 -- 172.21.15.38:0/363446485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d33a390 msgr2=0x55861d715f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d33a390 0x55861d715f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 -- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 msgr2=0x55861d716670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d716670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 -- 172.21.15.38:0/363446485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55861d78d7a0 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f7915d65640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f790c0caed0 tx=0x7f790c0cdaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e70b4c5da3d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f78f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c049040 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f790c0c9ed0 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55861d676850 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f790c0cd770 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f791e53d740 10 client.18291 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.088+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55861d78e8d0 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55861d676850 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f790c0f10c0 con 0x55861d3321b0 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 10 client.18291 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 10 client.18291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:19.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 20 client.18291 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d2eeda0 0x55861d791040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 4 client.18291 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55861d673c80 con 0x55861d2eeda0 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f7915564640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d2eeda0 0x55861d791040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f7915564640 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d2eeda0 0x55861d791040 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a871bb6be3cb2b31 server_cookie=195a4f020a89383c in_seq=0 out_seq=0 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.089+0000 7f78f97fa640 10 client.18291 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f78f97fa640 1 -- 172.21.15.38:0/363446485 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7474 (crc 0 0 0) 0x55861d673c80 con 0x55861d2eeda0 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f78f97fa640 10 client.18291 handle_command_reply: tid=0 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 client.18291 shutdown 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 msgr2=0x55861d71aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f790c0caed0 tx=0x7f790c0cdaf0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 shutdown_connections 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55861d35b070 0x55861d716670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55861d2eeda0 0x55861d791040 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55861d33a390 0x55861d715f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f78f97fa640 0 client.18291 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 --2- 172.21.15.38:0/363446485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55861d3321b0 0x55861d71aa60 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 >> 172.21.15.38:0/363446485 conn(0x55861d34f460 msgr2=0x55861d70f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 shutdown_connections 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 1 -- 172.21.15.38:0/363446485 wait complete. 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.090+0000 7f791e53d740 20 client.18291 trim_cache size 0 max 16384 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:29:19.097 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "75a9e3b9-81b4-4dfc-92ed-38f82ef0a592": { 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:17.616723+0000", 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.098 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.099 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.100 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "a879a378-0472-405a-9891-3e8f77e97d82": { 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:07.217872+0000", 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.101 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:29:19.102 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.103 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.104 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.105 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.106 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.108 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.110 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:19.111 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 msgr2=0x7f78fc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 0x7f78fc0b8c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fd0 tx=0x7f7908009500 comp rx=0 tx=0).stop 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 msgr2=0x7f791019b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f790c005ab0 tx=0x7f790c0040c0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 shutdown_connections 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f78fc0b6700 0x7f78fc0b8c10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7910108d20 0x7f791019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79101083d0 0x7f791019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 --2- 172.21.15.38:0/635844907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7910102ae0 0x7f791019b320 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 >> 172.21.15.38:0/635844907 conn(0x7f7910079760 msgr2=0x7f7910101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 shutdown_connections 2024-09-21T06:29:19.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:19.091+0000 7f7917fc9640 1 -- 172.21.15.38:0/635844907 wait complete. 2024-09-21T06:29:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:29:19.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:29:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: pgmap v616: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 220 B/s wr, 7 op/s 2024-09-21T06:29:19.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:19 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:29:19.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:29:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:29:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: pgmap v616: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 220 B/s wr, 7 op/s 2024-09-21T06:29:19.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:19 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:29:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:29:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:29:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:19.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: pgmap v616: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 220 B/s wr, 7 op/s 2024-09-21T06:29:19.656 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:19 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:29:19.936 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:29:19.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:29:20.199 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 -- 172.21.15.38:0/3168772618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 msgr2=0x7f84a0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3168772618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0102ef0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f849c009900 tx=0x7f849c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 -- 172.21.15.38:0/3168772618 shutdown_connections 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3168772618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 0x7f84a010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3168772618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 0x7f84a01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3168772618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0102ef0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.693+0000 7f84a73f1640 1 -- 172.21.15.38:0/3168772618 >> 172.21.15.38:0/3168772618 conn(0x7f84a0079760 msgr2=0x7f84a0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.694+0000 7f84a73f1640 1 -- 172.21.15.38:0/3168772618 shutdown_connections 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.694+0000 7f84a73f1640 1 -- 172.21.15.38:0/3168772618 wait complete. 2024-09-21T06:29:20.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.694+0000 7f84a73f1640 1 Processor -- start 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 -- start start 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 0x7f84a0199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 0x7f84a019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0112bb0 con 0x7f84a0102ae0 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0112a30 con 0x7f84a01083d0 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a73f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0112d30 con 0x7f84a0108d20 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59262/0 (socket says 172.21.15.38:59262) 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 -- 172.21.15.38:0/3693399113 learned_addr learned my addr 172.21.15.38:0/3693399113 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a498c640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 0x7f84a0199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a598e640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 0x7f84a019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 -- 172.21.15.38:0/3693399113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 msgr2=0x7f84a019ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 0x7f84a019ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 -- 172.21.15.38:0/3693399113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 msgr2=0x7f84a0199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.695+0000 7f84a518d640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 0x7f84a0199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84a518d640 1 -- 172.21.15.38:0/3693399113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a019f570 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84a518d640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f849c006010 tx=0x7f849c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c03f070 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f849c003ac0 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a019f800 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c035030 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.696+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a006bb40 con 0x7f84a0102ae0 2024-09-21T06:29:20.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.697+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a0103d10 con 0x7f84a0102ae0 2024-09-21T06:29:20.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.699+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f849c042070 con 0x7f84a0102ae0 2024-09-21T06:29:20.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.700+0000 7f84967fc640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 0x7f848c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:20.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.700+0000 7f84a498c640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 0x7f848c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:20.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.700+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f849c1082f0 con 0x7f84a0102ae0 2024-09-21T06:29:20.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.700+0000 7f84a498c640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 0x7f848c0b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f84a0079d00 tx=0x7f8490009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:20.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.703+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f849c0ce830 con 0x7f84a0102ae0 2024-09-21T06:29:20.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.933+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84a006c620 con 0x7f84a0102ae0 2024-09-21T06:29:20.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.934+0000 7f84967fc640 1 -- 172.21.15.38:0/3693399113 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f849c0d2c10 con 0x7f84a0102ae0 2024-09-21T06:29:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:29:20.936 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:29:20.937 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 msgr2=0x7f848c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 0x7f848c0b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f84a0079d00 tx=0x7f8490009110 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 msgr2=0x7f84a0199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f849c006010 tx=0x7f849c004430 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 shutdown_connections 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f848c0b6680 0x7f848c0b8b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84a0108d20 0x7f84a019ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84a01083d0 0x7f84a0199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 --2- 172.21.15.38:0/3693399113 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84a0102ae0 0x7f84a0199600 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 >> 172.21.15.38:0/3693399113 conn(0x7f84a0079760 msgr2=0x7f84a01014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:20.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 shutdown_connections 2024-09-21T06:29:20.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:20.937+0000 7f84a73f1640 1 -- 172.21.15.38:0/3693399113 wait complete. 2024-09-21T06:29:21.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:21 smithi038 ceph-mon[31215]: pgmap v617: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:21.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:21 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3693399113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:21.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:21 smithi174 ceph-mon[34815]: pgmap v617: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:21.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:21 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3693399113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:21 smithi044 ceph-mon[34369]: pgmap v617: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:29:21.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:21 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3693399113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:21.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:21.943 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 -- 172.21.15.38:0/1288370047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 msgr2=0x7f429010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 --2- 172.21.15.38:0/1288370047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429010fbc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f4280009900 tx=0x7f428002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 -- 172.21.15.38:0/1288370047 shutdown_connections 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 --2- 172.21.15.38:0/1288370047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290110100 0x7f4290112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 --2- 172.21.15.38:0/1288370047 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429010fbc0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 --2- 172.21.15.38:0/1288370047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290075770 0x7f4290075b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 -- 172.21.15.38:0/1288370047 >> 172.21.15.38:0/1288370047 conn(0x7f429007b850 msgr2=0x7f429007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 -- 172.21.15.38:0/1288370047 shutdown_connections 2024-09-21T06:29:22.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.416+0000 7f4297454640 1 -- 172.21.15.38:0/1288370047 wait complete. 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 Processor -- start 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 -- start start 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290075770 0x7f429019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290110100 0x7f42901a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4290115dd0 con 0x7f42900760c0 2024-09-21T06:29:22.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4290115c50 con 0x7f4290075770 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f4297454640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4290115f50 con 0x7f4290110100 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f42949ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f42949ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59284/0 (socket says 172.21.15.38:59284) 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.417+0000 7f42949ef640 1 -- 172.21.15.38:0/4206178421 learned_addr learned my addr 172.21.15.38:0/4206178421 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42951f0640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290075770 0x7f429019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42959f1640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290110100 0x7f42901a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 -- 172.21.15.38:0/4206178421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290110100 msgr2=0x7f42901a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290110100 0x7f42901a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 -- 172.21.15.38:0/4206178421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290075770 msgr2=0x7f429019c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290075770 0x7f429019c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 -- 172.21.15.38:0/4206178421 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42901a2730 con 0x7f42900760c0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42949ef640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4280005940 tx=0x7f42800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42867fc640 1 -- 172.21.15.38:0/4206178421 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428003f030 con 0x7f42900760c0 2024-09-21T06:29:22.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42901a29c0 con 0x7f42900760c0 2024-09-21T06:29:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42867fc640 1 -- 172.21.15.38:0/4206178421 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4280031910 con 0x7f42900760c0 2024-09-21T06:29:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f42867fc640 1 -- 172.21.15.38:0/4206178421 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280035070 con 0x7f42900760c0 2024-09-21T06:29:22.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.418+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42901a9180 con 0x7f42900760c0 2024-09-21T06:29:22.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.421+0000 7f429d9c8740 1 Processor -- start 2024-09-21T06:29:22.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.421+0000 7f42867fc640 1 -- 172.21.15.38:0/4206178421 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4280042030 con 0x7f42900760c0 2024-09-21T06:29:22.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.421+0000 7f429d9c8740 1 -- start start 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.421+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.421+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce47800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f429d9c8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e7fcdbdea0 con 0x55e7fca7f390 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f429d9c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e7fcdad2d0 con 0x55e7fca771b0 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f429d9c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7fcdb10e0 con 0x55e7fcaa0070 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42949ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42959f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce47800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42949ef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59296/0 (socket says 172.21.15.38:59296) 2024-09-21T06:29:22.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42949ef640 1 -- 172.21.15.38:0/2866562825 learned_addr learned my addr 172.21.15.38:0/2866562825 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 -- 172.21.15.38:0/2866562825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 msgr2=0x55e7fce472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42867fc640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 0x7f427c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 -- 172.21.15.38:0/2866562825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 msgr2=0x55e7fce47d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 -- 172.21.15.38:0/2866562825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7fcb0b650 con 0x55e7fca771b0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42949ef640 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42959f1640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 0x7f427c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42867fc640 1 -- 172.21.15.38:0/4206178421 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4280107bd0 con 0x7f42900760c0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.422+0000 7f42951f0640 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce47800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f428c004630 tx=0x7f428c00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3e176d45f34ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.423+0000 7f427b7fe640 1 -- 172.21.15.38:0/2866562825 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c003bd0 con 0x55e7fca771b0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.423+0000 7f427b7fe640 1 -- 172.21.15.38:0/2866562825 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f428c015070 con 0x55e7fca771b0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.423+0000 7f427b7fe640 1 -- 172.21.15.38:0/2866562825 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c004dd0 con 0x55e7fca771b0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- 172.21.15.38:0/2866562825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 msgr2=0x55e7fce47800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce47800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f428c004630 tx=0x7f428c00bb20 comp rx=0 tx=0).stop 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f42959f1640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 0x7f427c0b8b90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4290076750 tx=0x7f4288009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- 172.21.15.38:0/2866562825 shutdown_connections 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca7f390 0x55e7fce47d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce47800 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2866562825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- 172.21.15.38:0/2866562825 >> 172.21.15.38:0/2866562825 conn(0x55e7fca94460 msgr2=0x55e7fce451b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- 172.21.15.38:0/2866562825 shutdown_connections 2024-09-21T06:29:22.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- 172.21.15.38:0/2866562825 wait complete. 2024-09-21T06:29:22.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 -- start start 2024-09-21T06:29:22.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.424+0000 7f429d9c8740 1 Processor -- start 2024-09-21T06:29:22.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce52ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce5ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55e7fcc0e700 con 0x55e7fca771b0 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e7fcd48160 con 0x55e7fca7f390 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e7fce55aa0 con 0x55e7fcaa0070 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f429d9c8740 10 client.0 _ll_register_callbacks cb 0x55e7fcd619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59300/0 (socket says 172.21.15.38:59300) 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 -- 172.21.15.38:0/1523883785 learned_addr learned my addr 172.21.15.38:0/1523883785 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42949ef640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce52ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42959f1640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce5ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 -- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 msgr2=0x55e7fce5ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce5ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 -- 172.21.15.38:0/1523883785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 msgr2=0x55e7fce52ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce52ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42951f0640 1 -- 172.21.15.38:0/1523883785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7fcd75c90 con 0x55e7fca771b0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.425+0000 7f42959f1640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce5ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f42951f0640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f428c00bfa0 tx=0x7f428c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68d714b05ded8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c028060 con 0x55e7fca771b0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f428c015070 con 0x55e7fca771b0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f428c011440 con 0x55e7fca771b0 2024-09-21T06:29:22.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f428c011640 con 0x55e7fca771b0 2024-09-21T06:29:22.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f429d9c8740 10 client.18309 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:22.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e7fce617e0 con 0x55e7fca771b0 2024-09-21T06:29:22.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f428c015070 con 0x55e7fca771b0 2024-09-21T06:29:22.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.426+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f428c022070 con 0x55e7fca771b0 2024-09-21T06:29:22.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 10 client.18309 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 10 client.18309 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 20 client.18309 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca5e9f0 0x55e7fce64bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 4 client.18309 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7fcdbfdf0 con 0x55e7fca5e9f0 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f42949ef640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca5e9f0 0x55e7fce64bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f4278ff9640 10 client.18309 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.427+0000 7f42949ef640 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca5e9f0 0x55e7fce64bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=805c5fe05fc5a5f5 server_cookie=bf32211a6b70f278 in_seq=0 out_seq=0 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f4278ff9640 1 -- 172.21.15.38:0/1523883785 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7fcdbfdf0 con 0x55e7fca5e9f0 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f4278ff9640 10 client.18309 handle_command_reply: tid=0 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 client.18309 shutdown 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 msgr2=0x55e7fce529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f428c00bfa0 tx=0x7f428c00bfd0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 shutdown_connections 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca5e9f0 0x55e7fce64bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce5ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce52ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f4278ff9640 0 client.18309 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1523883785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce529a0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.428+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 >> 172.21.15.38:0/1523883785 conn(0x55e7fca94460 msgr2=0x55e7fce4a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.429+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 shutdown_connections 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.429+0000 7f429d9c8740 1 -- 172.21.15.38:0/1523883785 wait complete. 2024-09-21T06:29:22.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.429+0000 7f429d9c8740 20 client.18309 trim_cache size 0 max 16384 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 Processor -- start 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 -- start start 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce4fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f42901b41d0 con 0x55e7fca771b0 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42901b1aa0 con 0x55e7fca7f390 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f429d9c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42901af910 con 0x55e7fcaa0070 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f42951f0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f42951f0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59308/0 (socket says 172.21.15.38:59308) 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.442+0000 7f42951f0640 1 -- 172.21.15.38:0/2283794077 learned_addr learned my addr 172.21.15.38:0/2283794077 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42949ef640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce4fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42959f1640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 -- 172.21.15.38:0/2283794077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 msgr2=0x55e7fce500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 -- 172.21.15.38:0/2283794077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 msgr2=0x55e7fce4fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce4fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 -- 172.21.15.38:0/2283794077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7fce45aa0 con 0x55e7fca771b0 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42949ef640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce4fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f42951f0640 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f428c02dbb0 tx=0x7f428c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e418e6fac3768 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f427affd640 1 -- 172.21.15.38:0/2283794077 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c028070 con 0x55e7fca771b0 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f427affd640 1 -- 172.21.15.38:0/2283794077 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f428c015040 con 0x55e7fca771b0 2024-09-21T06:29:22.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.443+0000 7f427affd640 1 -- 172.21.15.38:0/2283794077 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c011a60 con 0x55e7fca771b0 2024-09-21T06:29:22.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- 172.21.15.38:0/2283794077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 msgr2=0x55e7fce4aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f428c02dbb0 tx=0x7f428c00b5b0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- 172.21.15.38:0/2283794077 shutdown_connections 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fcaa0070 0x55e7fce500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca7f390 0x55e7fce4fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 --2- 172.21.15.38:0/2283794077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fca771b0 0x55e7fce4aad0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- 172.21.15.38:0/2283794077 >> 172.21.15.38:0/2283794077 conn(0x55e7fca94460 msgr2=0x55e7fce4a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- 172.21.15.38:0/2283794077 shutdown_connections 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- 172.21.15.38:0/2283794077 wait complete. 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 -- start start 2024-09-21T06:29:22.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.444+0000 7f429d9c8740 1 Processor -- start 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce65d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fca7f390 0x55e7fce66250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f42901aff60 con 0x55e7fcaa0070 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42901b13d0 con 0x55e7fca771b0 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42901b0630 con 0x55e7fca7f390 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f429d9c8740 10 client.0 _ll_register_callbacks cb 0x7f428010b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59312/0 (socket says 172.21.15.38:59312) 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 -- 172.21.15.38:0/1056979027 learned_addr learned my addr 172.21.15.38:0/1056979027 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42949ef640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fca7f390 0x55e7fce66250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42951f0640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 -- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fca7f390 msgr2=0x55e7fce66250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fca7f390 0x55e7fce66250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 -- 172.21.15.38:0/1056979027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 msgr2=0x55e7fce65d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.445+0000 7f42959f1640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce65d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f42959f1640 1 -- 172.21.15.38:0/1056979027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7fcece470 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f42959f1640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4288010970 tx=0x7f4288004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609a04ac3ceb090d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f4278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428801eb20 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f428c015040 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f428801ecc0 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4288004b20 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f429d9c8740 10 client.18315 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e7fcecf660 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.446+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f428c015040 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4288026070 con 0x55e7fcaa0070 2024-09-21T06:29:22.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 10 client.18315 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 10 client.18315 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 20 client.18315 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca33da0 0x55e7fced1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 4 client.18315 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7fcdbb8a0 con 0x55e7fca33da0 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f42951f0640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca33da0 0x55e7fced1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f42951f0640 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca33da0 0x55e7fced1ed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=960e75a8c665e351 server_cookie=2d04058c1200eff1 in_seq=0 out_seq=0 2024-09-21T06:29:22.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.447+0000 7f4278ff9640 10 client.18315 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f4278ff9640 1 -- 172.21.15.38:0/1056979027 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7fcdbb8a0 con 0x55e7fca33da0 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f4278ff9640 10 client.18315 handle_command_reply: tid=0 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 client.18315 shutdown 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 msgr2=0x55e7fce66790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f4288010970 tx=0x7f4288004a40 comp rx=0 tx=0).stop 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 shutdown_connections 2024-09-21T06:29:22.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55e7fca33da0 0x55e7fced1ed0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7fcaa0070 0x55e7fce66790 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e7fca7f390 0x55e7fce66250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 --2- 172.21.15.38:0/1056979027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7fca771b0 0x55e7fce65d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 >> 172.21.15.38:0/1056979027 conn(0x55e7fca94460 msgr2=0x55e7fce482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f4278ff9640 0 client.18315 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 shutdown_connections 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 1 -- 172.21.15.38:0/1056979027 wait complete. 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.448+0000 7f429d9c8740 20 client.18315 trim_cache size 0 max 16384 2024-09-21T06:29:22.454 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 msgr2=0x7f427c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 0x7f427c0b8b90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4290076750 tx=0x7f4288009740 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 msgr2=0x7f429019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4280005940 tx=0x7f42800042f0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 shutdown_connections 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f427c0b6680 0x7f427c0b8b90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4290110100 0x7f42901a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f42900760c0 0x7f429019cd60 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 --2- 172.21.15.38:0/4206178421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4290075770 0x7f429019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 >> 172.21.15.38:0/4206178421 conn(0x7f429007b850 msgr2=0x7f4290107c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:22.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 shutdown_connections 2024-09-21T06:29:22.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:22.449+0000 7f4297454640 1 -- 172.21.15.38:0/4206178421 wait complete. 2024-09-21T06:29:23.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:23.447 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:23 smithi174 ceph-mon[34815]: pgmap v618: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:23.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:23 smithi038 ceph-mon[31215]: pgmap v618: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:23.502 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:23.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:23 smithi044 ceph-mon[34369]: pgmap v618: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:23.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.990+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3507876362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f98102fa0 msgr2=0x7f9f981033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.990+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3507876362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f98102fa0 0x7f9f981033b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009900 tx=0x7f9f8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3507876362 shutdown_connections 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3507876362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f981038f0 0x7f9f9810f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3507876362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f98102fa0 0x7f9f981033b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3507876362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 0x7f9f98107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3507876362 >> 172.21.15.38:0/3507876362 conn(0x7f9f98079e40 msgr2=0x7f9f9807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3507876362 shutdown_connections 2024-09-21T06:29:23.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3507876362 wait complete. 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.991+0000 7f9f9e03c640 1 Processor -- start 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 -- start start 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f98102fa0 0x7f9f9819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 0x7f9f9819ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98112b60 con 0x7f9f981038f0 2024-09-21T06:29:23.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981129e0 con 0x7f9f98102fa0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f9e03c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98112ce0 con 0x7f9f98107630 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59326/0 (socket says 172.21.15.38:59326) 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 -- 172.21.15.38:0/3566255285 learned_addr learned my addr 172.21.15.38:0/3566255285 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f977fe640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f98102fa0 0x7f9f9819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f97fff640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 0x7f9f9819ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 -- 172.21.15.38:0/3566255285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 msgr2=0x7f9f9819ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 0x7f9f9819ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 -- 172.21.15.38:0/3566255285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f98102fa0 msgr2=0x7f9f9819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f98102fa0 0x7f9f9819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.992+0000 7f9f96ffd640 1 -- 172.21.15.38:0/3566255285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f981a0670 con 0x7f9f981038f0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005940 tx=0x7f9f8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f94ff9640 1 -- 172.21.15.38:0/3566255285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c03f030 con 0x7f9f981038f0 2024-09-21T06:29:23.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f94ff9640 1 -- 172.21.15.38:0/3566255285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f8c031910 con 0x7f9f981038f0 2024-09-21T06:29:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f981a0900 con 0x7f9f981038f0 2024-09-21T06:29:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f94ff9640 1 -- 172.21.15.38:0/3566255285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c035070 con 0x7f9f981038f0 2024-09-21T06:29:23.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.993+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981a70c0 con 0x7f9f981038f0 2024-09-21T06:29:23.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.995+0000 7f9fa45b0740 1 Processor -- start 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 -- start start 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f94ff9640 1 -- 172.21.15.38:0/3566255285 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9f8c042030 con 0x7f9f981038f0 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562e8d736ea0 con 0x562e8d3f01b0 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e8d7262d0 con 0x562e8d419070 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562e8d72a0e0 con 0x562e8d3f8390 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59334/0 (socket says 172.21.15.38:59334) 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 -- 172.21.15.38:0/114982791 learned_addr learned my addr 172.21.15.38:0/114982791 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f97fff640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:23.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 -- 172.21.15.38:0/114982791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 msgr2=0x562e8d7c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 -- 172.21.15.38:0/114982791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 msgr2=0x562e8d7c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f977fe640 1 -- 172.21.15.38:0/114982791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e8d484650 con 0x562e8d3f01b0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.996+0000 7f9f97fff640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f977fe640 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009a70 tx=0x7f9f88009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6905c0204d35d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f94ff9640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 0x7f9f800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f97fff640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 0x7f9f800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f94ff9640 1 -- 172.21.15.38:0/3566255285 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f8c107c50 con 0x7f9f981038f0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f7dffb640 1 -- 172.21.15.38:0/114982791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88017070 con 0x562e8d3f01b0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f7dffb640 1 -- 172.21.15.38:0/114982791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f88013470 con 0x562e8d3f01b0 2024-09-21T06:29:24.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.997+0000 7f9f7dffb640 1 -- 172.21.15.38:0/114982791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88012630 con 0x562e8d3f01b0 2024-09-21T06:29:24.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- 172.21.15.38:0/114982791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 msgr2=0x562e8d7c0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9f97fff640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 0x7f9f800b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9f90005fd0 tx=0x7f9f90009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009a70 tx=0x7f9f88009f30 comp rx=0 tx=0).stop 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- 172.21.15.38:0/114982791 shutdown_connections 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7c0800 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/114982791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- 172.21.15.38:0/114982791 >> 172.21.15.38:0/114982791 conn(0x562e8d40d460 msgr2=0x562e8d7be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- 172.21.15.38:0/114982791 shutdown_connections 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- 172.21.15.38:0/114982791 wait complete. 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.998+0000 7f9fa45b0740 1 -- start start 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 Processor -- start 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 0x562e8d7cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 0x562e8d7d7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x562e8d587700 con 0x562e8d3f01b0 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e8d6c1160 con 0x562e8d3f8390 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562e8d7ceaa0 con 0x562e8d419070 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9fa45b0740 10 client.0 _ll_register_callbacks cb 0x562e8d6da9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59346/0 (socket says 172.21.15.38:59346) 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9f977fe640 1 -- 172.21.15.38:0/2233364253 learned_addr learned my addr 172.21.15.38:0/2233364253 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:23.999+0000 7f9f97fff640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 0x562e8d7d7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 0x562e8d7cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 -- 172.21.15.38:0/2233364253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 msgr2=0x562e8d7d7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 0x562e8d7d7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 -- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 msgr2=0x562e8d7cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 0x562e8d7cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 -- 172.21.15.38:0/2233364253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e8d6eec90 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 0x562e8d7cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f97fff640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 0x562e8d7d7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000c00 tx=0x7f9f88006e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcf35d2d27355d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88029060 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f88013a70 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f88013470 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f88017040 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9fa45b0740 10 client.18327 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.000+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562e8d7da720 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f88013470 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9f8801c4e0 con 0x562e8d3f01b0 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 10 client.18327 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:24.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 10 client.18327 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 20 client.18327 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3d79f0 0x562e8d7dda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 4 client.18327 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e8d738df0 con 0x562e8d3d79f0 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.001+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3d79f0 0x562e8d7dda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.002+0000 7f9f76ffd640 10 client.18327 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:24.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.002+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3d79f0 0x562e8d7dda80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e779466278167f8b server_cookie=e2e60d12cf33f9b9 in_seq=0 out_seq=0 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.002+0000 7f9f76ffd640 1 -- 172.21.15.38:0/2233364253 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e8d738df0 con 0x562e8d3d79f0 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.002+0000 7f9f76ffd640 10 client.18327 handle_command_reply: tid=0 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 client.18327 shutdown 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 msgr2=0x562e8d7cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000c00 tx=0x7f9f88006e60 comp rx=0 tx=0).stop 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 shutdown_connections 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3d79f0 0x562e8d7dda80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d419070 0x562e8d7d7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f8390 0x562e8d7cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9f76ffd640 0 client.18327 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2233364253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cb980 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 >> 172.21.15.38:0/2233364253 conn(0x562e8d40d460 msgr2=0x562e8d7c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 shutdown_connections 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2233364253 wait complete. 2024-09-21T06:29:24.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.003+0000 7f9fa45b0740 20 client.18327 trim_cache size 0 max 16384 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 Processor -- start 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 -- start start 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981b2070 con 0x562e8d3f01b0 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981af940 con 0x562e8d419070 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ad7b0 con 0x562e8d3f8390 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.016+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59352/0 (socket says 172.21.15.38:59352) 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 -- 172.21.15.38:0/2981695569 learned_addr learned my addr 172.21.15.38:0/2981695569 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f97fff640 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 -- 172.21.15.38:0/2981695569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 msgr2=0x562e8d7d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 -- 172.21.15.38:0/2981695569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 msgr2=0x562e8d7c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 -- 172.21.15.38:0/2981695569 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e8d7c25b0 con 0x562e8d3f01b0 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f977fe640 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9f88013ea0 tx=0x7f9f880098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de4887515e4f960 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f7d7fa640 1 -- 172.21.15.38:0/2981695569 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88029040 con 0x562e8d3f01b0 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f7d7fa640 1 -- 172.21.15.38:0/2981695569 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f88013470 con 0x562e8d3f01b0 2024-09-21T06:29:24.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.017+0000 7f9f7d7fa640 1 -- 172.21.15.38:0/2981695569 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88025940 con 0x562e8d3f01b0 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2981695569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 msgr2=0x562e8d7cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9f88013ea0 tx=0x7f9f880098f0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2981695569 shutdown_connections 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d419070 0x562e8d7c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/2981695569 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d3f01b0 0x562e8d7cbe40 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2981695569 >> 172.21.15.38:0/2981695569 conn(0x562e8d40d460 msgr2=0x562e8d7cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2981695569 shutdown_connections 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- 172.21.15.38:0/2981695569 wait complete. 2024-09-21T06:29:24.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.018+0000 7f9fa45b0740 1 -- start start 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 Processor -- start 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f01b0 0x562e8d7cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ade00 con 0x562e8d419070 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981af270 con 0x562e8d3f01b0 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f981ae4d0 con 0x562e8d3f8390 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9fa45b0740 10 client.0 _ll_register_callbacks cb 0x7f9f900095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59368/0 (socket says 172.21.15.38:59368) 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9f97fff640 1 -- 172.21.15.38:0/1171870469 learned_addr learned my addr 172.21.15.38:0/1171870469 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9f977fe640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f01b0 0x562e8d7cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.019+0000 7f9f96ffd640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 -- 172.21.15.38:0/1171870469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 msgr2=0x562e8d7d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 -- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f01b0 msgr2=0x562e8d7cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f01b0 0x562e8d7cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 -- 172.21.15.38:0/1171870469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e8d84b6c0 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f97fff640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9f90010ab0 tx=0x7f9f90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64264b1e0b83bfa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9001f770 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f9001f910 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f88013470 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f9001fb10 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9fa45b0740 10 client.18333 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.020+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562e8d84c8b0 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f88013470 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9f90027070 con 0x562e8d419070 2024-09-21T06:29:24.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 10 client.18333 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 10 client.18333 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 20 client.18333 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3acda0 0x562e8d84f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 4 client.18333 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e8d7348a0 con 0x562e8d3acda0 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9f977fe640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3acda0 0x562e8d84f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9f977fe640 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3acda0 0x562e8d84f120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=901c65643019da45 server_cookie=2d675a76832b7ba0 in_seq=0 out_seq=0 2024-09-21T06:29:24.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.021+0000 7f9f76ffd640 10 client.18333 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9f76ffd640 1 -- 172.21.15.38:0/1171870469 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e8d7348a0 con 0x562e8d3acda0 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9f76ffd640 10 client.18333 handle_command_reply: tid=0 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 client.18333 shutdown 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 msgr2=0x562e8d7d06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9f90010ab0 tx=0x7f9f90004a40 comp rx=0 tx=0).stop 2024-09-21T06:29:24.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 shutdown_connections 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x562e8d3acda0 0x562e8d84f120 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x562e8d419070 0x562e8d7d06c0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e8d3f8390 0x562e8d7d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 --2- 172.21.15.38:0/1171870469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e8d3f01b0 0x562e8d7cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9f76ffd640 0 client.18333 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 >> 172.21.15.38:0/1171870469 conn(0x562e8d40d460 msgr2=0x562e8d7ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 shutdown_connections 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 1 -- 172.21.15.38:0/1171870469 wait complete. 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.022+0000 7f9fa45b0740 20 client.18333 trim_cache size 0 max 16384 2024-09-21T06:29:24.028 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 msgr2=0x7f9f800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 0x7f9f800b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9f90005fd0 tx=0x7f9f90009740 comp rx=0 tx=0).stop 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 msgr2=0x7f9f9819aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c005940 tx=0x7f9f8c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 shutdown_connections 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f800b6680 0x7f9f800b8b90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f98107630 0x7f9f9819ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f981038f0 0x7f9f9819aca0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 --2- 172.21.15.38:0/3566255285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f98102fa0 0x7f9f9819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 >> 172.21.15.38:0/3566255285 conn(0x7f9f98079e40 msgr2=0x7f9f98101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 shutdown_connections 2024-09-21T06:29:24.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:24.023+0000 7f9f9e03c640 1 -- 172.21.15.38:0/3566255285 wait complete. 2024-09-21T06:29:24.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:25.084 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:25.483 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:25 smithi038 ceph-mon[31215]: pgmap v619: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 -- 172.21.15.38:0/4055050948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c105300 msgr2=0x7fba5c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 --2- 172.21.15.38:0/4055050948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c105300 0x7fba5c10d850 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fba44009900 tx=0x7fba4402a410 comp rx=0 tx=0).stop 2024-09-21T06:29:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 -- 172.21.15.38:0/4055050948 shutdown_connections 2024-09-21T06:29:25.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 --2- 172.21.15.38:0/4055050948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 0x7fba5c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 --2- 172.21.15.38:0/4055050948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c105300 0x7fba5c10d850 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 --2- 172.21.15.38:0/4055050948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c1049b0 0x7fba5c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 -- 172.21.15.38:0/4055050948 >> 172.21.15.38:0/4055050948 conn(0x7fba5c079730 msgr2=0x7fba5c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.575+0000 7fba6284e640 1 -- 172.21.15.38:0/4055050948 shutdown_connections 2024-09-21T06:29:25.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.576+0000 7fba6284e640 1 -- 172.21.15.38:0/4055050948 wait complete. 2024-09-21T06:29:25.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.576+0000 7fba6284e640 1 Processor -- start 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.576+0000 7fba6284e640 1 -- start start 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.576+0000 7fba6284e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba6284e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c105300 0x7fba5c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba6284e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 0x7fba5c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba6284e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c113b90 con 0x7fba5c1049b0 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba6284e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c113a10 con 0x7fba5c10de10 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba6284e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c113d10 con 0x7fba5c105300 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59386/0 (socket says 172.21.15.38:59386) 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 -- 172.21.15.38:0/3370699541 learned_addr learned my addr 172.21.15.38:0/3370699541 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba53fff640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c105300 0x7fba5c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba60deb640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 0x7fba5c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 -- 172.21.15.38:0/3370699541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c105300 msgr2=0x7fba5c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c105300 0x7fba5c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 -- 172.21.15.38:0/3370699541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 msgr2=0x7fba5c103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 0x7fba5c103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 -- 172.21.15.38:0/3370699541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c1a8800 con 0x7fba5c1049b0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba5bfff640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00d770 tx=0x7fba4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba59ffb640 1 -- 172.21.15.38:0/3370699541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c017070 con 0x7fba5c1049b0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.577+0000 7fba59ffb640 1 -- 172.21.15.38:0/3370699541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba4c009c30 con 0x7fba5c1049b0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.578+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1a8af0 con 0x7fba5c1049b0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.578+0000 7fba59ffb640 1 -- 172.21.15.38:0/3370699541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c003d70 con 0x7fba5c1049b0 2024-09-21T06:29:25.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.578+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1a9050 con 0x7fba5c1049b0 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.580+0000 7fba68dc2740 1 Processor -- start 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.580+0000 7fba68dc2740 1 -- start start 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba59ffb640 1 -- 172.21.15.38:0/3370699541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fba4c003f10 con 0x7fba5c1049b0 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defbe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defbebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d4def34ea0 con 0x55d4debf6390 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d4def242d0 con 0x55d4dec17070 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba68dc2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d4def280e0 con 0x55d4debee1b0 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59394/0 (socket says 172.21.15.38:59394) 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 -- 172.21.15.38:0/131074176 learned_addr learned my addr 172.21.15.38:0/131074176 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba5bfff640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defbebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba60deb640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defbe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 -- 172.21.15.38:0/131074176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 msgr2=0x55d4defbebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defbebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 -- 172.21.15.38:0/131074176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 msgr2=0x55d4defbe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defbe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba53fff640 1 -- 172.21.15.38:0/131074176 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4dec82650 con 0x55d4debf6390 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba5bfff640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defbebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.581+0000 7fba60deb640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:25.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba53fff640 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fba440314b0 tx=0x7fba44031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2e90e42d9d4dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba527fc640 1 -- 172.21.15.38:0/131074176 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44040070 con 0x55d4debf6390 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba527fc640 1 -- 172.21.15.38:0/131074176 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba44031710 con 0x55d4debf6390 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba527fc640 1 -- 172.21.15.38:0/131074176 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44035040 con 0x55d4debf6390 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba59ffb640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 0x7fba480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba60deb640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 0x7fba480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.582+0000 7fba59ffb640 1 -- 172.21.15.38:0/3370699541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fba4c0e7000 con 0x7fba5c1049b0 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- 172.21.15.38:0/131074176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 msgr2=0x55d4defbf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba60deb640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 0x7fba480b8c10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fba54005fd0 tx=0x7fba54009580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fba440314b0 tx=0x7fba44031bc0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- 172.21.15.38:0/131074176 shutdown_connections 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defbf120 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defbebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 --2- 172.21.15.38:0/131074176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- 172.21.15.38:0/131074176 >> 172.21.15.38:0/131074176 conn(0x55d4dec0b460 msgr2=0x55d4defbc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- 172.21.15.38:0/131074176 shutdown_connections 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- 172.21.15.38:0/131074176 wait complete. 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.583+0000 7fba68dc2740 1 -- start start 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 Processor -- start 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defc9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debf6390 0x55d4defca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55d4ded85700 con 0x55d4dec17070 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d4deebf160 con 0x55d4debf6390 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d4defcce20 con 0x55d4debee1b0 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba68dc2740 10 client.0 _ll_register_callbacks cb 0x55d4deed89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59406/0 (socket says 172.21.15.38:59406) 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 -- 172.21.15.38:0/1963284950 learned_addr learned my addr 172.21.15.38:0/1963284950 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:25.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba5bfff640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defc9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba53fff640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debf6390 0x55d4defca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 -- 172.21.15.38:0/1963284950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 msgr2=0x55d4defc9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defc9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 -- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debf6390 msgr2=0x55d4defca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debf6390 0x55d4defca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.584+0000 7fba60deb640 1 -- 172.21.15.38:0/1963284950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4deeecc90 con 0x55d4dec17070 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba60deb640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba54012930 tx=0x7fba54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62938f4700fa6ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5400ec60 con 0x55d4dec17070 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fba5400ee00 con 0x55d4dec17070 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44031710 con 0x55d4dec17070 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fba5401f420 con 0x55d4dec17070 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba68dc2740 10 client.18345 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:25.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d4defd8a90 con 0x55d4dec17070 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.585+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba44031710 con 0x55d4dec17070 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fba5400f040 con 0x55d4dec17070 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 10 client.18345 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 20 client.18345 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debd59f0 0x55d4defdbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 4 client.18345 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4def36df0 con 0x55d4debd59f0 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba5bfff640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debd59f0 0x55d4defdbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba5bfff640 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debd59f0 0x55d4defdbf00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e174a6595cdb5a1f server_cookie=289443b89983a9c1 in_seq=0 out_seq=0 2024-09-21T06:29:25.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.586+0000 7fba3b7fe640 10 client.18345 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba3b7fe640 1 -- 172.21.15.38:0/1963284950 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4def36df0 con 0x55d4debd59f0 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba3b7fe640 10 client.18345 handle_command_reply: tid=0 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 client.18345 shutdown 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 msgr2=0x55d4defca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fba54012930 tx=0x7fba54004a40 comp rx=0 tx=0).stop 2024-09-21T06:29:25.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 shutdown_connections 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4dec17070 0x55d4defca6e0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debf6390 0x55d4defca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debd59f0 0x55d4defdbf00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1963284950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defc9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 >> 172.21.15.38:0/1963284950 conn(0x55d4dec0b460 msgr2=0x55d4defc1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba3b7fe640 0 client.18345 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.587+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 shutdown_connections 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.588+0000 7fba68dc2740 1 -- 172.21.15.38:0/1963284950 wait complete. 2024-09-21T06:29:25.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.588+0000 7fba68dc2740 20 client.18345 trim_cache size 0 max 16384 2024-09-21T06:29:25.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 Processor -- start 2024-09-21T06:29:25.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 -- start start 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defd6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defc6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1b41e0 con 0x55d4debf6390 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1b1ab0 con 0x55d4dec17070 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba68dc2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1af920 con 0x55d4debee1b0 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59414/0 (socket says 172.21.15.38:59414) 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba53fff640 1 -- 172.21.15.38:0/1346333072 learned_addr learned my addr 172.21.15.38:0/1346333072 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:25.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba5bfff640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defd6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba60deb640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defc6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.601+0000 7fba53fff640 1 -- 172.21.15.38:0/1346333072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 msgr2=0x55d4defd6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba53fff640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defd6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba53fff640 1 -- 172.21.15.38:0/1346333072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 msgr2=0x55d4defc6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba53fff640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defc6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba53fff640 1 -- 172.21.15.38:0/1346333072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4defcc3a0 con 0x55d4debf6390 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba60deb640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defc6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba5bfff640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defd6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba53fff640 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fba44009900 tx=0x7fba4402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06c5cd8f2d9aa7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba51ffb640 1 -- 172.21.15.38:0/1346333072 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44040070 con 0x55d4debf6390 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba51ffb640 1 -- 172.21.15.38:0/1346333072 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba44031790 con 0x55d4debf6390 2024-09-21T06:29:25.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.602+0000 7fba51ffb640 1 -- 172.21.15.38:0/1346333072 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44035040 con 0x55d4debf6390 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- 172.21.15.38:0/1346333072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 msgr2=0x55d4defcb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fba44009900 tx=0x7fba4402a410 comp rx=0 tx=0).stop 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- 172.21.15.38:0/1346333072 shutdown_connections 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4dec17070 0x55d4defc6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcb890 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 --2- 172.21.15.38:0/1346333072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4debee1b0 0x55d4defd6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- 172.21.15.38:0/1346333072 >> 172.21.15.38:0/1346333072 conn(0x55d4dec0b460 msgr2=0x55d4defcb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- 172.21.15.38:0/1346333072 shutdown_connections 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- 172.21.15.38:0/1346333072 wait complete. 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 -- start start 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.603+0000 7fba68dc2740 1 Processor -- start 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debee1b0 0x55d4defd2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4dec17070 0x55d4defce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1aff70 con 0x55d4debf6390 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1b13e0 con 0x55d4debee1b0 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1b0640 con 0x55d4dec17070 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba68dc2740 10 client.0 _ll_register_callbacks cb 0x7fba54009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59418/0 (socket says 172.21.15.38:59418) 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 -- 172.21.15.38:0/2978221424 learned_addr learned my addr 172.21.15.38:0/2978221424 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba60deb640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4dec17070 0x55d4defce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba5bfff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debee1b0 0x55d4defd2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 -- 172.21.15.38:0/2978221424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4dec17070 msgr2=0x55d4defce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4dec17070 0x55d4defce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 -- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debee1b0 msgr2=0x55d4defd2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debee1b0 0x55d4defd2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.604+0000 7fba53fff640 1 -- 172.21.15.38:0/2978221424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4defce630 con 0x55d4debf6390 2024-09-21T06:29:25.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba53fff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fba44004280 tx=0x7fba440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3999b22c4cd2aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:25.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:25.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44040070 con 0x55d4debf6390 2024-09-21T06:29:25.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fba44031590 con 0x55d4debf6390 2024-09-21T06:29:25.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44031790 con 0x55d4debf6390 2024-09-21T06:29:25.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fba44035040 con 0x55d4debf6390 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 10 client.18351 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d4df0465c0 con 0x55d4debf6390 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba44031790 con 0x55d4debf6390 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fba4403c930 con 0x55d4debf6390 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 10 client.18351 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 10 client.18351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 20 client.18351 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debaada0 0x55d4df0488a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 4 client.18351 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.605+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4def328a0 con 0x55d4debaada0 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba5bfff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debaada0 0x55d4df0488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba5bfff640 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debaada0 0x55d4df0488a0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26630a0ac6c4f135 server_cookie=1b71f7ccc0bfe610 in_seq=0 out_seq=0 2024-09-21T06:29:25.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba3b7fe640 10 client.18351 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba3b7fe640 1 -- 172.21.15.38:0/2978221424 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4def328a0 con 0x55d4debaada0 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba3b7fe640 10 client.18351 handle_command_reply: tid=0 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.606+0000 7fba68dc2740 1 client.18351 shutdown 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 msgr2=0x55d4defcdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fba44004280 tx=0x7fba440046c0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 shutdown_connections 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55d4debaada0 0x55d4df0488a0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d4dec17070 0x55d4defce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d4debf6390 0x55d4defcdb30 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 --2- 172.21.15.38:0/2978221424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d4debee1b0 0x55d4defd2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba3b7fe640 0 client.18351 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 >> 172.21.15.38:0/2978221424 conn(0x55d4dec0b460 msgr2=0x55d4defcb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 shutdown_connections 2024-09-21T06:29:25.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 1 -- 172.21.15.38:0/2978221424 wait complete. 2024-09-21T06:29:25.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba68dc2740 20 client.18351 trim_cache size 0 max 16384 2024-09-21T06:29:25.616 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:25.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 msgr2=0x7fba480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 0x7fba480b8c10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fba54005fd0 tx=0x7fba54009580 comp rx=0 tx=0).stop 2024-09-21T06:29:25.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 msgr2=0x7fba5c1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.607+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00d770 tx=0x7fba4c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 shutdown_connections 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fba480b6700 0x7fba480b8c10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c10de10 0x7fba5c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fba5c105300 0x7fba5c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 --2- 172.21.15.38:0/3370699541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fba5c1049b0 0x7fba5c1026f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 >> 172.21.15.38:0/3370699541 conn(0x7fba5c079730 msgr2=0x7fba5c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 shutdown_connections 2024-09-21T06:29:25.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:25.608+0000 7fba6284e640 1 -- 172.21.15.38:0/3370699541 wait complete. 2024-09-21T06:29:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:25 smithi174 ceph-mon[34815]: pgmap v619: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:25.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:25 smithi044 ceph-mon[34369]: pgmap v619: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:27.313 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:27.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:27.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:27 smithi038 ceph-mon[31215]: pgmap v620: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:27.584 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:27.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:27 smithi174 ceph-mon[34815]: pgmap v620: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:27.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:27 smithi044 ceph-mon[34369]: pgmap v620: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:29:28.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 -- 172.21.15.38:0/2875922196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8109e00 msgr2=0x7f0ed8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2875922196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8109e00 0x7f0ed8110630 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009ca0 tx=0x7f0ed002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 -- 172.21.15.38:0/2875922196 shutdown_connections 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2875922196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8109e00 0x7f0ed8110630 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2875922196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 0x7f0ed81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2875922196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 -- 172.21.15.38:0/2875922196 >> 172.21.15.38:0/2875922196 conn(0x7f0ed807b910 msgr2=0x7f0ed807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 -- 172.21.15.38:0/2875922196 shutdown_connections 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.010+0000 7f0edfaed640 1 -- 172.21.15.38:0/2875922196 wait complete. 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 Processor -- start 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 -- start start 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 0x7f0ed8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8109e00 0x7f0ed8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8113be0 con 0x7f0ed8103bc0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8113a60 con 0x7f0ed8109e00 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.011+0000 7f0edfaed640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8113d60 con 0x7f0ed81094b0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59430/0 (socket says 172.21.15.38:59430) 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 -- 172.21.15.38:0/2683520338 learned_addr learned my addr 172.21.15.38:0/2683520338 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd088640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 0x7f0ed8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0ede08a640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8109e00 0x7f0ed8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 -- 172.21.15.38:0/2683520338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 msgr2=0x7f0ed8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 0x7f0ed8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 -- 172.21.15.38:0/2683520338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8109e00 msgr2=0x7f0ed8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8109e00 0x7f0ed8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 -- 172.21.15.38:0/2683520338 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81a8830 con 0x7f0ed8103bc0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edd889640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400e9f0 tx=0x7f0ed400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0eceffd640 1 -- 172.21.15.38:0/2683520338 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400cd80 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed81a8b20 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0eceffd640 1 -- 172.21.15.38:0/2683520338 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ed4010900 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0eceffd640 1 -- 172.21.15.38:0/2683520338 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40188d0 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.012+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed81a90b0 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.015+0000 7f0eceffd640 1 -- 172.21.15.38:0/2683520338 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0ed4010ab0 con 0x7f0ed8103bc0 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.015+0000 7f0ee6061740 1 Processor -- start 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.015+0000 7f0ee6061740 1 -- start start 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf4618970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4618eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55fcf458ee60 con 0x55fcf4271350 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcf457e290 con 0x55fcf4250670 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ee6061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fcf45820a0 con 0x55fcf4248490 2024-09-21T06:29:28.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59442/0 (socket says 172.21.15.38:59442) 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 -- 172.21.15.38:0/876239116 learned_addr learned my addr 172.21.15.38:0/876239116 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0edd088640 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4618eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0edd889640 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf4618970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0eceffd640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 0x7f0ec40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 -- 172.21.15.38:0/876239116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 msgr2=0x55fcf4618970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf4618970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 -- 172.21.15.38:0/876239116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 msgr2=0x55fcf4618eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4618eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.016+0000 7f0ede08a640 1 -- 172.21.15.38:0/876239116 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf42dc930 con 0x55fcf4271350 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0eceffd640 1 -- 172.21.15.38:0/2683520338 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ed40e7a40 con 0x7f0ed8103bc0 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0ede08a640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 0x7f0ec40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0ede08a640 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002f4c0 tx=0x7f0ed0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed01dade758ff8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0ec3fff640 1 -- 172.21.15.38:0/876239116 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0003970 con 0x55fcf4271350 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0ec3fff640 1 -- 172.21.15.38:0/876239116 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ed0036030 con 0x55fcf4271350 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.017+0000 7f0ec3fff640 1 -- 172.21.15.38:0/876239116 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002f660 con 0x55fcf4271350 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 -- 172.21.15.38:0/876239116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 msgr2=0x55fcf4618430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ede08a640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 0x7f0ec40b8b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ed004a000 tx=0x7f0ed004b000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002f4c0 tx=0x7f0ed0009800 comp rx=0 tx=0).stop 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 -- 172.21.15.38:0/876239116 shutdown_connections 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4618eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf4618970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 --2- 172.21.15.38:0/876239116 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4618430 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 -- 172.21.15.38:0/876239116 >> 172.21.15.38:0/876239116 conn(0x55fcf4265740 msgr2=0x55fcf4616320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 -- 172.21.15.38:0/876239116 shutdown_connections 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.018+0000 7f0ee6061740 1 -- 172.21.15.38:0/876239116 wait complete. 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 -- start start 2024-09-21T06:29:28.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 Processor -- start 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf46240d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4271350 0x55fcf462fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55fcf43df890 con 0x55fcf4250670 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcf4518d40 con 0x55fcf4248490 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fcf4626a90 con 0x55fcf4271350 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0ee6061740 10 client.0 _ll_register_callbacks cb 0x55fcf457cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.019+0000 7f0edd088640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59446/0 (socket says 172.21.15.38:59446) 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 -- 172.21.15.38:0/3741350107 learned_addr learned my addr 172.21.15.38:0/3741350107 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0ede08a640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4271350 0x55fcf462fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd889640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf46240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 -- 172.21.15.38:0/3741350107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4271350 msgr2=0x55fcf462fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4271350 0x55fcf462fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 -- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 msgr2=0x55fcf46240d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf46240d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 -- 172.21.15.38:0/3741350107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf46303a0 con 0x55fcf4250670 2024-09-21T06:29:28.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd889640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf46240d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0edd088640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800bed0 tx=0x7f0ec8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c100d22535edf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0ec17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004020 con 0x55fcf4250670 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ec80041c0 con 0x55fcf4250670 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.020+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ed0036030 con 0x55fcf4250670 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ec80043c0 con 0x55fcf4250670 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 10 client.18363 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fcf4632cb0 con 0x55fcf4250670 2024-09-21T06:29:28.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ed0036030 con 0x55fcf4250670 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0ec8003970 con 0x55fcf4250670 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 10 client.18363 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 10 client.18363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 20 client.18363 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf422fcd0 0x55fcf4636260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 4 client.18363 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcf4590db0 con 0x55fcf422fcd0 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.021+0000 7f0edd889640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf422fcd0 0x55fcf4636260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.022+0000 7f0ec17fa640 10 client.18363 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.022+0000 7f0edd889640 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf422fcd0 0x55fcf4636260 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac2705abbb67c30 server_cookie=debc7b04d5729368 in_seq=0 out_seq=0 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3741350107 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcf4590db0 con 0x55fcf422fcd0 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ec17fa640 10 client.18363 handle_command_reply: tid=0 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 client.18363 shutdown 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 msgr2=0x55fcf4624610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800bed0 tx=0x7f0ec8011810 comp rx=0 tx=0).stop 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 shutdown_connections 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf422fcd0 0x55fcf4636260 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4271350 0x55fcf462fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4250670 0x55fcf4624610 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3741350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf46240d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ec17fa640 0 client.18363 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 >> 172.21.15.38:0/3741350107 conn(0x55fcf4265740 msgr2=0x55fcf461b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 shutdown_connections 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 1 -- 172.21.15.38:0/3741350107 wait complete. 2024-09-21T06:29:28.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.023+0000 7f0ee6061740 20 client.18363 trim_cache size 0 max 16384 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 Processor -- start 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 -- start start 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf4623760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 0x55fcf4625b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81b4220 con 0x55fcf4271350 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81b1af0 con 0x55fcf4248490 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ee6061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81af960 con 0x55fcf4250670 2024-09-21T06:29:28.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.041+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59458/0 (socket says 172.21.15.38:59458) 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 -- 172.21.15.38:0/46677178 learned_addr learned my addr 172.21.15.38:0/46677178 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0edd889640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf4623760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0edd088640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 0x55fcf4625b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 -- 172.21.15.38:0/46677178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 msgr2=0x55fcf4625b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 0x55fcf4625b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 -- 172.21.15.38:0/46677178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 msgr2=0x55fcf4623760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf4623760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 -- 172.21.15.38:0/46677178 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf461b290 con 0x55fcf4271350 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0edd088640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 0x55fcf4625b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ede08a640 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002ade0 tx=0x7f0ed0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67cac906c5a8b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ec37fe640 1 -- 172.21.15.38:0/46677178 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0003970 con 0x55fcf4271350 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ec37fe640 1 -- 172.21.15.38:0/46677178 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ed005f070 con 0x55fcf4271350 2024-09-21T06:29:28.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.042+0000 7f0ec37fe640 1 -- 172.21.15.38:0/46677178 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002fd90 con 0x55fcf4271350 2024-09-21T06:29:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 -- 172.21.15.38:0/46677178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 msgr2=0x55fcf461d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0ed002ade0 tx=0x7f0ed0051000 comp rx=0 tx=0).stop 2024-09-21T06:29:28.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 -- 172.21.15.38:0/46677178 shutdown_connections 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf461d510 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4250670 0x55fcf4625b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 --2- 172.21.15.38:0/46677178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4248490 0x55fcf4623760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 -- 172.21.15.38:0/46677178 >> 172.21.15.38:0/46677178 conn(0x55fcf4265740 msgr2=0x55fcf46253f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 -- 172.21.15.38:0/46677178 shutdown_connections 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.043+0000 7f0ee6061740 1 -- 172.21.15.38:0/46677178 wait complete. 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 -- start start 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 Processor -- start 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf462c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4626cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81affb0 con 0x55fcf4271350 2024-09-21T06:29:28.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81b1420 con 0x55fcf4250670 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81b0680 con 0x55fcf4248490 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ee6061740 10 client.0 _ll_register_callbacks cb 0x7f0ec800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ede08a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59470/0 (socket says 172.21.15.38:59470) 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.044+0000 7f0ede08a640 1 -- 172.21.15.38:0/3224626467 learned_addr learned my addr 172.21.15.38:0/3224626467 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0edd088640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4626cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0edd889640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf462c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 -- 172.21.15.38:0/3224626467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 msgr2=0x55fcf462c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf462c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 -- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 msgr2=0x55fcf4626cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4626cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 -- 172.21.15.38:0/3224626467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf4615a70 con 0x55fcf4271350 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ede08a640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0ed005c040 tx=0x7f0ed0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a09fd71c398199 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:28.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ec17fa640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0009360 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ed002f870 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ed005f070 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ed002fa70 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ee6061740 10 client.18369 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.045+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fcf46a1aa0 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ed005f070 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0ed006d470 con 0x55fcf4271350 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 10 client.18369 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 10 client.18369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 20 client.18369 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf4205080 0x55fcf46a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 4 client.18369 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:28.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fcf458c860 con 0x55fcf4205080 2024-09-21T06:29:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0edd889640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf4205080 0x55fcf46a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0ec17fa640 10 client.18369 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:28.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.046+0000 7f0edd889640 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf4205080 0x55fcf46a3e70 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbfca9b1e1e318f server_cookie=33f45ecd11280d8 in_seq=0 out_seq=0 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.048+0000 7f0ec17fa640 1 -- 172.21.15.38:0/3224626467 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fcf458c860 con 0x55fcf4205080 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.048+0000 7f0ec17fa640 10 client.18369 handle_command_reply: tid=0 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.048+0000 7f0ee6061740 1 client.18369 shutdown 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.048+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 msgr2=0x55fcf4627370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.048+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0ed005c040 tx=0x7f0ed0009880 comp rx=0 tx=0).stop 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 shutdown_connections 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55fcf4271350 0x55fcf4627370 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcf4250670 0x55fcf4626cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55fcf4205080 0x55fcf46a3e70 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 --2- 172.21.15.38:0/3224626467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fcf4248490 0x55fcf462c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ec17fa640 0 client.18369 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 >> 172.21.15.38:0/3224626467 conn(0x55fcf4265740 msgr2=0x55fcf4625360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 shutdown_connections 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 1 -- 172.21.15.38:0/3224626467 wait complete. 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0ee6061740 20 client.18369 trim_cache size 0 max 16384 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "871e6bd0-0aff-496e-a3c0-df537c4e6cb9", 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:29:28.054 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 msgr2=0x7f0ec40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 0x7f0ec40b8b90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ed004a000 tx=0x7f0ed004b000 comp rx=0 tx=0).stop 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 msgr2=0x7f0ed8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400e9f0 tx=0x7f0ed400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 shutdown_connections 2024-09-21T06:29:28.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f0ec40b6680 0x7f0ec40b8b90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8109e00 0x7f0ed8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ed81094b0 0x7f0ed8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 --2- 172.21.15.38:0/2683520338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ed8103bc0 0x7f0ed8075710 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.049+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 >> 172.21.15.38:0/2683520338 conn(0x7f0ed807b910 msgr2=0x7f0ed8105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.050+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 shutdown_connections 2024-09-21T06:29:28.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:28.050+0000 7f0edfaed640 1 -- 172.21.15.38:0/2683520338 wait complete. 2024-09-21T06:29:28.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:29.165 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:29.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: pgmap v621: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:29:29.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:29:29.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.457 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:29:29.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.458 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:29 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:29:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: pgmap v621: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:29:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:29:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:29:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:29 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:29:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: pgmap v621: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-09-21T06:29:29.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:29:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:29:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:29.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:29 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.643+0000 7f51304e6640 1 -- 172.21.15.38:0/2278198195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128108cf0 msgr2=0x7f512810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.643+0000 7f51304e6640 1 --2- 172.21.15.38:0/2278198195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128108cf0 0x7f512810f520 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5120009ca0 tx=0x7f512002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 -- 172.21.15.38:0/2278198195 shutdown_connections 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 --2- 172.21.15.38:0/2278198195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128108cf0 0x7f512810f520 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 --2- 172.21.15.38:0/2278198195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51281083a0 0x7f51281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 --2- 172.21.15.38:0/2278198195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5128102a60 0x7f5128102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 -- 172.21.15.38:0/2278198195 >> 172.21.15.38:0/2278198195 conn(0x7f5128079730 msgr2=0x7f5128079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 -- 172.21.15.38:0/2278198195 shutdown_connections 2024-09-21T06:29:29.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 -- 172.21.15.38:0/2278198195 wait complete. 2024-09-21T06:29:29.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 Processor -- start 2024-09-21T06:29:29.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.644+0000 7f51304e6640 1 -- start start 2024-09-21T06:29:29.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51281083a0 0x7f512819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 0x7f512819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5128112a80 con 0x7f5128102a60 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5128112900 con 0x7f51281083a0 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f51304e6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5128112c00 con 0x7f5128108cf0 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48606/0 (socket says 172.21.15.38:48606) 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 -- 172.21.15.38:0/1863760014 learned_addr learned my addr 172.21.15.38:0/1863760014 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512da81640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51281083a0 0x7f512819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512ea83640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 0x7f512819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 -- 172.21.15.38:0/1863760014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 msgr2=0x7f512819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 0x7f512819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 -- 172.21.15.38:0/1863760014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51281083a0 msgr2=0x7f512819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51281083a0 0x7f512819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512e282640 1 -- 172.21.15.38:0/1863760014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51281a6600 con 0x7f5128102a60 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.645+0000 7f512ea83640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 0x7f512819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f512e282640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f512400d950 tx=0x7f512400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f511f7fe640 1 -- 172.21.15.38:0/1863760014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124017070 con 0x7f5128102a60 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f511f7fe640 1 -- 172.21.15.38:0/1863760014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5124009c30 con 0x7f5128102a60 2024-09-21T06:29:29.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51281a68f0 con 0x7f5128102a60 2024-09-21T06:29:29.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f511f7fe640 1 -- 172.21.15.38:0/1863760014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512400f6b0 con 0x7f5128102a60 2024-09-21T06:29:29.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.646+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51281a6e80 con 0x7f5128102a60 2024-09-21T06:29:29.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.648+0000 7f511f7fe640 1 -- 172.21.15.38:0/1863760014 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f51240109c0 con 0x7f5128102a60 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 Processor -- start 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 -- start start 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb39070 0x555b5bee0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5bee10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555b5be56e50 con 0x555b5bb101b0 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555b5be46280 con 0x555b5bb18390 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f5136a5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555b5be4a090 con 0x555b5bb39070 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48620/0 (socket says 172.21.15.38:48620) 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.649+0000 7f512e282640 1 -- 172.21.15.38:0/646686877 learned_addr learned my addr 172.21.15.38:0/646686877 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512ea83640 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb39070 0x555b5bee0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512da81640 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5bee10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f511f7fe640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 0x7f51140b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 -- 172.21.15.38:0/646686877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb39070 msgr2=0x555b5bee0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb39070 0x555b5bee0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 -- 172.21.15.38:0/646686877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 msgr2=0x555b5bee10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5bee10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 -- 172.21.15.38:0/646686877 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5bba4650 con 0x555b5bb101b0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512ea83640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 0x7f51140b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f511f7fe640 1 -- 172.21.15.38:0/1863760014 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f51240e72d0 con 0x7f5128102a60 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f512e282640 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f51240e4a10 tx=0x7f5124071260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810ed5e565c0531e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f511cff9640 1 -- 172.21.15.38:0/646686877 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240acf40 con 0x555b5bb101b0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f511cff9640 1 -- 172.21.15.38:0/646686877 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51240acc80 con 0x555b5bb101b0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.650+0000 7f511cff9640 1 -- 172.21.15.38:0/646686877 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240ac8e0 con 0x555b5bb101b0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f512ea83640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 0x7f51140b8c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5120004af0 tx=0x7f51200095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 -- 172.21.15.38:0/646686877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 msgr2=0x555b5bee0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f51240e4a10 tx=0x7f5124071260 comp rx=0 tx=0).stop 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 -- 172.21.15.38:0/646686877 shutdown_connections 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5bee10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5bee0b90 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 --2- 172.21.15.38:0/646686877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb39070 0x555b5bee0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.651+0000 7f5136a5a740 1 -- 172.21.15.38:0/646686877 >> 172.21.15.38:0/646686877 conn(0x555b5bb2d460 msgr2=0x555b5bede540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- 172.21.15.38:0/646686877 shutdown_connections 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- 172.21.15.38:0/646686877 wait complete. 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- start start 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 Processor -- start 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 0x555b5beec230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5beec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x555b5bca7700 con 0x555b5bb101b0 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555b5bde1110 con 0x555b5bb39070 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555b5beeedd0 con 0x555b5bb18390 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f5136a5a740 10 client.0 _ll_register_callbacks cb 0x555b5bdfa990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.652+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48628/0 (socket says 172.21.15.38:48628) 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 -- 172.21.15.38:0/3170567008 learned_addr learned my addr 172.21.15.38:0/3170567008 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512ea83640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5beec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512da81640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 0x555b5beec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 -- 172.21.15.38:0/3170567008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 msgr2=0x555b5beec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 0x555b5beec230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 -- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 msgr2=0x555b5beec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5beec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 -- 172.21.15.38:0/3170567008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5be0ec40 con 0x555b5bb101b0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512da81640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 0x555b5beec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f512e282640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f51240ace70 tx=0x7f5124005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837442b37dbf74c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124020020 con 0x555b5bb101b0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f51240c8380 con 0x555b5bb101b0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51240acc80 con 0x555b5bb101b0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51240acac0 con 0x555b5bb101b0 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5136a5a740 10 client.18381 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:29.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.653+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555b5befaaa0 con 0x555b5bb101b0 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51240acc80 con 0x555b5bb101b0 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5124070e40 con 0x555b5bb101b0 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 10 client.18381 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 10 client.18381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 20 client.18381 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baf79f0 0x555b5befde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 4 client.18381 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b5be58da0 con 0x555b5baf79f0 2024-09-21T06:29:29.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.654+0000 7f512da81640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baf79f0 0x555b5befde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.655+0000 7f512da81640 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baf79f0 0x555b5befde00 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d3f60d462f670a server_cookie=e27c9f283d7b3404 in_seq=0 out_seq=0 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.655+0000 7f5111ffb640 10 client.18381 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.655+0000 7f5111ffb640 1 -- 172.21.15.38:0/3170567008 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b5be58da0 con 0x555b5baf79f0 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.655+0000 7f5111ffb640 10 client.18381 handle_command_reply: tid=0 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.655+0000 7f5136a5a740 1 client.18381 shutdown 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 msgr2=0x555b5beebcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f51240ace70 tx=0x7f5124005880 comp rx=0 tx=0).stop 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 shutdown_connections 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5beec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baf79f0 0x555b5befde00 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb18390 0x555b5beec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3170567008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb101b0 0x555b5beebcf0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5111ffb640 0 client.18381 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:29.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 >> 172.21.15.38:0/3170567008 conn(0x555b5bb2d460 msgr2=0x555b5bee37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 shutdown_connections 2024-09-21T06:29:29.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 1 -- 172.21.15.38:0/3170567008 wait complete. 2024-09-21T06:29:29.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.656+0000 7f5136a5a740 20 client.18381 trim_cache size 0 max 16384 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.673+0000 7f5136a5a740 1 Processor -- start 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.673+0000 7f5136a5a740 1 -- start start 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.673+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beedce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.673+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.673+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5bee1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5136a5a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f51281b20b0 con 0x555b5bb18390 2024-09-21T06:29:29.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5136a5a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51281af980 con 0x555b5bb39070 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5136a5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51281ad7f0 con 0x555b5bb101b0 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48638/0 (socket says 172.21.15.38:48638) 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 -- 172.21.15.38:0/711987983 learned_addr learned my addr 172.21.15.38:0/711987983 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512e282640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beedce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 -- 172.21.15.38:0/711987983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 msgr2=0x555b5beedce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beedce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512ea83640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5bee1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 -- 172.21.15.38:0/711987983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 msgr2=0x555b5bee1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5bee1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 -- 172.21.15.38:0/711987983 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b5beecfb0 con 0x555b5bb18390 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512e282640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beedce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:29.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512ea83640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5bee1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:29.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f512da81640 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x555b5beeee60 tx=0x7f511800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7162c1624fbbf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5113fff640 1 -- 172.21.15.38:0/711987983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118003b20 con 0x555b5bb18390 2024-09-21T06:29:29.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5113fff640 1 -- 172.21.15.38:0/711987983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51180054f0 con 0x555b5bb18390 2024-09-21T06:29:29.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.674+0000 7f5113fff640 1 -- 172.21.15.38:0/711987983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511801d430 con 0x555b5bb18390 2024-09-21T06:29:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 -- 172.21.15.38:0/711987983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 msgr2=0x555b5bef7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x555b5beeee60 tx=0x7f511800bcb0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 -- 172.21.15.38:0/711987983 shutdown_connections 2024-09-21T06:29:29.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb39070 0x555b5bee1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb18390 0x555b5bef7a10 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 --2- 172.21.15.38:0/711987983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beedce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 -- 172.21.15.38:0/711987983 >> 172.21.15.38:0/711987983 conn(0x555b5bb2d460 msgr2=0x555b5bee1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 -- 172.21.15.38:0/711987983 shutdown_connections 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.675+0000 7f5136a5a740 1 -- 172.21.15.38:0/711987983 wait complete. 2024-09-21T06:29:29.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 -- start start 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 Processor -- start 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5beff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f51281ade40 con 0x555b5bb39070 2024-09-21T06:29:29.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51281af2b0 con 0x555b5bb18390 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51281ae510 con 0x555b5bb101b0 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f5136a5a740 10 client.0 _ll_register_callbacks cb 0x7f511800b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f512ea83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f512ea83640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48652/0 (socket says 172.21.15.38:48652) 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f512ea83640 1 -- 172.21.15.38:0/3731582744 learned_addr learned my addr 172.21.15.38:0/3731582744 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:29.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f512da81640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5beff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.676+0000 7f512e282640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 -- 172.21.15.38:0/3731582744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 msgr2=0x555b5beff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 -- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 msgr2=0x555b5beff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5beff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 -- 172.21.15.38:0/3731582744 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b5beffe50 con 0x555b5bb39070 2024-09-21T06:29:29.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f512ea83640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5120009ca0 tx=0x7f512002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250ecb37c844cdda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120004240 con 0x555b5bb39070 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f51200043e0 con 0x555b5bb39070 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51180054f0 con 0x555b5bb39070 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f51200045e0 con 0x555b5bb39070 2024-09-21T06:29:29.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5136a5a740 10 client.18387 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:29.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555b5bf68970 con 0x555b5bb39070 2024-09-21T06:29:29.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.677+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51180054f0 con 0x555b5bb39070 2024-09-21T06:29:29.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f51200305c0 con 0x555b5bb39070 2024-09-21T06:29:29.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 10 client.18387 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:29.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 10 client.18387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 20 client.18387 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baccda0 0x555b5bf6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 4 client.18387 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555b5be54850 con 0x555b5baccda0 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f512e282640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baccda0 0x555b5bf6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:29.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f512e282640 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baccda0 0x555b5bf6b1e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b66db176de32c4 server_cookie=1f720894715ada55 in_seq=0 out_seq=0 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.678+0000 7f5111ffb640 10 client.18387 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5111ffb640 1 -- 172.21.15.38:0/3731582744 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7758 (crc 0 0 0) 0x555b5be54850 con 0x555b5baccda0 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5111ffb640 10 client.18387 handle_command_reply: tid=0 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 client.18387 shutdown 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 msgr2=0x555b5bf67580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f5120009ca0 tx=0x7f512002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 shutdown_connections 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b5bb39070 0x555b5bf67580 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b5bb18390 0x555b5beff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x555b5baccda0 0x555b5bf6b1e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 --2- 172.21.15.38:0/3731582744 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555b5bb101b0 0x555b5beff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 >> 172.21.15.38:0/3731582744 conn(0x555b5bb2d460 msgr2=0x555b5bef77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5111ffb640 0 client.18387 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:29.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 shutdown_connections 2024-09-21T06:29:29.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 1 -- 172.21.15.38:0/3731582744 wait complete. 2024-09-21T06:29:29.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.679+0000 7f5136a5a740 20 client.18387 trim_cache size 0 max 16384 2024-09-21T06:29:29.694 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:29.694 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:29:29.694 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:29:29.694 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:29:29.694 INFO:teuthology.orchestra.run.smithi038.stdout: "75a9e3b9-81b4-4dfc-92ed-38f82ef0a592": { 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:17.616723+0000", 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.695 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.696 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:29:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.698 INFO:teuthology.orchestra.run.smithi038.stdout: "a879a378-0472-405a-9891-3e8f77e97d82": { 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:07.217872+0000", 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.699 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "871e6bd0-0aff-496e-a3c0-df537c4e6cb9": { 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:28.047574+0000", 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.700 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.701 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:29:29.702 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.704 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.705 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.706 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:29:29.707 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.708 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 msgr2=0x7f51140b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 0x7f51140b8c10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5120004af0 tx=0x7f51200095c0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 msgr2=0x7f512819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f512400d950 tx=0x7f512400de10 comp rx=0 tx=0).stop 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 shutdown_connections 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f51140b6700 0x7f51140b8c10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5128108cf0 0x7f512819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51281083a0 0x7f512819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 --2- 172.21.15.38:0/1863760014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5128102a60 0x7f512819b2f0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 >> 172.21.15.38:0/1863760014 conn(0x7f5128079730 msgr2=0x7f5128104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 shutdown_connections 2024-09-21T06:29:29.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:29.680+0000 7f51304e6640 1 -- 172.21.15.38:0/1863760014 wait complete. 2024-09-21T06:29:30.562 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:29:30.562 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:29:30.827 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:31.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 -- 172.21.15.38:0/2305976277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 msgr2=0x7fd358108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 --2- 172.21.15.38:0/2305976277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd358108830 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009900 tx=0x7fd34c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:31.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 -- 172.21.15.38:0/2305976277 shutdown_connections 2024-09-21T06:29:31.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 --2- 172.21.15.38:0/2305976277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 0x7fd35810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 --2- 172.21.15.38:0/2305976277 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd358108830 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 --2- 172.21.15.38:0/2305976277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 0x7fd358102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 -- 172.21.15.38:0/2305976277 >> 172.21.15.38:0/2305976277 conn(0x7fd358079770 msgr2=0x7fd358079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 -- 172.21.15.38:0/2305976277 shutdown_connections 2024-09-21T06:29:31.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.290+0000 7fd35d505640 1 -- 172.21.15.38:0/2305976277 wait complete. 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.291+0000 7fd35d505640 1 Processor -- start 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.291+0000 7fd35d505640 1 -- start start 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 0x7fd35819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 0x7fd35819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd358112b90 con 0x7fd358108420 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd358112a10 con 0x7fd358108d70 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd35d505640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd358112d10 con 0x7fd358102ae0 2024-09-21T06:29:31.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.294 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:31 smithi038 ceph-mon[31215]: pgmap v622: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48670/0 (socket says 172.21.15.38:48670) 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 -- 172.21.15.38:0/2626493312 learned_addr learned my addr 172.21.15.38:0/2626493312 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd356ffd640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 0x7fd35819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3577fe640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 0x7fd35819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 -- 172.21.15.38:0/2626493312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 msgr2=0x7fd35819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 0x7fd35819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 -- 172.21.15.38:0/2626493312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 msgr2=0x7fd35819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 0x7fd35819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 -- 172.21.15.38:0/2626493312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3581a0600 con 0x7fd358108420 2024-09-21T06:29:31.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.292+0000 7fd3567fc640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005940 tx=0x7fd34c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.293+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c03f030 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.293+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3581a0890 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.293+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd34c003cd0 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.293+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c035070 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.293+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3581a7050 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.294+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd358103d60 con 0x7fd358108420 2024-09-21T06:29:31.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.296+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd34c042030 con 0x7fd358108420 2024-09-21T06:29:31.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.296+0000 7fd33ffff640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 0x7fd3400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:31.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.297+0000 7fd356ffd640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 0x7fd3400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:31.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.297+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fd34c107f40 con 0x7fd358108420 2024-09-21T06:29:31.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.297+0000 7fd356ffd640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 0x7fd3400b8b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd34800a400 tx=0x7fd34800d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:31.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.300+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd34c0d28c0 con 0x7fd358108420 2024-09-21T06:29:31.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.527+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd35819b7c0 con 0x7fd358108420 2024-09-21T06:29:31.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.528+0000 7fd33ffff640 1 -- 172.21.15.38:0/2626493312 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fd35819b7c0 con 0x7fd358108420 2024-09-21T06:29:31.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:29:31.530 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:29:31.530 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 msgr2=0x7fd3400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 0x7fd3400b8b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd34800a400 tx=0x7fd34800d040 comp rx=0 tx=0).stop 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 msgr2=0x7fd35819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fd34c005940 tx=0x7fd34c004360 comp rx=0 tx=0).stop 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 shutdown_connections 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd3400b6680 0x7fd3400b8b90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd358108d70 0x7fd35819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd358108420 0x7fd35819ac30 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 --2- 172.21.15.38:0/2626493312 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd358102ae0 0x7fd35819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.530+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 >> 172.21.15.38:0/2626493312 conn(0x7fd358079770 msgr2=0x7fd3581019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.531+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 shutdown_connections 2024-09-21T06:29:31.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:31.531+0000 7fd35d505640 1 -- 172.21.15.38:0/2626493312 wait complete. 2024-09-21T06:29:31.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:31 smithi174 ceph-mon[34815]: pgmap v622: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:31.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:31 smithi044 ceph-mon[34369]: pgmap v622: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:32.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:29:32.418 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:32.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:32 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2626493312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:32.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:32 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2626493312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:32.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:32 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2626493312' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:29:32.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 -- 172.21.15.38:0/3957179676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc109e40 msgr2=0x7f4ecc110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 --2- 172.21.15.38:0/3957179676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc109e40 0x7f4ecc110670 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009ca0 tx=0x7f4ec402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 -- 172.21.15.38:0/3957179676 shutdown_connections 2024-09-21T06:29:32.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 --2- 172.21.15.38:0/3957179676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc109e40 0x7f4ecc110670 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 --2- 172.21.15.38:0/3957179676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 --2- 172.21.15.38:0/3957179676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 -- 172.21.15.38:0/3957179676 >> 172.21.15.38:0/3957179676 conn(0x7f4ecc0ff600 msgr2=0x7f4ecc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 -- 172.21.15.38:0/3957179676 shutdown_connections 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.880+0000 7f4ed2195640 1 -- 172.21.15.38:0/3957179676 wait complete. 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.881+0000 7f4ed2195640 1 Processor -- start 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.881+0000 7f4ed2195640 1 -- start start 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 0x7f4ecc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc113c40 con 0x7f4ecc1094f0 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc113ac0 con 0x7f4ecc109e40 2024-09-21T06:29:32.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ed2195640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc113dc0 con 0x7f4ecc103bb0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48690/0 (socket says 172.21.15.38:48690) 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 -- 172.21.15.38:0/1671558200 learned_addr learned my addr 172.21.15.38:0/1671558200 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 0x7f4ecc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 -- 172.21.15.38:0/1671558200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 msgr2=0x7f4ecc19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 -- 172.21.15.38:0/1671558200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 msgr2=0x7f4ecc19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 0x7f4ecc19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 -- 172.21.15.38:0/1671558200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ecc1a04a0 con 0x7f4ecc1094f0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 0x7f4ecc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e9f0 tx=0x7f4ec000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.882+0000 7f4ec8ff9640 1 -- 172.21.15.38:0/1671558200 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000ccc0 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.883+0000 7f4ec8ff9640 1 -- 172.21.15.38:0/1671558200 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ec0010900 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.883+0000 7f4ec8ff9640 1 -- 172.21.15.38:0/1671558200 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0018900 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.883+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ecc1a0790 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.883+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ecc1a6ef0 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.885+0000 7f4ec8ff9640 1 -- 172.21.15.38:0/1671558200 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4ec0010ab0 con 0x7f4ecc1094f0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.885+0000 7f4ed8709740 1 Processor -- start 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.885+0000 7f4ed8709740 1 -- start start 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55985f65eea0 con 0x55985f3181b0 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55985f64e2d0 con 0x55985f341070 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ed8709740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55985f6520e0 con 0x55985f320390 2024-09-21T06:29:32.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48698/0 (socket says 172.21.15.38:48698) 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/4044033236 learned_addr learned my addr 172.21.15.38:0/4044033236 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ec8ff9640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 0x7f4eb40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/4044033236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 msgr2=0x55985f6e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6e8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/4044033236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 msgr2=0x55985f6e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/4044033236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985f3ac650 con 0x55985f3181b0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 0x7f4eb40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.886+0000 7f4ec8ff9640 1 -- 172.21.15.38:0/1671558200 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4ec00e7b30 con 0x7f4ecc1094f0 2024-09-21T06:29:32.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.887+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00bd40 tx=0x7f4ebc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5b45e307292132 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.887+0000 7f4eb1ffb640 1 -- 172.21.15.38:0/4044033236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc015070 con 0x55985f3181b0 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.887+0000 7f4eb1ffb640 1 -- 172.21.15.38:0/4044033236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ebc00be30 con 0x55985f3181b0 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.887+0000 7f4eb1ffb640 1 -- 172.21.15.38:0/4044033236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc011a30 con 0x55985f3181b0 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- 172.21.15.38:0/4044033236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 msgr2=0x55985f6e8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 0x7f4eb40b8b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4004af0 tx=0x7f4ec40095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00bd40 tx=0x7f4ebc00f730 comp rx=0 tx=0).stop 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- 172.21.15.38:0/4044033236 shutdown_connections 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6e8800 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 --2- 172.21.15.38:0/4044033236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- 172.21.15.38:0/4044033236 >> 172.21.15.38:0/4044033236 conn(0x55985f335460 msgr2=0x55985f6e61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- 172.21.15.38:0/4044033236 shutdown_connections 2024-09-21T06:29:32.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- 172.21.15.38:0/4044033236 wait complete. 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 -- start start 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.888+0000 7f4ed8709740 1 Processor -- start 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55985f4af700 con 0x55985f320390 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55985f5e9160 con 0x55985f341070 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55985f6f6aa0 con 0x55985f3181b0 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ed8709740 10 client.0 _ll_register_callbacks cb 0x55985f6029e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48706/0 (socket says 172.21.15.38:48706) 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 -- 172.21.15.38:0/2026245970 learned_addr learned my addr 172.21.15.38:0/2026245970 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 -- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 msgr2=0x55985f6f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 -- 172.21.15.38:0/2026245970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 msgr2=0x55985f6ffdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 -- 172.21.15.38:0/2026245970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985f616c90 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e9c0 tx=0x7f4ec00b7320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a632220fb39143 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.889+0000 7f4eaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00ad140 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4ec00ac6a0 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ebc00be30 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4ec00aa020 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 10 client.18405 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55985f702780 con 0x55985f320390 2024-09-21T06:29:32.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ebc00be30 con 0x55985f320390 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4ec00ac8a0 con 0x55985f320390 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 10 client.18405 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 10 client.18405 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 20 client.18405 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2ff9f0 0x55985f705ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 4 client.18405 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.890+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55985f660df0 con 0x55985f2ff9f0 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.891+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2ff9f0 0x55985f705ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.891+0000 7f4eaaffd640 10 client.18405 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.891+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2ff9f0 0x55985f705ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=821962d098eba00 server_cookie=15f20d37b4bbd25a in_seq=0 out_seq=0 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2026245970 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55985f660df0 con 0x55985f2ff9f0 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4eaaffd640 10 client.18405 handle_command_reply: tid=0 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 client.18405 shutdown 2024-09-21T06:29:32.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 msgr2=0x55985f6f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e9c0 tx=0x7f4ec00b7320 comp rx=0 tx=0).stop 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 shutdown_connections 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2ff9f0 0x55985f705ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6f3ec0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4eaaffd640 0 client.18405 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2026245970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 >> 172.21.15.38:0/2026245970 conn(0x55985f335460 msgr2=0x55985f6eb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 shutdown_connections 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 1 -- 172.21.15.38:0/2026245970 wait complete. 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.892+0000 7f4ed8709740 20 client.18405 trim_cache size 0 max 16384 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 Processor -- start 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 -- start start 2024-09-21T06:29:32.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1b1f30 con 0x55985f320390 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1af800 con 0x55985f341070 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ed8709740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1ad670 con 0x55985f3181b0 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48712/0 (socket says 172.21.15.38:48712) 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3070392926 learned_addr learned my addr 172.21.15.38:0/3070392926 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3070392926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 msgr2=0x55985f6f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3070392926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 msgr2=0x55985f6ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.906+0000 7f4ecaffd640 1 -- 172.21.15.38:0/3070392926 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985f6e6f70 con 0x55985f320390 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c6a0 tx=0x7f4ec00ad3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fee4dea8ceadf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4eb17fa640 1 -- 172.21.15.38:0/3070392926 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000ce60 con 0x55985f320390 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4eb17fa640 1 -- 172.21.15.38:0/3070392926 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ec0010e20 con 0x55985f320390 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4eb17fa640 1 -- 172.21.15.38:0/3070392926 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0018d00 con 0x55985f320390 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 -- 172.21.15.38:0/3070392926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 msgr2=0x55985f6e92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c6a0 tx=0x7f4ec00ad3b0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 -- 172.21.15.38:0/3070392926 shutdown_connections 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f6ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f320390 0x55985f6e92f0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.907+0000 7f4ed8709740 1 --2- 172.21.15.38:0/3070392926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f3181b0 0x55985f6f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- 172.21.15.38:0/3070392926 >> 172.21.15.38:0/3070392926 conn(0x55985f335460 msgr2=0x55985f6f20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- 172.21.15.38:0/3070392926 shutdown_connections 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- 172.21.15.38:0/3070392926 wait complete. 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- start start 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 Processor -- start 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f76f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1adcc0 con 0x55985f3181b0 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1af130 con 0x55985f341070 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.908+0000 7f4ed8709740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ecc1ae390 con 0x55985f320390 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ed8709740 10 client.0 _ll_register_callbacks cb 0x7f4ec00096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48722/0 (socket says 172.21.15.38:48722) 2024-09-21T06:29:32.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/2631776129 learned_addr learned my addr 172.21.15.38:0/2631776129 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f76f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 msgr2=0x55985f6f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/2631776129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 msgr2=0x55985f76f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f76f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 -- 172.21.15.38:0/2631776129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985f6e15d0 con 0x55985f3181b0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecbfff640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f76f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ecb7fe640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x55985f6e6f40 tx=0x7f4ebc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb286955c7cd98f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4eaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc031060 con 0x55985f3181b0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4ebc005240 con 0x55985f3181b0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.909+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55985f65c8a0 con 0x55985f3181b0 2024-09-21T06:29:32.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4ebc015040 con 0x55985f3181b0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 10 client.18411 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55985f770c30 con 0x55985f3181b0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55985f65c8a0 con 0x55985f3181b0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4ebc02b030 con 0x55985f3181b0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 10 client.18411 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 10 client.18411 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 20 client.18411 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2d4da0 0x55985f773140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 4 client.18411 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55985f659cd0 con 0x55985f2d4da0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.910+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2d4da0 0x55985f773140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ecaffd640 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2d4da0 0x55985f773140 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=735c68ab22478101 server_cookie=6f07b27d08914944 in_seq=0 out_seq=0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4eaaffd640 10 client.18411 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4eaaffd640 1 -- 172.21.15.38:0/2631776129 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55985f659cd0 con 0x55985f2d4da0 2024-09-21T06:29:32.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4eaaffd640 10 client.18411 handle_command_reply: tid=0 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 client.18411 shutdown 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 msgr2=0x55985f6f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x55985f6e6f40 tx=0x7f4ebc00b6d0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 shutdown_connections 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x55985f2d4da0 0x55985f773140 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55985f341070 0x55985f76f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55985f320390 0x55985f6f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 --2- 172.21.15.38:0/2631776129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55985f3181b0 0x55985f6f83e0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 >> 172.21.15.38:0/2631776129 conn(0x55985f335460 msgr2=0x55985f6f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4eaaffd640 0 client.18411 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 shutdown_connections 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.911+0000 7f4ed8709740 1 -- 172.21.15.38:0/2631776129 wait complete. 2024-09-21T06:29:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed8709740 20 client.18411 trim_cache size 0 max 16384 2024-09-21T06:29:32.929 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:32.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 msgr2=0x7f4eb40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 0x7f4eb40b8b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4004af0 tx=0x7f4ec40095c0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 msgr2=0x7f4ecc19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e9f0 tx=0x7f4ec000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 shutdown_connections 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4eb40b6680 0x7f4eb40b8b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ecc109e40 0x7f4ecc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc1094f0 0x7f4ecc19aad0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 --2- 172.21.15.38:0/1671558200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc103bb0 0x7f4ecc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 >> 172.21.15.38:0/1671558200 conn(0x7f4ecc0ff600 msgr2=0x7f4ecc106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 shutdown_connections 2024-09-21T06:29:32.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:32.912+0000 7f4ed2195640 1 -- 172.21.15.38:0/1671558200 wait complete. 2024-09-21T06:29:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:33 smithi038 ceph-mon[31215]: pgmap v623: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:29:33.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:29:33.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:33 smithi174 ceph-mon[34815]: pgmap v623: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:29:33.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:33 smithi044 ceph-mon[34369]: pgmap v623: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:29:33.849 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 -- 172.21.15.38:0/23969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c102ae0 msgr2=0x7f4c6c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 --2- 172.21.15.38:0/23969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c102ef0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009ca0 tx=0x7f4c5c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 -- 172.21.15.38:0/23969995 shutdown_connections 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 --2- 172.21.15.38:0/23969995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 0x7f4c6c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 --2- 172.21.15.38:0/23969995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 --2- 172.21.15.38:0/23969995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c102ef0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 -- 172.21.15.38:0/23969995 >> 172.21.15.38:0/23969995 conn(0x7f4c6c0797b0 msgr2=0x7f4c6c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 -- 172.21.15.38:0/23969995 shutdown_connections 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.330+0000 7f4c72db8640 1 -- 172.21.15.38:0/23969995 wait complete. 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 Processor -- start 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 -- start start 2024-09-21T06:29:34.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 0x7f4c6c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c112b00 con 0x7f4c6c1083d0 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c112980 con 0x7f4c6c102ae0 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c72db8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c112c80 con 0x7f4c6c108d20 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.331+0000 7f4c6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48750/0 (socket says 172.21.15.38:48750) 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 -- 172.21.15.38:0/2183908679 learned_addr learned my addr 172.21.15.38:0/2183908679 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c71355640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 0x7f4c6c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 -- 172.21.15.38:0/2183908679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 msgr2=0x7f4c6c19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 0x7f4c6c19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 -- 172.21.15.38:0/2183908679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 msgr2=0x7f4c6c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 -- 172.21.15.38:0/2183908679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c1a0550 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400e9f0 tx=0x7f4c5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c69ffb640 1 -- 172.21.15.38:0/2183908679 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400ccc0 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c69ffb640 1 -- 172.21.15.38:0/2183908679 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c54010900 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c1a0840 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c69ffb640 1 -- 172.21.15.38:0/2183908679 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54018900 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.332+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c1a6fa0 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.335+0000 7f4c7932c740 1 Processor -- start 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.335+0000 7f4c7932c740 1 -- start start 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.335+0000 7f4c69ffb640 1 -- 172.21.15.38:0/2183908679 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4c54010ab0 con 0x7f4c6c1083d0 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948b9fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948ba0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559948b15ea0 con 0x5599487f8070 2024-09-21T06:29:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559948b052d0 con 0x5599487d7390 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c7932c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559948b090e0 con 0x5599487cf1b0 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48760/0 (socket says 172.21.15.38:48760) 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 -- 172.21.15.38:0/2541618747 learned_addr learned my addr 172.21.15.38:0/2541618747 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948ba0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948b9fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 -- 172.21.15.38:0/2541618747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 msgr2=0x559948b9fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948b9fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 -- 172.21.15.38:0/2541618747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 msgr2=0x559948ba0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948ba0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 -- 172.21.15.38:0/2541618747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559948863650 con 0x5599487f8070 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c71355640 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400dc60 tx=0x7f4c6400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc41af13079622c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c69ffb640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 0x7f4c580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.336+0000 7f4c62ffd640 1 -- 172.21.15.38:0/2541618747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64004030 con 0x5599487f8070 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c62ffd640 1 -- 172.21.15.38:0/2541618747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c640041d0 con 0x5599487f8070 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c62ffd640 1 -- 172.21.15.38:0/2541618747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640116a0 con 0x5599487f8070 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 0x7f4c580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c69ffb640 1 -- 172.21.15.38:0/2183908679 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4c540e7b30 con 0x7f4c6c1083d0 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c7932c740 1 -- 172.21.15.38:0/2541618747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 msgr2=0x559948b9f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400dc60 tx=0x7f4c6400f730 comp rx=0 tx=0).stop 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.337+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 0x7f4c580b8b90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0094e0 tx=0x7f4c5c0093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 -- 172.21.15.38:0/2541618747 shutdown_connections 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948ba0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948b9fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2541618747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948b9f6a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 -- 172.21.15.38:0/2541618747 >> 172.21.15.38:0/2541618747 conn(0x5599487ec460 msgr2=0x559948b9d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 -- 172.21.15.38:0/2541618747 shutdown_connections 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 -- 172.21.15.38:0/2541618747 wait complete. 2024-09-21T06:29:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 -- start start 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.338+0000 7f4c7932c740 1 Processor -- start 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948baf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487f8070 0x559948bafaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x559948966700 con 0x5599487cf1b0 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559948aa0160 con 0x5599487d7390 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559948bb21b0 con 0x5599487f8070 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c7932c740 10 client.0 _ll_register_callbacks cb 0x559948ab99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48772/0 (socket says 172.21.15.38:48772) 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 -- 172.21.15.38:0/3581612795 learned_addr learned my addr 172.21.15.38:0/3581612795 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948baf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c71355640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487f8070 0x559948bafaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 -- 172.21.15.38:0/3581612795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487f8070 msgr2=0x559948bafaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487f8070 0x559948bafaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 -- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 msgr2=0x559948baf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948baf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 -- 172.21.15.38:0/3581612795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559948acdc90 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c70b54640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c003bd0 tx=0x7f4c5c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a271f667460aa297 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c04f070 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.339+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4c5c004240 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c640041d0 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4c5c004440 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 10 client.18423 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559948bbde60 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c640041d0 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4c5c044040 con 0x5599487cf1b0 2024-09-21T06:29:34.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 10 client.18423 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 10 client.18423 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 20 client.18423 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5599487b69f0 0x559948bc1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 4 client.18423 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559948b17df0 con 0x5599487b69f0 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.340+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5599487b69f0 0x559948bc1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.341+0000 7f4c4bfff640 10 client.18423 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.341+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5599487b69f0 0x559948bc1390 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb15fdb755330aa3 server_cookie=b1f243826896d3f in_seq=0 out_seq=0 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c4bfff640 1 -- 172.21.15.38:0/3581612795 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559948b17df0 con 0x5599487b69f0 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c4bfff640 10 client.18423 handle_command_reply: tid=0 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 client.18423 shutdown 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 msgr2=0x559948baf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c003bd0 tx=0x7f4c5c0095c0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 shutdown_connections 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x5599487b69f0 0x559948bc1390 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487f8070 0x559948bafaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948baf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c4bfff640 0 client.18423 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 --2- 172.21.15.38:0/3581612795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487cf1b0 0x559948baf070 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 >> 172.21.15.38:0/3581612795 conn(0x5599487ec460 msgr2=0x559948ba2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 shutdown_connections 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 1 -- 172.21.15.38:0/3581612795 wait complete. 2024-09-21T06:29:34.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.342+0000 7f4c7932c740 20 client.18423 trim_cache size 0 max 16384 2024-09-21T06:29:34.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 Processor -- start 2024-09-21T06:29:34.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 -- start start 2024-09-21T06:29:34.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 0x559948b9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1afe30 con 0x5599487d7390 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ad700 con 0x5599487f8070 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c7932c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ab570 con 0x5599487cf1b0 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48788/0 (socket says 172.21.15.38:48788) 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 -- 172.21.15.38:0/1309425281 learned_addr learned my addr 172.21.15.38:0/1309425281 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c70b54640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c71355640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 0x559948b9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 -- 172.21.15.38:0/1309425281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 msgr2=0x559948bb0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 -- 172.21.15.38:0/1309425281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 msgr2=0x559948b9cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 0x559948b9cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c6bfff640 1 -- 172.21.15.38:0/1309425281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559948ba24a0 con 0x5599487d7390 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c71355640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 0x559948b9cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.356+0000 7f4c70b54640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.357+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4c540e5330 tx=0x7f4c540e7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7861efc0ed8ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.357+0000 7f4c627fc640 1 -- 172.21.15.38:0/1309425281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c54010e20 con 0x5599487d7390 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.357+0000 7f4c627fc640 1 -- 172.21.15.38:0/1309425281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c540ad4e0 con 0x5599487d7390 2024-09-21T06:29:34.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.357+0000 7f4c627fc640 1 -- 172.21.15.38:0/1309425281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c540a9320 con 0x5599487d7390 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- 172.21.15.38:0/1309425281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 msgr2=0x559948ba0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f4c540e5330 tx=0x7f4c540e7e30 comp rx=0 tx=0).stop 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- 172.21.15.38:0/1309425281 shutdown_connections 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487f8070 0x559948b9cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487d7390 0x559948ba0de0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 --2- 172.21.15.38:0/1309425281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- 172.21.15.38:0/1309425281 >> 172.21.15.38:0/1309425281 conn(0x5599487ec460 msgr2=0x559948ba06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- 172.21.15.38:0/1309425281 shutdown_connections 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- 172.21.15.38:0/1309425281 wait complete. 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 -- start start 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.358+0000 7f4c7932c740 1 Processor -- start 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948bb3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1abbc0 con 0x5599487f8070 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ad030 con 0x5599487d7390 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c1ac290 con 0x5599487cf1b0 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c7932c740 10 client.0 _ll_register_callbacks cb 0x7f4c54005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48790/0 (socket says 172.21.15.38:48790) 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 -- 172.21.15.38:0/2257197882 learned_addr learned my addr 172.21.15.38:0/2257197882 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c6bfff640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948bb3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 -- 172.21.15.38:0/2257197882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 msgr2=0x559948bb35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 -- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 msgr2=0x559948bb3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948bb3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 -- 172.21.15.38:0/2257197882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559948c2aeb0 con 0x5599487f8070 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c71355640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400dc60 tx=0x7f4c6400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10cd7d8602d42f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.359+0000 7f4c4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64003a00 con 0x5599487f8070 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4c64005040 con 0x5599487f8070 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c540ad4e0 con 0x5599487f8070 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4c64034050 con 0x5599487f8070 2024-09-21T06:29:34.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 10 client.18429 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559948c2c0a0 con 0x5599487f8070 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c540ad4e0 con 0x5599487f8070 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4c64011b40 con 0x5599487f8070 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 10 client.18429 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 10 client.18429 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 20 client.18429 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55994878bda0 0x559948c2e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 4 client.18429 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.360+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559948b138a0 con 0x55994878bda0 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55994878bda0 0x559948c2e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c70b54640 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55994878bda0 0x559948c2e660 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92f3427a75584930 server_cookie=76867a96139bf32e in_seq=0 out_seq=0 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c4bfff640 10 client.18429 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c4bfff640 1 -- 172.21.15.38:0/2257197882 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559948b138a0 con 0x55994878bda0 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c4bfff640 10 client.18429 handle_command_reply: tid=0 2024-09-21T06:29:34.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 client.18429 shutdown 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 msgr2=0x559948bb4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400dc60 tx=0x7f4c6400d970 comp rx=0 tx=0).stop 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 shutdown_connections 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x55994878bda0 0x559948c2e660 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5599487f8070 0x559948bb4060 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5599487d7390 0x559948bb3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c4bfff640 0 client.18429 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 --2- 172.21.15.38:0/2257197882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599487cf1b0 0x559948bb35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.361+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 >> 172.21.15.38:0/2257197882 conn(0x5599487ec460 msgr2=0x559948ba31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 shutdown_connections 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c7932c740 1 -- 172.21.15.38:0/2257197882 wait complete. 2024-09-21T06:29:34.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c7932c740 20 client.18429 trim_cache size 0 max 16384 2024-09-21T06:29:34.368 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:34.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 msgr2=0x7f4c580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 0x7f4c580b8b90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0094e0 tx=0x7f4c5c0093f0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 msgr2=0x7f4c6c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400e9f0 tx=0x7f4c5400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 shutdown_connections 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4c580b6680 0x7f4c580b8b90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c6c108d20 0x7f4c6c19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c6c1083d0 0x7f4c6c19ab80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 --2- 172.21.15.38:0/2183908679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c102ae0 0x7f4c6c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.362+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 >> 172.21.15.38:0/2183908679 conn(0x7f4c6c0797b0 msgr2=0x7f4c6c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.363+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 shutdown_connections 2024-09-21T06:29:34.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:34.363+0000 7f4c72db8640 1 -- 172.21.15.38:0/2183908679 wait complete. 2024-09-21T06:29:35.083 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:29:35.342 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:35.463 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:35 smithi038 ceph-mon[31215]: pgmap v624: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:35.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:35 smithi174 ceph-mon[34815]: pgmap v624: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:35.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:35 smithi044 ceph-mon[34369]: pgmap v624: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:35.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 -- 172.21.15.38:0/730442619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 msgr2=0x7f4d4c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 --2- 172.21.15.38:0/730442619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c110620 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009ca0 tx=0x7f4d4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 -- 172.21.15.38:0/730442619 shutdown_connections 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 --2- 172.21.15.38:0/730442619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c110620 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 --2- 172.21.15.38:0/730442619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c1094a0 0x7f4d4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 --2- 172.21.15.38:0/730442619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c103b60 0x7f4d4c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 -- 172.21.15.38:0/730442619 >> 172.21.15.38:0/730442619 conn(0x7f4d4c07b850 msgr2=0x7f4d4c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.806+0000 7f4d52918640 1 -- 172.21.15.38:0/730442619 shutdown_connections 2024-09-21T06:29:35.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.807+0000 7f4d52918640 1 -- 172.21.15.38:0/730442619 wait complete. 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.807+0000 7f4d52918640 1 Processor -- start 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.807+0000 7f4d52918640 1 -- start start 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c103b60 0x7f4d4c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c1094a0 0x7f4d4c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c113bf0 con 0x7f4d4c109df0 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c113a70 con 0x7f4d4c103b60 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d52918640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c113d70 con 0x7f4d4c1094a0 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48814/0 (socket says 172.21.15.38:48814) 2024-09-21T06:29:35.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 -- 172.21.15.38:0/1619199121 learned_addr learned my addr 172.21.15.38:0/1619199121 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c1094a0 0x7f4d4c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c103b60 0x7f4d4c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 -- 172.21.15.38:0/1619199121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c1094a0 msgr2=0x7f4d4c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c1094a0 0x7f4d4c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 -- 172.21.15.38:0/1619199121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c103b60 msgr2=0x7f4d4c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c103b60 0x7f4d4c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 -- 172.21.15.38:0/1619199121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c1a04f0 con 0x7f4d4c109df0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.808+0000 7f4d50eb5640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005e30 tx=0x7f4d44003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.809+0000 7f4d497fa640 1 -- 172.21.15.38:0/1619199121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44031650 con 0x7f4d4c109df0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.809+0000 7f4d497fa640 1 -- 172.21.15.38:0/1619199121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d440317f0 con 0x7f4d4c109df0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.809+0000 7f4d497fa640 1 -- 172.21.15.38:0/1619199121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4402fb70 con 0x7f4d4c109df0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.809+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c1a0780 con 0x7f4d4c109df0 2024-09-21T06:29:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.809+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c1a6f40 con 0x7f4d4c109df0 2024-09-21T06:29:35.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.812+0000 7f4d58e8c740 1 Processor -- start 2024-09-21T06:29:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.812+0000 7f4d497fa640 1 -- 172.21.15.38:0/1619199121 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d4402fd50 con 0x7f4d4c109df0 2024-09-21T06:29:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.812+0000 7f4d58e8c740 1 -- start start 2024-09-21T06:29:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b679b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b679c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f9b6711ea0 con 0x55f9b63cb1b0 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f9b67012d0 con 0x55f9b63d3390 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f9b67050e0 con 0x55f9b63f4070 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48824/0 (socket says 172.21.15.38:48824) 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4bfff640 1 -- 172.21.15.38:0/2636936920 learned_addr learned my addr 172.21.15.38:0/2636936920 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b679b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b679c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/2636936920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 msgr2=0x55f9b679c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b679c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/2636936920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 msgr2=0x55f9b679bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d497fa640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 0x7f4d340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/2636936920 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b645f650 con 0x55f9b63f4070 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.813+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d50eb5640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 0x7f4d340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b679b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c109170 tx=0x7f4d4000b5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b97028d9ffca12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d497fa640 1 -- 172.21.15.38:0/1619199121 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4d44108990 con 0x7f4d4c109df0 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d327fc640 1 -- 172.21.15.38:0/2636936920 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004030 con 0x55f9b63f4070 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d327fc640 1 -- 172.21.15.38:0/2636936920 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d400054f0 con 0x55f9b63f4070 2024-09-21T06:29:35.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.814+0000 7f4d327fc640 1 -- 172.21.15.38:0/2636936920 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004ce0 con 0x55f9b63f4070 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- 172.21.15.38:0/2636936920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 msgr2=0x55f9b679b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d50eb5640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 0x7f4d340b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009430 tx=0x7f4d44037830 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b679b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c109170 tx=0x7f4d4000b5b0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- 172.21.15.38:0/2636936920 shutdown_connections 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b679c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b679bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/2636936920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b679b6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- 172.21.15.38:0/2636936920 >> 172.21.15.38:0/2636936920 conn(0x55f9b63e8460 msgr2=0x55f9b6799590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- 172.21.15.38:0/2636936920 shutdown_connections 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- 172.21.15.38:0/2636936920 wait complete. 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.815+0000 7f4d58e8c740 1 -- start start 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 Processor -- start 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b67ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b67b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55f9b6562700 con 0x55f9b63cb1b0 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f9b669c160 con 0x55f9b63d3390 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f9b67ae180 con 0x55f9b63f4070 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d58e8c740 10 client.0 _ll_register_callbacks cb 0x55f9b66b59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48838/0 (socket says 172.21.15.38:48838) 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/3292882534 learned_addr learned my addr 172.21.15.38:0/3292882534 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:35.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b67b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b67ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/3292882534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 msgr2=0x55f9b67b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b67b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 msgr2=0x55f9b67ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b67ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/3292882534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b66c9c90 con 0x55f9b63cb1b0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.816+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b67ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000b480 tx=0x7f4d4000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99456454d068e855 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40027060 con 0x55f9b63cb1b0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4d40004040 con 0x55f9b63cb1b0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d400054f0 con 0x55f9b63cb1b0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4d40004240 con 0x55f9b63cb1b0 2024-09-21T06:29:35.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 10 client.18441 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9b67b9f00 con 0x55f9b63cb1b0 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d400054f0 con 0x55f9b63cb1b0 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4d4002c460 con 0x55f9b63cb1b0 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 10 client.18441 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 10 client.18441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.817+0000 7f4d58e8c740 20 client.18441 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b63b29f0 0x55f9b67bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d58e8c740 4 client.18441 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b6713df0 con 0x55f9b63b29f0 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b63b29f0 0x55f9b67bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d2b7fe640 10 client.18441 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.818+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b63b29f0 0x55f9b67bd310 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6b7246a88b245e server_cookie=dfb30834c6f6f445 in_seq=0 out_seq=0 2024-09-21T06:29:35.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3292882534 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9b6713df0 con 0x55f9b63b29f0 2024-09-21T06:29:35.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d2b7fe640 10 client.18441 handle_command_reply: tid=0 2024-09-21T06:29:35.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 client.18441 shutdown 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 msgr2=0x55f9b67ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000b480 tx=0x7f4d4000b390 comp rx=0 tx=0).stop 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 shutdown_connections 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b63b29f0 0x55f9b67bd310 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b67b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63d3390 0x55f9b67ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3292882534 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63cb1b0 0x55f9b67ab220 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d2b7fe640 0 client.18441 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.819+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 >> 172.21.15.38:0/3292882534 conn(0x55f9b63e8460 msgr2=0x55f9b6797bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.820+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 shutdown_connections 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.820+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3292882534 wait complete. 2024-09-21T06:29:35.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.820+0000 7f4d58e8c740 20 client.18441 trim_cache size 0 max 16384 2024-09-21T06:29:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 Processor -- start 2024-09-21T06:29:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 -- start start 2024-09-21T06:29:35.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63d3390 0x55f9b679cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1afdd0 con 0x55f9b63f4070 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1ad6a0 con 0x55f9b63cb1b0 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1ab510 con 0x55f9b63d3390 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48850/0 (socket says 172.21.15.38:48850) 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/4217190379 learned_addr learned my addr 172.21.15.38:0/4217190379 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.833+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63d3390 0x55f9b679cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/4217190379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63d3390 msgr2=0x55f9b679cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63d3390 0x55f9b679cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/4217190379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 msgr2=0x55f9b67a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 -- 172.21.15.38:0/4217190379 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b679e4d0 con 0x55f9b63f4070 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000be00 tx=0x7f4d40005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaabf94476836d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d31ffb640 1 -- 172.21.15.38:0/4217190379 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40027070 con 0x55f9b63f4070 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d31ffb640 1 -- 172.21.15.38:0/4217190379 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d40016050 con 0x55f9b63f4070 2024-09-21T06:29:35.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.834+0000 7f4d31ffb640 1 -- 172.21.15.38:0/4217190379 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4002c460 con 0x55f9b63f4070 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- 172.21.15.38:0/4217190379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 msgr2=0x55f9b67a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000be00 tx=0x7f4d40005780 comp rx=0 tx=0).stop 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- 172.21.15.38:0/4217190379 shutdown_connections 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63f4070 0x55f9b67a8410 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63d3390 0x55f9b679cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/4217190379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- 172.21.15.38:0/4217190379 >> 172.21.15.38:0/4217190379 conn(0x55f9b63e8460 msgr2=0x55f9b679c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- 172.21.15.38:0/4217190379 shutdown_connections 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- 172.21.15.38:0/4217190379 wait complete. 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.835+0000 7f4d58e8c740 1 -- start start 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 Processor -- start 2024-09-21T06:29:35.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b681eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1abb60 con 0x55f9b63d3390 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1acfd0 con 0x55f9b63cb1b0 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1ac230 con 0x55f9b63f4070 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d58e8c740 10 client.0 _ll_register_callbacks cb 0x7f4d3c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48858/0 (socket says 172.21.15.38:48858) 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 -- 172.21.15.38:0/3898269782 learned_addr learned my addr 172.21.15.38:0/3898269782 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b681eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 -- 172.21.15.38:0/3898269782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 msgr2=0x55f9b681eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b681eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 -- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 msgr2=0x55f9b67b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4bfff640 1 -- 172.21.15.38:0/3898269782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b681f1b0 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.836+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b681eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d4bfff640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x55f9b67bd880 tx=0x7f4d3c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500ae5c8b6bd5e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004020 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4d3c0041c0 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d40016050 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4d3c0043c0 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 10 client.18447 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9b6827700 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d40016050 con 0x55f9b63d3390 2024-09-21T06:29:35.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4d3c0047a0 con 0x55f9b63d3390 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 10 client.18447 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 10 client.18447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 20 client.18447 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b6387da0 0x55f9b6829ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 4 client.18447 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.837+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9b670f8a0 con 0x55f9b6387da0 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.838+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b6387da0 0x55f9b6829ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.838+0000 7f4d4b7fe640 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b6387da0 0x55f9b6829ef0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3225df37e02ce4ed server_cookie=32c6375f1ba255d7 in_seq=0 out_seq=0 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.838+0000 7f4d2b7fe640 10 client.18447 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d2b7fe640 1 -- 172.21.15.38:0/3898269782 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9b670f8a0 con 0x55f9b6387da0 2024-09-21T06:29:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d2b7fe640 10 client.18447 handle_command_reply: tid=0 2024-09-21T06:29:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 client.18447 shutdown 2024-09-21T06:29:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 msgr2=0x55f9b67b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x55f9b67bd880 tx=0x7f4d3c00afd0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 shutdown_connections 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55f9b6387da0 0x55f9b6829ef0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d2b7fe640 0 client.18447 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f9b63f4070 0x55f9b681eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f9b63d3390 0x55f9b67b14f0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 --2- 172.21.15.38:0/3898269782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9b63cb1b0 0x55f9b67b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 >> 172.21.15.38:0/3898269782 conn(0x55f9b63e8460 msgr2=0x55f9b67a0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 shutdown_connections 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 1 -- 172.21.15.38:0/3898269782 wait complete. 2024-09-21T06:29:35.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.839+0000 7f4d58e8c740 20 client.18447 trim_cache size 0 max 16384 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 msgr2=0x7f4d340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 0x7f4d340b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009430 tx=0x7f4d44037830 comp rx=0 tx=0).stop 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 msgr2=0x7f4d4c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4d44005e30 tx=0x7f4d44003f90 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 shutdown_connections 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d340b6680 0x7f4d340b8b90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d4c109df0 0x7f4d4c19fdc0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d4c1094a0 0x7f4d4c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 --2- 172.21.15.38:0/1619199121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d4c103b60 0x7f4d4c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 >> 172.21.15.38:0/1619199121 conn(0x7f4d4c07b850 msgr2=0x7f4d4c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 shutdown_connections 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:35.840+0000 7f4d52918640 1 -- 172.21.15.38:0/1619199121 wait complete. 2024-09-21T06:29:37.492 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:29:37.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:29:37.519 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:37 smithi038 ceph-mon[31215]: pgmap v625: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:29:37.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:37 smithi174 ceph-mon[34815]: pgmap v625: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:29:37.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:37 smithi044 ceph-mon[34369]: pgmap v625: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:29:37.765 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 -- 172.21.15.38:0/2422145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 msgr2=0x7ffb1810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/2422145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1810f540 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009ca0 tx=0x7ffb1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 -- 172.21.15.38:0/2422145826 shutdown_connections 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/2422145826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1810f540 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/2422145826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb181083c0 0x7ffb181087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/2422145826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb18102a80 0x7ffb18102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 -- 172.21.15.38:0/2422145826 >> 172.21.15.38:0/2422145826 conn(0x7ffb18079740 msgr2=0x7ffb18079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 -- 172.21.15.38:0/2422145826 shutdown_connections 2024-09-21T06:29:38.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.260+0000 7ffb1ec66640 1 -- 172.21.15.38:0/2422145826 wait complete. 2024-09-21T06:29:38.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 Processor -- start 2024-09-21T06:29:38.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 -- start start 2024-09-21T06:29:38.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb18102a80 0x7ffb1819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 0x7ffb1819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18113bb0 con 0x7ffb18108d10 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18113a30 con 0x7ffb181083c0 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.261+0000 7ffb1ec66640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18113d30 con 0x7ffb18102a80 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48880/0 (socket says 172.21.15.38:48880) 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 -- 172.21.15.38:0/3606935832 learned_addr learned my addr 172.21.15.38:0/3606935832 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 0x7ffb1819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb18102a80 0x7ffb1819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 -- 172.21.15.38:0/3606935832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb18102a80 msgr2=0x7ffb1819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb18102a80 0x7ffb1819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 -- 172.21.15.38:0/3606935832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 msgr2=0x7ffb1819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 0x7ffb1819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 -- 172.21.15.38:0/3606935832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb181a0530 con 0x7ffb18108d10 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 0x7ffb1819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1d203640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005e30 tx=0x7ffb10003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb15ffb640 1 -- 172.21.15.38:0/3606935832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10031650 con 0x7ffb18108d10 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb15ffb640 1 -- 172.21.15.38:0/3606935832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb100317f0 con 0x7ffb18108d10 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.262+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181a07c0 con 0x7ffb18108d10 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.263+0000 7ffb15ffb640 1 -- 172.21.15.38:0/3606935832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1002fac0 con 0x7ffb18108d10 2024-09-21T06:29:38.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.263+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181a6f80 con 0x7ffb18108d10 2024-09-21T06:29:38.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.265+0000 7ffb251da740 1 Processor -- start 2024-09-21T06:29:38.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb15ffb640 1 -- 172.21.15.38:0/3606935832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ffb1002fc80 con 0x7ffb18108d10 2024-09-21T06:29:38.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 -- start start 2024-09-21T06:29:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0609490 0x55ffb09d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ffb094fe60 con 0x55ffb0632350 2024-09-21T06:29:38.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffb093f290 con 0x55ffb0611670 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb251da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ffb09430a0 con 0x55ffb0609490 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48886/0 (socket says 172.21.15.38:48886) 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb17fff640 1 -- 172.21.15.38:0/3209895129 learned_addr learned my addr 172.21.15.38:0/3209895129 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0609490 0x55ffb09d9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb15ffb640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.266+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb1d203640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 -- 172.21.15.38:0/3209895129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0609490 msgr2=0x55ffb09d9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0609490 0x55ffb09d9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 -- 172.21.15.38:0/3209895129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 msgr2=0x55ffb09d9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09d9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 -- 172.21.15.38:0/3209895129 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb069d930 con 0x55ffb0632350 2024-09-21T06:29:38.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb15ffb640 1 -- 172.21.15.38:0/3606935832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7ffb10108a60 con 0x7ffb18108d10 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb17fff640 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0135d0 tx=0x7ffb0c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d146509d7acee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffafeffd640 1 -- 172.21.15.38:0/3209895129 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c019030 con 0x55ffb0632350 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffb1d203640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 0x7ffb000b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb10088150 tx=0x7ffb10003f70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffafeffd640 1 -- 172.21.15.38:0/3209895129 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c0035f0 con 0x55ffb0632350 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.267+0000 7ffafeffd640 1 -- 172.21.15.38:0/3209895129 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c011720 con 0x55ffb0632350 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 -- 172.21.15.38:0/3209895129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 msgr2=0x55ffb09d9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0135d0 tx=0x7ffb0c00b670 comp rx=0 tx=0).stop 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 -- 172.21.15.38:0/3209895129 shutdown_connections 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0609490 0x55ffb09d9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 --2- 172.21.15.38:0/3209895129 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0632350 0x55ffb09d9430 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 -- 172.21.15.38:0/3209895129 >> 172.21.15.38:0/3209895129 conn(0x55ffb0626740 msgr2=0x55ffb09d7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 -- 172.21.15.38:0/3209895129 shutdown_connections 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.268+0000 7ffb251da740 1 -- 172.21.15.38:0/3209895129 wait complete. 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 -- start start 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 Processor -- start 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55ffb07a0890 con 0x55ffb0609490 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffb08d9d40 con 0x55ffb0611670 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ffb09ebf70 con 0x55ffb0632350 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb251da740 10 client.0 _ll_register_callbacks cb 0x55ffb093dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48894/0 (socket says 172.21.15.38:48894) 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.269+0000 7ffb17fff640 1 -- 172.21.15.38:0/1918769725 learned_addr learned my addr 172.21.15.38:0/1918769725 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:38.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 -- 172.21.15.38:0/1918769725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 msgr2=0x55ffb09f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 -- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 msgr2=0x55ffb09e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 -- 172.21.15.38:0/1918769725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb09f5840 con 0x55ffb0609490 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb17fff640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b640 tx=0x7ffb0c004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb97f23efae8a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffaf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c022020 con 0x55ffb0609490 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7ffb0c003bb0 con 0x55ffb0609490 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c0035f0 con 0x55ffb0609490 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c032050 con 0x55ffb0609490 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb251da740 10 client.18459 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:38.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.270+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ffb09f8140 con 0x55ffb0609490 2024-09-21T06:29:38.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c0035f0 con 0x55ffb0609490 2024-09-21T06:29:38.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffb0c01e4f0 con 0x55ffb0609490 2024-09-21T06:29:38.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 10 client.18459 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:38.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 20 client.18459 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05f0cd0 0x55ffb09fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 4 client.18459 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffb0951db0 con 0x55ffb05f0cd0 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.271+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05f0cd0 0x55ffb09fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.272+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05f0cd0 0x55ffb09fb550 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd834dbe18c01637 server_cookie=3336f5da6db2987e in_seq=0 out_seq=0 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.272+0000 7ffaf7fff640 10 client.18459 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.272+0000 7ffaf7fff640 1 -- 172.21.15.38:0/1918769725 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffb0951db0 con 0x55ffb05f0cd0 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.272+0000 7ffaf7fff640 10 client.18459 handle_command_reply: tid=0 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 client.18459 shutdown 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 msgr2=0x55ffb09e9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b640 tx=0x7ffb0c004560 comp rx=0 tx=0).stop 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 shutdown_connections 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05f0cd0 0x55ffb09fb550 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffaf7fff640 0 client.18459 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 --2- 172.21.15.38:0/1918769725 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09e9370 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 >> 172.21.15.38:0/1918769725 conn(0x55ffb0626740 msgr2=0x55ffb09d5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 shutdown_connections 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 1 -- 172.21.15.38:0/1918769725 wait complete. 2024-09-21T06:29:38.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.273+0000 7ffb251da740 20 client.18459 trim_cache size 0 max 16384 2024-09-21T06:29:38.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 Processor -- start 2024-09-21T06:29:38.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 -- start start 2024-09-21T06:29:38.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181afe30 con 0x55ffb0609490 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181ad700 con 0x55ffb0611670 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb251da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181ab570 con 0x55ffb0632350 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48904/0 (socket says 172.21.15.38:48904) 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 -- 172.21.15.38:0/4268044395 learned_addr learned my addr 172.21.15.38:0/4268044395 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 -- 172.21.15.38:0/4268044395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 msgr2=0x55ffb09eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 -- 172.21.15.38:0/4268044395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 msgr2=0x55ffb09e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb17fff640 1 -- 172.21.15.38:0/4268044395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb09d1520 con 0x55ffb0609490 2024-09-21T06:29:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.291+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.292+0000 7ffb17fff640 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b6f0 tx=0x7ffb0c005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4193cac5957cf774 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.292+0000 7ffafe7fc640 1 -- 172.21.15.38:0/4268044395 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c022070 con 0x55ffb0609490 2024-09-21T06:29:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.292+0000 7ffafe7fc640 1 -- 172.21.15.38:0/4268044395 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c023040 con 0x55ffb0609490 2024-09-21T06:29:38.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.292+0000 7ffafe7fc640 1 -- 172.21.15.38:0/4268044395 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c019050 con 0x55ffb0609490 2024-09-21T06:29:38.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- 172.21.15.38:0/4268044395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 msgr2=0x55ffb09dae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b6f0 tx=0x7ffb0c005d10 comp rx=0 tx=0).stop 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- 172.21.15.38:0/4268044395 shutdown_connections 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0611670 0x55ffb09e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 --2- 172.21.15.38:0/4268044395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0609490 0x55ffb09dae20 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- 172.21.15.38:0/4268044395 >> 172.21.15.38:0/4268044395 conn(0x55ffb0626740 msgr2=0x55ffb09ea690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- 172.21.15.38:0/4268044395 shutdown_connections 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- 172.21.15.38:0/4268044395 wait complete. 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 -- start start 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.293+0000 7ffb251da740 1 Processor -- start 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0609490 0x55ffb09ed350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181abbc0 con 0x55ffb0611670 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181ad030 con 0x55ffb0609490 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181ac290 con 0x55ffb0632350 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb251da740 10 client.0 _ll_register_callbacks cb 0x7ffb08009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48910/0 (socket says 172.21.15.38:48910) 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 -- 172.21.15.38:0/2922693395 learned_addr learned my addr 172.21.15.38:0/2922693395 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb17fff640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0609490 0x55ffb09ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb17fff640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 -- 172.21.15.38:0/2922693395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 msgr2=0x55ffb09eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 -- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0609490 msgr2=0x55ffb09ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0609490 0x55ffb09ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 -- 172.21.15.38:0/2922693395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb0a64ee0 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb17fff640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffb1ca02640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009c70 tx=0x7ffb080128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e88c3ef519237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.294+0000 7ffaf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0802a060 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7ffb080035f0 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c023040 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffb080037f0 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 10 client.18465 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ffb0a66180 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c023040 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffb0801fb50 con 0x55ffb0611670 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 10 client.18465 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 10 client.18465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 20 client.18465 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:38.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05c6080 0x55ffb0a68920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:38.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 4 client.18465 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:29:38.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.295+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ffb094d860 con 0x55ffb05c6080 2024-09-21T06:29:38.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.296+0000 7ffb17fff640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05c6080 0x55ffb0a68920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:38.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.296+0000 7ffb17fff640 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05c6080 0x55ffb0a68920 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34af0dcaced3a56 server_cookie=cd61172a0cee934c in_seq=0 out_seq=0 2024-09-21T06:29:38.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.296+0000 7ffaf7fff640 10 client.18465 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffaf7fff640 1 -- 172.21.15.38:0/2922693395 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ffb094d860 con 0x55ffb05c6080 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffaf7fff640 10 client.18465 handle_command_reply: tid=0 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 client.18465 shutdown 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 msgr2=0x55ffb09ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009c70 tx=0x7ffb080128e0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 shutdown_connections 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55ffb05c6080 0x55ffb0a68920 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ffb0632350 0x55ffb09eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ffb0611670 0x55ffb09ed890 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 --2- 172.21.15.38:0/2922693395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffb0609490 0x55ffb09ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 >> 172.21.15.38:0/2922693395 conn(0x55ffb0626740 msgr2=0x55ffb09d6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffaf7fff640 0 client.18465 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 shutdown_connections 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.298+0000 7ffb251da740 1 -- 172.21.15.38:0/2922693395 wait complete. 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb251da740 20 client.18465 trim_cache size 0 max 16384 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a95c39bf-aa3e-4d02-ae4a-2076e9650234", 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2024-09-21T06:29:38.303 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:38.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 msgr2=0x7ffb000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 0x7ffb000b8b90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb10088150 tx=0x7ffb10003f70 comp rx=0 tx=0).stop 2024-09-21T06:29:38.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 msgr2=0x7ffb1819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:38.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7ffb10005e30 tx=0x7ffb10003d80 comp rx=0 tx=0).stop 2024-09-21T06:29:38.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 shutdown_connections 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7ffb000b6680 0x7ffb000b8b90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18108d10 0x7ffb1819fe00 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb181083c0 0x7ffb1819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 --2- 172.21.15.38:0/3606935832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb18102a80 0x7ffb1819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 >> 172.21.15.38:0/3606935832 conn(0x7ffb18079740 msgr2=0x7ffb181043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 shutdown_connections 2024-09-21T06:29:38.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:38.299+0000 7ffb1ec66640 1 -- 172.21.15.38:0/3606935832 wait complete. 2024-09-21T06:29:38.923 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:29:39.224 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:39.500 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:39 smithi038 ceph-mon[31215]: pgmap v626: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:29:39.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:39 smithi174 ceph-mon[34815]: pgmap v626: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:29:39.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:39 smithi044 ceph-mon[34369]: pgmap v626: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:29:39.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/1260895065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 msgr2=0x7f9f88102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/1260895065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f88102ef0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009900 tx=0x7f9f7002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/1260895065 shutdown_connections 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/1260895065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 0x7f9f8810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/1260895065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f881087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/1260895065 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f88102ef0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/1260895065 >> 172.21.15.38:0/1260895065 conn(0x7f9f88079760 msgr2=0x7f9f88079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/1260895065 shutdown_connections 2024-09-21T06:29:39.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.715+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/1260895065 wait complete. 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 Processor -- start 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 -- start start 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f8819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 0x7f9f8819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88113be0 con 0x7f9f88102ae0 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88113a60 con 0x7f9f88108d20 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8cbeb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88113d60 con 0x7f9f881083d0 2024-09-21T06:29:39.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55472/0 (socket says 172.21.15.38:55472) 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 -- 172.21.15.38:0/2966003631 learned_addr learned my addr 172.21.15.38:0/2966003631 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 0x7f9f8819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f8819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 -- 172.21.15.38:0/2966003631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 msgr2=0x7f9f8819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f8819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 -- 172.21.15.38:0/2966003631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 msgr2=0x7f9f8819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.716+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 0x7f9f8819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f8659c640 1 -- 172.21.15.38:0/2966003631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f881a04a0 con 0x7f9f88102ae0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f8819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005ab0 tx=0x7f9f700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f7f7fe640 1 -- 172.21.15.38:0/2966003631 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7003f030 con 0x7f9f88102ae0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f881a0730 con 0x7f9f88102ae0 2024-09-21T06:29:39.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f7f7fe640 1 -- 172.21.15.38:0/2966003631 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f70003cd0 con 0x7f9f88102ae0 2024-09-21T06:29:39.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f7f7fe640 1 -- 172.21.15.38:0/2966003631 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70035070 con 0x7f9f88102ae0 2024-09-21T06:29:39.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.717+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f881a6ef0 con 0x7f9f88102ae0 2024-09-21T06:29:39.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 Processor -- start 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 -- start start 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f7f7fe640 1 -- 172.21.15.38:0/2966003631 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9f70042030 con 0x7f9f88102ae0 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b7db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 0x557ea5b7e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557ea5af3e50 con 0x557ea57d6070 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ea5ae3280 con 0x557ea57b5390 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f9315f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557ea5ae7090 con 0x557ea57ad1b0 2024-09-21T06:29:39.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.720+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55486/0 (socket says 172.21.15.38:55486) 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 -- 172.21.15.38:0/2842898552 learned_addr learned my addr 172.21.15.38:0/2842898552 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b7db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 0x557ea5b7e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 -- 172.21.15.38:0/2842898552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 msgr2=0x557ea5b7db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b7db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 -- 172.21.15.38:0/2842898552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 msgr2=0x557ea5b7e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 0x557ea5b7e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 -- 172.21.15.38:0/2842898552 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea5841650 con 0x557ea57d6070 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 0x557ea5b7e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9f800039f0 tx=0x7f9f80003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c16f9eec08a9f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f7f7fe640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 0x7f9f740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f7cff9640 1 -- 172.21.15.38:0/2842898552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001a470 con 0x557ea57d6070 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f7cff9640 1 -- 172.21.15.38:0/2842898552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f80015070 con 0x557ea57d6070 2024-09-21T06:29:39.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.721+0000 7f9f7cff9640 1 -- 172.21.15.38:0/2842898552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80010780 con 0x557ea57d6070 2024-09-21T06:29:39.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f7f7fe640 1 -- 172.21.15.38:0/2966003631 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f70107bf0 con 0x7f9f88102ae0 2024-09-21T06:29:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 -- 172.21.15.38:0/2842898552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 msgr2=0x557ea5b7d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9f800039f0 tx=0x7f9f80003eb0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 0x7f9f740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 -- 172.21.15.38:0/2842898552 shutdown_connections 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57b5390 0x557ea5b7e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b7db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 --2- 172.21.15.38:0/2842898552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b7d650 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.722+0000 7f9f9315f740 1 -- 172.21.15.38:0/2842898552 >> 172.21.15.38:0/2842898552 conn(0x557ea57ca460 msgr2=0x557ea5b7b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- 172.21.15.38:0/2842898552 shutdown_connections 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- 172.21.15.38:0/2842898552 wait complete. 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f8659c640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 0x7f9f740b8b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9f70105440 tx=0x7f9f7002a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- start start 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 Processor -- start 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57ad1b0 0x557ea5b8d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b8d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x557ea5944700 con 0x557ea57d6070 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557ea5a7e110 con 0x557ea57ad1b0 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557ea5b90190 con 0x557ea57b5390 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.723+0000 7f9f9315f740 10 client.0 _ll_register_callbacks cb 0x557ea5a97990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55488/0 (socket says 172.21.15.38:55488) 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 -- 172.21.15.38:0/3856236828 learned_addr learned my addr 172.21.15.38:0/3856236828 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b8d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57ad1b0 0x557ea5b8d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 -- 172.21.15.38:0/3856236828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 msgr2=0x557ea5b8d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b8d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 -- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57ad1b0 msgr2=0x557ea5b8d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57ad1b0 0x557ea5b8d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 -- 172.21.15.38:0/3856236828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea5aabc40 con 0x557ea57d6070 2024-09-21T06:29:39.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005c00 tx=0x7f9f80010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd162aab0041ac2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001f030 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f80011980 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.724+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f80015070 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f80010520 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 10 client.18477 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ea5b9be80 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f80015070 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9f8001a6a0 con 0x557ea57d6070 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 10 client.18477 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 10 client.18477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 20 client.18477 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea57949f0 0x557ea5b9f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 4 client.18477 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:29:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ea5af5da0 con 0x557ea57949f0 2024-09-21T06:29:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.725+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea57949f0 0x557ea5b9f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.726+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea57949f0 0x557ea5b9f2f0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c831fd077449bf server_cookie=20a8c2604c3ff48c in_seq=0 out_seq=0 2024-09-21T06:29:39.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.726+0000 7f9f6dffb640 10 client.18477 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f6dffb640 1 -- 172.21.15.38:0/3856236828 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ea5af5da0 con 0x557ea57949f0 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f6dffb640 10 client.18477 handle_command_reply: tid=0 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 client.18477 shutdown 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 msgr2=0x557ea5b8db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005c00 tx=0x7f9f80010440 comp rx=0 tx=0).stop 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 shutdown_connections 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57d6070 0x557ea5b8db50 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea57949f0 0x557ea5b9f2f0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b8d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 --2- 172.21.15.38:0/3856236828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57ad1b0 0x557ea5b8d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f6dffb640 0 client.18477 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 >> 172.21.15.38:0/3856236828 conn(0x557ea57ca460 msgr2=0x557ea5b79b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 shutdown_connections 2024-09-21T06:29:39.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 1 -- 172.21.15.38:0/3856236828 wait complete. 2024-09-21T06:29:39.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.727+0000 7f9f9315f740 20 client.18477 trim_cache size 0 max 16384 2024-09-21T06:29:39.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 Processor -- start 2024-09-21T06:29:39.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 -- start start 2024-09-21T06:29:39.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b8ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881afda0 con 0x557ea57b5390 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ad670 con 0x557ea57d6070 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f9315f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ab4e0 con 0x557ea57ad1b0 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55502/0 (socket says 172.21.15.38:55502) 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 -- 172.21.15.38:0/1718387979 learned_addr learned my addr 172.21.15.38:0/1718387979 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b8ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 -- 172.21.15.38:0/1718387979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 msgr2=0x557ea5b8ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b8ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 -- 172.21.15.38:0/1718387979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 msgr2=0x557ea5b82f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b82f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f85d9b640 1 -- 172.21.15.38:0/1718387979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ea5b993f0 con 0x557ea57b5390 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.745+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b82f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9f780058c0 tx=0x7f9f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f4a5d7d198f8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f6ffff640 1 -- 172.21.15.38:0/1718387979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78014190 con 0x557ea57b5390 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f6ffff640 1 -- 172.21.15.38:0/1718387979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f780054f0 con 0x557ea57b5390 2024-09-21T06:29:39.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f6ffff640 1 -- 172.21.15.38:0/1718387979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78011760 con 0x557ea57b5390 2024-09-21T06:29:39.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f9315f740 1 -- 172.21.15.38:0/1718387979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 msgr2=0x557ea5b7e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.746+0000 7f9f9315f740 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9f780058c0 tx=0x7f9f780046c0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 -- 172.21.15.38:0/1718387979 shutdown_connections 2024-09-21T06:29:39.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b82f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57b5390 0x557ea5b7e680 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 --2- 172.21.15.38:0/1718387979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57ad1b0 0x557ea5b8ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 -- 172.21.15.38:0/1718387979 >> 172.21.15.38:0/1718387979 conn(0x557ea57ca460 msgr2=0x557ea5b827f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 -- 172.21.15.38:0/1718387979 shutdown_connections 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 -- 172.21.15.38:0/1718387979 wait complete. 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 -- start start 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 Processor -- start 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.747+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b91060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b915a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881abb30 con 0x557ea57ad1b0 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881acfa0 con 0x557ea57d6070 2024-09-21T06:29:39.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ac200 con 0x557ea57b5390 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 10 client.0 _ll_register_callbacks cb 0x7f9f80009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55504/0 (socket says 172.21.15.38:55504) 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 -- 172.21.15.38:0/4187362231 learned_addr learned my addr 172.21.15.38:0/4187362231 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b91060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 -- 172.21.15.38:0/4187362231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 msgr2=0x557ea5b91060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b91060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 -- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 msgr2=0x557ea5b915a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b915a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 -- 172.21.15.38:0/4187362231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ea5b91ce0 con 0x557ea57ad1b0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f86d9d640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f9f80004410 tx=0x7f9f80011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df390dd33894af19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001f040 con 0x557ea57ad1b0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f780054f0 con 0x557ea57ad1b0 2024-09-21T06:29:39.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.748+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f9f80011b90 con 0x557ea57ad1b0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f8001a470 con 0x557ea57ad1b0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 10 client.18483 fetch_fsmap learned FSMap version 34 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ea5c09920 con 0x557ea57ad1b0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9f780054f0 con 0x557ea57ad1b0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9f80029430 con 0x557ea57ad1b0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 10 client.18483 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 10 client.18483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 20 client.18483 populate_metadata read hostname 'smithi038' 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea5769da0 0x557ea5c0c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 4 client.18483 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ea5af1850 con 0x557ea5769da0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.749+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea5769da0 0x557ea5c0c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f85d9b640 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea5769da0 0x557ea5c0c000 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1193486df2a38d7a server_cookie=3daa5f60820eb5f2 in_seq=0 out_seq=0 2024-09-21T06:29:39.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f6dffb640 10 client.18483 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f6dffb640 1 -- 172.21.15.38:0/4187362231 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8238 (crc 0 0 0) 0x557ea5af1850 con 0x557ea5769da0 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f6dffb640 10 client.18483 handle_command_reply: tid=0 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 client.18483 shutdown 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 msgr2=0x557ea5b95bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f9f80004410 tx=0x7f9f80011ea0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 shutdown_connections 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557ea57d6070 0x557ea5b915a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x557ea5769da0 0x557ea5c0c000 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557ea57b5390 0x557ea5b91060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 --2- 172.21.15.38:0/4187362231 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557ea57ad1b0 0x557ea5b95bb0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f6dffb640 0 client.18483 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 >> 172.21.15.38:0/4187362231 conn(0x557ea57ca460 msgr2=0x557ea5b831b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.750+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 shutdown_connections 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f9315f740 1 -- 172.21.15.38:0/4187362231 wait complete. 2024-09-21T06:29:39.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f9315f740 20 client.18483 trim_cache size 0 max 16384 2024-09-21T06:29:39.757 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:29:39.757 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:29:39.757 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2024-09-21T06:29:39.757 INFO:teuthology.orchestra.run.smithi038.stdout: "a95c39bf-aa3e-4d02-ae4a-2076e9650234": { 2024-09-21T06:29:39.757 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "a95c39bf-aa3e-4d02-ae4a-2076e9650234", 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "75a9e3b9-81b4-4dfc-92ed-38f82ef0a592": { 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:17.616723+0000", 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.758 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.759 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.761 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.762 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "a879a378-0472-405a-9891-3e8f77e97d82": { 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:07.217872+0000", 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.763 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.764 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "871e6bd0-0aff-496e-a3c0-df537c4e6cb9": { 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:28.047574+0000", 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.765 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:29:39.766 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.768 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.769 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.770 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:29:39.771 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:29:39.772 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.773 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "a95c39bf-aa3e-4d02-ae4a-2076e9650234": { 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:38.296427+0000", 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 msgr2=0x7f9f740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 0x7f9f740b8b90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9f70105440 tx=0x7f9f7002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:39.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 msgr2=0x7f9f8819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005ab0 tx=0x7f9f700042f0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 shutdown_connections 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f9f740b6680 0x7f9f740b8b90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f88108d20 0x7f9f8819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f881083d0 0x7f9f8819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 --2- 172.21.15.38:0/2966003631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9f88102ae0 0x7f9f8819a530 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 >> 172.21.15.38:0/2966003631 conn(0x7f9f88079760 msgr2=0x7f9f88101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 shutdown_connections 2024-09-21T06:29:39.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:39.751+0000 7f9f8cbeb640 1 -- 172.21.15.38:0/2966003631 wait complete. 2024-09-21T06:29:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:40 smithi038 ceph-mon[31215]: scrub queued for path: / 2024-09-21T06:29:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:40 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:40 smithi038 ceph-mon[31215]: scrub summary: active paths [/] 2024-09-21T06:29:40.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:40 smithi038 ceph-mon[31215]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:40.518 INFO:tasks.cephfs.filesystem:scrub status for tag:a95c39bf-aa3e-4d02-ae4a-2076e9650234 - {'path': '/', 'tag': 'a95c39bf-aa3e-4d02-ae4a-2076e9650234', 'options': 'recursive,force'} 2024-09-21T06:29:40.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:40 smithi174 ceph-mon[34815]: scrub queued for path: / 2024-09-21T06:29:40.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:40 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:40.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:40 smithi174 ceph-mon[34815]: scrub summary: active paths [/] 2024-09-21T06:29:40.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:40 smithi174 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:40 smithi044 ceph-mon[34369]: scrub queued for path: / 2024-09-21T06:29:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:40 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:40 smithi044 ceph-mon[34369]: scrub summary: active paths [/] 2024-09-21T06:29:40.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:40 smithi044 ceph-mon[34369]: scrub summary: idle+waiting paths [/] 2024-09-21T06:29:41.587 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:41 smithi038 ceph-mon[31215]: pgmap v627: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:41.588 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:29:41.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:41 smithi174 ceph-mon[34815]: pgmap v627: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:41.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:41 smithi044 ceph-mon[34369]: pgmap v627: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6 op/s 2024-09-21T06:29:41.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 -- 172.21.15.38:0/2440548966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 msgr2=0x7f4d181105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2440548966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d181105b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009900 tx=0x7f4d1002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:41.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 -- 172.21.15.38:0/2440548966 shutdown_connections 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2440548966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d181105b0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2440548966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18109430 0x7f4d18109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2440548966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18103b00 0x7f4d18103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.715+0000 7f4d1f194640 1 -- 172.21.15.38:0/2440548966 >> 172.21.15.38:0/2440548966 conn(0x7f4d180ff500 msgr2=0x7f4d18101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 -- 172.21.15.38:0/2440548966 shutdown_connections 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 -- 172.21.15.38:0/2440548966 wait complete. 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 Processor -- start 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 -- start start 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18103b00 0x7f4d1819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.716+0000 7f4d1f194640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18109430 0x7f4d1819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1f194640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1f194640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18113bb0 con 0x7f4d18109d80 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1f194640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18113a30 con 0x7f4d18103b00 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1f194640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18113d30 con 0x7f4d18109430 2024-09-21T06:29:41.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55528/0 (socket says 172.21.15.38:55528) 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 -- 172.21.15.38:0/2740134488 learned_addr learned my addr 172.21.15.38:0/2740134488 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1cf30640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18103b00 0x7f4d1819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d17fff640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18109430 0x7f4d1819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 -- 172.21.15.38:0/2740134488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18109430 msgr2=0x7f4d1819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18109430 0x7f4d1819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 -- 172.21.15.38:0/2740134488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18103b00 msgr2=0x7f4d1819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18103b00 0x7f4d1819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 -- 172.21.15.38:0/2740134488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d181a0430 con 0x7f4d18109d80 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1d731640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4d100314b0 tx=0x7f4d10003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1003f070 con 0x7f4d18109d80 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d10031be0 con 0x7f4d18109d80 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d181a06c0 con 0x7f4d18109d80 2024-09-21T06:29:41.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.717+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10035030 con 0x7f4d18109d80 2024-09-21T06:29:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.718+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181a0bb0 con 0x7f4d18109d80 2024-09-21T06:29:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.719+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d18103f10 con 0x7f4d18109d80 2024-09-21T06:29:41.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.721+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d10042070 con 0x7f4d18109d80 2024-09-21T06:29:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.721+0000 7f4d15ffb640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 0x7f4d040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.722+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f4d10108480 con 0x7f4d18109d80 2024-09-21T06:29:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.722+0000 7f4d1cf30640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 0x7f4d040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:41.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.722+0000 7f4d1cf30640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 0x7f4d040b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000abe0 tx=0x7f4d0000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:41.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.725+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d100cea20 con 0x7f4d18109d80 2024-09-21T06:29:41.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.934+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4d18063800 con 0x7f4d040b6680 2024-09-21T06:29:41.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.943+0000 7f4d15ffb640 1 -- 172.21.15.38:0/2740134488 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f4d18063800 con 0x7f4d040b6680 2024-09-21T06:29:41.945 INFO:teuthology.orchestra.run.smithi038.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:19:39", "first": "2024-09-21T06:20:00", "last": "2024-09-21T06:29:00", "last_pruned": "2024-09-21T06:29:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T06:29:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 msgr2=0x7f4d040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 0x7f4d040b8b90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000abe0 tx=0x7f4d0000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 msgr2=0x7f4d1819fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4d100314b0 tx=0x7f4d10003b90 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 shutdown_connections 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.945+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4d040b6680 0x7f4d040b8b90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d18109d80 0x7f4d1819fdc0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d18109430 0x7f4d1819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 --2- 172.21.15.38:0/2740134488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d18103b00 0x7f4d1819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 >> 172.21.15.38:0/2740134488 conn(0x7f4d180ff500 msgr2=0x7f4d18106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 shutdown_connections 2024-09-21T06:29:41.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:41.946+0000 7f4d1f194640 1 -- 172.21.15.38:0/2740134488 wait complete. 2024-09-21T06:29:41.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:29:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 -- 172.21.15.38:0/2024884003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85881029b0 msgr2=0x7f8588102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 --2- 172.21.15.38:0/2024884003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85881029b0 0x7f8588102dc0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8578009900 tx=0x7f857802a410 comp rx=0 tx=0).stop 2024-09-21T06:29:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 -- 172.21.15.38:0/2024884003 shutdown_connections 2024-09-21T06:29:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 --2- 172.21.15.38:0/2024884003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8588108c30 0x7f858810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 --2- 172.21.15.38:0/2024884003 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881082e0 0x7f85881086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 --2- 172.21.15.38:0/2024884003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f85881029b0 0x7f8588102dc0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 -- 172.21.15.38:0/2024884003 >> 172.21.15.38:0/2024884003 conn(0x7f858807a740 msgr2=0x7f858807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 -- 172.21.15.38:0/2024884003 shutdown_connections 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.072+0000 7f858e2a2640 1 -- 172.21.15.38:0/2024884003 wait complete. 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 Processor -- start 2024-09-21T06:29:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 -- start start 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 0x7f85881994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85881082e0 0x7f8588199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f8588112a60 con 0x7f8588108c30 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85881128e0 con 0x7f85881082e0 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858e2a2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8588112be0 con 0x7f85881029b0 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858c83f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858c83f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55554/0 (socket says 172.21.15.38:55554) 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.073+0000 7f858c83f640 1 -- 172.21.15.38:0/4258831566 learned_addr learned my addr 172.21.15.38:0/4258831566 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f8587fff640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 0x7f85881994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f85877fe640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85881082e0 0x7f8588199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 -- 172.21.15.38:0/4258831566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 msgr2=0x7f85881994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 0x7f85881994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 -- 172.21.15.38:0/4258831566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85881082e0 msgr2=0x7f8588199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85881082e0 0x7f8588199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 -- 172.21.15.38:0/4258831566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858819f410 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f8587fff640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 0x7f85881994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858c83f640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f858000efd0 tx=0x7f858000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580003b70 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8580003d10 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858819f700 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580010990 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.074+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85881a5e90 con 0x7f8588108c30 2024-09-21T06:29:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.075+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8588102dc0 con 0x7f8588108c30 2024-09-21T06:29:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.077+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8580004b40 con 0x7f8588108c30 2024-09-21T06:29:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.077+0000 7f85857fa640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 0x7f85700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.078+0000 7f8587fff640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 0x7f85700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.078+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f85800e7fc0 con 0x7f8588108c30 2024-09-21T06:29:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.078+0000 7f8587fff640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 0x7f85700b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8578000c00 tx=0x7f8578005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:42.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.081+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85800ae560 con 0x7f8588108c30 2024-09-21T06:29:42.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.291+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 --> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f858810aa60 con 0x7f85700b6680 2024-09-21T06:29:42.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.298+0000 7f85857fa640 1 -- 172.21.15.38:0/4258831566 <== mgr.14223 v2:172.21.15.38:6800/4178988721 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f858810aa60 con 0x7f85700b6680 2024-09-21T06:29:42.300 INFO:teuthology.orchestra.run.smithi038.stdout:/ 1m 6m3h 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 msgr2=0x7f85700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 0x7f85700b8b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8578000c00 tx=0x7f8578005a20 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 msgr2=0x7f858819ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f858000efd0 tx=0x7f858000c6a0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 shutdown_connections 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f85700b6680 0x7f85700b8b90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8588108c30 0x7f858819ed10 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85881082e0 0x7f8588199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 --2- 172.21.15.38:0/4258831566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85881029b0 0x7f85881994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:42.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 >> 172.21.15.38:0/4258831566 conn(0x7f858807a740 msgr2=0x7f85881063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:42.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 shutdown_connections 2024-09-21T06:29:42.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:29:42.301+0000 7f858e2a2640 1 -- 172.21.15.38:0/4258831566 wait complete. 2024-09-21T06:29:42.314 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T06:29:42.325 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T06:29:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:43 smithi174 ceph-mon[34815]: pgmap v628: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-21T06:29:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:43 smithi174 ceph-mon[34815]: from='client.18489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:43.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:43 smithi174 ceph-mon[34815]: from='client.18495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:43 smithi044 ceph-mon[34369]: pgmap v628: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-21T06:29:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:43 smithi044 ceph-mon[34369]: from='client.18489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:43.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:43 smithi044 ceph-mon[34369]: from='client.18495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:43.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:43 smithi038 ceph-mon[31215]: pgmap v628: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-21T06:29:43.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:43 smithi038 ceph-mon[31215]: from='client.18489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:43.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:43 smithi038 ceph-mon[31215]: from='client.18495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:44.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:44 smithi174 ceph-mon[34815]: scrub summary: idle 2024-09-21T06:29:44.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:44 smithi044 ceph-mon[34369]: scrub summary: idle 2024-09-21T06:29:44.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:44 smithi038 ceph-mon[31215]: scrub summary: idle 2024-09-21T06:29:45.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:45 smithi174 ceph-mon[34815]: pgmap v629: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:45.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:45 smithi044 ceph-mon[34369]: pgmap v629: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:45.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:45 smithi038 ceph-mon[31215]: pgmap v629: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:29:47.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:47 smithi174 ceph-mon[34815]: pgmap v630: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:47.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:47 smithi044 ceph-mon[34369]: pgmap v630: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:47.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:47 smithi038 ceph-mon[31215]: pgmap v630: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:49.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:49 smithi174 ceph-mon[34815]: pgmap v631: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T06:29:49.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:49 smithi044 ceph-mon[34369]: pgmap v631: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T06:29:49.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:49 smithi038 ceph-mon[31215]: pgmap v631: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-21T06:29:51.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:51 smithi174 ceph-mon[34815]: pgmap v632: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:51.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:51 smithi044 ceph-mon[34369]: pgmap v632: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:51.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:51 smithi038 ceph-mon[31215]: pgmap v632: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:53.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:53 smithi174 ceph-mon[34815]: pgmap v633: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:29:53.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:53 smithi044 ceph-mon[34369]: pgmap v633: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:29:53.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:53 smithi038 ceph-mon[31215]: pgmap v633: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T06:29:55.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:55 smithi174 ceph-mon[34815]: pgmap v634: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:55.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:55 smithi044 ceph-mon[34369]: pgmap v634: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:55.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:55 smithi038 ceph-mon[31215]: pgmap v634: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:29:57.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:57 smithi174 ceph-mon[34815]: pgmap v635: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:29:57.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:57 smithi044 ceph-mon[34369]: pgmap v635: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:29:57.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:57 smithi038 ceph-mon[31215]: pgmap v635: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:29:59.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:29:59 smithi174 ceph-mon[34815]: pgmap v636: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:29:59.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:29:59 smithi044 ceph-mon[34369]: pgmap v636: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:29:59.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:29:59 smithi038 ceph-mon[31215]: pgmap v636: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:30:00.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:00 smithi174 ceph-mon[34815]: overall HEALTH_OK 2024-09-21T06:30:00.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:00 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:00 smithi044 ceph-mon[34369]: overall HEALTH_OK 2024-09-21T06:30:00.655 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:00 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:00.668 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:00 smithi038 ceph-mon[31215]: overall HEALTH_OK 2024-09-21T06:30:00.668 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:00 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:01.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:01 smithi174 ceph-mon[34815]: pgmap v637: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:01.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:01 smithi044 ceph-mon[34369]: pgmap v637: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:01.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:01 smithi038 ceph-mon[31215]: pgmap v637: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:02.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:02.737 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:02 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:02.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:02 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:02.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:02 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' 2024-09-21T06:30:03.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:03 smithi174 ceph-mon[34815]: pgmap v638: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:30:03.906 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:03 smithi044 ceph-mon[34369]: pgmap v638: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:30:03.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:03 smithi038 ceph-mon[31215]: pgmap v638: 97 pgs: 97 active+clean; 67 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:30:05.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:05 smithi174 ceph-mon[34815]: pgmap v639: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-21T06:30:05.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:05 smithi044 ceph-mon[34369]: pgmap v639: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-21T06:30:05.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:05 smithi038 ceph-mon[31215]: pgmap v639: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-09-21T06:30:07.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:07 smithi174 ceph-mon[34815]: pgmap v640: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:30:07.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:07 smithi044 ceph-mon[34369]: pgmap v640: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:30:07.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:07 smithi038 ceph-mon[31215]: pgmap v640: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:30:09.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:09 smithi174 ceph-mon[34815]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:30:09.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:09 smithi174 ceph-mon[34815]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:30:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:09 smithi044 ceph-mon[34369]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:30:09.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:09 smithi044 ceph-mon[34369]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:30:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:09 smithi038 ceph-mon[31215]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:30:09.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:09 smithi038 ceph-mon[31215]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:30:10.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:30:10.791 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:11.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 -- 172.21.15.38:0/4184101340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c1020e0 msgr2=0x7f4e9c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/4184101340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c1024f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009900 tx=0x7f4e8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 -- 172.21.15.38:0/4184101340 shutdown_connections 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/4184101340 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c106c20 0x7f4e9c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/4184101340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1062d0 0x7f4e9c1066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/4184101340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c1024f0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 -- 172.21.15.38:0/4184101340 >> 172.21.15.38:0/4184101340 conn(0x7f4e9c079e40 msgr2=0x7f4e9c07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 -- 172.21.15.38:0/4184101340 shutdown_connections 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.254+0000 7f4ea0e88640 1 -- 172.21.15.38:0/4184101340 wait complete. 2024-09-21T06:30:11.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 Processor -- start 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 -- start start 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c1062d0 0x7f4e9c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c113be0 con 0x7f4e9c106c20 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c113a60 con 0x7f4e9c1020e0 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4ea0e88640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c113d60 con 0x7f4e9c1062d0 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50888/0 (socket says 172.21.15.38:50888) 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 -- 172.21.15.38:0/504625816 learned_addr learned my addr 172.21.15.38:0/504625816 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c1062d0 0x7f4e9c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 -- 172.21.15.38:0/504625816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c1062d0 msgr2=0x7f4e9c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c1062d0 0x7f4e9c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 -- 172.21.15.38:0/504625816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1020e0 msgr2=0x7f4e9c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.255+0000 7f4e9ad9d640 1 -- 172.21.15.38:0/504625816 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c1a2700 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400eb10 tx=0x7f4e9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/504625816 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94004b20 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/504625816 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e94004cc0 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c1a29f0 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/504625816 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94010720 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.256+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c1a9150 con 0x7f4e9c106c20 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.260+0000 7f4ea73fc740 1 Processor -- start 2024-09-21T06:30:11.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/504625816 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4e94005020 con 0x7f4e9c106c20 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 -- start start 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e4351b0 0x55951e805b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e8060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55951e77be50 con 0x55951e45e070 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55951e76b280 con 0x55951e4351b0 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.261+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55951e76f090 con 0x55951e43d390 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50898/0 (socket says 172.21.15.38:50898) 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 -- 172.21.15.38:0/1275459590 learned_addr learned my addr 172.21.15.38:0/1275459590 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e4351b0 0x55951e805b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e8060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 -- 172.21.15.38:0/1275459590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 msgr2=0x55951e8060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e8060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 -- 172.21.15.38:0/1275459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e4351b0 msgr2=0x55951e805b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e4351b0 0x55951e805b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 -- 172.21.15.38:0/1275459590 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951e4c9650 con 0x55951e45e070 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e8b7fe640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 0x7f4e840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f4e90012790 tx=0x7f4e9000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d272ce73962b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.262+0000 7f4e8b7fe640 1 -- 172.21.15.38:0/504625816 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f4e940e7cd0 con 0x7f4e9c106c20 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.263+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 0x7f4e840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.263+0000 7f4e88ff9640 1 -- 172.21.15.38:0/1275459590 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012dd0 con 0x55951e45e070 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.263+0000 7f4e88ff9640 1 -- 172.21.15.38:0/1275459590 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e90012080 con 0x55951e45e070 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.263+0000 7f4e88ff9640 1 -- 172.21.15.38:0/1275459590 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000edd0 con 0x55951e45e070 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1275459590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 msgr2=0x55951e805650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 0x7f4e840b8c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009230 tx=0x7f4e8c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f4e90012790 tx=0x7f4e9000b390 comp rx=0 tx=0).stop 2024-09-21T06:30:11.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1275459590 shutdown_connections 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e8060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e4351b0 0x55951e805b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1275459590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e805650 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1275459590 >> 172.21.15.38:0/1275459590 conn(0x55951e452460 msgr2=0x55951e803540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1275459590 shutdown_connections 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1275459590 wait complete. 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.264+0000 7f4ea73fc740 1 -- start start 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 Processor -- start 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e810d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e81d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x55951e5cc700 con 0x55951e45e070 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55951e706110 con 0x55951e43d390 2024-09-21T06:30:11.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55951e813e30 con 0x55951e4351b0 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4ea73fc740 10 client.0 _ll_register_callbacks cb 0x55951e71f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e9a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e810d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e9ad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e81d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:35974/0 (socket says 172.21.15.38:35974) 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e9a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e810d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.38:38440/0 (socket says 172.21.15.38:38440) 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 -- 172.21.15.38:0/3288488594 learned_addr learned my addr 172.21.15.38:0/3288488594 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 -- 172.21.15.38:0/3288488594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 msgr2=0x55951e810d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e810d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 -- 172.21.15.38:0/3288488594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 msgr2=0x55951e81d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e81d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.265+0000 7f4e99d9b640 1 -- 172.21.15.38:0/3288488594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951e733c40 con 0x55951e43d390 2024-09-21T06:30:11.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e81d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000e910 tx=0x7f4e900045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0cc219af0377ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012230 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e90012080 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f4e90005030 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4e9002d050 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4ea73fc740 10 client.27734 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.266+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55951e81fb40 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e90012080 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4e90004bf0 con 0x55951e43d390 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 10 client.27734 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 10 client.27734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 20 client.27734 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:11.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e41c9f0 0x55951e822ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 4 client.27734 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:11.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55951e77dda0 con 0x55951e41c9f0 2024-09-21T06:30:11.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.267+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e41c9f0 0x55951e822ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.268+0000 7f4e81ffb640 10 client.27734 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.268+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e41c9f0 0x55951e822ea0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06acf2286e23fce server_cookie=2acb2007d01bc7dc in_seq=0 out_seq=0 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.268+0000 7f4e81ffb640 1 -- 172.21.15.38:0/3288488594 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55951e77dda0 con 0x55951e41c9f0 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.268+0000 7f4e81ffb640 10 client.27734 handle_command_reply: tid=0 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.268+0000 7f4ea73fc740 1 client.27734 shutdown 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 msgr2=0x55951e811280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000e910 tx=0x7f4e900045b0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 shutdown_connections 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e45e070 0x55951e81d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e43d390 0x55951e811280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e41c9f0 0x55951e822ea0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/3288488594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e810d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4e81ffb640 0 client.27734 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 >> 172.21.15.38:0/3288488594 conn(0x55951e452460 msgr2=0x55951e808830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 shutdown_connections 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 1 -- 172.21.15.38:0/3288488594 wait complete. 2024-09-21T06:30:11.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.269+0000 7f4ea73fc740 20 client.27734 trim_cache size 0 max 16384 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.286+0000 7f4ea73fc740 1 Processor -- start 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.286+0000 7f4ea73fc740 1 -- start start 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e80c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e81d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b4210 con 0x55951e43d390 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b1ae0 con 0x55951e45e070 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1af950 con 0x55951e4351b0 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50906/0 (socket says 172.21.15.38:50906) 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 -- 172.21.15.38:0/2250581318 learned_addr learned my addr 172.21.15.38:0/2250581318 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e80c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e81d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 -- 172.21.15.38:0/2250581318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 msgr2=0x55951e80c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e80c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 -- 172.21.15.38:0/2250581318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 msgr2=0x55951e81d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e81d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.287+0000 7f4e99d9b640 1 -- 172.21.15.38:0/2250581318 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951e80f240 con 0x55951e43d390 2024-09-21T06:30:11.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4e900107c0 tx=0x7f4e900107f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64736216148d4ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4e83fff640 1 -- 172.21.15.38:0/2250581318 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000bad0 con 0x55951e43d390 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4e83fff640 1 -- 172.21.15.38:0/2250581318 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e90036020 con 0x55951e43d390 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4e83fff640 1 -- 172.21.15.38:0/2250581318 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012080 con 0x55951e43d390 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4ea73fc740 1 -- 172.21.15.38:0/2250581318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 msgr2=0x55951e806d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.288+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4e900107c0 tx=0x7f4e900107f0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- 172.21.15.38:0/2250581318 shutdown_connections 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e81d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e43d390 0x55951e806d90 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/2250581318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e4351b0 0x55951e80c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- 172.21.15.38:0/2250581318 >> 172.21.15.38:0/2250581318 conn(0x55951e452460 msgr2=0x55951e806680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- 172.21.15.38:0/2250581318 shutdown_connections 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- 172.21.15.38:0/2250581318 wait complete. 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- start start 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 Processor -- start 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e819ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e814b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1affa0 con 0x55951e4351b0 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b1410 con 0x55951e45e070 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.289+0000 7f4ea73fc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b0670 con 0x55951e43d390 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4ea73fc740 10 client.0 _ll_register_callbacks cb 0x7f4e8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50916/0 (socket says 172.21.15.38:50916) 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 -- 172.21.15.38:0/1292471609 learned_addr learned my addr 172.21.15.38:0/1292471609 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:11.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9ad9d640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e814b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e819ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 -- 172.21.15.38:0/1292471609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 msgr2=0x55951e819ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e819ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 -- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 msgr2=0x55951e814b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e814b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 -- 172.21.15.38:0/1292471609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951e815300 con 0x55951e4351b0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e819ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e9a59c640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c032fd0 tx=0x7f4e8c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366b04987e4d6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c05f060 con 0x55951e4351b0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f4e8c0035f0 con 0x55951e4351b0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.290+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e90036020 con 0x55951e4351b0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4e8c035040 con 0x55951e4351b0 2024-09-21T06:30:11.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 10 client.18513 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55951e88d390 con 0x55951e4351b0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e90036020 con 0x55951e4351b0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4e8c059070 con 0x55951e4351b0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 10 client.18513 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 10 client.18513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 20 client.18513 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e3f1da0 0x55951e88fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 4 client.18513 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55951e779850 con 0x55951e3f1da0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.291+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e3f1da0 0x55951e88fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4e81ffb640 10 client.18513 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4e99d9b640 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e3f1da0 0x55951e88fb30 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=720caf2d7550a8f server_cookie=b61d1d670a78fcc4 in_seq=0 out_seq=0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4e81ffb640 1 -- 172.21.15.38:0/1292471609 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8042 (crc 0 0 0) 0x55951e779850 con 0x55951e3f1da0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4e81ffb640 10 client.18513 handle_command_reply: tid=0 2024-09-21T06:30:11.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 client.18513 shutdown 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 msgr2=0x55951e819510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c032fd0 tx=0x7f4e8c009260 comp rx=0 tx=0).stop 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 shutdown_connections 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55951e45e070 0x55951e814b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x55951e3f1da0 0x55951e88fb30 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55951e43d390 0x55951e819ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 --2- 172.21.15.38:0/1292471609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55951e4351b0 0x55951e819510 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 >> 172.21.15.38:0/1292471609 conn(0x55951e452460 msgr2=0x55951e806680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4e81ffb640 0 client.18513 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 shutdown_connections 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 1 -- 172.21.15.38:0/1292471609 wait complete. 2024-09-21T06:30:11.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.292+0000 7f4ea73fc740 20 client.18513 trim_cache size 0 max 16384 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {}, 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_stats": { 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "75a9e3b9-81b4-4dfc-92ed-38f82ef0a592": { 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:17.616723+0000", 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "dc9a4de9-c5d6-4e9b-a91a-ebe55ebc4c3d": { 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:47.308158+0000", 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "1709a48e-fb32-45cb-a7dd-e37e839a45a5": { 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:37.281302+0000", 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.301 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "ebac8ec8-b5e3-4aeb-aec5-ec921f791c3d": { 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:45.328045+0000", 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "11957ca1-5032-432a-abc6-8183a74e5c82": { 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:52.585799+0000", 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.302 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "e2a19825-79ac-4efb-b1ac-68ac5b225b50": { 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:42.618941+0000", 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "a879a378-0472-405a-9891-3e8f77e97d82": { 2024-09-21T06:30:11.303 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:07.217872+0000", 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "44214bd5-b452-43e8-8096-757e3e46aa97": { 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:32.666083+0000", 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.304 INFO:teuthology.orchestra.run.smithi038.stdout: "944b1ed9-2cab-4266-b8ac-235a1b44fbfb": { 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:19:40.226020+0000", 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "871e6bd0-0aff-496e-a3c0-df537c4e6cb9": { 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:28.047574+0000", 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "866bb5c6-3cde-4cbd-958a-7d308dc68dac": { 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:56.943020+0000", 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "a731b352-00be-4974-8b5a-144773b28336": { 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:22.819406+0000", 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.306 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "deeae389-f623-4887-9b46-5fbab1e9858b": { 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:20:33.994245+0000", 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "35bee73d-349c-4edf-b605-479b745044b2": { 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:21:18.041610+0000", 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.307 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "154f3245-8d5b-4a68-b835-86b6199c35ba": { 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:28:27.327444+0000", 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "5200e6e3-2912-474b-a40a-e79b2b144851": { 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:27:03.306645+0000", 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.308 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "a30f7bb4-b898-470a-8e19-29d90dda54d9": { 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:22.914223+0000", 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "c9d0ce09-15ac-453f-8dfd-01525a60349a": { 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:01.492984+0000", 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.309 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "cfe6246a-cfbc-4d5b-93df-8465c32cabff": { 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:23:25.494773+0000", 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "065314d2-be68-48ef-a133-ae9d6104dd56": { 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:22:43.501379+0000", 2024-09-21T06:30:11.310 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "d4479779-ee77-40df-91a5-049be9f3de7a": { 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:07.423170+0000", 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "b873fa6b-504a-4971-89b8-6ffa0a1b827c": { 2024-09-21T06:30:11.311 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:17.894019+0000", 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "402d740f-2038-4de8-aa8d-8566296d8cd3": { 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:12.529372+0000", 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.312 INFO:teuthology.orchestra.run.smithi038.stdout: "d6ff5cbc-6a97-4b82-bbe5-5043be4cd68e": { 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:24:28.678864+0000", 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "b7c768bc-9171-42b5-acea-7c082800993a": { 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:10.366263+0000", 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.313 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "a2da322f-d1ba-4e07-98ba-07e91d47351e": { 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:25:51.948667+0000", 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "a95c39bf-aa3e-4d02-ae4a-2076e9650234": { 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:29:38.296427+0000", 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.314 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "23dae03e-9c5a-40a1-8db9-220615a22fa9": { 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "start_time": "2024-09-21T06:26:02.180520+0000", 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_started": 0, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_passed": 0, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_failed": 0, 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: "uninline_skipped": 0 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:11.315 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 msgr2=0x7f4e840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 0x7f4e840b8c10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009230 tx=0x7f4e8c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 msgr2=0x7f4e9c1a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400eb10 tx=0x7f4e9400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 shutdown_connections 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f4e840b6700 0x7f4e840b8c10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4e9c106c20 0x7f4e9c1a1fd0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e9c1062d0 0x7f4e9c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 --2- 172.21.15.38:0/504625816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e9c1020e0 0x7f4e9c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 >> 172.21.15.38:0/504625816 conn(0x7f4e9c079e40 msgr2=0x7f4e9c107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 shutdown_connections 2024-09-21T06:30:11.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:11.293+0000 7f4ea0e88640 1 -- 172.21.15.38:0/504625816 wait complete. 2024-09-21T06:30:11.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:11 smithi174 ceph-mon[34815]: pgmap v643: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:11.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:11 smithi044 ceph-mon[34369]: pgmap v643: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:11.927 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:11 smithi038 ceph-mon[31215]: pgmap v643: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:12.064 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:30:12.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:30:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:12.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 -- 172.21.15.38:0/3924841648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 msgr2=0x7fb2541087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 --2- 172.21.15.38:0/3924841648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb2541087e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb248009900 tx=0x7fb24802a410 comp rx=0 tx=0).stop 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 -- 172.21.15.38:0/3924841648 shutdown_connections 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 --2- 172.21.15.38:0/3924841648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 0x7fb25410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 --2- 172.21.15.38:0/3924841648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb2541087e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 --2- 172.21.15.38:0/3924841648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 0x7fb254102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 -- 172.21.15.38:0/3924841648 >> 172.21.15.38:0/3924841648 conn(0x7fb254079790 msgr2=0x7fb254079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 -- 172.21.15.38:0/3924841648 shutdown_connections 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.761+0000 7fb258907640 1 -- 172.21.15.38:0/3924841648 wait complete. 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 Processor -- start 2024-09-21T06:30:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 -- start start 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 0x7fb25419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 0x7fb25419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb254112b00 con 0x7fb2541083d0 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb254112980 con 0x7fb254108d20 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb258907640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb254112c80 con 0x7fb254102ae0 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb251d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb251d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50934/0 (socket says 172.21.15.38:50934) 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb251d9b640 1 -- 172.21.15.38:0/1481477349 learned_addr learned my addr 172.21.15.38:0/1481477349 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb25259c640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 0x7fb25419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.762+0000 7fb252d9d640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 0x7fb25419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 -- 172.21.15.38:0/1481477349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 msgr2=0x7fb25419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 0x7fb25419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 -- 172.21.15.38:0/1481477349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 msgr2=0x7fb25419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 0x7fb25419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 -- 172.21.15.38:0/1481477349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541a6620 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb251d9b640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fb248005940 tx=0x7fb2480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24803f030 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb248031910 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541a68b0 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248035070 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.763+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541a6d90 con 0x7fb2541083d0 2024-09-21T06:30:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.764+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb254103d10 con 0x7fb2541083d0 2024-09-21T06:30:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.766+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb248042030 con 0x7fb2541083d0 2024-09-21T06:30:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.767+0000 7fb2437fe640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 0x7fb23c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.767+0000 7fb25259c640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 0x7fb23c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.767+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7fb248107d50 con 0x7fb2541083d0 2024-09-21T06:30:12.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.767+0000 7fb25259c640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 0x7fb23c0b8bc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb25406c680 tx=0x7fb244009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:12.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.770+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb2480d26a0 con 0x7fb2541083d0 2024-09-21T06:30:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.994+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb254102ef0 con 0x7fb2541083d0 2024-09-21T06:30:12.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.995+0000 7fb2437fe640 1 -- 172.21.15.38:0/1481477349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fb254102ef0 con 0x7fb2541083d0 2024-09-21T06:30:12.997 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:12.997 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:30:12.997 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 msgr2=0x7fb23c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 0x7fb23c0b8bc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb25406c680 tx=0x7fb244009680 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 msgr2=0x7fb25419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fb248005940 tx=0x7fb2480042f0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 shutdown_connections 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb23c0b66b0 0x7fb23c0b8bc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb254108d20 0x7fb25419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2541083d0 0x7fb25419b8d0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 --2- 172.21.15.38:0/1481477349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254102ae0 0x7fb25419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 >> 172.21.15.38:0/1481477349 conn(0x7fb254079790 msgr2=0x7fb254106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 shutdown_connections 2024-09-21T06:30:12.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:12.997+0000 7fb258907640 1 -- 172.21.15.38:0/1481477349 wait complete. 2024-09-21T06:30:13.643 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:13 smithi038 ceph-mon[31215]: pgmap v644: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:13.643 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:13 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1481477349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:13.674 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:30:13.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:13 smithi174 ceph-mon[34815]: pgmap v644: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:13.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:13 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1481477349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:13 smithi044 ceph-mon[34369]: pgmap v644: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:30:13.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:13 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1481477349' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:13.934 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 -- 172.21.15.38:0/1836548649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57641049e0 msgr2=0x7f5764104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 --2- 172.21.15.38:0/1836548649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57641049e0 0x7f5764104df0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f575c009900 tx=0x7f575c02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 -- 172.21.15.38:0/1836548649 shutdown_connections 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 --2- 172.21.15.38:0/1836548649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f5764110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 --2- 172.21.15.38:0/1836548649 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5764105330 0x7f576410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 --2- 172.21.15.38:0/1836548649 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57641049e0 0x7f5764104df0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 -- 172.21.15.38:0/1836548649 >> 172.21.15.38:0/1836548649 conn(0x7f5764079750 msgr2=0x7f5764079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 -- 172.21.15.38:0/1836548649 shutdown_connections 2024-09-21T06:30:14.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.330+0000 7f5768e64640 1 -- 172.21.15.38:0/1836548649 wait complete. 2024-09-21T06:30:14.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 Processor -- start 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 -- start start 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57641049e0 0x7f5764102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f57641031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f5764113be0 con 0x7f5764105330 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5764113a60 con 0x7f576410de40 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.331+0000 7f5768e64640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5764113d60 con 0x7f57641049e0 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50966/0 (socket says 172.21.15.38:50966) 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 -- 172.21.15.38:0/2835576398 learned_addr learned my addr 172.21.15.38:0/2835576398 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f576259c640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57641049e0 0x7f5764102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5762d9d640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f57641031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 -- 172.21.15.38:0/2835576398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57641049e0 msgr2=0x7f5764102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57641049e0 0x7f5764102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 -- 172.21.15.38:0/2835576398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 msgr2=0x7f57641031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f57641031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 -- 172.21.15.38:0/2835576398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57641a88d0 con 0x7f5764105330 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5762d9d640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f57641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f574c00d740 tx=0x7f574c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f575b7fe640 1 -- 172.21.15.38:0/2835576398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c017070 con 0x7f5764105330 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57641a8bc0 con 0x7f5764105330 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f575b7fe640 1 -- 172.21.15.38:0/2835576398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f574c00de50 con 0x7f5764105330 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f575b7fe640 1 -- 172.21.15.38:0/2835576398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00f620 con 0x7f5764105330 2024-09-21T06:30:14.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.332+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57641a9150 con 0x7f5764105330 2024-09-21T06:30:14.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.335+0000 7f576f3d8740 1 Processor -- start 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 -- start start 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f575b7fe640 1 -- 172.21.15.38:0/2835576398 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f574c01a070 con 0x7f5764105330 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d0499be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d049a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5582d040fea0 con 0x5582d00f2070 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582d03ff2d0 con 0x5582d00c91b0 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576f3d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5582d04030e0 con 0x5582d00d1390 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f5762d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f5761d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d049a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f5762d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50972/0 (socket says 172.21.15.38:50972) 2024-09-21T06:30:14.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f5762d9d640 1 -- 172.21.15.38:0/3049388612 learned_addr learned my addr 172.21.15.38:0/3049388612 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:14.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.336+0000 7f576259c640 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d0499be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 -- 172.21.15.38:0/3049388612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 msgr2=0x5582d049a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d049a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 -- 172.21.15.38:0/3049388612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 msgr2=0x5582d0499be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d0499be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 -- 172.21.15.38:0/3049388612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d015d650 con 0x5582d00f2070 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5762d9d640 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5754009f10 tx=0x7f575400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93b405b5d133ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f575b7fe640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 0x7f57500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5758ff9640 1 -- 172.21.15.38:0/3049388612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754003b70 con 0x5582d00f2070 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f576259c640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 0x7f57500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f575b7fe640 1 -- 172.21.15.38:0/2835576398 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f574c0e7210 con 0x7f5764105330 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5758ff9640 1 -- 172.21.15.38:0/3049388612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5754003d10 con 0x5582d00f2070 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.337+0000 7f5758ff9640 1 -- 172.21.15.38:0/3049388612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540119a0 con 0x5582d00f2070 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 -- 172.21.15.38:0/3049388612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 msgr2=0x5582d04996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576259c640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 0x7f57500b8c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f575c009230 tx=0x7f575c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f5754009f10 tx=0x7f575400f730 comp rx=0 tx=0).stop 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 -- 172.21.15.38:0/3049388612 shutdown_connections 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d049a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d0499be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 --2- 172.21.15.38:0/3049388612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04996a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 -- 172.21.15.38:0/3049388612 >> 172.21.15.38:0/3049388612 conn(0x5582d00e6460 msgr2=0x5582d0497590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 -- 172.21.15.38:0/3049388612 shutdown_connections 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.338+0000 7f576f3d8740 1 -- 172.21.15.38:0/3049388612 wait complete. 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 -- start start 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 Processor -- start 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d04a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d04a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x5582d0260700 con 0x5582d00f2070 2024-09-21T06:30:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582d039a160 con 0x5582d00c91b0 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5582d04a7e80 con 0x5582d00d1390 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576f3d8740 10 client.0 _ll_register_callbacks cb 0x5582d03b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f5762d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f5762d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50978/0 (socket says 172.21.15.38:50978) 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f576259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d04a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.339+0000 7f5762d9d640 1 -- 172.21.15.38:0/2756717891 learned_addr learned my addr 172.21.15.38:0/2756717891 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d04a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 -- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 msgr2=0x5582d04a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d04a52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 -- 172.21.15.38:0/2756717891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 msgr2=0x5582d04a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d04a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 -- 172.21.15.38:0/2756717891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d03c7c90 con 0x5582d00f2070 2024-09-21T06:30:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5762d9d640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f5754011480 tx=0x7f5754009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff534a176d0a016 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5749ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754004a40 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f5754004be0 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5754003d10 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5754004de0 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f576f3d8740 10 client.18531 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.340+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5582d04b3b90 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5754003d10 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f575402c020 con 0x5582d00f2070 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 10 client.18531 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 10 client.18531 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 20 client.18531 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d00b09f0 0x5582d04b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 4 client.18531 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582d0411df0 con 0x5582d00b09f0 2024-09-21T06:30:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.341+0000 7f576259c640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d00b09f0 0x5582d04b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.342+0000 7f5749ffb640 10 client.18531 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:30:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.342+0000 7f576259c640 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d00b09f0 0x5582d04b6fa0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cefc706b0282a4bc server_cookie=67d90e3217052ed in_seq=0 out_seq=0 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.342+0000 7f5749ffb640 1 -- 172.21.15.38:0/2756717891 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582d0411df0 con 0x5582d00b09f0 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f5749ffb640 10 client.18531 handle_command_reply: tid=0 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 client.18531 shutdown 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 msgr2=0x5582d04b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f5754011480 tx=0x7f5754009cd0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 shutdown_connections 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d00b09f0 0x5582d04b6fa0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00f2070 0x5582d04b1170 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00d1390 0x5582d04a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2756717891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00c91b0 0x5582d04a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 >> 172.21.15.38:0/2756717891 conn(0x5582d00e6460 msgr2=0x5582d049c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f5749ffb640 0 client.18531 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 shutdown_connections 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 1 -- 172.21.15.38:0/2756717891 wait complete. 2024-09-21T06:30:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.343+0000 7f576f3d8740 20 client.18531 trim_cache size 0 max 16384 2024-09-21T06:30:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.356+0000 7f576f3d8740 1 Processor -- start 2024-09-21T06:30:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 -- start start 2024-09-21T06:30:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00c91b0 0x5582d04a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00f2070 0x5582d0497100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f57641b4410 con 0x5582d00d1390 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57641b1ce0 con 0x5582d00f2070 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576f3d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57641afb50 con 0x5582d00c91b0 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50994/0 (socket says 172.21.15.38:50994) 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 -- 172.21.15.38:0/2689362110 learned_addr learned my addr 172.21.15.38:0/2689362110 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f576259c640 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00c91b0 0x5582d04a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 -- 172.21.15.38:0/2689362110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00c91b0 msgr2=0x5582d04a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00c91b0 0x5582d04a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 -- 172.21.15.38:0/2689362110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00f2070 msgr2=0x5582d0497100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00f2070 0x5582d0497100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 -- 172.21.15.38:0/2689362110 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d04a6070 con 0x5582d00d1390 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.357+0000 7f5761d9b640 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f574c0e48c0 tx=0x7f574c0eac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f78fe01c309794 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f574bfff640 1 -- 172.21.15.38:0/2689362110 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c021040 con 0x5582d00d1390 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f574bfff640 1 -- 172.21.15.38:0/2689362110 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f574c0acb30 con 0x5582d00d1390 2024-09-21T06:30:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f574bfff640 1 -- 172.21.15.38:0/2689362110 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0a9290 con 0x5582d00d1390 2024-09-21T06:30:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 -- 172.21.15.38:0/2689362110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 msgr2=0x5582d0496bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f574c0e48c0 tx=0x7f574c0eac40 comp rx=0 tx=0).stop 2024-09-21T06:30:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 -- 172.21.15.38:0/2689362110 shutdown_connections 2024-09-21T06:30:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00f2070 0x5582d0497100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00d1390 0x5582d0496bc0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 --2- 172.21.15.38:0/2689362110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00c91b0 0x5582d04a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.358+0000 7f576f3d8740 1 -- 172.21.15.38:0/2689362110 >> 172.21.15.38:0/2689362110 conn(0x5582d00e6460 msgr2=0x5582d04a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- 172.21.15.38:0/2689362110 shutdown_connections 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- 172.21.15.38:0/2689362110 wait complete. 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- start start 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 Processor -- start 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00d1390 0x5582d04b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00f2070 0x5582d04b8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f57641b01a0 con 0x5582d00c91b0 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57641b1610 con 0x5582d00d1390 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.359+0000 7f576f3d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57641b0870 con 0x5582d00f2070 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576f3d8740 10 client.0 _ll_register_callbacks cb 0x7f5754015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51000/0 (socket says 172.21.15.38:51000) 2024-09-21T06:30:14.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 -- 172.21.15.38:0/13957523 learned_addr learned my addr 172.21.15.38:0/13957523 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f5762d9d640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00f2070 0x5582d04b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f5761d9b640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00d1390 0x5582d04b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 -- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00f2070 msgr2=0x5582d04b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00f2070 0x5582d04b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 -- 172.21.15.38:0/13957523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00d1390 msgr2=0x5582d04b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00d1390 0x5582d04b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 -- 172.21.15.38:0/13957523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d04b8c10 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576259c640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f576406c980 tx=0x7f575c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce985b59aed8a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f5749ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c035040 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f575c004450 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.360+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f574c0acb30 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f575c05f050 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 10 client.18537 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5582d0521860 con 0x5582d00c91b0 2024-09-21T06:30:14.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f574c0acb30 con 0x5582d00c91b0 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f575c004bc0 con 0x5582d00c91b0 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 10 client.18537 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 10 client.18537 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 20 client.18537 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d0085da0 0x5582d0524080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 4 client.18537 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 --> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582d040d8a0 con 0x5582d0085da0 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.361+0000 7f5761d9b640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d0085da0 0x5582d0524080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f5761d9b640 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d0085da0 0x5582d0524080 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=428ab53336d2c498 server_cookie=8550a7c6cf2d672b in_seq=0 out_seq=0 2024-09-21T06:30:14.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f5749ffb640 10 client.18537 ms_handle_connect on v2:172.21.15.174:6838/2335561806 2024-09-21T06:30:14.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f5749ffb640 1 -- 172.21.15.38:0/13957523 <== mds.2 v2:172.21.15.174:6838/2335561806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582d040d8a0 con 0x5582d0085da0 2024-09-21T06:30:14.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f5749ffb640 10 client.18537 handle_command_reply: tid=0 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 client.18537 shutdown 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 msgr2=0x5582d04ba910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f576406c980 tx=0x7f575c009260 comp rx=0 tx=0).stop 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 shutdown_connections 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:6838/2335561806,v1:172.21.15.174:6839/2335561806] conn(0x5582d0085da0 0x5582d0524080 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5582d00f2070 0x5582d04b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582d00d1390 0x5582d04b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 --2- 172.21.15.38:0/13957523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5582d00c91b0 0x5582d04ba910 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 >> 172.21.15.38:0/13957523 conn(0x5582d00e6460 msgr2=0x5582d049aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f5749ffb640 0 client.18537 ms_handle_reset on v2:172.21.15.174:6838/2335561806 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.362+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 shutdown_connections 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f576f3d8740 1 -- 172.21.15.38:0/13957523 wait complete. 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f576f3d8740 20 client.18537 trim_cache size 0 max 16384 2024-09-21T06:30:14.368 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 msgr2=0x7f57500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 0x7f57500b8c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f575c009230 tx=0x7f575c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 msgr2=0x7f5764102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f574c00d740 tx=0x7f574c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 shutdown_connections 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f57500b6700 0x7f57500b8c10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f576410de40 0x7f57641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5764105330 0x7f5764102c60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 --2- 172.21.15.38:0/2835576398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57641049e0 0x7f5764102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 >> 172.21.15.38:0/2835576398 conn(0x7f5764079750 msgr2=0x7f57640ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 shutdown_connections 2024-09-21T06:30:14.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:14.363+0000 7f5768e64640 1 -- 172.21.15.38:0/2835576398 wait complete. 2024-09-21T06:30:15.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:30:15.338 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:15.730 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:15 smithi038 ceph-mon[31215]: pgmap v645: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:30:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.762+0000 7f71e098f640 1 -- 172.21.15.38:0/3040207478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc108d10 msgr2=0x7f71dc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.762+0000 7f71e098f640 1 --2- 172.21.15.38:0/3040207478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc108d10 0x7f71dc10f540 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009ca0 tx=0x7f71d402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 -- 172.21.15.38:0/3040207478 shutdown_connections 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 --2- 172.21.15.38:0/3040207478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc108d10 0x7f71dc10f540 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 --2- 172.21.15.38:0/3040207478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc1083c0 0x7f71dc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 --2- 172.21.15.38:0/3040207478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc102ad0 0x7f71dc102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 -- 172.21.15.38:0/3040207478 >> 172.21.15.38:0/3040207478 conn(0x7f71dc0796d0 msgr2=0x7f71dc079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 -- 172.21.15.38:0/3040207478 shutdown_connections 2024-09-21T06:30:15.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.763+0000 7f71e098f640 1 -- 172.21.15.38:0/3040207478 wait complete. 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 Processor -- start 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 -- start start 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc102ad0 0x7f71dc19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc108d10 0x7f71dc19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc112af0 con 0x7f71dc1083c0 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc112970 con 0x7f71dc108d10 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71e098f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc112c70 con 0x7f71dc102ad0 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51012/0 (socket says 172.21.15.38:51012) 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1331138272 learned_addr learned my addr 172.21.15.38:0/1331138272 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71da59c640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc102ad0 0x7f71dc19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1331138272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc102ad0 msgr2=0x7f71dc19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc102ad0 0x7f71dc19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1331138272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc108d10 msgr2=0x7f71dc19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71dad9d640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc108d10 0x7f71dc19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc108d10 0x7f71dc19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.764+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1331138272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc1a0420 con 0x7f71dc1083c0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c8c0 tx=0x7f71d000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71cb7fe640 1 -- 172.21.15.38:0/1331138272 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007bb0 con 0x7f71dc1083c0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71cb7fe640 1 -- 172.21.15.38:0/1331138272 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71d0007d50 con 0x7f71dc1083c0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71dc1a0710 con 0x7f71dc1083c0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71cb7fe640 1 -- 172.21.15.38:0/1331138272 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0018770 con 0x7f71dc1083c0 2024-09-21T06:30:15.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.765+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71dc1a6f30 con 0x7f71dc1083c0 2024-09-21T06:30:15.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.767+0000 7f71e6f03740 1 Processor -- start 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 -- start start 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71cb7fe640 1 -- 172.21.15.38:0/1331138272 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f71d000f9b0 con 0x7f71dc1083c0 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e0cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e0d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558a03d82ea0 con 0x558a03a65070 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558a03d722d0 con 0x558a03a3c1b0 2024-09-21T06:30:15.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71e6f03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a03d760e0 con 0x558a03a44390 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51016/0 (socket says 172.21.15.38:51016) 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.768+0000 7f71dad9d640 1 -- 172.21.15.38:0/3277681914 learned_addr learned my addr 172.21.15.38:0/3277681914 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71da59c640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e0cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e0d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 -- 172.21.15.38:0/3277681914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 msgr2=0x558a03e0d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e0d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 -- 172.21.15.38:0/3277681914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 msgr2=0x558a03e0cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e0cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 -- 172.21.15.38:0/3277681914 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a03ad0650 con 0x558a03a65070 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e0d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71da59c640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e0cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71cb7fe640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 0x7f71c40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71dad9d640 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f71d4006010 tx=0x7f71d40099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b1613a18082222 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71da59c640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 0x7f71c40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71c8ff9640 1 -- 172.21.15.38:0/3277681914 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4003970 con 0x558a03a65070 2024-09-21T06:30:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71cb7fe640 1 -- 172.21.15.38:0/1331138272 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f71d00e7800 con 0x7f71dc1083c0 2024-09-21T06:30:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.769+0000 7f71c8ff9640 1 -- 172.21.15.38:0/3277681914 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71d4036070 con 0x558a03a65070 2024-09-21T06:30:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71c8ff9640 1 -- 172.21.15.38:0/3277681914 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004440 con 0x558a03a65070 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 -- 172.21.15.38:0/3277681914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 msgr2=0x558a03e0c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71da59c640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 0x7f71c40b8bc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x558a03e0b320 tx=0x7f71cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f71d4006010 tx=0x7f71d40099c0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 -- 172.21.15.38:0/3277681914 shutdown_connections 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e0d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e0cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 --2- 172.21.15.38:0/3277681914 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e0c6a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.770+0000 7f71e6f03740 1 -- 172.21.15.38:0/3277681914 >> 172.21.15.38:0/3277681914 conn(0x558a03a59460 msgr2=0x558a03e0a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- 172.21.15.38:0/3277681914 shutdown_connections 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- 172.21.15.38:0/3277681914 wait complete. 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- start start 2024-09-21T06:30:15.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 Processor -- start 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e17d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a44390 0x558a03e18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x558a03bd3700 con 0x558a03a65070 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558a03d0d160 con 0x558a03a44390 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558a03e1ae70 con 0x558a03a3c1b0 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.771+0000 7f71e6f03740 10 client.0 _ll_register_callbacks cb 0x558a03d269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51032/0 (socket says 172.21.15.38:51032) 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 -- 172.21.15.38:0/1520935026 learned_addr learned my addr 172.21.15.38:0/1520935026 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71da59c640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e17d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a44390 0x558a03e18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 -- 172.21.15.38:0/1520935026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 msgr2=0x558a03e17d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e17d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 -- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a44390 msgr2=0x558a03e18270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a44390 0x558a03e18270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 -- 172.21.15.38:0/1520935026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a03d3ac90 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71da59c640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e17d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71dad9d640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f71d402a900 tx=0x7f71d4032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dd26801ca14b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4051020 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f71d4031750 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.772+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d4036070 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f71d405c050 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 10 client.18549 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558a03e26ab0 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71d4036070 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f71d404c030 con 0x558a03a65070 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 10 client.18549 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 10 client.18549 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:30:15.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 20 client.18549 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a03a239f0 0x558a03e29e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 4 client.18549 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a03d84df0 con 0x558a03a239f0 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.773+0000 7f71da59c640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a03a239f0 0x558a03e29e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.774+0000 7f71da59c640 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a03a239f0 0x558a03e29e10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=759ed23bc57f3a3d server_cookie=beeed182e64169e8 in_seq=0 out_seq=0 2024-09-21T06:30:15.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.774+0000 7f71c1ffb640 10 client.18549 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71c1ffb640 1 -- 172.21.15.38:0/1520935026 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a03d84df0 con 0x558a03a239f0 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71c1ffb640 10 client.18549 handle_command_reply: tid=0 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 client.18549 shutdown 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 msgr2=0x558a03e187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f71d402a900 tx=0x7f71d4032f30 comp rx=0 tx=0).stop 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 shutdown_connections 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a03a239f0 0x558a03e29e10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e187f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a44390 0x558a03e18270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1520935026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e17d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 >> 172.21.15.38:0/1520935026 conn(0x558a03a59460 msgr2=0x558a03e0d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71c1ffb640 0 client.18549 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:30:15.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 shutdown_connections 2024-09-21T06:30:15.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 1 -- 172.21.15.38:0/1520935026 wait complete. 2024-09-21T06:30:15.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.775+0000 7f71e6f03740 20 client.18549 trim_cache size 0 max 16384 2024-09-21T06:30:15.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.788+0000 7f71e6f03740 1 Processor -- start 2024-09-21T06:30:15.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.788+0000 7f71e6f03740 1 -- start start 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.788+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e19c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a65070 0x558a03e09bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71e6f03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1b1f20 con 0x558a03a44390 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71e6f03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1af7f0 con 0x558a03a65070 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71e6f03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1ad660 con 0x558a03a3c1b0 2024-09-21T06:30:15.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51042/0 (socket says 172.21.15.38:51042) 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1345794595 learned_addr learned my addr 172.21.15.38:0/1345794595 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71dad9d640 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a65070 0x558a03e09bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71da59c640 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e19c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1345794595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 msgr2=0x558a03e19c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e19c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1345794595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a65070 msgr2=0x558a03e09bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a65070 0x558a03e09bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 -- 172.21.15.38:0/1345794595 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a03e0f500 con 0x558a03a44390 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f71d00e4f70 tx=0x7f71d000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d12b33e3948c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71c3fff640 1 -- 172.21.15.38:0/1345794595 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00e5390 con 0x558a03a44390 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71c3fff640 1 -- 172.21.15.38:0/1345794595 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71d00add10 con 0x558a03a44390 2024-09-21T06:30:15.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.789+0000 7f71c3fff640 1 -- 172.21.15.38:0/1345794595 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00b62a0 con 0x558a03a44390 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 -- 172.21.15.38:0/1345794595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 msgr2=0x558a03e0dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f71d00e4f70 tx=0x7f71d000fd80 comp rx=0 tx=0).stop 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 -- 172.21.15.38:0/1345794595 shutdown_connections 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a65070 0x558a03e09bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a44390 0x558a03e0dde0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 --2- 172.21.15.38:0/1345794595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a3c1b0 0x558a03e19c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 -- 172.21.15.38:0/1345794595 >> 172.21.15.38:0/1345794595 conn(0x558a03a59460 msgr2=0x558a03e0d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 -- 172.21.15.38:0/1345794595 shutdown_connections 2024-09-21T06:30:15.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.790+0000 7f71e6f03740 1 -- 172.21.15.38:0/1345794595 wait complete. 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 -- start start 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 Processor -- start 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e2d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e2aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1adcb0 con 0x558a03a65070 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1af120 con 0x558a03a3c1b0 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1ae380 con 0x558a03a44390 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71e6f03740 10 client.0 _ll_register_callbacks cb 0x7f71d4009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71dad9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51052/0 (socket says 172.21.15.38:51052) 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71dad9d640 1 -- 172.21.15.38:0/636714493 learned_addr learned my addr 172.21.15.38:0/636714493 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71da59c640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e2d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.791+0000 7f71d9d9b640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e2aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 -- 172.21.15.38:0/636714493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 msgr2=0x558a03e2aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e2aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 -- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 msgr2=0x558a03e2d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e2d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 -- 172.21.15.38:0/636714493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a03e2b650 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71dad9d640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f71d402ade0 tx=0x7f71d402f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e056488100c1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4051070 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f71d4031450 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d00add10 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f71d4049040 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71e6f03740 10 client.18555 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558a03e943f0 con 0x558a03a65070 2024-09-21T06:30:15.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71d00add10 con 0x558a03a65070 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.792+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f71d4067070 con 0x558a03a65070 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 10 client.18555 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 10 client.18555 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 20 client.18555 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a039f8da0 0x558a03e96c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 4 client.18555 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 --> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a03d808a0 con 0x558a039f8da0 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71da59c640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a039f8da0 0x558a03e96c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71c1ffb640 10 client.18555 ms_handle_connect on v2:172.21.15.44:6836/2962370729 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71da59c640 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a039f8da0 0x558a03e96c30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4055844bdb6c28e9 server_cookie=4fc67d91a1a567e in_seq=0 out_seq=0 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71c1ffb640 1 -- 172.21.15.38:0/636714493 <== mds.1 v2:172.21.15.44:6836/2962370729 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a03d808a0 con 0x558a039f8da0 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71c1ffb640 10 client.18555 handle_command_reply: tid=0 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.793+0000 7f71e6f03740 1 client.18555 shutdown 2024-09-21T06:30:15.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 msgr2=0x558a03e2af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f71d402ade0 tx=0x7f71d402f970 comp rx=0 tx=0).stop 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 shutdown_connections 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:6836/2962370729,v1:172.21.15.44:6837/2962370729] conn(0x558a039f8da0 0x558a03e96c30 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558a03a65070 0x558a03e2af60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558a03a44390 0x558a03e2aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 --2- 172.21.15.38:0/636714493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a03a3c1b0 0x558a03e2d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 >> 172.21.15.38:0/636714493 conn(0x558a03a59460 msgr2=0x558a03e23ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71c1ffb640 0 client.18555 ms_handle_reset on v2:172.21.15.44:6836/2962370729 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 shutdown_connections 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 1 -- 172.21.15.38:0/636714493 wait complete. 2024-09-21T06:30:15.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e6f03740 20 client.18555 trim_cache size 0 max 16384 2024-09-21T06:30:15.801 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:30:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.794+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 msgr2=0x7f71c40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 0x7f71c40b8bc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x558a03e0b320 tx=0x7f71cc00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 msgr2=0x7f71dc19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:15.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c8c0 tx=0x7f71d000ccc0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 shutdown_connections 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f71c40b66b0 0x7f71c40b8bc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc108d10 0x7f71dc19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71dc1083c0 0x7f71dc19ab10 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 --2- 172.21.15.38:0/1331138272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71dc102ad0 0x7f71dc19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 >> 172.21.15.38:0/1331138272 conn(0x7f71dc0796d0 msgr2=0x7f71dc1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 shutdown_connections 2024-09-21T06:30:15.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:15.795+0000 7f71e098f640 1 -- 172.21.15.38:0/1331138272 wait complete. 2024-09-21T06:30:15.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:15 smithi174 ceph-mon[34815]: pgmap v645: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:30:15.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:15 smithi044 ceph-mon[34369]: pgmap v645: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-09-21T06:30:16.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:30:16.708 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 -- 172.21.15.38:0/3518551347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 msgr2=0x7fe590103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 --2- 172.21.15.38:0/3518551347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe590103f70 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe580009900 tx=0x7fe58002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 -- 172.21.15.38:0/3518551347 shutdown_connections 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 --2- 172.21.15.38:0/3518551347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 0x7fe590110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 --2- 172.21.15.38:0/3518551347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 0x7fe5901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 --2- 172.21.15.38:0/3518551347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe590103f70 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 -- 172.21.15.38:0/3518551347 >> 172.21.15.38:0/3518551347 conn(0x7fe59007b850 msgr2=0x7fe59007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 -- 172.21.15.38:0/3518551347 shutdown_connections 2024-09-21T06:30:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 -- 172.21.15.38:0/3518551347 wait complete. 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.122+0000 7fe596817640 1 Processor -- start 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 -- start start 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 0x7fe59019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 0x7fe59019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe590113bd0 con 0x7fe590103b60 2024-09-21T06:30:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe590113a50 con 0x7fe5901094a0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe596817640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe590113d50 con 0x7fe590109df0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe58ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe58ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51078/0 (socket says 172.21.15.38:51078) 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe58ffff640 1 -- 172.21.15.38:0/1087452299 learned_addr learned my addr 172.21.15.38:0/1087452299 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 0x7fe59019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.123+0000 7fe594db4640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 0x7fe59019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 -- 172.21.15.38:0/1087452299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 msgr2=0x7fe59019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 0x7fe59019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 -- 172.21.15.38:0/1087452299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 msgr2=0x7fe59019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 0x7fe59019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 -- 172.21.15.38:0/1087452299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5901a04d0 con 0x7fe590103b60 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58ffff640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fe580005ab0 tx=0x7fe5800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58d7fa640 1 -- 172.21.15.38:0/1087452299 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58003f030 con 0x7fe590103b60 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5901a0760 con 0x7fe590103b60 2024-09-21T06:30:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58d7fa640 1 -- 172.21.15.38:0/1087452299 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe580003cd0 con 0x7fe590103b60 2024-09-21T06:30:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe58d7fa640 1 -- 172.21.15.38:0/1087452299 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580035070 con 0x7fe590103b60 2024-09-21T06:30:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.124+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5901a0c40 con 0x7fe590103b60 2024-09-21T06:30:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 Processor -- start 2024-09-21T06:30:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 -- start start 2024-09-21T06:30:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe58d7fa640 1 -- 172.21.15.38:0/1087452299 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe580042030 con 0x7fe590103b60 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d206be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d207120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b1d17cea0 con 0x561b1ce5f070 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b1d16c2d0 con 0x561b1ce3e390 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b1d1700e0 con 0x561b1ce361b0 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51080/0 (socket says 172.21.15.38:51080) 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.127+0000 7fe594db4640 1 -- 172.21.15.38:0/3112251765 learned_addr learned my addr 172.21.15.38:0/3112251765 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe58ffff640 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d206be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d207120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 -- 172.21.15.38:0/3112251765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 msgr2=0x561b1d206be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d206be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 -- 172.21.15.38:0/3112251765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 msgr2=0x561b1d207120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d207120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 -- 172.21.15.38:0/3112251765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1ceca650 con 0x561b1ce5f070 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe58d7fa640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 0x7fe5780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe594db4640 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe588009f90 tx=0x7fe588010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e7ae65a5380789 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe58ffff640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 0x7fe5780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe58d7fa640 1 -- 172.21.15.38:0/1087452299 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7fe580107b80 con 0x7fe590103b60 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe5767fc640 1 -- 172.21.15.38:0/3112251765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588011700 con 0x561b1ce5f070 2024-09-21T06:30:17.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe5767fc640 1 -- 172.21.15.38:0/3112251765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe588011d70 con 0x561b1ce5f070 2024-09-21T06:30:17.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.128+0000 7fe5767fc640 1 -- 172.21.15.38:0/3112251765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588019e10 con 0x561b1ce5f070 2024-09-21T06:30:17.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 -- 172.21.15.38:0/3112251765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 msgr2=0x561b1d2066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe58ffff640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 0x7fe5780b8bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe5801053a0 tx=0x7fe5800319c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe588009f90 tx=0x7fe588010860 comp rx=0 tx=0).stop 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 -- 172.21.15.38:0/3112251765 shutdown_connections 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d207120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d206be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/3112251765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d2066a0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 -- 172.21.15.38:0/3112251765 >> 172.21.15.38:0/3112251765 conn(0x561b1ce53460 msgr2=0x561b1d204590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 -- 172.21.15.38:0/3112251765 shutdown_connections 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.129+0000 7fe59cd8b740 1 -- 172.21.15.38:0/3112251765 wait complete. 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 -- start start 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 Processor -- start 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d211d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d212240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x561b1cfcd700 con 0x561b1ce5f070 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561b1d107160 con 0x561b1ce3e390 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561b1d214e80 con 0x561b1ce361b0 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe59cd8b740 10 client.0 _ll_register_callbacks cb 0x561b1d1209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51096/0 (socket says 172.21.15.38:51096) 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe594db4640 1 -- 172.21.15.38:0/763749519 learned_addr learned my addr 172.21.15.38:0/763749519 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.130+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d212240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d211d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 -- 172.21.15.38:0/763749519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 msgr2=0x561b1d211d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d211d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 -- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 msgr2=0x561b1d212240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d212240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 -- 172.21.15.38:0/763749519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1d134c90 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d212240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe594db4640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe588019870 tx=0x7fe588013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fb743bf32baa16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe56f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588003b70 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe588011d70 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.131+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7fe588003d10 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe588019e10 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 10 client.18567 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b1d224f40 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe588011d70 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe588030030 con 0x561b1ce5f070 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 10 client.18567 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 10 client.18567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 20 client.18567 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:17.137 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1ce1d9f0 0x561b1d2283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 4 client.18567 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:30:17.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b1d17edf0 con 0x561b1ce1d9f0 2024-09-21T06:30:17.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.132+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1ce1d9f0 0x561b1d2283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.133+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1ce1d9f0 0x561b1d2283b0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e83775cb815893f server_cookie=df89fd493a834988 in_seq=0 out_seq=0 2024-09-21T06:30:17.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.133+0000 7fe56f7fe640 10 client.18567 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe56f7fe640 1 -- 172.21.15.38:0/763749519 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b1d17edf0 con 0x561b1ce1d9f0 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe56f7fe640 10 client.18567 handle_command_reply: tid=0 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 client.18567 shutdown 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 msgr2=0x561b1d21e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe588019870 tx=0x7fe588013040 comp rx=0 tx=0).stop 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 shutdown_connections 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d21e170 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d212240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1ce1d9f0 0x561b1d2283b0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/763749519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d211d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe56f7fe640 0 client.18567 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 >> 172.21.15.38:0/763749519 conn(0x561b1ce53460 msgr2=0x561b1d209880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 shutdown_connections 2024-09-21T06:30:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 1 -- 172.21.15.38:0/763749519 wait complete. 2024-09-21T06:30:17.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.134+0000 7fe59cd8b740 20 client.18567 trim_cache size 0 max 16384 2024-09-21T06:30:17.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.147+0000 7fe59cd8b740 1 Processor -- start 2024-09-21T06:30:17.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.147+0000 7fe59cd8b740 1 -- start start 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d208090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d213930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901afef0 con 0x561b1ce5f070 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901ad7c0 con 0x561b1ce3e390 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901ab630 con 0x561b1ce361b0 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51104/0 (socket says 172.21.15.38:51104) 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 -- 172.21.15.38:0/1249732053 learned_addr learned my addr 172.21.15.38:0/1249732053 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d208090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d213930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 -- 172.21.15.38:0/1249732053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 msgr2=0x561b1d208090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d208090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 -- 172.21.15.38:0/1249732053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 msgr2=0x561b1d213930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d213930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 -- 172.21.15.38:0/1249732053 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1d214440 con 0x561b1ce5f070 2024-09-21T06:30:17.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.148+0000 7fe594db4640 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fe588009720 tx=0x7fe588010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d4eae6d1f68a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.150+0000 7fe575ffb640 1 -- 172.21.15.38:0/1249732053 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5880193d0 con 0x561b1ce5f070 2024-09-21T06:30:17.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.150+0000 7fe575ffb640 1 -- 172.21.15.38:0/1249732053 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe588020040 con 0x561b1ce5f070 2024-09-21T06:30:17.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.150+0000 7fe575ffb640 1 -- 172.21.15.38:0/1249732053 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588011760 con 0x561b1ce5f070 2024-09-21T06:30:17.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1249732053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 msgr2=0x561b1d203bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fe588009720 tx=0x7fe588010860 comp rx=0 tx=0).stop 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1249732053 shutdown_connections 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce5f070 0x561b1d203bc0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce3e390 0x561b1d213930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1249732053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d208090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1249732053 >> 172.21.15.38:0/1249732053 conn(0x561b1ce53460 msgr2=0x561b1d213220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1249732053 shutdown_connections 2024-09-21T06:30:17.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1249732053 wait complete. 2024-09-21T06:30:17.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.151+0000 7fe59cd8b740 1 -- start start 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 Processor -- start 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d22bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce5f070 0x561b1d229870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901abc80 con 0x561b1ce3e390 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901ad0f0 con 0x561b1ce5f070 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901ac350 con 0x561b1ce361b0 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe59cd8b740 10 client.0 _ll_register_callbacks cb 0x7fe588009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe58f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe58f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51118/0 (socket says 172.21.15.38:51118) 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe594db4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d22bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe58f7fe640 1 -- 172.21.15.38:0/1402044800 learned_addr learned my addr 172.21.15.38:0/1402044800 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.152+0000 7fe594db4640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce5f070 0x561b1d229870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 -- 172.21.15.38:0/1402044800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 msgr2=0x561b1d22bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d22bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 -- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce5f070 msgr2=0x561b1d229870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:30:17.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce5f070 0x561b1d229870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 -- 172.21.15.38:0/1402044800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1d229fe0 con 0x561b1ce3e390 2024-09-21T06:30:17.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe58f7fe640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b010 tx=0x7fe584012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e80b3c90d3e23f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.153+0000 7fe56f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.157+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58402a060 con 0x561b1ce3e390 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.157+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fe58400fc30 con 0x561b1ce3e390 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.157+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe588020040 con 0x561b1ce3e390 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe584021040 con 0x561b1ce3e390 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 10 client.18573 fetch_fsmap learned FSMap version 34 2024-09-21T06:30:17.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561b1d292c10 con 0x561b1ce3e390 2024-09-21T06:30:17.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe588020040 con 0x561b1ce3e390 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe58401f4b0 con 0x561b1ce3e390 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 10 client.18573 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 10 client.18573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 20 client.18573 populate_metadata read hostname 'smithi038' 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1cdf2da0 0x561b1d2953b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 4 client.18573 mds_command: new command op to 24728 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 --> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b1d17a8a0 con 0x561b1cdf2da0 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.158+0000 7fe594db4640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1cdf2da0 0x561b1d2953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe594db4640 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1cdf2da0 0x561b1d2953b0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e3f7d4a3bb1290 server_cookie=f5446135638647af in_seq=0 out_seq=0 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe56f7fe640 10 client.18573 ms_handle_connect on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe56f7fe640 1 -- 172.21.15.38:0/1402044800 <== mds.0 v2:172.21.15.44:6838/2983639005 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b1d17a8a0 con 0x561b1cdf2da0 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe56f7fe640 10 client.18573 handle_command_reply: tid=0 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 client.18573 shutdown 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 msgr2=0x561b1d2291d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b010 tx=0x7fe584012e50 comp rx=0 tx=0).stop 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 shutdown_connections 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561b1ce5f070 0x561b1d229870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561b1ce3e390 0x561b1d2291d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.44:6838/2983639005,v1:172.21.15.44:6839/2983639005] conn(0x561b1cdf2da0 0x561b1d2953b0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe56f7fe640 0 client.18573 ms_handle_reset on v2:172.21.15.44:6838/2983639005 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 --2- 172.21.15.38:0/1402044800 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561b1ce361b0 0x561b1d22bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.159+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 >> 172.21.15.38:0/1402044800 conn(0x561b1ce53460 msgr2=0x561b1d207de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 shutdown_connections 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe59cd8b740 1 -- 172.21.15.38:0/1402044800 wait complete. 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe59cd8b740 20 client.18573 trim_cache size 0 max 16384 2024-09-21T06:30:17.163 INFO:teuthology.orchestra.run.smithi038.stdout:[] 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 msgr2=0x7fe5780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 0x7fe5780b8bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe5801053a0 tx=0x7fe5800319c0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 msgr2=0x7fe59019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fe580005ab0 tx=0x7fe5800042f0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 shutdown_connections 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fe5780b66b0 0x7fe5780b8bc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe590109df0 0x7fe59019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5901094a0 0x7fe59019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 --2- 172.21.15.38:0/1087452299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe590103b60 0x7fe59019a620 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 >> 172.21.15.38:0/1087452299 conn(0x7fe59007b850 msgr2=0x7fe590107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 shutdown_connections 2024-09-21T06:30:17.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.160+0000 7fe596817640 1 -- 172.21.15.38:0/1087452299 wait complete. 2024-09-21T06:30:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:17 smithi038 ceph-mon[31215]: pgmap v646: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:17.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:17 smithi038 ceph-mon[31215]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:30:17.847 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T06:30:17.848 INFO:tasks.fwd_scrub:done joining 2024-09-21T06:30:17.848 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:30:17.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:30:17.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:17 smithi174 ceph-mon[34815]: pgmap v646: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:17.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:17 smithi174 ceph-mon[34815]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:30:17.904 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:17 smithi044 ceph-mon[34369]: pgmap v646: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:17.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:17 smithi044 ceph-mon[34369]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 -- 172.21.15.38:0/1768476345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 msgr2=0x7f935c1065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 --2- 172.21.15.38:0/1768476345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c1065f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f934c009900 tx=0x7f934c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 -- 172.21.15.38:0/1768476345 shutdown_connections 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 --2- 172.21.15.38:0/1768476345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 --2- 172.21.15.38:0/1768476345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c1065f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 --2- 172.21.15.38:0/1768476345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 0x7f935c102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 -- 172.21.15.38:0/1768476345 >> 172.21.15.38:0/1768476345 conn(0x7f935c079ea0 msgr2=0x7f935c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 -- 172.21.15.38:0/1768476345 shutdown_connections 2024-09-21T06:30:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.974+0000 7f93644b6640 1 -- 172.21.15.38:0/1768476345 wait complete. 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 Processor -- start 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 -- start start 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 0x7f935c103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c103a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f935c113b20 con 0x7f935c1061e0 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f935c1139a0 con 0x7f935c102070 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f93644b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f935c113ca0 con 0x7f935c106b30 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f9361a51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f9361a51640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51140/0 (socket says 172.21.15.38:51140) 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f9361a51640 1 -- 172.21.15.38:0/3785824103 learned_addr learned my addr 172.21.15.38:0/3785824103 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.975+0000 7f9362252640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 0x7f935c103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9362a53640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c103a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 -- 172.21.15.38:0/3785824103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 msgr2=0x7f935c103a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c103a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 -- 172.21.15.38:0/3785824103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 msgr2=0x7f935c103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 0x7f935c103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 -- 172.21.15.38:0/3785824103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c1a8730 con 0x7f935c1061e0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9362a53640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f9361a51640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f934c005940 tx=0x7f934c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c03f030 con 0x7f935c1061e0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c1a89c0 con 0x7f935c1061e0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f934c003cd0 con 0x7f935c1061e0 2024-09-21T06:30:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c035070 con 0x7f935c1061e0 2024-09-21T06:30:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.976+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c1a8eb0 con 0x7f935c1061e0 2024-09-21T06:30:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.977+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c102480 con 0x7f935c1061e0 2024-09-21T06:30:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.979+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f934c042030 con 0x7f935c1061e0 2024-09-21T06:30:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.980+0000 7f93537fe640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 0x7f93480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.980+0000 7f9362252640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 0x7f93480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.980+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f934c108400 con 0x7f935c1061e0 2024-09-21T06:30:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.981+0000 7f9362252640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 0x7f93480b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f935c104a50 tx=0x7f935800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:17.984+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f934c0ce9a0 con 0x7f935c1061e0 2024-09-21T06:30:18.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.173+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f935c1a92a0 con 0x7f935c1061e0 2024-09-21T06:30:18.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.175+0000 7f93537fe640 1 -- 172.21.15.38:0/3785824103 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+23001 (secure 0 0 0) 0x7f934c0d2d80 con 0x7f935c1061e0 2024-09-21T06:30:18.177 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:18.177 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":87,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:30:17.149581+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:30:18.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 msgr2=0x7f93480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 0x7f93480b8b90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f935c104a50 tx=0x7f935800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 msgr2=0x7f935c103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f934c005940 tx=0x7f934c004360 comp rx=0 tx=0).stop 2024-09-21T06:30:18.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 shutdown_connections 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f93480b6680 0x7f93480b8b90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f935c106b30 0x7f935c103a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f935c1061e0 0x7f935c103540 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 --2- 172.21.15.38:0/3785824103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f935c102070 0x7f935c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 >> 172.21.15.38:0/3785824103 conn(0x7f935c079ea0 msgr2=0x7f935c107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 shutdown_connections 2024-09-21T06:30:18.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.177+0000 7f93644b6640 1 -- 172.21.15.38:0/3785824103 wait complete. 2024-09-21T06:30:18.191 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:13:12.045212+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:17:43.494293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:17:45.824173+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 86, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:30:18.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 -- 172.21.15.38:0/4152250548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc8102990 msgr2=0x7f7dc8102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 --2- 172.21.15.38:0/4152250548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc8102990 0x7f7dc8102da0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009900 tx=0x7f7db802a410 comp rx=0 tx=0).stop 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 -- 172.21.15.38:0/4152250548 shutdown_connections 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 --2- 172.21.15.38:0/4152250548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dc8108c10 0x7f7dc810f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 --2- 172.21.15.38:0/4152250548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc81082c0 0x7f7dc81086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 --2- 172.21.15.38:0/4152250548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc8102990 0x7f7dc8102da0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 -- 172.21.15.38:0/4152250548 >> 172.21.15.38:0/4152250548 conn(0x7f7dc80fe3b0 msgr2=0x7f7dc8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 -- 172.21.15.38:0/4152250548 shutdown_connections 2024-09-21T06:30:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.306+0000 7f7dcf077640 1 -- 172.21.15.38:0/4152250548 wait complete. 2024-09-21T06:30:18.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 Processor -- start 2024-09-21T06:30:18.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 -- start start 2024-09-21T06:30:18.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dc8102990 0x7f7dc819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc8108c10 0x7f7dc81a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8113b10 con 0x7f7dc81082c0 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8113990 con 0x7f7dc8108c10 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcf077640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc8113c90 con 0x7f7dc8102990 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51172/0 (socket says 172.21.15.38:51172) 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3960786064 learned_addr learned my addr 172.21.15.38:0/3960786064 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dcd614640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc8108c10 0x7f7dc81a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3960786064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dc8102990 msgr2=0x7f7dc819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dc8102990 0x7f7dc819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3960786064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc8108c10 msgr2=0x7f7dc81a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc8108c10 0x7f7dc81a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.307+0000 7f7dc7fff640 1 -- 172.21.15.38:0/3960786064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc81a25e0 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dc7fff640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00ccc0 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc81a28d0 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7dbc010900 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc018900 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.308+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc81a9060 con 0x7f7dc81082c0 2024-09-21T06:30:18.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.309+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc8102da0 con 0x7f7dc81082c0 2024-09-21T06:30:18.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.311+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7dbc010ab0 con 0x7f7dc81082c0 2024-09-21T06:30:18.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.312+0000 7f7dc5ffb640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 0x7f7db00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.312+0000 7f7dcce13640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 0x7f7db00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.312+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f7dbc0e7fe0 con 0x7f7dc81082c0 2024-09-21T06:30:18.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.313+0000 7f7dcce13640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 0x7f7db00b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7db80096c0 tx=0x7f7db8000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.315+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7dbc0ae580 con 0x7f7dc81082c0 2024-09-21T06:30:18.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.504+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7dc81a93e0 con 0x7f7dc81082c0 2024-09-21T06:30:18.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.505+0000 7f7dc5ffb640 1 -- 172.21.15.38:0/3960786064 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f7dbc0b2960 con 0x7f7dc81082c0 2024-09-21T06:30:18.507 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-21T06:30:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 msgr2=0x7f7db00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 0x7f7db00b8b90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7db80096c0 tx=0x7f7db8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 msgr2=0x7f7dc819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 shutdown_connections 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f7db00b6680 0x7f7db00b8b90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dc8108c10 0x7f7dc81a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.507+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7dc81082c0 0x7f7dc819cc50 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.508+0000 7f7dcf077640 1 --2- 172.21.15.38:0/3960786064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dc8102990 0x7f7dc819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.508+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 >> 172.21.15.38:0/3960786064 conn(0x7f7dc80fe3b0 msgr2=0x7f7dc81078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.508+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 shutdown_connections 2024-09-21T06:30:18.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.508+0000 7f7dcf077640 1 -- 172.21.15.38:0/3960786064 wait complete. 2024-09-21T06:30:18.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 -- 172.21.15.38:0/3668633402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548109d30 msgr2=0x7fb548110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3668633402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548109d30 0x7fb548110560 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fb540009ca0 tx=0x7fb54002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 -- 172.21.15.38:0/3668633402 shutdown_connections 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3668633402 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb548109d30 0x7fb548110560 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3668633402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5481093e0 0x7fb5481097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3668633402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 0x7fb548103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 -- 172.21.15.38:0/3668633402 >> 172.21.15.38:0/3668633402 conn(0x7fb5480ff4b0 msgr2=0x7fb548101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 -- 172.21.15.38:0/3668633402 shutdown_connections 2024-09-21T06:30:18.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.636+0000 7fb54f64a640 1 -- 172.21.15.38:0/3668633402 wait complete. 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 Processor -- start 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 -- start start 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 0x7fb54819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb548109d30 0x7fb54819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb548113b60 con 0x7fb5481093e0 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5481139e0 con 0x7fb548103ab0 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54f64a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb548113ce0 con 0x7fb548109d30 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54cbe5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54cbe5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51190/0 (socket says 172.21.15.38:51190) 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.637+0000 7fb54cbe5640 1 -- 172.21.15.38:0/3101897543 learned_addr learned my addr 172.21.15.38:0/3101897543 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54d3e6640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 0x7fb54819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54dbe7640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb548109d30 0x7fb54819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 -- 172.21.15.38:0/3101897543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb548109d30 msgr2=0x7fb54819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb548109d30 0x7fb54819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 -- 172.21.15.38:0/3101897543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 msgr2=0x7fb54819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 0x7fb54819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 -- 172.21.15.38:0/3101897543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5481a0350 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54cbe5640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c8c0 tx=0x7fb53800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538007bb0 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb538007d50 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380188c0 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5481a0640 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.638+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5481a6e60 con 0x7fb5481093e0 2024-09-21T06:30:18.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.639+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb548104d20 con 0x7fb5481093e0 2024-09-21T06:30:18.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.641+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb53800fb60 con 0x7fb5481093e0 2024-09-21T06:30:18.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.642+0000 7fb53e7fc640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 0x7fb5340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.642+0000 7fb54d3e6640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 0x7fb5340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.642+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fb5380e79a0 con 0x7fb5481093e0 2024-09-21T06:30:18.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.642+0000 7fb54d3e6640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 0x7fb5340b8c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb544005d00 tx=0x7fb54400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.645+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb538014030 con 0x7fb5481093e0 2024-09-21T06:30:18.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.833+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb54802e640 con 0x7fb5481093e0 2024-09-21T06:30:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.833+0000 7fb53e7fc640 1 -- 172.21.15.38:0/3101897543 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fb5380adff0 con 0x7fb5481093e0 2024-09-21T06:30:18.835 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-21T06:30:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 msgr2=0x7fb5340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 0x7fb5340b8c10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb544005d00 tx=0x7fb54400b410 comp rx=0 tx=0).stop 2024-09-21T06:30:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 msgr2=0x7fb54819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c8c0 tx=0x7fb53800cd80 comp rx=0 tx=0).stop 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 shutdown_connections 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb5340b6700 0x7fb5340b8c10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb548109d30 0x7fb54819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb5481093e0 0x7fb54819aa50 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 --2- 172.21.15.38:0/3101897543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb548103ab0 0x7fb54819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 >> 172.21.15.38:0/3101897543 conn(0x7fb5480ff4b0 msgr2=0x7fb5481068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.835+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 shutdown_connections 2024-09-21T06:30:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.836+0000 7fb54f64a640 1 -- 172.21.15.38:0/3101897543 wait complete. 2024-09-21T06:30:18.847 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:18 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3785824103' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:18.848 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:18 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3960786064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:30:18.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:30:18.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:18 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3785824103' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:18.895 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:18 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3960786064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:30:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:18 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3785824103' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:18.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:18 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3960786064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 -- 172.21.15.38:0/3017627501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 msgr2=0x7f38a8102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 --2- 172.21.15.38:0/3017627501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a8102550 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f3890009900 tx=0x7f389002a410 comp rx=0 tx=0).stop 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 -- 172.21.15.38:0/3017627501 shutdown_connections 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 --2- 172.21.15.38:0/3017627501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a810ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 --2- 172.21.15.38:0/3017627501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a8107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 --2- 172.21.15.38:0/3017627501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a8102550 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 -- 172.21.15.38:0/3017627501 >> 172.21.15.38:0/3017627501 conn(0x7f38a8079e50 msgr2=0x7f38a807a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 -- 172.21.15.38:0/3017627501 shutdown_connections 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.963+0000 7f38aee9b640 1 -- 172.21.15.38:0/3017627501 wait complete. 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 Processor -- start 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 -- start start 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8113b20 con 0x7f38a8102140 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38a81139a0 con 0x7f38a8107a70 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38aee9b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38a8113ca0 con 0x7f38a81083c0 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38acc37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38acc37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51210/0 (socket says 172.21.15.38:51210) 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.964+0000 7f38acc37640 1 -- 172.21.15.38:0/1973721177 learned_addr learned my addr 172.21.15.38:0/1973721177 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38a7fff640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 -- 172.21.15.38:0/1973721177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 msgr2=0x7f38a819fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38ad438640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a819fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 -- 172.21.15.38:0/1973721177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 msgr2=0x7f38a819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 -- 172.21.15.38:0/1973721177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a81a04a0 con 0x7f38a8102140 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38a7fff640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38ad438640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38acc37640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3890006010 tx=0x7f3890004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389003f070 con 0x7f38a8102140 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3890031e10 con 0x7f38a8102140 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a81a0730 con 0x7f38a8102140 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890035030 con 0x7f38a8102140 2024-09-21T06:30:18.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.965+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a81a0c20 con 0x7f38a8102140 2024-09-21T06:30:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.966+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a8102550 con 0x7f38a8102140 2024-09-21T06:30:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.968+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3890042070 con 0x7f38a8102140 2024-09-21T06:30:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.969+0000 7f38a5ffb640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 0x7f38940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.969+0000 7f38a7fff640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 0x7f38940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:18.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.969+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f3890108860 con 0x7f38a8102140 2024-09-21T06:30:18.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.969+0000 7f38a7fff640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 0x7f38940b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f38a807a7a0 tx=0x7f3898008350 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:18.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:18.972+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38900ceda0 con 0x7f38a8102140 2024-09-21T06:30:19.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.163+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38a802e640 con 0x7f38a8102140 2024-09-21T06:30:19.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.163+0000 7f38a5ffb640 1 -- 172.21.15.38:0/1973721177 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f38900d3180 con 0x7f38a8102140 2024-09-21T06:30:19.165 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-09-21T06:30:19.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 msgr2=0x7f38940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:19.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 0x7f38940b8b90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f38a807a7a0 tx=0x7f3898008350 comp rx=0 tx=0).stop 2024-09-21T06:30:19.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 msgr2=0x7f38a819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3890006010 tx=0x7f3890004430 comp rx=0 tx=0).stop 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 shutdown_connections 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f38940b6680 0x7f38940b8b90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a81083c0 0x7f38a819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38a8107a70 0x7f38a819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 --2- 172.21.15.38:0/1973721177 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f38a8102140 0x7f38a819a600 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 >> 172.21.15.38:0/1973721177 conn(0x7f38a8079e50 msgr2=0x7f38a8105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 shutdown_connections 2024-09-21T06:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.166+0000 7f38aee9b640 1 -- 172.21.15.38:0/1973721177 wait complete. 2024-09-21T06:30:19.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:30:19.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 -- 172.21.15.38:0/3643623006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 msgr2=0x7fc464110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:19.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 --2- 172.21.15.38:0/3643623006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc464110580 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009900 tx=0x7fc45c02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:19.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 -- 172.21.15.38:0/3643623006 shutdown_connections 2024-09-21T06:30:19.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 --2- 172.21.15.38:0/3643623006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc464110580 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 --2- 172.21.15.38:0/3643623006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 0x7fc464109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 --2- 172.21.15.38:0/3643623006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 0x7fc464103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 -- 172.21.15.38:0/3643623006 >> 172.21.15.38:0/3643623006 conn(0x7fc4640ff510 msgr2=0x7fc464101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 -- 172.21.15.38:0/3643623006 shutdown_connections 2024-09-21T06:30:19.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.292+0000 7fc46c68c640 1 -- 172.21.15.38:0/3643623006 wait complete. 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 Processor -- start 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 -- start start 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 0x7fc46419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 0x7fc46419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fc464113b30 con 0x7fc464109d50 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4641139b0 con 0x7fc464109400 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46c68c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc464113cb0 con 0x7fc464103ad0 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.293+0000 7fc46ac29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51234/0 (socket says 172.21.15.38:51234) 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 -- 172.21.15.38:0/727141447 learned_addr learned my addr 172.21.15.38:0/727141447 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:19.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc469c27640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 0x7fc46419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46a428640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 0x7fc46419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 -- 172.21.15.38:0/727141447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 msgr2=0x7fc46419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 0x7fc46419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 -- 172.21.15.38:0/727141447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 msgr2=0x7fc46419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 0x7fc46419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 -- 172.21.15.38:0/727141447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4641a0330 con 0x7fc464109d50 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46ac29640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fc45c005ab0 tx=0x7fc45c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c03f030 con 0x7fc464109d50 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4641a05c0 con 0x7fc464109d50 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc45c003cd0 con 0x7fc464109d50 2024-09-21T06:30:19.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c035070 con 0x7fc464109d50 2024-09-21T06:30:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.294+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4641a0b00 con 0x7fc464109d50 2024-09-21T06:30:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.295+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc464104d40 con 0x7fc464109d50 2024-09-21T06:30:19.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.297+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc45c042030 con 0x7fc464109d50 2024-09-21T06:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.297+0000 7fc4577fe640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 0x7fc4500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.298+0000 7fc46a428640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 0x7fc4500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.298+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fc45c1082a0 con 0x7fc464109d50 2024-09-21T06:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.298+0000 7fc46a428640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 0x7fc4500b8b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc458005fd0 tx=0x7fc458005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:19.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.301+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc45c0ce840 con 0x7fc464109d50 2024-09-21T06:30:19.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.539+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc46410bb70 con 0x7fc464109d50 2024-09-21T06:30:19.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.547+0000 7fc4577fe640 1 -- 172.21.15.38:0/727141447 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+834054 (secure 0 0 0) 0x7fc45c0d2c20 con 0x7fc464109d50 2024-09-21T06:30:19.558 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:19.558 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:19.558 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 27, 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "active_gid": 14223, 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "active_name": "x", 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addrs": { 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6800", 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 4178988721 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:6801", 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 4178988721 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.559 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addr": "172.21.15.38:6801/4178988721", 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "active_change": "2024-09-21T06:11:11.566250+0000", 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "available": true, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "standbys": [ 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 24133, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "z", 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.560 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.561 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.562 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.563 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.564 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.565 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-21T06:30:19.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.568 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-21T06:30:19.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.571 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.572 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.574 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.575 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.576 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.579 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-21T06:30:19.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-21T06:30:19.581 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-21T06:30:19.582 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.583 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.584 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.585 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.586 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.587 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.588 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:30:19.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-21T06:30:19.590 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.591 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.593 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.594 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.595 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.596 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.600 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:30:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-21T06:30:19.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.603 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.604 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.605 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:19.607 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:30:19.608 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.609 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.610 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.611 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:30:19.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:30:19.613 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-21T06:30:19.614 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-21T06:30:19.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-21T06:30:19.616 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nginx": { 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nginx", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nginx container image", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.617 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.619 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-21T06:30:19.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-21T06:30:19.621 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-21T06:30:19.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba_metrics": { 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.624 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.626 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.629 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:19.682 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.684 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.685 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.686 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.688 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.689 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.690 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.691 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.692 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.693 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.694 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.698 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-21T06:30:19.699 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:30:19.700 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.702 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.703 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.704 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-21T06:30:19.706 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.707 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.708 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:19.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_interval": { 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.710 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.711 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-21T06:30:19.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-21T06:30:19.713 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-21T06:30:19.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-21T06:30:19.715 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.717 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.718 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.720 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.721 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:30:19.722 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.724 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.726 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.728 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.729 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.730 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.731 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.732 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.733 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.734 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.735 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:30:19.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:30:19.738 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.739 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.740 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.742 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.743 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:30:19.744 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.745 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "[]", 2024-09-21T06:30:19.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "{}", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.748 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.749 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.750 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.751 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.754 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:30:19.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:30:19.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:30:19.757 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.758 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.759 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.762 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.763 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.764 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.765 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.766 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.767 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.769 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-21T06:30:19.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-21T06:30:19.771 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.772 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.774 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.775 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.776 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.778 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:19.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.780 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.781 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.782 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.783 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "sso_oauth2": { 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sso_oauth2", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.784 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.785 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.787 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.788 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.789 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.790 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.791 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.793 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-21T06:30:19.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.795 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:19.796 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.797 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.798 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.799 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.800 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.801 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.802 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.803 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.805 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-21T06:30:19.806 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-21T06:30:19.807 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.808 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.809 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-21T06:30:19.810 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.811 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.812 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.813 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.814 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.815 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.816 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.817 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.819 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.820 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:19.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.822 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.823 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-21T06:30:19.824 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.825 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.826 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.827 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.828 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.829 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.831 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.832 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.833 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.834 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.835 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.836 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.837 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-21T06:30:19.838 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-21T06:30:19.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.840 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.841 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.842 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.843 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.844 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.845 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-21T06:30:19.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.847 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.848 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.849 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.850 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.851 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.852 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.853 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.854 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.855 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.856 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:30:19.857 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.858 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.859 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.860 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.861 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.862 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.863 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.864 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.865 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.865 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.865 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-21T06:30:19.865 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.866 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.867 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.868 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.869 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.870 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-21T06:30:19.871 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.872 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.873 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.874 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.875 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.876 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.877 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.878 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.881 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.883 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-21T06:30:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.885 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.886 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.887 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.888 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.890 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.891 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.892 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.893 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.894 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.895 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.896 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.897 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.898 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.899 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.900 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.901 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.902 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.903 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.904 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-21T06:30:19.906 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:30:19.907 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.908 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.909 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.910 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.911 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.912 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.913 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.914 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:19.915 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-21T06:30:19.917 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.918 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:30:19.919 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.920 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.921 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.922 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.923 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.925 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-21T06:30:19.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.927 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.928 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.929 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.930 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:19.931 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.932 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.933 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.934 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.935 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.936 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.937 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.938 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.939 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.940 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.941 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.942 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-21T06:30:19.943 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:19.944 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.946 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.947 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.948 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.949 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max_requests": { 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_requests", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:19.950 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.951 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.952 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.953 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.954 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.955 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.956 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.957 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.958 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:30:19.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.960 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-21T06:30:19.961 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.962 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.963 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.964 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.965 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.966 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.968 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.970 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.971 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.972 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.973 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.975 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.976 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.977 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.978 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.979 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-21T06:30:19.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-21T06:30:19.981 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.982 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.984 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smb", 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.986 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "internal_store_backend": { 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "internal_store_backend", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.988 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.989 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.990 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:19.991 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:19.992 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "update_orchestration": { 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "update_orchestration", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.993 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:19.994 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.995 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.996 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:19.997 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:19.998 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:19.999 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.000 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.001 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.002 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.003 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.004 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.005 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.006 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.007 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.008 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.009 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.010 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.011 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.012 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.013 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.014 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.015 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.016 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.017 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.018 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.019 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.020 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.022 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.023 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.024 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-21T06:30:20.025 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-21T06:30:20.026 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-21T06:30:20.027 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-21T06:30:20.028 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-21T06:30:20.029 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-21T06:30:20.030 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-21T06:30:20.031 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.032 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.033 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.034 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.035 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.037 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.038 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.039 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.042 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.043 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.044 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.045 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.046 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.047 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.048 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.049 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.050 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.051 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-21T06:30:20.052 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.053 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.054 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.055 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.056 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-21T06:30:20.057 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-21T06:30:20.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.059 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.060 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.062 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.063 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.064 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.065 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.066 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.067 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.069 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.070 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-21T06:30:20.071 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.072 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.073 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.074 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 24155, 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "y", 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.075 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.076 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.077 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.078 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.079 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.081 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.082 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.083 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.084 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-21T06:30:20.085 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.086 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.087 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.089 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:30:20.090 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.091 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.092 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.094 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-21T06:30:20.095 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:20.096 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.097 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.099 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.100 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.101 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.102 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.103 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.104 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.105 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.106 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.108 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.109 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.110 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-21T06:30:20.111 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.112 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-21T06:30:20.114 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.115 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.116 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.118 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.119 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.120 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.121 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.122 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:30:20.123 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:30:20.124 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:30:20.125 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.127 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-21T06:30:20.128 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nginx": { 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nginx", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nginx container image", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.129 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.131 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-21T06:30:20.132 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba_metrics": { 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.138 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.139 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-21T06:30:20.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.153 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.154 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.155 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.156 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-21T06:30:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.159 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.161 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.162 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.163 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.165 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.166 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.167 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.168 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_interval": { 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-21T06:30:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-21T06:30:20.170 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.172 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.173 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.174 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.175 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.177 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:30:20.181 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.182 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.183 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.184 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.185 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.186 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.187 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.188 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:30:20.189 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:30:20.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.191 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.192 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.193 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.194 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.195 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.196 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:30:20.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.198 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.199 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.200 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "[]", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.202 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "{}", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.203 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.204 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.205 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.206 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:30:20.208 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:30:20.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:30:20.210 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.211 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.212 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.213 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.214 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:30:20.215 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:30:20.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:30:20.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:30:20.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.219 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.221 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.222 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.223 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.224 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.225 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.226 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.227 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.228 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.229 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.230 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.231 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.232 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.233 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.234 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.236 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.237 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:20.239 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-21T06:30:20.240 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.241 INFO:teuthology.orchestra.run.smithi038.stdout: "sso_oauth2": { 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sso_oauth2", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.242 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.243 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.248 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.249 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.253 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.254 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.255 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.256 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.257 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.258 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.260 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.261 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.263 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.264 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.265 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.266 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.268 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-21T06:30:20.269 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.270 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.271 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.272 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.273 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.274 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.275 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.276 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-21T06:30:20.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-21T06:30:20.278 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:20.280 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-21T06:30:20.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-21T06:30:20.282 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.283 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.284 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.285 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.286 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.287 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.289 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.291 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.292 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.293 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.294 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.295 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:30:20.296 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.297 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.298 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.299 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.301 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.302 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.303 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.304 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.305 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.306 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.307 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.308 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.310 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.311 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.312 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.313 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.314 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:30:20.315 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.316 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.318 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.319 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.320 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.321 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.322 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.323 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.325 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.326 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.327 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.328 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.329 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.330 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.331 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.333 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.334 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.335 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.336 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.337 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.338 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.339 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.340 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.341 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.342 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.343 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.344 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.345 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.346 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.347 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.348 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.350 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.352 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.353 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.354 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.355 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.356 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.357 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.359 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.360 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.361 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.363 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.364 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.365 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.366 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.367 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-21T06:30:20.368 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.370 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-21T06:30:20.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-21T06:30:20.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.373 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.374 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.375 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.376 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.377 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.378 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.379 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.380 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.381 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.382 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.383 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.385 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.386 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.387 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.388 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.392 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.393 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.394 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.395 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.396 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.397 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.398 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.399 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.400 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.401 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "max_requests": { 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_requests", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.402 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.404 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.405 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.406 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.408 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.409 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.410 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.411 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.413 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.415 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.416 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.417 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-21T06:30:20.418 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.419 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.420 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.421 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.422 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.423 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.424 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.425 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.426 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.427 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.428 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.429 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.430 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.431 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.432 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.433 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.434 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.435 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.436 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smb", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "internal_store_backend": { 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "internal_store_backend", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.437 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.438 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.439 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.440 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.443 INFO:teuthology.orchestra.run.smithi038.stdout: "update_orchestration": { 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "update_orchestration", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.444 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:30:20.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:30:20.446 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.447 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.448 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.449 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.450 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.451 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.452 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.453 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.454 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.455 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.456 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.457 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.458 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.459 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.460 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.461 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.462 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.463 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-21T06:30:20.464 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.465 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.467 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.468 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.469 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.471 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.472 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.474 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.475 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-21T06:30:20.476 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-21T06:30:20.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-21T06:30:20.478 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-21T06:30:20.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.481 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.482 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-21T06:30:20.483 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.485 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.485 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.486 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.487 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.488 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.489 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.490 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.491 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.492 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.493 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.494 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.497 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.498 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.499 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.500 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.501 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.502 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.503 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.504 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.505 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.506 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-21T06:30:20.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.508 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.509 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.511 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.512 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.513 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.514 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.515 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.516 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.517 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.518 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.519 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.520 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.521 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.522 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "modules": [ 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "dashboard", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "iostat", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "nfs", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "restful", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_schedule" 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.527 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.528 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.529 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.530 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2024-09-21T06:30:20.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2024-09-21T06:30:20.532 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.533 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.534 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.535 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.536 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.537 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.538 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.539 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2024-09-21T06:30:20.540 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2024-09-21T06:30:20.541 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2024-09-21T06:30:20.542 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:30:20.543 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.544 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.545 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.546 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2359", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.547 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "6", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.549 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.551 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.552 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:30:20.553 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2024-09-21T06:30:20.554 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "read", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap-read" 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_down_multiplier": { 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_down_multiplier", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_refresh_rate": { 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_refresh_rate", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "20", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "agent_starting_port": { 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "agent_starting_port", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4721", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2024-09-21T06:30:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2024-09-21T06:30:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_log_destination": { 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm_log_destination", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "file", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "file,syslog", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "syslog" 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "cgroups_split": { 2024-09-21T06:30:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cgroups_split", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2024-09-21T06:30:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_elasticsearch": { 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "elasticsearch container image", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_agent": { 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_collector": { 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_jaeger_query": { 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Jaeger query container image", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_loki": { 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_loki", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:30:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Loki container image", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nginx": { 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nginx", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:30:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nginx container image", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_nvmeof": { 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_nvmeof", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Nvme-of container image", 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:30:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_promtail": { 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_promtail", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Promtail container image", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba": { 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_samba_metrics": { 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "900", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:30:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "grafana_dashboards_path": { 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "hw_monitoring": { 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hw_monitoring", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "inventory_list_all": { 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "inventory_list_all", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "log_refresh_metadata": { 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_refresh_metadata", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:30:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:30:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2024-09-21T06:30:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "oob_default_addr": { 2024-09-21T06:30:20.611 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "oob_default_addr", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "169.254.1.1", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2024-09-21T06:30:20.612 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2024-09-21T06:30:20.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2024-09-21T06:30:20.614 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2024-09-21T06:30:20.615 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2024-09-21T06:30:20.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "secure_monitoring_stack": { 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:30:20.617 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "service_discovery_port": { 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "service_discovery_port", 2024-09-21T06:30:20.618 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8765", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.619 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.620 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.621 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_keepalive_interval": { 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.622 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "use_agent": { 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_agent", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.624 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.625 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.626 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.627 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.628 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.629 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.630 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.631 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.634 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.635 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.636 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.637 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.638 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:30:20.639 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:30:20.640 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:30:20.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:30:20.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:30:20.643 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:30:20.644 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:30:20.645 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:30:20.646 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:30:20.647 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:30:20.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.649 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.651 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.652 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.653 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.654 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.655 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.656 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.657 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "[]", 2024-09-21T06:30:20.658 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "{}", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.659 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.660 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.661 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.662 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.663 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.664 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.665 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.666 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.667 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.668 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.671 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.672 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.673 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:30:20.674 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:30:20.675 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:30:20.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.680 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.681 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.682 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.684 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.685 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.686 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.688 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.688 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.688 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.689 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.689 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.689 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.689 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.689 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.690 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.691 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.692 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.694 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.695 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.697 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.698 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "sso_oauth2": { 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sso_oauth2", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.700 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.701 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.703 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.704 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.705 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.706 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.708 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.710 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.711 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.712 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.714 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.715 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.717 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.719 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.720 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.721 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.723 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.724 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.725 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.726 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.727 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.728 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2024-09-21T06:30:20.729 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "5", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.730 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.732 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.734 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.735 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "InfluxDB server port", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.736 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2024-09-21T06:30:20.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2024-09-21T06:30:20.738 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "32", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2024-09-21T06:30:20.739 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2024-09-21T06:30:20.740 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.741 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.742 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.743 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.744 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.745 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.746 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.747 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.748 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.750 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.751 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.752 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.753 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "k8sevents", 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_event_retention_days": { 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.754 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "config_check_secs": { 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_check_secs", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.755 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "10", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.756 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.757 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.759 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.760 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2024-09-21T06:30:20.762 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.763 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.764 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.765 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.766 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.767 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2024-09-21T06:30:20.769 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2024-09-21T06:30:20.770 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.771 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.772 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.773 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.774 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.775 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.776 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.777 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.778 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2024-09-21T06:30:20.780 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.781 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.782 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.784 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.785 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.786 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.787 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.789 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.790 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.791 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "fail_fs": { 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "fail_fs", 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.795 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.797 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.798 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.800 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_perf_query", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.801 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.803 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.805 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.807 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.808 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.811 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.813 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.814 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.815 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.816 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.817 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.818 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.819 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.820 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "threshold": { 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threshold", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3.0", 2024-09-21T06:30:20.821 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1.0", 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "scaling threshold", 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.822 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_pg_recovery_event": { 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.823 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.825 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.826 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.827 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.828 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2024-09-21T06:30:20.829 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2024-09-21T06:30:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.832 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.833 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "exclude_perf_counters": { 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "exclude_perf_counters", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:30:20.834 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.835 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.836 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.837 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.839 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.840 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.841 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.842 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.843 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.844 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.845 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2024-09-21T06:30:20.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.847 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.848 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.849 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.851 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.852 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.853 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.854 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.855 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.857 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.858 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.859 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.860 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.861 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.862 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.863 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "max_requests": { 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_requests", 2024-09-21T06:30:20.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.865 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.866 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.867 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rgw", 2024-09-21T06:30:20.868 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.869 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.870 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.871 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:30:20.873 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.875 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.876 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.877 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.878 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.880 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "storage_class": { 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "storage_class", 2024-09-21T06:30:20.881 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "local", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.882 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.883 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.884 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.885 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.886 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.888 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.889 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.890 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.891 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.893 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.893 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.893 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.893 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.894 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.895 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.896 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.897 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption7": { 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption7", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "42", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.899 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.900 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.901 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smb", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "internal_store_backend": { 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "internal_store_backend", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.903 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.904 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.905 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.906 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.907 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.908 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.909 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "update_orchestration": { 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "update_orchestration", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.910 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.911 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.912 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.913 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.914 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.915 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.916 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.917 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.918 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.919 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.920 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.921 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.922 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.923 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.924 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.925 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.926 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.927 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.928 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.929 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.930 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.931 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.932 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.933 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.934 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.935 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.936 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.938 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.939 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.940 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:30:20.941 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.942 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.943 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_perf": { 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_perf", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.944 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.945 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.950 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard_description": { 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard_description", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.951 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.952 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.953 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.954 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.955 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.956 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.957 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.959 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.960 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.961 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.962 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.963 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.965 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.966 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.967 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.968 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.969 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.971 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "periodic_async_work": { 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "periodic_async_work", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Periodically check for async work", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.973 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.974 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.976 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.977 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.978 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.979 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.980 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.981 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.982 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.983 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.984 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "sqlite3_killpoint": { 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "dev", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.985 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.986 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2024-09-21T06:30:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "services": { 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "dashboard": "https://172.21.15.38:8443/" 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "always_on_modules": { 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "octopus": [ 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-21T06:30:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "pacific": [ 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-21T06:30:20.990 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "quincy": [ 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.991 INFO:teuthology.orchestra.run.smithi038.stdout: "reef": [ 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "squid": [ 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-21T06:30:20.992 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "last_failure_osd_epoch": 5, 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "active_clients": [ 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.993 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1124876418 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "libcephsqlite", 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3736705689 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.994 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3400488800 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.995 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2608075340 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2007543116 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.996 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.38:0", 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1447053189 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-21T06:30:20.997 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.553+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 msgr2=0x7fc4500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.553+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 0x7fc4500b8b90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc458005fd0 tx=0x7fc458005850 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.553+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 msgr2=0x7fc46419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.553+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fc45c005ab0 tx=0x7fc45c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 shutdown_connections 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fc4500b6680 0x7fc4500b8b90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc464109d50 0x7fc46419fcc0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc464109400 0x7fc46419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 --2- 172.21.15.38:0/727141447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc464103ad0 0x7fc46419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 >> 172.21.15.38:0/727141447 conn(0x7fc4640ff510 msgr2=0x7fc464106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 shutdown_connections 2024-09-21T06:30:20.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:19.554+0000 7fc46c68c640 1 -- 172.21.15.38:0/727141447 wait complete. 2024-09-21T06:30:21.042 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:30:21.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:30:21.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:19 smithi038 ceph-mon[31215]: pgmap v648: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:30:21.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3101897543' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1973721177' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.043 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:19 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/727141447' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:19 smithi044 ceph-mon[34369]: pgmap v648: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3101897543' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1973721177' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:19 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/727141447' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:19 smithi174 ceph-mon[34815]: pgmap v648: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 219 B/s wr, 6 op/s 2024-09-21T06:30:21.044 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3101897543' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.045 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1973721177' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:30:21.045 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:19 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/727141447' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:30:21.313 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:21.736 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:21 smithi038 ceph-mon[31215]: pgmap v649: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:21.802 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:21.802 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:21.802 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 0, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.001498585, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000338661, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:21.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 213, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 206, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1144672, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 126624, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:21.804 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.038842969, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.018617255, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.028295388, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 205, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.011651023, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000056834 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.805 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1144672, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 126624 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 5, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 159, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 108320, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.018093966, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.012937097, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.003446312, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:21.806 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 158, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.012201255, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000077223 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 108320 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-21T06:30:21.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:21.808 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:21.809 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 29, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-21T06:30:21.810 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:21.811 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 214, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1114574, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 214, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 214, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1114574, 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-21T06:30:21.812 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:21.813 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:21.813 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:21.813 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:21.813 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:21.813 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:21.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:21 smithi174 ceph-mon[34815]: pgmap v649: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:21.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:21 smithi044 ceph-mon[34369]: pgmap v649: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:30:22.554 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T06:30:22.555 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T06:30:22.555 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T06:30:22.555 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:30:22.555 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:30:22.555 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:30:22.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:30:22.819 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 218, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 211, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1146032, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 129824, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.043238550, 2024-09-21T06:30:23.320 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.019271182, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.033225734, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 210, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.011219317, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000053425 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1146032, 2024-09-21T06:30:23.321 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 129824 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 5, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 163, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 109024, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.016405055, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.011692340, 2024-09-21T06:30:23.322 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.003194184, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 162, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.011949157, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000073760 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.323 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 109024 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 0, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.000328893, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000245836, 2024-09-21T06:30:23.324 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:23.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:23.326 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-21T06:30:23.328 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 149007, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 30, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:23.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:23.330 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 219, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1115224, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 219, 2024-09-21T06:30:23.331 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 219, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1115224, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:23.332 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:23.894 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:23 smithi174 ceph-mon[34815]: pgmap v650: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:23.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:23 smithi044 ceph-mon[34369]: pgmap v650: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:23.934 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:23 smithi038 ceph-mon[31215]: pgmap v650: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:23.966 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:30:23.967 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:30:23.967 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T06:30:23.967 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:30:23.967 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:30:23.967 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:30:23.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:30:24.227 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 4, 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 4, 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 2992, 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 448, 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:24.729 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.003361731, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000053432, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.002241134, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 3, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.003969279, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001323093 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:24.730 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 158, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 108048, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.016362026, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.012676983, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.002000044, 2024-09-21T06:30:24.731 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 156, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.008005886, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000051319 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 108048 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 214, 2024-09-21T06:30:24.732 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 207, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1144944, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 127264, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.040007201, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.018844404, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.030039534, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 206, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.010610602, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000051507 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:24.733 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1144944, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:24.734 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:24.735 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-21T06:30:24.736 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 149024, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 31, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-21T06:30:24.737 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-21T06:30:24.738 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 215, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1114704, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 215, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 215, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1114704, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:24.739 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:24.740 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:24.740 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:24.973 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:24 smithi174 ceph-mon[34815]: pgmap v651: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:24.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:24 smithi038 ceph-mon[31215]: pgmap v651: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:25.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:24 smithi044 ceph-mon[34369]: pgmap v651: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:25.407 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T06:30:25.407 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T06:30:25.407 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T06:30:25.408 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:30:25.408 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:30:25.408 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:30:25.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:30:25.667 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 4, 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 4, 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 2992, 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 448, 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:26.169 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.003171025, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000043440, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.002183074, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 3, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.003892214, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.001297404 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:26.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 220, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 213, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1146576, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 131104, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.043297421, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.019039668, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.034717069, 2024-09-21T06:30:26.171 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 212, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.011325925, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000053424 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 1146576, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 131104 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:26.172 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 162, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 108752, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.016390510, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.013177530, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.001488632, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 160, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.008120952, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000050755 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:26.173 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_encrypted_bytes": 108752 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:26.174 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:26.175 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:30:26.176 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 30, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:26.177 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 221, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 1115484, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 221, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2024-09-21T06:30:26.178 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 221, 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 1115484, 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-21T06:30:26.179 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-21T06:30:26.857 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:30:26.857 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:30:26.857 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T06:30:26.857 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:30:26.857 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:30:26.857 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:30:26.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:30:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:27.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:26 smithi044 ceph-mon[34369]: pgmap v652: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:27.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:26 smithi038 ceph-mon[31215]: pgmap v652: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:27.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:26 smithi174 ceph-mon[34815]: pgmap v652: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 11576, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 10974, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 5364931, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 47895703, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 193, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-21T06:30:27.674 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 1.390755300, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.635303380, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.417403577, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.326064591, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10976, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 4.491688867, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000409228 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8656, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001583652, 2024-09-21T06:30:27.675 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000182 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1277392, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 171632 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 49687, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 87353, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 19981072, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 79440484, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 18, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 5.281500709, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 2.927435437, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 2.880021363, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.512988874, 2024-09-21T06:30:27.676 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 87352, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 12.369298778, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000141602 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 96509, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.016663875, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000172 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 15458064, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 38725184 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.677 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 9974, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 10386, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 3775076, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 27963282, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 32, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 1.211432265, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.651277969, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.252011044, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.287771767, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10381, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 8.792136211, 2024-09-21T06:30:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000846945 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4405, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000912472, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000207 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-21T06:30:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4118, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 27.802375409, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.006751426 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 11692, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.400057328, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000290802 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-21T06:30:27.680 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 19239, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 19199, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 19199, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 43.939504836, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002288635 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 40, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 5, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 2, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 1014, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 11, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 6683, 2024-09-21T06:30:27.681 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 1416, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 5200, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 67, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 4660, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 2418, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 3, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 3, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 11, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 23472, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 23367, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-21T06:30:27.682 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 145, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 2285, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 40, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 612, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 4120, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 4120, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:27.683 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 489, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 28, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 461, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 3631, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 68, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 8909, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 18483, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 17985, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 9324, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 75, 2024-09-21T06:30:27.684 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 9824 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 147, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 194, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 7812, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 7618, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-21T06:30:27.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 28, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 145, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 11, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:27.686 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_write_failed": 0 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 43146, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 34733, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 34733, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 8413, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 11201, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 61, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 50, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 50, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 11, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 1, 2024-09-21T06:30:27.687 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 13, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 81509370, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 100927959, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3352, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 89.416196013, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.026675476 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 2920, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 12870, 2024-09-21T06:30:27.688 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 9950, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 278, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 791, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 513, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 6683, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 19279, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 12596, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 3, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 10098, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 10095, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 177396, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 445526016 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 21526, 2024-09-21T06:30:27.689 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 96, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 19239, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 172, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 268, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 9466, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 18.553064054, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001959968 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 147, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.064276572, 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000437255 2024-09-21T06:30:27.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-21T06:30:27.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 391, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.134182606, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000343178 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000167655, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000167655 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-21T06:30:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 11, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002917498, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000265227 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 623, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.247042252, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002001672 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.694 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 11, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.348259806, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.031659982 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000209254, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000209254 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 702, 2024-09-21T06:30:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.828220369, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001179801 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002151006, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001075503 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:27.696 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 473, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 9.013056136, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.019055086 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.023538769, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004707753 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:27.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 17, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.552248141, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.091308714 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 10, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.024473506, 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002447350 2024-09-21T06:30:27.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 7339, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 12.145697212, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001654952 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:27.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 4, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 84, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 42, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 638, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.701 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:27.702 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:27.703 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 1913530, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 3397, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 1584, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 18, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:27.704 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 176, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 12195721, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 188243, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-21T06:30:27.705 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 25388, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 110513029, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 31, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 25388, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 25388, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1271.314684570, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.050075416 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 25388, 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 43387 2024-09-21T06:30:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 25388, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 4288, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 21100, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 445, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 8190, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 133, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 3457, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 97, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-21T06:30:27.707 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 11, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 8225, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 4155, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 16380, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-21T06:30:27.708 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-21T06:30:27.709 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 87, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 12, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 2119, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 14, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 161 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-21T06:30:27.710 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 20, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 10, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 7672, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 7618, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:27.711 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 71233, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 20708669, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 71233, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 71233, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 20708669, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 25388, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 111302239, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 25388, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 111302239, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.713 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 25388, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 25388, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 25388, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 25388, 2024-09-21T06:30:27.714 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 7618, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 789298, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 7618, 2024-09-21T06:30:27.715 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 105, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 789298, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x556a508cb5f0": { 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 43146, 2024-09-21T06:30:27.716 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 96733655, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 43146, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3352, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 96733655, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "trackedop": { 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-21T06:30:27.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:27.718 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T06:30:28.665 INFO:tasks.check_counter:Daemon mds.b mds.exported=145 2024-09-21T06:30:28.665 INFO:tasks.check_counter:Daemon mds.b mds.imported=40 2024-09-21T06:30:28.666 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T06:30:28.666 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-21T06:30:28.666 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-21T06:30:28.666 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:30:28.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:30:28.924 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:29.224 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:28 smithi044 ceph-mon[34369]: pgmap v653: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:30:29.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:28 smithi038 ceph-mon[31215]: pgmap v653: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:30:29.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:28 smithi174 ceph-mon[34815]: pgmap v653: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-09-21T06:30:29.473 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T06:30:29.473 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:29.473 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1845, 2024-09-21T06:30:29.473 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1826, 2024-09-21T06:30:29.473 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 31318867, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 641100, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.238999069, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.108510621, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.090042352, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.041143038, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1825, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.087261023, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000047814 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:29.474 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1219648, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 133568 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 605, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 763, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 33709869, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 556738, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2024-09-21T06:30:29.475 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.096610340, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.036291676, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.033810810, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.020046202, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 762, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.032301061, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000042389 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 365872 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 292, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 294, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 33632146, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 92863, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.047833894, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.012043855, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.024488581, 2024-09-21T06:30:29.477 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.008799522, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 292, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.010859229, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000037189 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.478 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4101, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.218772158, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000053346 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:29.479 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.480 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 14126, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 4808, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 9318, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 7258, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-21T06:30:29.481 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 2, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-21T06:30:29.482 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:30:29.483 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-21T06:30:29.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:29.485 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_write_failed": 0 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-21T06:30:29.486 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 43146, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 11, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 12, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 81509370, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 100927959, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 100927847, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.487 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 43146 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 2932, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 12829, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 9897, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 268, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 726, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 458, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 14126, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 19166, 2024-09-21T06:30:29.488 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 5040, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 142240, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 348188672 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.489 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.492 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-21T06:30:29.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.497 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.498 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.499 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 4, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 3, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2680, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-21T06:30:29.501 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:29.502 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:29.503 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 345304, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 3173, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:29.504 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 176, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 17074860, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 196001, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-21T06:30:29.505 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2488, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 26, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 4, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2488, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2488, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.670975971, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000671614 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2488, 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2489 2024-09-21T06:30:29.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2488, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2488, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1582, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 903, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-21T06:30:29.507 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-21T06:30:29.509 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-21T06:30:29.509 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-21T06:30:29.509 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-21T06:30:29.509 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-21T06:30:29.509 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 2, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-21T06:30:29.510 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-21T06:30:29.511 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 87, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 12, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 10, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 10, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-21T06:30:29.512 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.513 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2738, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 98398741, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2738, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2738, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 98398741, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.514 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2488, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 96742794, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2488, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 96742794, 2024-09-21T06:30:29.515 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2488, 2024-09-21T06:30:29.516 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2488, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2488, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2488, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:29.517 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x5629346256c0": { 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:29.518 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:29.520 INFO:teuthology.orchestra.run.smithi044.stdout: "trackedop": { 2024-09-21T06:30:29.520 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-21T06:30:29.520 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:29.520 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T06:30:30.261 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T06:30:30.261 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T06:30:30.261 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-21T06:30:30.261 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:30:30.261 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:30:30.262 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:30:30.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:30:30.520 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 6848, 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 7559, 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4121699, 2024-09-21T06:30:31.031 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 24750608, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 10, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.684429000, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.356631174, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.259608959, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.084876368, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 7557, 2024-09-21T06:30:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.380374765, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050334 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 9451, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001695164, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000179 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 2329, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 2504, 2024-09-21T06:30:31.033 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 640967, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 7336907, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 63, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 9, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.337659944, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.168309259, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.076606610, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.070785822, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2502, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.278040925, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000111127 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.034 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 88, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000016313, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000185 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1888, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 372864 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 18578, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 30753, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 8492377, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 25703150, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 13, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 1.856899059, 2024-09-21T06:30:31.035 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 1.084993803, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 1.507877127, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.080654262, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 30753, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.622536237, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000052760 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 36652, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.006171224, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000168 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 7621840, 2024-09-21T06:30:31.036 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 14321200 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1646, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 10.074802133, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.006120778 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.037 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4907, 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.620049876, 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000330150 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 5715, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 5706, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5706, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 17.169885844, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003009093 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-21T06:30:31.039 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 9, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 78, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 8, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 1, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 2329, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 356, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 1873, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 100, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 1819, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 321, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 12, 2024-09-21T06:30:31.040 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 7935, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 7617, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 118, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:31.041 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 16, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 161, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 120, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 1889, 2024-09-21T06:30:31.042 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 1768, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-21T06:30:31.043 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 1768, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 139, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 139, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 1629, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 18, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 4679, 2024-09-21T06:30:31.044 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 6544, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 9875, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 4499, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 643, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 4191 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 126, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 2, 2024-09-21T06:30:31.045 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 100, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 3481, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 3381, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:31.046 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 16, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 9, 2024-09-21T06:30:31.047 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_write_failed": 0 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-21T06:30:31.048 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 17393, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 17393, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 24, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 24, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 3, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-21T06:30:31.049 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 46631221, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1060, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 27.706951366, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.026138633 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1128, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 4562, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 3434, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 167, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 275, 2024-09-21T06:30:31.050 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 108, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 2329, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 6555, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 4226, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 3501, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 3501, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 153548, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 373174272 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 7215, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 43, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 5715, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 18, 2024-09-21T06:30:31.051 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 166, 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1628, 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.233906723, 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001986429 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-21T06:30:31.052 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 7, 2024-09-21T06:30:31.053 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.005631501, 2024-09-21T06:30:31.053 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000804500 2024-09-21T06:30:31.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.053 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:31.053 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.054 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 249, 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.136282161, 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000547317 2024-09-21T06:30:31.055 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-21T06:30:31.056 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.057 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.059 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:31.059 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.060 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.060 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.060 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-21T06:30:31.060 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.061 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.061 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.061 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-21T06:30:31.061 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.062 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-21T06:30:31.064 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 326, 2024-09-21T06:30:31.065 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.279280231, 2024-09-21T06:30:31.065 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000856687 2024-09-21T06:30:31.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.065 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-21T06:30:31.065 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.066 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 140, 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2.267328480, 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.016195203 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.068 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.069 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 15, 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2.625597619, 2024-09-21T06:30:31.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.175039841 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-21T06:30:31.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.073 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3341, 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 8.621859129, 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002580622 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:31.075 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.076 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 0, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 3426, 2024-09-21T06:30:31.077 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 1713, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 626, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:31.078 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:31.079 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:31.080 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:31.081 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 1119092, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 1491, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 264, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 3, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 176, 2024-09-21T06:30:31.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 4684984, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 82918, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 6582, 2024-09-21T06:30:31.083 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 44126108, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 33, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 6582, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6582, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 18.719730302, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002844079 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6582, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 6747 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.084 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 6582, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 1841, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 4741, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 10, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 73, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 1133, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 44, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 8, 2024-09-21T06:30:31.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 3419, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1768, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 20, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-21T06:30:31.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-21T06:30:31.087 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 87, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 12, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 231, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-21T06:30:31.088 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 41 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 10, 2024-09-21T06:30:31.089 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 3389, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 3381, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 27751, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 9932460, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 27751, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:31.090 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 27751, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 9932460, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:31.091 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 6582, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 44475613, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6582, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 44475613, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:31.092 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 6582, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 6582, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6582, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 6582, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:31.093 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3381, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 349505, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3381, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 73, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 349505, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.094 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55c8cffd5450": { 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 17393, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 42436917, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 17393, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1060, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 42436917, 2024-09-21T06:30:31.095 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: "trackedop": { 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:31.096 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T06:30:31.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:30 smithi038 ceph-mon[31215]: pgmap v654: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:31.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:30 smithi174 ceph-mon[34815]: pgmap v654: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:31.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:30 smithi044 ceph-mon[34369]: pgmap v654: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:31.985 INFO:tasks.check_counter:Daemon mds.h mds.exported=16 2024-09-21T06:30:31.985 INFO:tasks.check_counter:Daemon mds.h mds.imported=120 2024-09-21T06:30:31.985 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T06:30:31.985 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:30:31.985 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:30:31.985 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:30:31.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:30:32.238 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:32.908 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 257, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 236, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1224466, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 136260, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.050971434, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.020615135, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.042677602, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000020197, 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:32.909 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 236, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.018202867, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000077130 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1223632, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 135936 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 682, 2024-09-21T06:30:32.910 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 845, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 167708, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 584163, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.092964606, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.044423499, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.016564071, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.023542328, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 843, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.039505767, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000046863 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.911 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 367600 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1563, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1565, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4645982, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 497092, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-21T06:30:32.912 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.203041116, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.091463065, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.046042316, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.050829452, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1563, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.065133100, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000041671 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:32.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3737, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.119996999, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000032110 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.914 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 472, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 472, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 472, 2024-09-21T06:30:32.916 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 1, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-21T06:30:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:30:32.918 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-21T06:30:32.919 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-21T06:30:32.920 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_write_failed": 0 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-21T06:30:32.921 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 2138, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 4, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 8375765, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 8372214, 2024-09-21T06:30:32.922 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 2138 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 7, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 802, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 795, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 4, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 127, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 123, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 472, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 1224, 2024-09-21T06:30:32.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 752, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 118720, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 320847872 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.924 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.927 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.928 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:32.934 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-21T06:30:32.935 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2010, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:32.936 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:32.937 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 189534, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 54, 2024-09-21T06:30:32.938 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 176, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:32.939 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 348131, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 2119, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2245, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-09-21T06:30:32.940 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2245, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2245, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.735975006, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000773262 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2245, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2246 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2245, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2245, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-21T06:30:32.941 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1433, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 810, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:32.942 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-21T06:30:32.943 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 87, 2024-09-21T06:30:32.944 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 12, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 5, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 5, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:32.945 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:32.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2498, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 5797453, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2498, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2498, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 5797453, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.947 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2245, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 4181466, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2245, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 4181466, 2024-09-21T06:30:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:32.949 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2245, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2245, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2245, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2245, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:32.950 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x5577adcf52b0": { 2024-09-21T06:30:32.951 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-21T06:30:32.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-21T06:30:32.953 INFO:teuthology.orchestra.run.smithi044.stdout: "trackedop": { 2024-09-21T06:30:32.953 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-21T06:30:32.953 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-21T06:30:32.953 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-21T06:30:33.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:32 smithi044 ceph-mon[34369]: pgmap v655: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:33.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:32 smithi174 ceph-mon[34815]: pgmap v655: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:33.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:32 smithi038 ceph-mon[31215]: pgmap v655: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:33.704 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T06:30:33.704 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T06:30:33.704 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-21T06:30:33.704 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:30:33.705 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:30:33.705 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:30:33.705 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:30:33.965 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:34.512 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T06:30:34.512 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:34.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1104, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1106, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 25510687, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 351079, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 7, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.166249601, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.065918320, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.046518612, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.041760657, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1104, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.061637873, 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000055831 2024-09-21T06:30:34.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 854, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 835, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 14457526, 2024-09-21T06:30:34.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 326178, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.121564609, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.050386683, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.060777608, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.016918600, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 834, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.041652442, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000049942 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.515 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1219488, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 133408 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 531, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 689, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 4327130, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 534788, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.081016532, 2024-09-21T06:30:34.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.034587286, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.019345690, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.020532283, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 688, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.033968322, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000049372 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:30:34.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 367520 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3637, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.122275683, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000033619 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.518 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.519 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 5636, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 6, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 5630, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 5627, 2024-09-21T06:30:34.520 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-09-21T06:30:34.521 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:30:34.522 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-21T06:30:34.523 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-21T06:30:34.524 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_started": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_write_failed": 0 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-21T06:30:34.525 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 17393, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 24, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 3, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-21T06:30:34.526 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 46631221, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 46628374, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 17393 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 1115, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 4579, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 3464, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 153, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 293, 2024-09-21T06:30:34.527 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 140, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 5636, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 6548, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 912, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 131584, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 341356544 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-09-21T06:30:34.528 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.531 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-21T06:30:34.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-21T06:30:34.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-21T06:30:34.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.536 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.537 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.538 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 2, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 0, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-09-21T06:30:34.539 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 1996, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:34.541 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:34.542 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 258810, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 1264, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 176, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:34.543 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 6771723, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 82669, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 2236, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-09-21T06:30:34.544 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 2236, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2236, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2.497968587, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001117159 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2236, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2237 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 2236, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 2236, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-21T06:30:34.545 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 1415, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 819, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-09-21T06:30:34.546 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-21T06:30:34.547 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-09-21T06:30:34.548 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 12, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 8, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 8, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-21T06:30:34.549 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2485, 2024-09-21T06:30:34.550 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 44056018, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2485, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2485, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 44056018, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:34.551 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2236, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 42440723, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2236, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 42440723, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2236, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2236, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2236, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2236, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T06:30:34.554 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55fb76c51450": { 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:34.555 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "trackedop": { 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:34.556 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T06:30:35.296 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:34 smithi174 ceph-mon[34815]: pgmap v656: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:35.323 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T06:30:35.323 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T06:30:35.324 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-21T06:30:35.324 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:30:35.324 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:30:35.324 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:30:35.324 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:30:35.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:34 smithi044 ceph-mon[34369]: pgmap v656: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:35.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:34 smithi038 ceph-mon[31215]: pgmap v656: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:35.576 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:36.090 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T06:30:36.090 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:36.090 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 0, 2024-09-21T06:30:36.090 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2, 2024-09-21T06:30:36.090 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 0, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.001149720, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.000325508, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:36.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 220, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 213, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1146576, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 131104, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.044511771, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.019284164, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.036587154, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 212, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.014829960, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000069952 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1146576, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 131104 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 5, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 164, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:30:36.093 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 109200, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.015851945, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.011048404, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.002973784, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 163, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.015286893, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000093784 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:36.094 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 109200 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:36.095 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:36.096 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 30, 2024-09-21T06:30:36.097 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T06:30:36.098 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 2, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 221, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1115484, 2024-09-21T06:30:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 221, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 221, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1115484, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:36.100 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T06:30:36.757 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-09-21T06:30:36.757 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-09-21T06:30:36.758 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-21T06:30:36.758 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-21T06:30:36.758 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-21T06:30:36.758 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:30:36.758 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:30:37.007 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:37.255 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:37 smithi174 ceph-mon[34815]: pgmap v657: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:30:37.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:37 smithi044 ceph-mon[34369]: pgmap v657: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:30:37.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:37 smithi038 ceph-mon[31215]: pgmap v657: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T06:30:37.528 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2635, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 4168, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 914553, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 6787165, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 63, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 8, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.283266083, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.145110309, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.128704434, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.017629448, 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:37.529 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4167, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.176763829, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000042419 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4147, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000702847, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000169 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 736336, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 1933504 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1329, 2024-09-21T06:30:37.530 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1118, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1572880, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 543131, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 13, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.123514390, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.055064215, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.076536224, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.009619831, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1117, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.051704949, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000046289 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.531 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1071, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000171546, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000160 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1228160, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 145792 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2789, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2545, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1372861, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 1448499, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 10, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-09-21T06:30:37.532 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.229549571, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.108497073, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.143473548, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.013961506, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2543, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.080317779, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000031583 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4402, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000773562, 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000175 2024-09-21T06:30:37.533 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 368880 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 678, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.994870540, 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001467360 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.534 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 902, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.057869927, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000064157 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 955, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 953, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 953, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.996645273, 2024-09-21T06:30:37.535 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001045797 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 2, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 11, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 17, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 2, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 2, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 13, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 13, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 581, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 1, 2024-09-21T06:30:37.536 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 1, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 3, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 1807, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 1639, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 34, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 33, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 469, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 34, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 414, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 279, 2024-09-21T06:30:37.537 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 1, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 234, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 6, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 279, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 2, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 2, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 277, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 2, 2024-09-21T06:30:37.538 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 647, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 573, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 882, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 255, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 26, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 949 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-09-21T06:30:37.539 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 29, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 6, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 1, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 468, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 467, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-21T06:30:37.540 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 33, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_started": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_succeeded": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_write_failed": 0 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-21T06:30:37.541 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 2138, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 2138, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 4, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 4, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-21T06:30:37.542 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 8375765, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 460, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 3.228338262, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.007018126 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 21, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 788, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 767, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 18, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 118, 2024-09-21T06:30:37.543 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 100, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 17, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 1243, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 1226, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 1, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 495, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 494, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 128340, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 336412672 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 1157, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 29, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 955, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 13, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 126, 2024-09-21T06:30:37.544 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 54, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.041661084, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000771501 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000671178, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000671178 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.545 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 381, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.155351387, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000407746 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.546 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000119259, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000119259 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.547 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-21T06:30:37.548 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.549 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 48, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.024574832, 2024-09-21T06:30:37.550 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000511975 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.551 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.062527803, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.015631950 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-21T06:30:37.552 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.553 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.554 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 464, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.711739730, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001533921 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.555 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 2, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 1, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 1, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 832, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 832, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 653, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.556 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:37.557 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:37.558 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 292641, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 127, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 264, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 3, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T06:30:37.559 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7968, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 176, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 94059, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 541, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T06:30:37.560 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 1406, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 4306656, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 30, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 1406, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1406, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 6.202922069, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.004411751 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-21T06:30:37.561 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1406, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1491 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 1406, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 321, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 1085, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 42, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 502, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 36, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-21T06:30:37.562 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 479, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 279, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-21T06:30:37.563 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-21T06:30:37.564 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 87, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 12, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 90, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 33 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.565 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 10, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 467, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 467, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.566 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 6749, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 3144961, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 6749, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 6749, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 3144961, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.567 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1406, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 4355695, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1406, 2024-09-21T06:30:37.568 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 4355695, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 1406, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 1406, 2024-09-21T06:30:37.569 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1406, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1406, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 467, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 49039, 2024-09-21T06:30:37.570 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 467, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 42, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 49039, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x563f640b9450": { 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:37.571 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2138, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 4181461, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2138, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 460, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 4181461, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "trackedop": { 2024-09-21T06:30:37.572 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-21T06:30:37.573 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:37.573 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T06:30:38.239 INFO:tasks.check_counter:Daemon mds.i mds.exported=33 2024-09-21T06:30:38.239 INFO:tasks.check_counter:Daemon mds.i mds.imported=34 2024-09-21T06:30:38.239 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T06:30:38.239 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:30:38.239 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:30:38.239 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:30:38.239 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:30:38.481 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:39.081 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 229, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 220, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1150992, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 134272, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 0, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.047775491, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.019337044, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.040604131, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:39.082 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 220, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.017253317, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000078424 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1150992, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 134272 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 166, 2024-09-21T06:30:39.083 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 109456, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 3, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.014397559, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.011442926, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.000883742, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 164, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.011959178, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000072921 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:39.084 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 109456 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 0, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 0, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 2, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.000306259, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.000229979, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:39.085 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 0, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.086 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T06:30:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:30:39.088 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 29, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:30:39.089 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 968, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 2, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 226, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1116198, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 226, 2024-09-21T06:30:39.090 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 226, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1116198, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T06:30:39.091 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T06:30:39.144 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:39 smithi174 ceph-mon[34815]: pgmap v658: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:39.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:39 smithi044 ceph-mon[34369]: pgmap v658: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:39.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:39 smithi038 ceph-mon[31215]: pgmap v658: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:39.741 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T06:30:39.742 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T06:30:39.742 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T06:30:39.742 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:30:39.742 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:30:39.742 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:30:39.754 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:30:39.754 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:30:39.754 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:30:39.776 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-21T06:30:39.776 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:30:39.836 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:30:40.150 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.637+0000 7f200e30e640 1 -- 172.21.15.38:0/295183969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 msgr2=0x7f200810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.637+0000 7f200e30e640 1 --2- 172.21.15.38:0/295183969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200810f520 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2000009ca0 tx=0x7f200002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 -- 172.21.15.38:0/295183969 shutdown_connections 2024-09-21T06:30:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 --2- 172.21.15.38:0/295183969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200810f520 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 --2- 172.21.15.38:0/295183969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20081083a0 0x7f20081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 --2- 172.21.15.38:0/295183969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2008102a60 0x7f2008102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 -- 172.21.15.38:0/295183969 >> 172.21.15.38:0/295183969 conn(0x7f2008079730 msgr2=0x7f2008079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 -- 172.21.15.38:0/295183969 shutdown_connections 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 -- 172.21.15.38:0/295183969 wait complete. 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 Processor -- start 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.638+0000 7f200e30e640 1 -- start start 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2008102a60 0x7f200819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 0x7f200819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f2008112aa0 con 0x7f2008108cf0 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2008112920 con 0x7f20081083a0 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200e30e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2008112c20 con 0x7f2008102a60 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34448/0 (socket says 172.21.15.38:34448) 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 -- 172.21.15.38:0/2678875007 learned_addr learned my addr 172.21.15.38:0/2678875007 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f2007fff640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2008102a60 0x7f200819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f1ffffff640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 0x7f200819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 -- 172.21.15.38:0/2678875007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2008102a60 msgr2=0x7f200819b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2008102a60 0x7f200819b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 -- 172.21.15.38:0/2678875007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 msgr2=0x7f200819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 0x7f200819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 -- 172.21.15.38:0/2678875007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20081a66e0 con 0x7f2008108cf0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f1ffffff640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 0x7f200819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f200c8ab640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2000005e30 tx=0x7f2000003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.639+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000031650 con 0x7f2008108cf0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.640+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f20000317f0 con 0x7f2008108cf0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.640+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20081a6970 con 0x7f2008108cf0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.640+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200002fb70 con 0x7f2008108cf0 2024-09-21T06:30:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.640+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20081a6f00 con 0x7f2008108cf0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.641+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2008102e70 con 0x7f2008108cf0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.643+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f200002fd10 con 0x7f2008108cf0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.644+0000 7f2005ffb640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 0x7f1ff40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.644+0000 7f2007fff640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 0x7f1ff40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.644+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f2000108b70 con 0x7f2008108cf0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.644+0000 7f2007fff640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 0x7f1ff40b8c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f200806b9c0 tx=0x7f1ff800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.647+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20000cf0b0 con 0x7f2008108cf0 2024-09-21T06:30:40.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.846+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f200806b270 con 0x7f2008108cf0 2024-09-21T06:30:40.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.847+0000 7f2005ffb640 1 -- 172.21.15.38:0/2678875007 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) ==== 81+0+884 (secure 0 0 0) 0x7f200806b270 con 0x7f2008108cf0 2024-09-21T06:30:40.848 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3616524215 2024-09-22T06:11:11.566124+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2830323983 2024-09-22T06:09:44.936252+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/656404670 2024-09-22T06:09:44.936252+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4180047505 2024-09-22T06:09:44.936252+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/4133136045 2024-09-22T06:09:44.936252+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/1209175440 2024-09-22T06:10:11.734481+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/656404670 2024-09-22T06:09:44.936252+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/408464608 2024-09-22T06:11:11.566124+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/487105377 2024-09-22T06:10:11.734481+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3616524215 2024-09-22T06:11:11.566124+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/1209175440 2024-09-22T06:10:11.734481+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3076275909 2024-09-22T06:10:11.734481+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3629682408 2024-09-22T06:10:11.734481+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3669181697 2024-09-22T06:11:11.566124+0000 2024-09-21T06:30:40.849 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2861151403 2024-09-22T06:11:11.566124+0000 2024-09-21T06:30:40.850 INFO:teuthology.orchestra.run.smithi038.stderr:listed 15 entries 2024-09-21T06:30:40.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 msgr2=0x7f1ff40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:40.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 0x7f1ff40b8c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f200806b9c0 tx=0x7f1ff800b410 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 msgr2=0x7f200819bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2000005e30 tx=0x7f2000003f90 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 shutdown_connections 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f1ff40b6730 0x7f1ff40b8c40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2008108cf0 0x7f200819bed0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20081083a0 0x7f200819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 --2- 172.21.15.38:0/2678875007 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2008102a60 0x7f200819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.850+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 >> 172.21.15.38:0/2678875007 conn(0x7f2008079730 msgr2=0x7f2008104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.851+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 shutdown_connections 2024-09-21T06:30:40.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:40.851+0000 7f200e30e640 1 -- 172.21.15.38:0/2678875007 wait complete. 2024-09-21T06:30:41.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:41 smithi038 ceph-mon[31215]: pgmap v659: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:41.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:41 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2678875007' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:30:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:41 smithi174 ceph-mon[34815]: pgmap v659: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:41.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:41 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2678875007' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:30:41.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:41 smithi044 ceph-mon[34369]: pgmap v659: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:30:41.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:41 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2678875007' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:30:41.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:30:41.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:30:41.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:30:41.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:30:41.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:30:41.496 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:30:41.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:30:41.553 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-21T06:30:41.594 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:30:41.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:30:41.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:30:41.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:30:41.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-21T06:30:41.741 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:30:41.752 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:30:41.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:30:41.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:30:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 -- 172.21.15.38:0/769489765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 msgr2=0x7fa6f410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/769489765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f410f550 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009ca0 tx=0x7fa6e402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 -- 172.21.15.38:0/769489765 shutdown_connections 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/769489765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f410f550 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/769489765 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 0x7fa6f41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/769489765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 0x7fa6f4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 -- 172.21.15.38:0/769489765 >> 172.21.15.38:0/769489765 conn(0x7fa6f4079750 msgr2=0x7fa6f4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 -- 172.21.15.38:0/769489765 shutdown_connections 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.456+0000 7fa6f8e43640 1 -- 172.21.15.38:0/769489765 wait complete. 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.457+0000 7fa6f8e43640 1 Processor -- start 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.457+0000 7fa6f8e43640 1 -- start start 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 0x7fa6f4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 0x7fa6f41999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112ad0 con 0x7fa6f4108d20 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112950 con 0x7fa6f4102a90 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f8e43640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112c50 con 0x7fa6f41083d0 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34470/0 (socket says 172.21.15.38:34470) 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 -- 172.21.15.38:0/638650381 learned_addr learned my addr 172.21.15.38:0/638650381 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f259c640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 0x7fa6f4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f1d9b640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 0x7fa6f41999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 -- 172.21.15.38:0/638650381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 msgr2=0x7fa6f41999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 0x7fa6f41999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 -- 172.21.15.38:0/638650381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 msgr2=0x7fa6f4199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 0x7fa6f4199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.458+0000 7fa6f2d9d640 1 -- 172.21.15.38:0/638650381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f419f370 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6f2d9d640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4005e30 tx=0x7fa6e4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e404a070 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f419f600 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa6e4031660 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e402f930 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.459+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f406bb80 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.460+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f4103d10 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.462+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa6e404d070 con 0x7fa6f4108d20 2024-09-21T06:30:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.462+0000 7fa6eb7fe640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 0x7fa6e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:42.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.463+0000 7fa6f259c640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 0x7fa6e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:42.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.463+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fa6e4109e50 con 0x7fa6f4108d20 2024-09-21T06:30:42.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.463+0000 7fa6f259c640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 0x7fa6e00b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00bbe0 tx=0x7fa6ec00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:42.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.466+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6e4084710 con 0x7fa6f4108d20 2024-09-21T06:30:42.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.689+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6f4102ea0 con 0x7fa6f4108d20 2024-09-21T06:30:42.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.690+0000 7fa6eb7fe640 1 -- 172.21.15.38:0/638650381 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7fa6f4102ea0 con 0x7fa6f4108d20 2024-09-21T06:30:42.692 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:42.692 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:30:42.692 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:30:42.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 msgr2=0x7fa6e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 0x7fa6e00b8b90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00bbe0 tx=0x7fa6ec00b390 comp rx=0 tx=0).stop 2024-09-21T06:30:42.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 msgr2=0x7fa6f419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:42.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4005e30 tx=0x7fa6e4003f10 comp rx=0 tx=0).stop 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 shutdown_connections 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fa6e00b6680 0x7fa6e00b8b90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6f4108d20 0x7fa6f419ec40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6f41083d0 0x7fa6f41999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 --2- 172.21.15.38:0/638650381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6f4102a90 0x7fa6f4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 >> 172.21.15.38:0/638650381 conn(0x7fa6f4079750 msgr2=0x7fa6f4104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 shutdown_connections 2024-09-21T06:30:42.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:42.692+0000 7fa6f8e43640 1 -- 172.21.15.38:0/638650381 wait complete. 2024-09-21T06:30:43.376 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:43 smithi038 ceph-mon[31215]: pgmap v660: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:43.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:43 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/638650381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:43 smithi174 ceph-mon[34815]: pgmap v660: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:43.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:43 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/638650381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:43.405 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:30:43.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:43 smithi044 ceph-mon[34369]: pgmap v660: 97 pgs: 97 active+clean; 67 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:30:43.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:43 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/638650381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:43.663 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:44.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 -- 172.21.15.38:0/2948542132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 msgr2=0x7f02e81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 --2- 172.21.15.38:0/2948542132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e81098b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009900 tx=0x7f02dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 -- 172.21.15.38:0/2948542132 shutdown_connections 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 --2- 172.21.15.38:0/2948542132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8109df0 0x7f02e8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 --2- 172.21.15.38:0/2948542132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e81098b0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 --2- 172.21.15.38:0/2948542132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8103b60 0x7f02e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 -- 172.21.15.38:0/2948542132 >> 172.21.15.38:0/2948542132 conn(0x7f02e807b850 msgr2=0x7f02e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 -- 172.21.15.38:0/2948542132 shutdown_connections 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.122+0000 7f02eff31640 1 -- 172.21.15.38:0/2948542132 wait complete. 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 Processor -- start 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 -- start start 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 0x7f02e819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:44.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 0x7f02e819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8113bd0 con 0x7f02e81094a0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8113a50 con 0x7f02e8103b60 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02eff31640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8113d50 con 0x7f02e8109df0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34478/0 (socket says 172.21.15.38:34478) 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 -- 172.21.15.38:0/834671553 learned_addr learned my addr 172.21.15.38:0/834671553 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02edccd640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 0x7f02e819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ee4ce640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 0x7f02e819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 -- 172.21.15.38:0/834671553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 msgr2=0x7f02e819fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 0x7f02e819fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 -- 172.21.15.38:0/834671553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 msgr2=0x7f02e819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 0x7f02e819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02ed4cc640 1 -- 172.21.15.38:0/834671553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81a0590 con 0x7f02e81094a0 2024-09-21T06:30:44.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02ee4ce640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 0x7f02e819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.123+0000 7f02edccd640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 0x7f02e819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02ed4cc640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005940 tx=0x7f02dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc03f030 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e81a0820 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02dc004440 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc035070 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.124+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e81a6fe0 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.125+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e8104de0 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.127+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f02dc042030 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.127+0000 7f02daffd640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 0x7f02d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.127+0000 7f02edccd640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 0x7f02d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.128+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f02dc107d60 con 0x7f02e81094a0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.128+0000 7f02edccd640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 0x7f02d40b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009b50 tx=0x7f02e4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:44.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.130+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02dc0ce300 con 0x7f02e81094a0 2024-09-21T06:30:44.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.361+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02e810bbc0 con 0x7f02e81094a0 2024-09-21T06:30:44.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.361+0000 7f02daffd640 1 -- 172.21.15.38:0/834671553 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11911 (secure 0 0 0) 0x7f02dc0d26e0 con 0x7f02e81094a0 2024-09-21T06:30:44.363 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:44.363 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"btime":"2024-09-21T06:25:00:028204+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/1987897049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":1987897049},{"type":"v1","addr":"172.21.15.38:6835","nonce":1987897049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/2771020933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":2771020933},{"type":"v1","addr":"172.21.15.38:6837","nonce":2771020933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14859,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/3257072539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":3257072539},{"type":"v1","addr":"172.21.15.38:6839","nonce":3257072539}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14871,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6841/959334651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6840","nonce":959334651},{"type":"v1","addr":"172.21.15.38:6841","nonce":959334651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24604,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/2480120484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":2480120484},{"type":"v1","addr":"172.21.15.174:6833","nonce":2480120484}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1766511458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1766511458},{"type":"v1","addr":"172.21.15.174:6835","nonce":1766511458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:17:47.782150+0000","modified":"2024-09-21T06:24:59.932771+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24728,"mds_1":24695,"mds_2":24667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24641":{"gid":24641,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/3742968843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3742968843},{"type":"v1","addr":"172.21.15.44:6833","nonce":3742968843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/2784474374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":2784474374},{"type":"v1","addr":"172.21.15.174:6837","nonce":2784474374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/3535582137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3535582137},{"type":"v1","addr":"172.21.15.44:6835","nonce":3535582137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/2335561806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2335561806},{"type":"v1","addr":"172.21.15.174:6839","nonce":2335561806}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.44:6837/2962370729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2962370729},{"type":"v1","addr":"172.21.15.44:6837","nonce":2962370729}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24728":{"gid":24728,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6839/2983639005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2983639005},{"type":"v1","addr":"172.21.15.44:6839","nonce":2983639005}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24728,"qdb_cluster":[24667,24695,24728]},"id":1}]} 2024-09-21T06:30:44.364 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-21T06:30:44.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 msgr2=0x7f02d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 0x7f02d40b8b90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009b50 tx=0x7f02e4005f90 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 msgr2=0x7f02e819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005940 tx=0x7f02dc004040 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 shutdown_connections 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f02d40b6680 0x7f02d40b8b90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109df0 0x7f02e819fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f02e81094a0 0x7f02e819abc0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 --2- 172.21.15.38:0/834671553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e8103b60 0x7f02e819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 >> 172.21.15.38:0/834671553 conn(0x7f02e807b850 msgr2=0x7f02e8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 shutdown_connections 2024-09-21T06:30:44.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:44.364+0000 7f02eff31640 1 -- 172.21.15.38:0/834671553 wait complete. 2024-09-21T06:30:45.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:30:45.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:45 smithi038 ceph-mon[31215]: pgmap v661: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:30:45.236 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:45 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/834671553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:45.271 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:45.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:45 smithi174 ceph-mon[34815]: pgmap v661: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:30:45.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:45 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/834671553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:45 smithi044 ceph-mon[34369]: pgmap v661: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:30:45.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:45 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/834671553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:30:45.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 -- 172.21.15.38:0/3748652818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f645810de50 msgr2=0x7f6458110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:45.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 --2- 172.21.15.38:0/3748652818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f645810de50 0x7f6458110340 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f6450009900 tx=0x7f645002a410 comp rx=0 tx=0).stop 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 -- 172.21.15.38:0/3748652818 shutdown_connections 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 --2- 172.21.15.38:0/3748652818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f645810de50 0x7f6458110340 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 --2- 172.21.15.38:0/3748652818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6458105340 0x7f645810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 --2- 172.21.15.38:0/3748652818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 0x7f6458104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 -- 172.21.15.38:0/3748652818 >> 172.21.15.38:0/3748652818 conn(0x7f6458079750 msgr2=0x7f6458079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 -- 172.21.15.38:0/3748652818 shutdown_connections 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.764+0000 7f645d7d6640 1 -- 172.21.15.38:0/3748652818 wait complete. 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 Processor -- start 2024-09-21T06:30:45.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 -- start start 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 0x7f645819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 0x7f64581a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f6458113d20 con 0x7f6458105340 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6458113ba0 con 0x7f645810de50 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f645d7d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6458113ea0 con 0x7f64581049f0 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f64567fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f64567fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34510/0 (socket says 172.21.15.38:34510) 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.765+0000 7f64567fc640 1 -- 172.21.15.38:0/2834223082 learned_addr learned my addr 172.21.15.38:0/2834223082 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64577fe640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 0x7f64581a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f6456ffd640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 0x7f645819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:45.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 -- 172.21.15.38:0/2834223082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 msgr2=0x7f645819c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 0x7f645819c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 -- 172.21.15.38:0/2834223082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 msgr2=0x7f64581a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 0x7f64581a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 -- 172.21.15.38:0/2834223082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64581a27c0 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64577fe640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 0x7f64581a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f64567fc640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f644c00b990 tx=0x7f644c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c019070 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64581a2ab0 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f644c00cba0 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c0126b0 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.766+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64581a9290 con 0x7f6458105340 2024-09-21T06:30:45.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.767+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6458104e80 con 0x7f6458105340 2024-09-21T06:30:45.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.769+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f644c01c070 con 0x7f6458105340 2024-09-21T06:30:45.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.770+0000 7f643ffff640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 0x7f64400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:45.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.770+0000 7f6456ffd640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 0x7f64400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:45.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.770+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f644c0e6ff0 con 0x7f6458105340 2024-09-21T06:30:45.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.770+0000 7f6456ffd640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 0x7f64400b8c10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6448009890 tx=0x7f6448008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:45.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.773+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f644c0ad550 con 0x7f6458105340 2024-09-21T06:30:45.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.962+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f645819d980 con 0x7f6458105340 2024-09-21T06:30:45.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.964+0000 7f643ffff640 1 -- 172.21.15.38:0/2834223082 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+23001 (secure 0 0 0) 0x7f644c0b1930 con 0x7f6458105340 2024-09-21T06:30:45.966 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-21T06:30:45.966 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":87,"fsid":"d022e7d2-77df-11ef-baf5-efdc52797490","created":"2024-09-21T06:09:10.509247+0000","modified":"2024-09-21T06:30:17.149581+0000","last_up_change":"2024-09-21T06:17:00.323519+0000","last_in_change":"2024-09-21T06:16:35.881540+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:13:12.045212+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:17:43.494293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:17:45.824173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b14f970-8964-441c-94f3-4ab77aa6be8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6803","nonce":1319599999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6805","nonce":1319599999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6809","nonce":1319599999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":1319599999},{"type":"v1","addr":"172.21.15.38:6807","nonce":1319599999}]},"public_addr":"172.21.15.38:6803/1319599999","cluster_addr":"172.21.15.38:6805/1319599999","heartbeat_back_addr":"172.21.15.38:6809/1319599999","heartbeat_front_addr":"172.21.15.38:6807/1319599999","state":["exists","up"]},{"osd":1,"uuid":"4a3c3919-c745-4fab-9d95-d9a0671f12e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6801","nonce":375751782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6803","nonce":375751782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6807","nonce":375751782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":375751782},{"type":"v1","addr":"172.21.15.44:6805","nonce":375751782}]},"public_addr":"172.21.15.44:6801/375751782","cluster_addr":"172.21.15.44:6803/375751782","heartbeat_back_addr":"172.21.15.44:6807/375751782","heartbeat_front_addr":"172.21.15.44:6805/375751782","state":["exists","up"]},{"osd":2,"uuid":"e6daee57-622c-4b39-95f3-2e013ae4c531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6801","nonce":1341151207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6803","nonce":1341151207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6807","nonce":1341151207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1341151207},{"type":"v1","addr":"172.21.15.174:6805","nonce":1341151207}]},"public_addr":"172.21.15.174:6801/1341151207","cluster_addr":"172.21.15.174:6803/1341151207","heartbeat_back_addr":"172.21.15.174:6807/1341151207","heartbeat_front_addr":"172.21.15.174:6805/1341151207","state":["exists","up"]},{"osd":3,"uuid":"1ac42b28-351a-4ee8-aad9-baa87d419cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6811","nonce":2396097926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6813","nonce":2396097926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6817","nonce":2396097926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":2396097926},{"type":"v1","addr":"172.21.15.38:6815","nonce":2396097926}]},"public_addr":"172.21.15.38:6811/2396097926","cluster_addr":"172.21.15.38:6813/2396097926","heartbeat_back_addr":"172.21.15.38:6817/2396097926","heartbeat_front_addr":"172.21.15.38:6815/2396097926","state":["exists","up"]},{"osd":4,"uuid":"7b694d72-2d22-4f2e-939e-1e8a56796bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6809","nonce":1910802405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6811","nonce":1910802405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6815","nonce":1910802405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1910802405},{"type":"v1","addr":"172.21.15.44:6813","nonce":1910802405}]},"public_addr":"172.21.15.44:6809/1910802405","cluster_addr":"172.21.15.44:6811/1910802405","heartbeat_back_addr":"172.21.15.44:6815/1910802405","heartbeat_front_addr":"172.21.15.44:6813/1910802405","state":["exists","up"]},{"osd":5,"uuid":"f2331d76-8457-48ed-98b7-21d8a7289ae5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6809","nonce":2947272530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6811","nonce":2947272530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6815","nonce":2947272530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":2947272530},{"type":"v1","addr":"172.21.15.174:6813","nonce":2947272530}]},"public_addr":"172.21.15.174:6809/2947272530","cluster_addr":"172.21.15.174:6811/2947272530","heartbeat_back_addr":"172.21.15.174:6815/2947272530","heartbeat_front_addr":"172.21.15.174:6813/2947272530","state":["exists","up"]},{"osd":6,"uuid":"8d2b3d8e-d555-44f1-b3e6-cc3845cd9cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6819","nonce":1769685316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6821","nonce":1769685316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6825","nonce":1769685316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1769685316},{"type":"v1","addr":"172.21.15.38:6823","nonce":1769685316}]},"public_addr":"172.21.15.38:6819/1769685316","cluster_addr":"172.21.15.38:6821/1769685316","heartbeat_back_addr":"172.21.15.38:6825/1769685316","heartbeat_front_addr":"172.21.15.38:6823/1769685316","state":["exists","up"]},{"osd":7,"uuid":"326d922e-492f-4a69-93b0-f2861433f48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6817","nonce":1039773435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6819","nonce":1039773435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6823","nonce":1039773435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1039773435},{"type":"v1","addr":"172.21.15.44:6821","nonce":1039773435}]},"public_addr":"172.21.15.44:6817/1039773435","cluster_addr":"172.21.15.44:6819/1039773435","heartbeat_back_addr":"172.21.15.44:6823/1039773435","heartbeat_front_addr":"172.21.15.44:6821/1039773435","state":["exists","up"]},{"osd":8,"uuid":"c5cfb5b9-32ed-4457-8ba7-20cc22188450","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6817","nonce":3305912414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6819","nonce":3305912414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6823","nonce":3305912414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3305912414},{"type":"v1","addr":"172.21.15.174:6821","nonce":3305912414}]},"public_addr":"172.21.15.174:6817/3305912414","cluster_addr":"172.21.15.174:6819/3305912414","heartbeat_back_addr":"172.21.15.174:6823/3305912414","heartbeat_front_addr":"172.21.15.174:6821/3305912414","state":["exists","up"]},{"osd":9,"uuid":"df485a7b-dc9a-4ee0-8c81-8f5aaed79c30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6827","nonce":2245140106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6829","nonce":2245140106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6833","nonce":2245140106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":2245140106},{"type":"v1","addr":"172.21.15.38:6831","nonce":2245140106}]},"public_addr":"172.21.15.38:6827/2245140106","cluster_addr":"172.21.15.38:6829/2245140106","heartbeat_back_addr":"172.21.15.38:6833/2245140106","heartbeat_front_addr":"172.21.15.38:6831/2245140106","state":["exists","up"]},{"osd":10,"uuid":"65ea74b8-1f22-4471-82bc-46af8862d7ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6825","nonce":2459414427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6827","nonce":2459414427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6831","nonce":2459414427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2459414427},{"type":"v1","addr":"172.21.15.44:6829","nonce":2459414427}]},"public_addr":"172.21.15.44:6825/2459414427","cluster_addr":"172.21.15.44:6827/2459414427","heartbeat_back_addr":"172.21.15.44:6831/2459414427","heartbeat_front_addr":"172.21.15.44:6829/2459414427","state":["exists","up"]},{"osd":11,"uuid":"5f96a5ad-c4d1-4a79-9d09-c302e723251d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6825","nonce":1533000307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6827","nonce":1533000307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6831","nonce":1533000307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1533000307},{"type":"v1","addr":"172.21.15.174:6829","nonce":1533000307}]},"public_addr":"172.21.15.174:6825/1533000307","cluster_addr":"172.21.15.174:6827/1533000307","heartbeat_back_addr":"172.21.15.174:6831/1533000307","heartbeat_front_addr":"172.21.15.174:6829/1533000307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:16.490507+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:12:42.328409+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:08.301339+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:34.336802+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:13:59.681226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:25.574256+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:14:51.403652+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:15.691775+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:15:42.079602+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:07.379155+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:32.182744+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:16:57.521648+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"3.5","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6801/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2830323983":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4180047505":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/4133136045":"2024-09-22T06:09:44.936252+0000","172.21.15.38:6801/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/656404670":"2024-09-22T06:09:44.936252+0000","172.21.15.38:0/408464608":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/487105377":"2024-09-22T06:10:11.734481+0000","172.21.15.38:6800/3616524215":"2024-09-22T06:11:11.566124+0000","172.21.15.38:6800/1209175440":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3076275909":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3629682408":"2024-09-22T06:10:11.734481+0000","172.21.15.38:0/3669181697":"2024-09-22T06:11:11.566124+0000","172.21.15.38:0/2861151403":"2024-09-22T06:11:11.566124+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 msgr2=0x7f64400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 0x7f64400b8c10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6448009890 tx=0x7f6448008040 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 msgr2=0x7f645819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f644c00b990 tx=0x7f644c00be50 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 shutdown_connections 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f64400b6700 0x7f64400b8c10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f645810de50 0x7f64581a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6458105340 0x7f645819cdf0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 --2- 172.21.15.38:0/2834223082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64581049f0 0x7f645819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:45.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 >> 172.21.15.38:0/2834223082 conn(0x7f6458079750 msgr2=0x7f645810ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:45.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 shutdown_connections 2024-09-21T06:30:45.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:45.966+0000 7f645d7d6640 1 -- 172.21.15.38:0/2834223082 wait complete. 2024-09-21T06:30:46.237 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:46 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2834223082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:46.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:46 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2834223082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:46.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:46 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2834223082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:30:46.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:30:46.983 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:47.364 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:47 smithi038 ceph-mon[31215]: pgmap v662: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:30:47.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-mon[34815]: pgmap v662: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:30:47.404 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-mon[34369]: pgmap v662: 97 pgs: 97 active+clean; 67 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- 172.21.15.38:0/3075050883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004102a60 msgr2=0x7f7004102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 --2- 172.21.15.38:0/3075050883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004102a60 0x7f7004102e70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009900 tx=0x7f6ff402a410 comp rx=0 tx=0).stop 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- 172.21.15.38:0/3075050883 shutdown_connections 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 --2- 172.21.15.38:0/3075050883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7004108cf0 0x7f700410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 --2- 172.21.15.38:0/3075050883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70041083a0 0x7f70041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 --2- 172.21.15.38:0/3075050883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004102a60 0x7f7004102e70 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- 172.21.15.38:0/3075050883 >> 172.21.15.38:0/3075050883 conn(0x7f7004079730 msgr2=0x7f7004079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- 172.21.15.38:0/3075050883 shutdown_connections 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- 172.21.15.38:0/3075050883 wait complete. 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 Processor -- start 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.455+0000 7f700a824640 1 -- start start 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 0x7f700419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 0x7f700419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112aa0 con 0x7f7004108cf0 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112920 con 0x7f70041083a0 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f700a824640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112c20 con 0x7f7004102a60 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34530/0 (socket says 172.21.15.38:34530) 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 -- 172.21.15.38:0/1885571861 learned_addr learned my addr 172.21.15.38:0/1885571861 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7003fff640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 0x7f700419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f70037fe640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 0x7f700419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 -- 172.21.15.38:0/1885571861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 msgr2=0x7f700419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 0x7f700419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 -- 172.21.15.38:0/1885571861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 msgr2=0x7f700419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 0x7f700419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 -- 172.21.15.38:0/1885571861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70041a0470 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f70037fe640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 0x7f700419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7003fff640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 0x7f700419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.456+0000 7f7008dc1640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00cce0 tx=0x7f6ffc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.457+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00f450 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.457+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6ffc00fac0 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.457+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70041a0760 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.457+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc018be0 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.457+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70041a6f80 con 0x7f7004108cf0 2024-09-21T06:30:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.458+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7004102e70 con 0x7f7004108cf0 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.459+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6ffc00fc70 con 0x7f7004108cf0 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.460+0000 7f70017fa640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 0x7f6fec0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.460+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f6ffc0e7de0 con 0x7f7004108cf0 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.460+0000 7f7003fff640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 0x7f6fec0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.461+0000 7f7003fff640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 0x7f6fec0b8c40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4000c00 tx=0x7f6ff4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:47.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.463+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ffc014030 con 0x7f7004108cf0 2024-09-21T06:30:47.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.692+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f700419b6f0 con 0x7f7004108cf0 2024-09-21T06:30:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.696+0000 7f70017fa640 1 -- 172.21.15.38:0/1885571861 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f700419b6f0 con 0x7f7004108cf0 2024-09-21T06:30:47.697 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:30:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.699+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 msgr2=0x7f6fec0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.699+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 0x7f6fec0b8c40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4000c00 tx=0x7f6ff4009680 comp rx=0 tx=0).stop 2024-09-21T06:30:47.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.699+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 msgr2=0x7f700419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.699+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00cce0 tx=0x7f6ffc00a620 comp rx=0 tx=0).stop 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 shutdown_connections 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f6fec0b6730 0x7f6fec0b8c40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7004108cf0 0x7f700419fe00 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70041083a0 0x7f700419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 --2- 172.21.15.38:0/1885571861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7004102a60 0x7f700419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 >> 172.21.15.38:0/1885571861 conn(0x7f7004079730 msgr2=0x7f7004106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 shutdown_connections 2024-09-21T06:30:47.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:47.700+0000 7f700a824640 1 -- 172.21.15.38:0/1885571861 wait complete. 2024-09-21T06:30:47.986 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a[31211]: 2024-09-21T06:30:47.693+0000 7f5118332640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:30:48.037 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-mds[63741]: -- 172.21.15.174:0/2210700124 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588f8b1f860 con 0x5588fccc7a80 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: starting mds.c at 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-mds[64029]: -- 172.21.15.174:0/244107181 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8c7611860 con 0x55f8cb7b9a80 2024-09-21T06:30:48.038 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:30:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: starting mds.i at 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-mds[62413]: -- 172.21.15.44:0/3378978401 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e8954f860 con 0x555e8d6f7600 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: starting mds.k at 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-mds[63249]: -- 172.21.15.44:0/1093043716 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f205b65860 con 0x55f209d0da80 2024-09-21T06:30:48.039 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: starting mds.b at 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-mds[62695]: -- 172.21.15.44:0/1250091641 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b64bc85860 con 0x55b64fe2d180 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: starting mds.e at 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: 2024-09-21T06:30:47.773+0000 7f8112687640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: ignoring --setuser ceph since I am not root 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: ignoring --setgroup ceph since I am not root 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-mds[62965]: -- 172.21.15.44:0/441104190 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cacb07860 con 0x559cb0cafa80 2024-09-21T06:30:48.040 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:30:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: starting mds.h at 2024-09-21T06:30:48.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:30:48.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:48.377 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:30:48.378 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:30:48.378 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:30:48.378 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:48 smithi038 ceph-mon[31215]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:30:48.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:30:48.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:48.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:30:48.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:30:48.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:30:48.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:48 smithi174 ceph-mon[34815]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/1885571861' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:30:48.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:48 smithi044 ceph-mon[34369]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:30:48.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:30:48.672 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: pgmap v664: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6836/2897338540,v1:172.21.15.174:6838/2897338540] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.174:6837/391663765,v1:172.21.15.174:6839/391663765] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6832/4106416387,v1:172.21.15.44:6834/4106416387] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6833/4041318459,v1:172.21.15.44:6835/4041318459] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6836/141743895,v1:172.21.15.44:6837/141743895] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: mds.? [v2:172.21.15.44:6838/585080466,v1:172.21.15.44:6839/585080466] up:boot 2024-09-21T06:30:49.081 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:30:49.082 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:49 smithi038 ceph-mon[31215]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 -- 172.21.15.38:0/628561574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b0102ae0 msgr2=0x7fd4b0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/628561574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b0102ae0 0x7fd4b0102ef0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009900 tx=0x7fd4ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 -- 172.21.15.38:0/628561574 shutdown_connections 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/628561574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0108d20 0x7fd4b010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/628561574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b01083d0 0x7fd4b01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/628561574 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b0102ae0 0x7fd4b0102ef0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 -- 172.21.15.38:0/628561574 >> 172.21.15.38:0/628561574 conn(0x7fd4b0079760 msgr2=0x7fd4b0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 -- 172.21.15.38:0/628561574 shutdown_connections 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.174+0000 7fd4b7db7640 1 -- 172.21.15.38:0/628561574 wait complete. 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 Processor -- start 2024-09-21T06:30:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 -- start start 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 0x7fd4b019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b0108d20 0x7fd4b01a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0112b30 con 0x7fd4b01083d0 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01129b0 con 0x7fd4b0102ae0 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.175+0000 7fd4b7db7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0112cb0 con 0x7fd4b0108d20 2024-09-21T06:30:49.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34542/0 (socket says 172.21.15.38:34542) 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 -- 172.21.15.38:0/3563939358 learned_addr learned my addr 172.21.15.38:0/3563939358 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5b53640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 0x7fd4b019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b6354640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b0108d20 0x7fd4b01a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 -- 172.21.15.38:0/3563939358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b0108d20 msgr2=0x7fd4b01a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b0108d20 0x7fd4b01a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 -- 172.21.15.38:0/3563939358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 msgr2=0x7fd4b019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 0x7fd4b019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 -- 172.21.15.38:0/3563939358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b01a2650 con 0x7fd4b01083d0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5b53640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 0x7fd4b019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b5352640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000b450 tx=0x7fd4a000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0015020 con 0x7fd4b01083d0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4a0011d60 con 0x7fd4b01083d0 2024-09-21T06:30:49.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000f340 con 0x7fd4b01083d0 2024-09-21T06:30:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.176+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b01a2940 con 0x7fd4b01083d0 2024-09-21T06:30:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.177+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01a9160 con 0x7fd4b01083d0 2024-09-21T06:30:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.178+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b0103d10 con 0x7fd4b01083d0 2024-09-21T06:30:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.179+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd4a0018020 con 0x7fd4b01083d0 2024-09-21T06:30:49.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.180+0000 7fd4a6ffd640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 0x7fd49c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.180+0000 7fd4b5b53640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 0x7fd49c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.180+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8655+0+0 (secure 0 0 0) 0x7fd4a00e71b0 con 0x7fd4b01083d0 2024-09-21T06:30:49.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.180+0000 7fd4b5b53640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 0x7fd49c0b8c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:49.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.184+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4a001f020 con 0x7fd4b01083d0 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: pgmap v664: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6836/2897338540,v1:172.21.15.174:6838/2897338540] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.174:6837/391663765,v1:172.21.15.174:6839/391663765] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6832/4106416387,v1:172.21.15.44:6834/4106416387] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6833/4041318459,v1:172.21.15.44:6835/4041318459] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6836/141743895,v1:172.21.15.44:6837/141743895] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: mds.? [v2:172.21.15.44:6838/585080466,v1:172.21.15.44:6839/585080466] up:boot 2024-09-21T06:30:49.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:30:49.396 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:49 smithi174 ceph-mon[34815]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: pgmap v664: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6836/2897338540,v1:172.21.15.174:6838/2897338540] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.174:6837/391663765,v1:172.21.15.174:6839/391663765] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6832/4106416387,v1:172.21.15.44:6834/4106416387] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6833/4041318459,v1:172.21.15.44:6835/4041318459] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6836/141743895,v1:172.21.15.44:6837/141743895] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: mds.? [v2:172.21.15.44:6838/585080466,v1:172.21.15.44:6839/585080466] up:boot 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:30:49.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:30:49.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:30:49.406 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:49 smithi044 ceph-mon[34369]: from='mgr.14223 172.21.15.38:0/3984854625' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:30:49.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:49.415+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd4b019d8d0 con 0x7fd4b01083d0 2024-09-21T06:30:50.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.045+0000 7fd4a6ffd640 1 -- 172.21.15.38:0/3563939358 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fd4a000d040 con 0x7fd4b01083d0 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 msgr2=0x7fd49c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 0x7fd49c0b8c40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac000c00 tx=0x7fd4ac009680 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 msgr2=0x7fd4b019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000b450 tx=0x7fd4a000b910 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 shutdown_connections 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fd49c0b6730 0x7fd49c0b8c40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b0108d20 0x7fd4b01a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b01083d0 0x7fd4b019cd40 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 --2- 172.21.15.38:0/3563939358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b0102ae0 0x7fd4b019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 >> 172.21.15.38:0/3563939358 conn(0x7fd4b0079760 msgr2=0x7fd4b006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:50.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 shutdown_connections 2024-09-21T06:30:50.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:50.049+0000 7fd4b7db7640 1 -- 172.21.15.38:0/3563939358 wait complete. 2024-09-21T06:30:50.351 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:50 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:50.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:50 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:50.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:50 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:50.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:30:51.014 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: pgmap v665: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: Cluster is now healthy 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:51.319 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:51 smithi038 ceph-mon[31215]: fsmap 12 up:standby 2024-09-21T06:30:51.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: pgmap v665: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:51.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:51.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:30:51.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: Cluster is now healthy 2024-09-21T06:30:51.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:51.397 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:51 smithi174 ceph-mon[34815]: fsmap 12 up:standby 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: pgmap v665: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: Cluster is now healthy 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/3563939358' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:51.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:51 smithi044 ceph-mon[34369]: fsmap 12 up:standby 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 -- 172.21.15.38:0/1246519629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1048c0 msgr2=0x7fb82c104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 --2- 172.21.15.38:0/1246519629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1048c0 0x7fb82c104cd0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fb828009900 tx=0x7fb82802a410 comp rx=0 tx=0).stop 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 -- 172.21.15.38:0/1246519629 shutdown_connections 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 --2- 172.21.15.38:0/1246519629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c10de70 0x7fb82c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 --2- 172.21.15.38:0/1246519629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c1052a0 0x7fb82c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 --2- 172.21.15.38:0/1246519629 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1048c0 0x7fb82c104cd0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 -- 172.21.15.38:0/1246519629 >> 172.21.15.38:0/1246519629 conn(0x7fb82c079760 msgr2=0x7fb82c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 -- 172.21.15.38:0/1246519629 shutdown_connections 2024-09-21T06:30:51.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.576+0000 7fb833102640 1 -- 172.21.15.38:0/1246519629 wait complete. 2024-09-21T06:30:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 Processor -- start 2024-09-21T06:30:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 -- start start 2024-09-21T06:30:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c1048c0 0x7fb82c1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:51.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c10de70 0x7fb82c103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c113bf0 con 0x7fb82c1052a0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c113a70 con 0x7fb82c1048c0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb833102640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c113d70 con 0x7fb82c10de70 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb823fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb823fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60912/0 (socket says 172.21.15.38:60912) 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb823fff640 1 -- 172.21.15.38:0/819839766 learned_addr learned my addr 172.21.15.38:0/819839766 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.577+0000 7fb83169f640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c10de70 0x7fb82c103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb830e9e640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c1048c0 0x7fb82c1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 -- 172.21.15.38:0/819839766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c10de70 msgr2=0x7fb82c103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c10de70 0x7fb82c103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 -- 172.21.15.38:0/819839766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c1048c0 msgr2=0x7fb82c1027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c1048c0 0x7fb82c1027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 -- 172.21.15.38:0/819839766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1a88a0 con 0x7fb82c1052a0 2024-09-21T06:30:51.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb823fff640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00d950 tx=0x7fb81c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c017070 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb81c009c30 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1a8b90 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0047a0 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.578+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1a90f0 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.580+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c06c190 con 0x7fb82c1052a0 2024-09-21T06:30:51.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.581+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb81c004020 con 0x7fb82c1052a0 2024-09-21T06:30:51.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.582+0000 7fb821ffb640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 0x7fb8140b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:51.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.582+0000 7fb830e9e640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 0x7fb8140b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:51.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.582+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8655+0+0 (secure 0 0 0) 0x7fb81c0e73e0 con 0x7fb82c1052a0 2024-09-21T06:30:51.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.583+0000 7fb830e9e640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 0x7fb8140b8c10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8280314b0 tx=0x7fb8280058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:51.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.586+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb81c020020 con 0x7fb82c1052a0 2024-09-21T06:30:51.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:51.775+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb82c02e640 con 0x7fb82c1052a0 2024-09-21T06:30:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:30:52.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.046+0000 7fb821ffb640 1 -- 172.21.15.38:0/819839766 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7fb81c0ad850 con 0x7fb82c1052a0 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 msgr2=0x7fb8140b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 0x7fb8140b8c10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8280314b0 tx=0x7fb8280058d0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 msgr2=0x7fb82c102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00d950 tx=0x7fb81c00de10 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 shutdown_connections 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7fb8140b6700 0x7fb8140b8c10 secure :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8280314b0 tx=0x7fb8280058d0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb82c10de70 0x7fb82c103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c1052a0 0x7fb82c102d10 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 --2- 172.21.15.38:0/819839766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c1048c0 0x7fb82c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.050+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 >> 172.21.15.38:0/819839766 conn(0x7fb82c079760 msgr2=0x7fb82c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.051+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 shutdown_connections 2024-09-21T06:30:52.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:52.051+0000 7fb833102640 1 -- 172.21.15.38:0/819839766 wait complete. 2024-09-21T06:30:52.326 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:52 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:52.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:52 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:52.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:52 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:52.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d022e7d2-77df-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:30:52.937 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:53.331 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:53 smithi038 ceph-mon[31215]: pgmap v666: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-21T06:30:53.331 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:53 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:53.331 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:53 smithi038 ceph-mon[31215]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:30:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:53 smithi174 ceph-mon[34815]: pgmap v666: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-21T06:30:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:53 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:53.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:53 smithi174 ceph-mon[34815]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:30:53.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:53 smithi044 ceph-mon[34369]: pgmap v666: 97 pgs: 97 active+clean; 67 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-21T06:30:53.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:53 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/819839766' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:53.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:53 smithi044 ceph-mon[34369]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 -- 172.21.15.38:0/3687585179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1648108cf0 msgr2=0x7f164810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 --2- 172.21.15.38:0/3687585179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1648108cf0 0x7f164810f520 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f1640009ca0 tx=0x7f164002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 -- 172.21.15.38:0/3687585179 shutdown_connections 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 --2- 172.21.15.38:0/3687585179 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1648108cf0 0x7f164810f520 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 --2- 172.21.15.38:0/3687585179 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16481083a0 0x7f16481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 --2- 172.21.15.38:0/3687585179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648102a60 0x7f1648102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 -- 172.21.15.38:0/3687585179 >> 172.21.15.38:0/3687585179 conn(0x7f1648079730 msgr2=0x7f1648079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:53.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 -- 172.21.15.38:0/3687585179 shutdown_connections 2024-09-21T06:30:53.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.424+0000 7f16501ae640 1 -- 172.21.15.38:0/3687585179 wait complete. 2024-09-21T06:30:53.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 Processor -- start 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 -- start start 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1648102a60 0x7f16480ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648108cf0 0x7f16481000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 -- 0x7f1648112aa0 con 0x7f16481083a0 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1648112920 con 0x7f1648108cf0 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.425+0000 7f16501ae640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1648112c20 con 0x7f1648102a60 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60930/0 (socket says 172.21.15.38:60930) 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 -- 172.21.15.38:0/2074135149 learned_addr learned my addr 172.21.15.38:0/2074135149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164df4a640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1648102a60 0x7f16480ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164e74b640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648108cf0 0x7f16481000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 -- 172.21.15.38:0/2074135149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1648102a60 msgr2=0x7f16480ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1648102a60 0x7f16480ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 -- 172.21.15.38:0/2074135149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648108cf0 msgr2=0x7f16481000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648108cf0 0x7f16481000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 -- 172.21.15.38:0/2074135149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16481a87a0 con 0x7f16481083a0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f164d749640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f163800d740 tx=0x7f163800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638017070 con 0x7f16481083a0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f163800de50 con 0x7f16481083a0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16481a8a90 con 0x7f16481083a0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638004d90 con 0x7f16481083a0 2024-09-21T06:30:53.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.426+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16481a8f80 con 0x7f16481083a0 2024-09-21T06:30:53.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.428+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1648102e70 con 0x7f16481083a0 2024-09-21T06:30:53.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.429+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1638004f30 con 0x7f16481083a0 2024-09-21T06:30:53.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.430+0000 7f163effd640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 0x7f16340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:53.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.430+0000 7f164df4a640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 0x7f16340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:53.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.430+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8159+0+0 (secure 0 0 0) 0x7f16380e72f0 con 0x7f16481083a0 2024-09-21T06:30:53.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.431+0000 7f164df4a640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 0x7f16340b8b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f16481010c0 tx=0x7f164400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:53.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.433+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16380b1d40 con 0x7f16481083a0 2024-09-21T06:30:53.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:53.623+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f164802e640 con 0x7f16481083a0 2024-09-21T06:30:54.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.059+0000 7f163effd640 1 -- 172.21.15.38:0/2074135149 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7f16380b6c80 con 0x7f16481083a0 2024-09-21T06:30:54.062 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2024-09-21T06:30:54.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 msgr2=0x7f16340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:54.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 0x7f16340b8b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f16481010c0 tx=0x7f164400b410 comp rx=0 tx=0).stop 2024-09-21T06:30:54.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 msgr2=0x7f16480ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:54.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f163800d740 tx=0x7f163800dc00 comp rx=0 tx=0).stop 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 shutdown_connections 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:6800/4178988721,v1:172.21.15.38:6801/4178988721] conn(0x7f16340b6680 0x7f16340b8b90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1648108cf0 0x7f16481000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16481083a0 0x7f16480ffbb0 secure :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f163800d740 tx=0x7f163800dc00 comp rx=0 tx=0).stop 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 --2- 172.21.15.38:0/2074135149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1648102a60 0x7f16480ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.062+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 >> 172.21.15.38:0/2074135149 conn(0x7f1648079730 msgr2=0x7f164806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.063+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 shutdown_connections 2024-09-21T06:30:54.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-21T06:30:54.063+0000 7f16501ae640 1 -- 172.21.15.38:0/2074135149 wait complete. 2024-09-21T06:30:54.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:54 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:54.393 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:54 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:54.405 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:54 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:30:54.767 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:30:54.794 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:30:54.827 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:30:54.854 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:30:54.854 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:30:54.870 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:30:54.888 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:30:54.909 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:30:54.909 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:30:54.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:30:55.063 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:54 smithi038 systemd[1]: Stopping Ceph mon.a for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:30:55.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:55 smithi044 ceph-mon[34369]: pgmap v668: 65 pgs: 65 active+clean; 577 KiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:30:55.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:55 smithi044 ceph-mon[34369]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:55.155 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:55 smithi044 ceph-mon[34369]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:30:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:55 smithi174 ceph-mon[34815]: pgmap v668: 65 pgs: 65 active+clean; 577 KiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:30:55.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:55 smithi174 ceph-mon[34815]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:55.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:55 smithi174 ceph-mon[34815]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:30:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 ceph-mon[31215]: pgmap v668: 65 pgs: 65 active+clean; 577 KiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:30:55.486 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 ceph-mon[31215]: from='client.? 172.21.15.38:0/2074135149' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:30:55.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 ceph-mon[31215]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:30:55.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a[31211]: 2024-09-21T06:30:55.229+0000 7f511db3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:30:55.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a[31211]: 2024-09-21T06:30:55.229+0000 7f511db3d640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:30:55.487 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 podman[113274]: 2024-09-21 06:30:55.302529222 +0000 UTC m=+0.202047420 container died 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:30:55.958 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 podman[113274]: 2024-09-21 06:30:55.739350254 +0000 UTC m=+0.638868442 container cleanup 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:30:55.959 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 bash[113274]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:30:56.219 INFO:journalctl@ceph.mon.a.smithi038.stdout:Sep 21 06:30:55 smithi038 podman[113320]: 2024-09-21 06:30:55.957579802 +0000 UTC m=+0.654540183 container remove 9fe2f7dd28b781375b98fc790d847b476450b5cbe721668eec7d4174bfa140ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:30:56.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:30:56.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:30:56.268 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:30:56.268 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:30:56.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:30:56.604 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 systemd[1]: Stopping Ceph mon.b for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:30:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b[34365]: 2024-09-21T06:30:56.602+0000 7f1b5f9c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:30:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b[34365]: 2024-09-21T06:30:56.602+0000 7f1b5f9c4640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:30:56.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 podman[66752]: 2024-09-21 06:30:56.643653304 +0000 UTC m=+0.172010804 container died ed8d4f326caf950f6925acc6fcd49c1a321ad2a4778e157ca53ef275da15c978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:30:57.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 podman[66752]: 2024-09-21 06:30:56.98604167 +0000 UTC m=+0.514399170 container cleanup ed8d4f326caf950f6925acc6fcd49c1a321ad2a4778e157ca53ef275da15c978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:30:57.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:56 smithi044 bash[66752]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:30:57.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:30:57.440 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:57 smithi044 podman[66764]: 2024-09-21 06:30:57.178953934 +0000 UTC m=+0.532335738 container remove ed8d4f326caf950f6925acc6fcd49c1a321ad2a4778e157ca53ef275da15c978 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:30:57.440 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:57 smithi044 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T06:30:57.440 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:57 smithi044 systemd[1]: Stopped Ceph mon.b for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:30:57.440 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 21 06:30:57 smithi044 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.b.service: Consumed 14.264s CPU time. 2024-09-21T06:30:57.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:30:57.468 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:30:57.468 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:30:57.468 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:30:57.814 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:57 smithi174 systemd[1]: Stopping Ceph mon.c for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:30:58.139 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c[34808]: 2024-09-21T06:30:57.812+0000 7fca497e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:30:58.139 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c[34808]: 2024-09-21T06:30:57.812+0000 7fca497e5640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:30:58.139 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:57 smithi174 podman[67427]: 2024-09-21 06:30:57.833191911 +0000 UTC m=+0.161276897 container died 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:30:58.394 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:58 smithi174 podman[67427]: 2024-09-21 06:30:58.237653919 +0000 UTC m=+0.565738912 container cleanup 20c40e55f0600408a3e18afec3c568ccdb624e738503babc3e420c625c748ceb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:30:58.395 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 06:30:58 smithi174 bash[67427]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:30:58.626 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:30:58.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:30:58.670 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:30:58.670 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:30:58.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:30:58.986 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:30:58 smithi038 systemd[1]: Stopping Ceph mgr.x for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:30:59.313 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:30:59 smithi038 podman[113450]: 2024-09-21 06:30:59.017302859 +0000 UTC m=+0.145687434 container died 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:30:59.736 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:30:59 smithi038 podman[113450]: 2024-09-21 06:30:59.511858353 +0000 UTC m=+0.640242966 container cleanup 18d9ddb492f34d0e98f8c1699aef0ef4665803e76dd83d4fedb93f8fb95b3d40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:30:59.736 INFO:journalctl@ceph.mgr.x.smithi038.stdout:Sep 21 06:30:59 smithi038 bash[113450]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:30:59.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:30:59.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:30:59.973 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:30:59.973 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:30:59.973 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:31:00.268 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:31:00 smithi044 systemd[1]: Stopping Ceph mgr.y for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:00.610 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:31:00 smithi044 podman[66876]: 2024-09-21 06:31:00.322407039 +0000 UTC m=+0.160958083 container died 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:31:00.904 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:31:00 smithi044 podman[66876]: 2024-09-21 06:31:00.691154201 +0000 UTC m=+0.529705246 container cleanup 1ea7776556a6ca6f520bbdc991172a446b7eab8fc6021f1bd642938cb6d7b685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:31:00.905 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 21 06:31:00 smithi044 bash[66876]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:31:01.099 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:31:01.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:01.136 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:31:01.136 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:31:01.136 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:31:01.456 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:01 smithi174 systemd[1]: Stopping Ceph mgr.z for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:01.752 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:01 smithi174 podman[67552]: 2024-09-21 06:31:01.454800765 +0000 UTC m=+0.130476587 container died 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T06:31:02.002 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:01 smithi174 podman[67552]: 2024-09-21 06:31:01.825481883 +0000 UTC m=+0.501157705 container cleanup 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T06:31:02.003 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:01 smithi174 bash[67552]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:31:02.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:31:02.275 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:02 smithi174 podman[67564]: 2024-09-21 06:31:02.001663465 +0000 UTC m=+0.541678447 container remove 454d8e4f5b767f653ec7ad760e001350543a908911b901b981e3f35c82d60077 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:02.275 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:02 smithi174 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T06:31:02.275 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:02 smithi174 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z.service: Failed with result 'exit-code'. 2024-09-21T06:31:02.275 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:02 smithi174 systemd[1]: Stopped Ceph mgr.z for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:31:02.275 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 06:31:02 smithi174 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mgr.z.service: Consumed 7.217s CPU time. 2024-09-21T06:31:02.288 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:02.288 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:31:02.288 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:31:02.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:31:02.593 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:02 smithi038 systemd[1]: Stopping Ceph osd.0 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:02.986 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:31:02.589+0000 7ff8a3602640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:02.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:31:02.589+0000 7ff8a3602640 -1 osd.0 90 *** Got signal Terminated *** 2024-09-21T06:31:02.987 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0[48003]: 2024-09-21T06:31:02.589+0000 7ff8a3602640 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:08.385 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:08 smithi038 podman[113570]: 2024-09-21 06:31:08.1226269 +0000 UTC m=+5.633548957 container died b4dc8f65d3a2adb0ead3df0810e7c00a72ba2f6f5ac4ce06aaaa82494fcb370e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:31:08.736 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:08 smithi038 podman[113570]: 2024-09-21 06:31:08.558357039 +0000 UTC m=+6.069279137 container cleanup b4dc8f65d3a2adb0ead3df0810e7c00a72ba2f6f5ac4ce06aaaa82494fcb370e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:31:08.736 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:08 smithi038 bash[113570]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:31:09.161 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:08 smithi038 podman[113585]: 2024-09-21 06:31:08.751427749 +0000 UTC m=+0.627822493 container remove b4dc8f65d3a2adb0ead3df0810e7c00a72ba2f6f5ac4ce06aaaa82494fcb370e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:31:09.465 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.160898037 +0000 UTC m=+0.108455019 container create e33f4e271a8dbdd7c1cf6b1e9e2b5f149956d6a5c03cedec5ca95343b1e2e062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:31:09.465 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.068835598 +0000 UTC m=+0.016392601 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:09.465 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.380344997 +0000 UTC m=+0.327901977 container init e33f4e271a8dbdd7c1cf6b1e9e2b5f149956d6a5c03cedec5ca95343b1e2e062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:31:09.465 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.383877778 +0000 UTC m=+0.331434768 container start e33f4e271a8dbdd7c1cf6b1e9e2b5f149956d6a5c03cedec5ca95343b1e2e062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T06:31:09.465 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.463397068 +0000 UTC m=+0.410954058 container attach e33f4e271a8dbdd7c1cf6b1e9e2b5f149956d6a5c03cedec5ca95343b1e2e062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:31:09.736 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 21 06:31:09 smithi038 podman[113669]: 2024-09-21 06:31:09.577287219 +0000 UTC m=+0.524844208 container died e33f4e271a8dbdd7c1cf6b1e9e2b5f149956d6a5c03cedec5ca95343b1e2e062 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-21T06:31:10.237 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:31:10.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:10.284 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:31:10.284 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:31:10.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:31:10.588 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:10 smithi044 systemd[1]: Stopping Ceph osd.1 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:10.905 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:31:10.586+0000 7fdbcadff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:10.905 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:31:10.586+0000 7fdbcadff640 -1 osd.1 90 *** Got signal Terminated *** 2024-09-21T06:31:10.905 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1[39085]: 2024-09-21T06:31:10.586+0000 7fdbcadff640 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:16.405 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:16 smithi044 podman[67012]: 2024-09-21 06:31:16.02761245 +0000 UTC m=+5.544009458 container died 0dda1734939738be000deb26f613e28826b9deee6c521543e1f4b7a4ad131b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T06:31:16.781 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:16 smithi044 podman[67012]: 2024-09-21 06:31:16.503573422 +0000 UTC m=+6.019970429 container cleanup 0dda1734939738be000deb26f613e28826b9deee6c521543e1f4b7a4ad131b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T06:31:16.781 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:16 smithi044 bash[67012]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:31:17.096 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:16 smithi044 podman[67028]: 2024-09-21 06:31:16.780262923 +0000 UTC m=+0.746706761 container remove 0dda1734939738be000deb26f613e28826b9deee6c521543e1f4b7a4ad131b8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:31:17.355 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:16.998556229 +0000 UTC m=+0.015957200 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:17.356 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:17.239456317 +0000 UTC m=+0.256857278 container create d453a1439456a12b0548cf6d10d109c87d7e26aec243ea14d70fa82af4025c24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:17.655 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:17.467087053 +0000 UTC m=+0.484488012 container init d453a1439456a12b0548cf6d10d109c87d7e26aec243ea14d70fa82af4025c24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:31:17.655 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:17.470582605 +0000 UTC m=+0.487983571 container start d453a1439456a12b0548cf6d10d109c87d7e26aec243ea14d70fa82af4025c24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:31:17.655 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:17.550201239 +0000 UTC m=+0.567602199 container attach d453a1439456a12b0548cf6d10d109c87d7e26aec243ea14d70fa82af4025c24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:31:17.962 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 21 06:31:17 smithi044 podman[67117]: 2024-09-21 06:31:17.669963727 +0000 UTC m=+0.687364704 container died d453a1439456a12b0548cf6d10d109c87d7e26aec243ea14d70fa82af4025c24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:31:18.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:31:18.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:18.354 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:31:18.354 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:31:18.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:31:18.645 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:18 smithi174 systemd[1]: Stopping Ceph osd.2 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:19.144 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:31:18.678+0000 7fb21e1ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:19.145 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:31:18.678+0000 7fb21e1ad640 -1 osd.2 90 *** Got signal Terminated *** 2024-09-21T06:31:19.145 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2[39902]: 2024-09-21T06:31:18.678+0000 7fb21e1ad640 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:24.338 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:24 smithi174 podman[67677]: 2024-09-21 06:31:24.056706922 +0000 UTC m=+5.507707440 container died dc21f0ae1743cc4826e8b1fa5131bb6a062d7ac79e8caa23420ff567eae3a0ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:31:24.644 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:24 smithi174 podman[67677]: 2024-09-21 06:31:24.436843798 +0000 UTC m=+5.887844313 container cleanup dc21f0ae1743cc4826e8b1fa5131bb6a062d7ac79e8caa23420ff567eae3a0ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:31:24.644 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:24 smithi174 bash[67677]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:31:25.052 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:24 smithi174 podman[67692]: 2024-09-21 06:31:24.696772451 +0000 UTC m=+0.641093985 container remove dc21f0ae1743cc4826e8b1fa5131bb6a062d7ac79e8caa23420ff567eae3a0ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:25.334 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:24.954516332 +0000 UTC m=+0.015697658 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:25.334 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:25.080931974 +0000 UTC m=+0.142113352 container create 95edd3750ab495bf361ae5321e4fd4772024d030a44e13c0b0a5c6692f959646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:31:25.645 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:25.333304641 +0000 UTC m=+0.394485957 container init 95edd3750ab495bf361ae5321e4fd4772024d030a44e13c0b0a5c6692f959646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T06:31:25.645 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:25.337155222 +0000 UTC m=+0.398336539 container start 95edd3750ab495bf361ae5321e4fd4772024d030a44e13c0b0a5c6692f959646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-21T06:31:25.645 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:25.424927726 +0000 UTC m=+0.486109057 container attach 95edd3750ab495bf361ae5321e4fd4772024d030a44e13c0b0a5c6692f959646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:31:25.645 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 06:31:25 smithi174 podman[67779]: 2024-09-21 06:31:25.532498517 +0000 UTC m=+0.593679834 container died 95edd3750ab495bf361ae5321e4fd4772024d030a44e13c0b0a5c6692f959646 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T06:31:26.160 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:31:26.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:26.200 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:31:26.200 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:31:26.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:31:26.486 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:26 smithi038 systemd[1]: Stopping Ceph osd.3 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:26.986 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:26 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:26.495+0000 7ff8f64ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:26.987 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:26 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:26.495+0000 7ff8f64ee640 -1 osd.3 90 *** Got signal Terminated *** 2024-09-21T06:31:26.987 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:26 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:26.495+0000 7ff8f64ee640 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:29.236 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:28 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:28.930+0000 7ff8eead1640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:02.317045+0000 front 2024-09-21T06:31:02.317170+0000 (oldest deadline 2024-09-21T06:31:28.217241+0000) 2024-09-21T06:31:30.236 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:29 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:29.947+0000 7ff8eead1640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:02.317045+0000 front 2024-09-21T06:31:02.317170+0000 (oldest deadline 2024-09-21T06:31:28.217241+0000) 2024-09-21T06:31:30.237 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:29 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:29.977+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:30.237 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:30 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:30.172+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:30.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:30.338+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:31.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:30 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:30.950+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:31.237 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:30 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3[54533]: 2024-09-21T06:31:30.985+0000 7ff8eead1640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:02.317045+0000 front 2024-09-21T06:31:02.317170+0000 (oldest deadline 2024-09-21T06:31:28.217241+0000) 2024-09-21T06:31:31.237 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:31.188+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:31.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:31 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:31.083+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:31.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:31.319+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:32.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:31.698+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:32.155 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:31 smithi038 podman[113772]: 2024-09-21 06:31:31.883712795 +0000 UTC m=+5.486381466 container died 399bde10c5270280635d31fbe297f5ccff36b2628ee0491390ba3dc023b149e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True) 2024-09-21T06:31:32.155 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:31 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:31.997+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:32.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:32 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:32.100+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:32.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:32 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:32.231+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:32.486 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:32 smithi038 podman[113772]: 2024-09-21 06:31:32.328643296 +0000 UTC m=+5.931311992 container cleanup 399bde10c5270280635d31fbe297f5ccff36b2628ee0491390ba3dc023b149e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:31:32.487 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:32 smithi038 bash[113772]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:31:32.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:32.363+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:32.961 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:32 smithi038 podman[113788]: 2024-09-21 06:31:32.630174678 +0000 UTC m=+0.748052801 container remove 399bde10c5270280635d31fbe297f5ccff36b2628ee0491390ba3dc023b149e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:31:33.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:32.735+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:33.224 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:33 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:33.011+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:33.225 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:32 smithi038 podman[113876]: 2024-09-21 06:31:32.863172075 +0000 UTC m=+0.016680248 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:33.225 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:32 smithi038 podman[113876]: 2024-09-21 06:31:32.972820612 +0000 UTC m=+0.126328817 container create 7de5bfa741b535fd7a54a73cc0a73a230998e20c2b02478a0400ea1ef4dddde4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:31:33.225 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:33 smithi038 podman[113876]: 2024-09-21 06:31:33.158714961 +0000 UTC m=+0.312223124 container init 7de5bfa741b535fd7a54a73cc0a73a230998e20c2b02478a0400ea1ef4dddde4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:31:33.225 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:33 smithi038 podman[113876]: 2024-09-21 06:31:33.162234978 +0000 UTC m=+0.315743142 container start 7de5bfa741b535fd7a54a73cc0a73a230998e20c2b02478a0400ea1ef4dddde4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:31:33.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:33 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:33.122+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:33.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:33 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:33.222+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:33.487 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:33 smithi038 podman[113876]: 2024-09-21 06:31:33.275687864 +0000 UTC m=+0.429196040 container attach 7de5bfa741b535fd7a54a73cc0a73a230998e20c2b02478a0400ea1ef4dddde4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:33.487 INFO:journalctl@ceph.osd.3.smithi038.stdout:Sep 21 06:31:33 smithi038 podman[113876]: 2024-09-21 06:31:33.362532945 +0000 UTC m=+0.516041109 container died 7de5bfa741b535fd7a54a73cc0a73a230998e20c2b02478a0400ea1ef4dddde4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:31:33.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:33.351+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:33.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:31:34.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:34.011 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:31:34.011 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:31:34.011 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:31:34.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:33.763+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:34.236 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:34 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:34.194+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:34.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:34 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:34.013+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:34.325 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:34 smithi044 systemd[1]: Stopping Ceph osd.4 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:34.325 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:34.090+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:34.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:34 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:34.381+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:34.655 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:31:34.323+0000 7f733a751640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:34.655 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:31:34.323+0000 7f733a751640 -1 osd.4 90 *** Got signal Terminated *** 2024-09-21T06:31:34.655 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:34 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4[45502]: 2024-09-21T06:31:34.323+0000 7f733a751640 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:35.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:34 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:34.795+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:35.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:35 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:35.071+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:35.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:35 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:35.218+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:35.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:35 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:35.055+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:35.804 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:35 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:35.419+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:36.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:35 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:35.801+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:36.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:36 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:36.100+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:36.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:36 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:36.081+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:36.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:36 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:36.182+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:36.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:36 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:36.182+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:36.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:36 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:36.392+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:37.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:36 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:36.832+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:37.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:37 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:37.145+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:37.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:37 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:37.216+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:37.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:37 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:37.216+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:37.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:37 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:37.086+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:37.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:37 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:37.086+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:37.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:37 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:37.357+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:38.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:37 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:37.803+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:38.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:38 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:38.150+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:38.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:38 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:38.089+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:38.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:38 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:38.089+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:38.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:38 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:38.190+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:38.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:38 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:38.190+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:38.644 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:38 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:38.373+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:38.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:38 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:38.629+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:39.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:38 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:38.770+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:39.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:39 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:39.100+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:39.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:39.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:39.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:39.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:39.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:39.204+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:39.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:39 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:39.204+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:39.753 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:39 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:39.401+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:39.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:39 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:39.583+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:39.905 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:39 smithi044 podman[67235]: 2024-09-21 06:31:39.676313553 +0000 UTC m=+5.456871182 container died fd2b723e2d111085215a4e759fe1ab37cbeb0cb081b2cef57acd4a255ef57b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:40.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:39 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:39.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:40.192 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:40 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:40.091+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:40.192 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67235]: 2024-09-21 06:31:40.015157924 +0000 UTC m=+5.795715556 container cleanup fd2b723e2d111085215a4e759fe1ab37cbeb0cb081b2cef57acd4a255ef57b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:31:40.193 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 bash[67235]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:31:40.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:40.071+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:40.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:40.071+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:40.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:40.168+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:40.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:40.168+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:40.598 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67249]: 2024-09-21 06:31:40.191429543 +0000 UTC m=+0.515496217 container remove fd2b723e2d111085215a4e759fe1ab37cbeb0cb081b2cef57acd4a255ef57b77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:31:40.800 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:40 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:40.422+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:40.800 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:40 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:40.422+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:40.862 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:40 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:40.597+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:40.863 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67334]: 2024-09-21 06:31:40.625736132 +0000 UTC m=+0.108555575 container create 5228602888bef7aafc3cc0b2ffff942c98986936d75801c1a1608aa9ba899efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:31:40.863 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67334]: 2024-09-21 06:31:40.533067552 +0000 UTC m=+0.015887007 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:41.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:40 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:40.798+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:41 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:41.083+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:41 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:41.083+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67334]: 2024-09-21 06:31:40.861720202 +0000 UTC m=+0.344539646 container init 5228602888bef7aafc3cc0b2ffff942c98986936d75801c1a1608aa9ba899efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67334]: 2024-09-21 06:31:40.865063407 +0000 UTC m=+0.347882855 container start 5228602888bef7aafc3cc0b2ffff942c98986936d75801c1a1608aa9ba899efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:40 smithi044 podman[67334]: 2024-09-21 06:31:40.945101624 +0000 UTC m=+0.427921071 container attach 5228602888bef7aafc3cc0b2ffff942c98986936d75801c1a1608aa9ba899efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:31:41.155 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 21 06:31:41 smithi044 podman[67334]: 2024-09-21 06:31:41.058485638 +0000 UTC m=+0.541305098 container died 5228602888bef7aafc3cc0b2ffff942c98986936d75801c1a1608aa9ba899efd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:31:41.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:41 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:41.142+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:41.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:41 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:41.142+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:41.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:41 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:41.090+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:41.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:41 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:41.090+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:41.641 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:41 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:41.599+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:41.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:41 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:41.236+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:41.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:41 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:41.408+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:41.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:41 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:41.408+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:41.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:31:41.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:41.724 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:31:41.724 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:31:41.724 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:31:42.041 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:41 smithi174 systemd[1]: Stopping Ceph osd.5 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:42.041 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:41 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:41.791+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:42.041 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:41 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:41.791+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:42.362 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:42.283+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:42.363 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:42.038+0000 7f773c9e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:42.363 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:42.038+0000 7f773c9e1640 -1 osd.5 90 *** Got signal Terminated *** 2024-09-21T06:31:42.363 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:42.038+0000 7f773c9e1640 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:42.363 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:42.360+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:42.363 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:42.360+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:42.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:42 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:42.051+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:42.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:42 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:42.051+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:42.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:42 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:42.151+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:42.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:42 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:42.151+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:42.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:42 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:42.123+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:42.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:42 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:42.123+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:42.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:42 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:42.553+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:43.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:42.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:43.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:42 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:42.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:43.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:43 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:43.056+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:43.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:43 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:43.056+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:43.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:43 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:43.164+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:43.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:43 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:43.164+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:43.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:43 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:43.126+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:43.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:43 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:43.126+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:43.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:43 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:43.278+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:43.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:43 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:43.352+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:43.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:43 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:43.352+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:43.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:43 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:43.580+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:44.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:43 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:43.767+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:44.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:43 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:43.767+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:44.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:44 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:44.009+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:44.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:44 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:44.009+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:44.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:44 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:44.145+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:44.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:44 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:44.145+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:44.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:44 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:44.148+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:44.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:44 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:44.148+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:44.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:44.321+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:44.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:44.363+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:44.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:44.363+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:44.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:44.363+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.257877+0000 front 2024-09-21T06:31:20.257858+0000 (oldest deadline 2024-09-21T06:31:44.358078+0000) 2024-09-21T06:31:44.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:44 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:44.597+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:45.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:44.746+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:45.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:44.746+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:45.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:44 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:44.746+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:45.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:44 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:44.981+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:45.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:44 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:44.981+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:45.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:45 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:45.168+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:45.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:45 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:45.168+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:45.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:45 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:45.168+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:45.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:45 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:45.185+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:45.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:45 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:45.185+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:45.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:45.332+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:45.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:45.331+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:45.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:45.331+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:45.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:45.331+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.257877+0000 front 2024-09-21T06:31:20.257858+0000 (oldest deadline 2024-09-21T06:31:44.358078+0000) 2024-09-21T06:31:45.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:45 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:45.646+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:46.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:45.734+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:46.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:45.734+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:46.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:45 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:45.734+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:46.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:46 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:46.007+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:46.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:46 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:46.007+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:46.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:46.139+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:46.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:46.139+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:46.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:46.139+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:46.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:46.186+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:46.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:46.186+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:46.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:46.360+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:46.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:46.360+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:46.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:46.339+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:03.756590+0000 front 2024-09-21T06:31:03.756382+0000 (oldest deadline 2024-09-21T06:31:29.656457+0000) 2024-09-21T06:31:46.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:46.339+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.557424+0000 front 2024-09-21T06:31:15.557388+0000 (oldest deadline 2024-09-21T06:31:40.257539+0000) 2024-09-21T06:31:46.645 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5[46448]: 2024-09-21T06:31:46.339+0000 7f7738fcc640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.257877+0000 front 2024-09-21T06:31:20.257858+0000 (oldest deadline 2024-09-21T06:31:44.358078+0000) 2024-09-21T06:31:47.002 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:46 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:46.668+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:47.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:46.775+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:47.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:46.775+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:47.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:46 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:46.775+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:47.401 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:47.398+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:47.401 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:47.398+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:47.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:47.000+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:47.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:47.000+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:47.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:47.158+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:47.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:47.158+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:47.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:47.158+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:47.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:47.195+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:47.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:47 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:47.195+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:47.690 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:47 smithi174 podman[67895]: 2024-09-21 06:31:47.42970461 +0000 UTC m=+5.504575985 container died 0b0b5299501e087e71e9268ddcc989b260d9c00df6991718ba1fec980e762d37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:31:48.099 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:47 smithi174 podman[67895]: 2024-09-21 06:31:47.78846627 +0000 UTC m=+5.863337615 container cleanup 0b0b5299501e087e71e9268ddcc989b260d9c00df6991718ba1fec980e762d37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:31:48.099 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:47 smithi174 bash[67895]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:31:48.099 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:47.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:48.099 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:47.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:48.099 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:47 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:47.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:48.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:47.710+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:48.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:47.710+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:48.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:47.959+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:48.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:47 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:47.959+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:48.386 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67912]: 2024-09-21 06:31:48.098090629 +0000 UTC m=+0.664877996 container remove 0b0b5299501e087e71e9268ddcc989b260d9c00df6991718ba1fec980e762d37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:31:48.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:48.152+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:48.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:48.152+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:48.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:48.152+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:48.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:48.150+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:48.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:48 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:48.150+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:48 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:48.384+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:48 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:48.384+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.308077891 +0000 UTC m=+0.015758429 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.415923407 +0000 UTC m=+0.123603981 container create 2176fd2b4d90640a0e0d92b58d611dc02b088348ba19004a750c888f287ad453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.634650806 +0000 UTC m=+0.342331335 container init 2176fd2b4d90640a0e0d92b58d611dc02b088348ba19004a750c888f287ad453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:31:48.639 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.63781983 +0000 UTC m=+0.345500362 container start 2176fd2b4d90640a0e0d92b58d611dc02b088348ba19004a750c888f287ad453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:31:48.895 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.734827569 +0000 UTC m=+0.442508098 container attach 2176fd2b4d90640a0e0d92b58d611dc02b088348ba19004a750c888f287ad453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:31:48.895 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 06:31:48 smithi174 podman[67999]: 2024-09-21 06:31:48.828136586 +0000 UTC m=+0.535817132 container died 2176fd2b4d90640a0e0d92b58d611dc02b088348ba19004a750c888f287ad453 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:31:48.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:48 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:48.747+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:48.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:48 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:48.747+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:48.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:48 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:48.747+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:48.971 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:48 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:48.690+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:48.971 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:48 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:48.690+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:49.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:48 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:48.969+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:49.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:48 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:48.969+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:49.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:48 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:48.969+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:49.472 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:49 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:49.373+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:49.472 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:49 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:49.373+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:49.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.146+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:49.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.146+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:49.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.146+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:49.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:49.124+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:49.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:49.124+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:49.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:49.124+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:49.492 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:31:49.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:49.530 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:31:49.530 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:31:49.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:31:49.729 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:49 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:49.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:49.729 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:49 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:49.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:49.729 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:49 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:49.727+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:49.825 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 systemd[1]: Stopping Ceph osd.6 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:50.010 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:49 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:49.707+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:50.011 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:49 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:49.707+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:50.133 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.822+0000 7fd65defc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:50.133 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.822+0000 7fd65defc640 -1 osd.6 90 *** Got signal Terminated *** 2024-09-21T06:31:50.133 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:49 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:49.822+0000 7fd65defc640 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:50.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.009+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:50.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.009+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:50.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.009+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:50.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:50.134+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:50.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:50.134+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:50.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:50.134+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:50.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:50.131+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:50.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:50.131+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:50.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:50.131+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:50.716 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:50 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:50.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:50.717 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:50 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:50.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:50.983 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:50.688+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:50.983 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:50.688+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:51.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:50 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:50.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:51.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:50 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:50.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:51.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:50 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:50.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:51.388 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:51.171+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:51.388 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:51.171+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:51.388 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:51.171+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:51.389 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:51.128+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:51.389 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:51.128+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:51.389 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:51 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:51.128+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:51.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.981+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:51.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.981+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:51.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:50 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:50.981+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:51.715 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:51 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:51.459+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:51.716 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:51 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:51.459+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:52.031 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:51 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:51.726+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:52.031 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:51 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:51.726+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:52.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:51 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:51.714+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:52.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:51 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:51.714+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:52.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:51 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:51.714+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:52.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:52 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:52.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:52.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:52 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:52.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:52.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:52 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:52.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:52.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:52.193+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:52.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:52.193+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:52.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:52.193+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:52.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:52.153+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:52.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:52.153+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:52.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:52 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:52.153+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:52.737 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:52.470+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:52.737 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:52.470+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:53.074 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:52 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:52.739+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:53.074 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:52 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:52.739+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:53.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:52.735+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:53.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:52.735+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:53.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:52.735+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:53.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:52 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:52.735+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:53.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:53 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:53.072+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:53.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:53 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:53.072+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:53.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:53 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:53.072+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:53.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:53.220+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:53.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:53.220+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:53.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:53.220+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:53.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:53.180+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:53.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:53.180+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:53.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:53 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:53.180+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:53.513+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:53.513+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:53.513+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:53.689+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:53.689+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:53.689+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:53.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:53 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:53.689+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:54.029 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:53 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:53.717+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:54.029 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:53 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:53.717+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:54.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:54.027+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:54.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:54.027+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:54.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:54.027+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:54.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:54.027+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:54.486 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:54.172+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.661715+0000 front 2024-09-21T06:31:04.661754+0000 (oldest deadline 2024-09-21T06:31:29.961895+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:54.172+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:12.763376+0000 front 2024-09-21T06:31:12.763395+0000 (oldest deadline 2024-09-21T06:31:36.163652+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:54.172+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:19.665109+0000 front 2024-09-21T06:31:19.664879+0000 (oldest deadline 2024-09-21T06:31:44.964836+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6[61102]: 2024-09-21T06:31:54.172+0000 7fd6564df640 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.666679+0000 front 2024-09-21T06:31:30.666725+0000 (oldest deadline 2024-09-21T06:31:53.566796+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:54.133+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:54.133+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:54.133+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:54.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:54 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:54.133+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:54.478+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:54.478+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:54.478+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:54.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:54.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:54.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:54.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:54 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:54.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:55.035 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:54.766+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:55.035 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:54 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:54.766+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:55.384 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:55 smithi038 podman[113977]: 2024-09-21 06:31:55.141263378 +0000 UTC m=+5.408787231 container died b85aff6de95309d5eee086ccb8b92866d0929f42488fc10defbedc67ee13f7d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:31:55.384 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:55.109+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:55.384 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:55.109+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:55.384 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:55.109+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:55.384 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:55 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:55.109+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:55.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:55.033+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:55.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:55.033+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:55.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:55.033+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:55.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:55.033+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:55.736 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:55 smithi038 podman[113977]: 2024-09-21 06:31:55.573848836 +0000 UTC m=+5.841372689 container cleanup b85aff6de95309d5eee086ccb8b92866d0929f42488fc10defbedc67ee13f7d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T06:31:55.736 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:55 smithi038 bash[113977]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:55.527+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:55.527+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:55.527+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:55.650+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:55.650+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:55.650+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:55.813 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:55 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:55.650+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:56.077 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:55 smithi038 podman[114006]: 2024-09-21 06:31:55.758598848 +0000 UTC m=+0.609273802 container remove b85aff6de95309d5eee086ccb8b92866d0929f42488fc10defbedc67ee13f7d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:55.769+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:55.769+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.017+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.017+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.017+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:56.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.017+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:56 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:56.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:56 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:56.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:56 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:56.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:56 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:56.074+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.184592779 +0000 UTC m=+0.111949977 container create c44ce2cbb28b633d538a5b4488f82b663a75db048cadfbcda19fabe5f1db9d87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:31:56.334 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.088870518 +0000 UTC m=+0.016227689 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:31:56.618 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.411960609 +0000 UTC m=+0.339317773 container init c44ce2cbb28b633d538a5b4488f82b663a75db048cadfbcda19fabe5f1db9d87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:31:56.618 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.415579418 +0000 UTC m=+0.342936580 container start c44ce2cbb28b633d538a5b4488f82b663a75db048cadfbcda19fabe5f1db9d87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:31:56.894 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:56.486+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:56.486+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:56.486+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:56.638+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:56.638+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:56.638+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:56.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:56 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:56.638+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:56.907 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.645095006 +0000 UTC m=+0.572452167 container attach c44ce2cbb28b633d538a5b4488f82b663a75db048cadfbcda19fabe5f1db9d87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:31:56.907 INFO:journalctl@ceph.osd.6.smithi038.stdout:Sep 21 06:31:56 smithi038 podman[114095]: 2024-09-21 06:31:56.645307747 +0000 UTC m=+0.572664914 container died c44ce2cbb28b633d538a5b4488f82b663a75db048cadfbcda19fabe5f1db9d87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:31:57.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:56.761+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:57.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:56.761+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:57.155 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:56.761+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:31:57.155 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.979+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:57.156 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.979+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:57.156 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.979+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:57.156 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:56 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:56.979+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:57.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:57 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:57.092+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:57.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:57 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:57.092+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:57.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:57 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:57.092+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:57.237 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:57 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:57.092+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:57.290 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:31:57.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:31:57.339 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:31:57.339 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:31:57.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:31:57.636 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 systemd[1]: Stopping Ceph osd.7 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:31:57.894 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:57.470+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:57.470+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:57.470+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:57.665+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:57.665+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:57.665+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:57.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:57 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:57.665+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.634+0000 7f1bfe9fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.634+0000 7f1bfe9fd640 -1 osd.7 90 *** Got signal Terminated *** 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.634+0000 7f1bfe9fd640 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.738+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.738+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:57.905 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:57 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:57.738+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:31:58.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:58.015+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:58.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:58.015+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:58.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:58.015+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:58.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:58.015+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:58.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:58 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:58.118+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:58.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:58 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:58.118+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:58.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:58 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:58.118+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:58.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:58 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:58.118+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:58.485+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:58.485+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:58.485+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:58.677+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:58.677+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:58.677+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:58.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:58 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:58.677+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:59.003 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:58.707+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:59.003 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:58.707+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:59.003 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:58 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:58.707+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:31:59.291 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.001+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:31:59.292 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.001+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:31:59.292 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.001+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:31:59.292 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.001+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:31:59.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:59 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:59.105+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:31:59.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:59 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:59.105+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:31:59.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:59 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:59.105+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:31:59.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:31:59 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:31:59.105+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:59.439+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:59.439+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:31:59.439+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:59.671+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:59.671+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:59.671+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:31:59.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:31:59 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:31:59.671+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:31:59.993 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:59.735+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:31:59.993 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:59.735+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:31:59.993 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:31:59.735+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:32:00.273 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.991+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:00.273 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.991+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:00.273 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.991+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:00.273 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.991+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:00.273 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:31:59 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:31:59.991+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:00.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:00.097+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:00.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:00.097+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:00.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:00.097+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:00.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:00 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:00.097+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:00.692 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:00.440+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:00.693 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:00.440+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:00.693 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:00.440+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:01.031 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:00.773+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:32:01.031 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:00.773+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:32:01.031 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:00.773+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:32:01.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:00.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:01.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:00.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:01.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:00.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:01.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:00 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:00.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:01.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:01.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:01.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:01.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:01.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:01.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:01.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:01.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:01.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:01.029+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:01.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:01 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:01.070+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:01.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:01 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:01.070+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:01.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:01 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:01.070+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:01.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:01 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:01.070+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:01.710 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:01.435+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:01.710 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:01.435+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:01.710 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:01.435+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:01.710 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:01.435+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:02.077 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:01.744+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:14.184667+0000 front 2024-09-21T06:31:14.184808+0000 (oldest deadline 2024-09-21T06:31:37.685017+0000) 2024-09-21T06:32:02.077 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:01.744+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:22.187358+0000 front 2024-09-21T06:31:22.187113+0000 (oldest deadline 2024-09-21T06:31:46.887182+0000) 2024-09-21T06:32:02.078 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:01 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7[52128]: 2024-09-21T06:32:01.744+0000 7f1bf6fe0640 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:30.288948+0000 front 2024-09-21T06:31:30.288860+0000 (oldest deadline 2024-09-21T06:31:56.188948+0000) 2024-09-21T06:32:02.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:01.708+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:02.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:01.708+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:02.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:01.708+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:02.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:01 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:01.708+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:02.406 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:02 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:02.075+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:02.406 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:02 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:02.075+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:02.406 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:02 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:02.075+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:02.406 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:02 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:02.075+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:02.406 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:02 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:02.075+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:02.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:02.065+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:02.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:02.065+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:02.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:02.065+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:02.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:02 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:02.065+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:02.687 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:02.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:02.687 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:02.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:02.687 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:02.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:02.688 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:02.419+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:03.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:02.685+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:03.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:02.685+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:03.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:02.685+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:03.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:02 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:02.685+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:03 smithi044 podman[67436]: 2024-09-21 06:32:03.029929921 +0000 UTC m=+5.500370273 container died 5b418cbeecc55873be34e9d4a200c640aaa28f1f6de1ca592fc5c97ee4dcc9ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:03 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:03.115+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:03 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:03.115+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:03 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:03.115+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:03 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:03.115+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:03.295 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:03 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:03.115+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:03.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:03 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:03.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:03.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:03 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:03.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:03.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:03 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:03.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:03.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:03 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:03.037+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:03.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:03 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:03.037+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:03.655 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:03 smithi044 podman[67436]: 2024-09-21 06:32:03.393092965 +0000 UTC m=+5.863533316 container cleanup 5b418cbeecc55873be34e9d4a200c640aaa28f1f6de1ca592fc5c97ee4dcc9ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:32:03.655 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:03 smithi044 bash[67436]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:32:03.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:03.402+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:03.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:03.402+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:03.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:03.402+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:03.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:03.402+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:04.011 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:03 smithi044 podman[67465]: 2024-09-21 06:32:03.677534606 +0000 UTC m=+0.645503553 container remove 5b418cbeecc55873be34e9d4a200c640aaa28f1f6de1ca592fc5c97ee4dcc9ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:32:04.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:03.672+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:04.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:03.672+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:04.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:03.672+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:04.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:03.672+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:04.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:03 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:03.672+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:04.340 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:04.136+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:04.340 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:04.136+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:04.136+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:04.136+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:04.136+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:03.912658137 +0000 UTC m=+0.015557592 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:04.020201894 +0000 UTC m=+0.123101379 container create 68eb1ccb325036fa701800ebf725149fcc05a9f395cd6ebc4548dafa55529eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:04.247460271 +0000 UTC m=+0.350359726 container init 68eb1ccb325036fa701800ebf725149fcc05a9f395cd6ebc4548dafa55529eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:04.250735877 +0000 UTC m=+0.353635322 container start 68eb1ccb325036fa701800ebf725149fcc05a9f395cd6ebc4548dafa55529eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:04.341 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:04.339099499 +0000 UTC m=+0.441998942 container attach 68eb1ccb325036fa701800ebf725149fcc05a9f395cd6ebc4548dafa55529eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:32:04.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:04 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:04.002+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:04.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:04 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:04.002+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:04.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:04 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:04.002+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:04.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:04 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:04.002+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:04.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:04 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:04.002+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:04.641 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:04.388+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:04.641 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:04.388+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:04.641 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:04.388+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:04.641 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:04.388+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:04.655 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 21 06:32:04 smithi044 podman[67551]: 2024-09-21 06:32:04.440438802 +0000 UTC m=+0.543338250 container died 68eb1ccb325036fa701800ebf725149fcc05a9f395cd6ebc4548dafa55529eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:32:04.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:04.639+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:04.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:04.639+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:04.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:04.639+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:04.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:04.639+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:04.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:04 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:04.639+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:05.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:32:05.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:05.067 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:32:05.067 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:32:05.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:32:05.356 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 systemd[1]: Stopping Ceph osd.8 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:05.356 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.354+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:05.356 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.354+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:05.356 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.354+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:05.356 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.354+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:05.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:05 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:05.185+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:05.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:05 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:05.185+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:05.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:05 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:05.185+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:05.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:05 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:05.185+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:05.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:05 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:05.185+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:05.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:05 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:05.008+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:05.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:05 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:05.008+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:05.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:05 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:05.008+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:05.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:05 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:05.008+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:05.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:05 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:05.008+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:05.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.381+0000 7fd8b08f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:05.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.381+0000 7fd8b08f4640 -1 osd.8 90 *** Got signal Terminated *** 2024-09-21T06:32:05.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:05.381+0000 7fd8b08f4640 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:32:06.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:05.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:06.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:05.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:06.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:05.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:06.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:05.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:06.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:05 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:05.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:06.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:06.001+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:06.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:06.001+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:06.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:06.001+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:06.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:06.001+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:06.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:06 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:06.001+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:06.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:06.357+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:06.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:06.357+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:06.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:06.357+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:06.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:06.357+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:06.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:06 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:06.200+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:06.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:06 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:06.200+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:06.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:06 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:06.200+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:06.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:06 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:06.200+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:06.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:06 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:06.200+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:07.086 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:06.702+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:07.086 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:06.702+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:07.087 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:06.702+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:07.087 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:06.702+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:07.087 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:06 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:06.702+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:07.343 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:07 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:07.033+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:07.343 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:07 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:07.033+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:07.343 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:07 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:07.033+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:07.343 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:07 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:07.033+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:07.343 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:07 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:07.033+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:07.395 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:07.308+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:07.395 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:07.308+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:07.396 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:07.308+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:07.396 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:07.308+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:07.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:07 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:07.190+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:07.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:07 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:07.190+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:07.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:07 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:07.190+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:07.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:07 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:07.190+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:07.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:07 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:07.190+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:08.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:07.660+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:08.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:07.660+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:08.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:07.660+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:08.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:07.660+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:08.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:07 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:07.660+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:08.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:08 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:08.058+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:08.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:08 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:08.058+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:08.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:08 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:08.058+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:08.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:08 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:08.058+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:08.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:08 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:08.058+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:08.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:08.349+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:08.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:08.349+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:08.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:08.349+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:08.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:08.349+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:08.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:08.199+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:09.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:09.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:09.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:09.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:09.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:09.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:08 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:08.691+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:09.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.018+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:09.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.018+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:09.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.018+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:09.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.018+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:09.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.018+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:09.644 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:09.389+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:11.221764+0000 front 2024-09-21T06:31:11.221692+0000 (oldest deadline 2024-09-21T06:31:40.622347+0000) 2024-09-21T06:32:09.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:09.389+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:23.423972+0000 front 2024-09-21T06:31:23.424034+0000 (oldest deadline 2024-09-21T06:31:45.624519+0000) 2024-09-21T06:32:09.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:09.389+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:27.826287+0000 front 2024-09-21T06:31:27.826237+0000 (oldest deadline 2024-09-21T06:31:52.526086+0000) 2024-09-21T06:32:09.645 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8[52619]: 2024-09-21T06:32:09.389+0000 7fd8a8ed7640 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:35.427381+0000 front 2024-09-21T06:31:35.427215+0000 (oldest deadline 2024-09-21T06:32:00.727193+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:09.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:09 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:09.172+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:10.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:09 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:09.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:10.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.982+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:10.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.982+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:10.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.982+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:10.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.982+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:10.236 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:09 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:09.982+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:10.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:10 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:10.161+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:10 smithi174 podman[68115]: 2024-09-21 06:32:10.784014615 +0000 UTC m=+5.520589443 container died 0f96fe70a1ffeba7e72e12ff51dd2859cdf7377485d5f26ee081429e0a228f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.686+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:11.042 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:10 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:10.687+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:11.394 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:11 smithi174 podman[68115]: 2024-09-21 06:32:11.156789422 +0000 UTC m=+5.893364254 container cleanup 0f96fe70a1ffeba7e72e12ff51dd2859cdf7377485d5f26ee081429e0a228f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:11.394 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:11 smithi174 bash[68115]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:32:11.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:11 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:11.005+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:11.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:11 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:11.005+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:11.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:11 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:11.005+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:11.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:11 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:11.005+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:11.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:11 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:11.005+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:11.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:11 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:11.195+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:11.723 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:11 smithi174 podman[68130]: 2024-09-21 06:32:11.424481875 +0000 UTC m=+0.633720715 container remove 0f96fe70a1ffeba7e72e12ff51dd2859cdf7377485d5f26ee081429e0a228f20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:32:12.020 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:11 smithi174 podman[68219]: 2024-09-21 06:32:11.766969666 +0000 UTC m=+0.109772939 container create 4c1e97c289f0e9c2a2929c542bc9fd60b359d8f526141f89125568d9e544dd97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:32:12.020 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:11 smithi174 podman[68219]: 2024-09-21 06:32:11.672746258 +0000 UTC m=+0.015549551 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:32:12.020 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:12.020 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:12.020 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:12.021 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:12.021 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:12.021 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:11 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:11.721+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:12.289 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:12 smithi174 podman[68219]: 2024-09-21 06:32:12.01921605 +0000 UTC m=+0.362019330 container init 4c1e97c289f0e9c2a2929c542bc9fd60b359d8f526141f89125568d9e544dd97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:32:12.289 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:12 smithi174 podman[68219]: 2024-09-21 06:32:12.022981494 +0000 UTC m=+0.365784768 container start 4c1e97c289f0e9c2a2929c542bc9fd60b359d8f526141f89125568d9e544dd97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-21T06:32:12.289 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:12 smithi174 podman[68219]: 2024-09-21 06:32:12.102577641 +0000 UTC m=+0.445380915 container attach 4c1e97c289f0e9c2a2929c542bc9fd60b359d8f526141f89125568d9e544dd97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:32:12.289 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 06:32:12 smithi174 podman[68219]: 2024-09-21 06:32:12.239870168 +0000 UTC m=+0.582673466 container died 4c1e97c289f0e9c2a2929c542bc9fd60b359d8f526141f89125568d9e544dd97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T06:32:12.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:12.020+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:12.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:12.020+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:12.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:12.020+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:12.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:12.020+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:12.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:12.020+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:12.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:12.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:12.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:12.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:12.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:12.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:12 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:12.179+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:12.815 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:12.816 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:12.816 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:12.816 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:12.816 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:12.816 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:12 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:12.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:12.829 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:32:12.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:12.869 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:32:12.869 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:32:12.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:12 smithi038 systemd[1]: Stopping Ceph osd.9 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.227+0000 7f7872369640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:13.229 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.227+0000 7f7872369640 -1 osd.9 90 *** Got signal Terminated *** 2024-09-21T06:32:13.230 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:13 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:13.227+0000 7f7872369640 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:13.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:13 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:13.181+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:14.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:13.715+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:14.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:14.063+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:14.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:14.063+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:14.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:14.063+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:14.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:14.063+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:14.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:14 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:14.063+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:14.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:14 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:14.203+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:15.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:14 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:14.692+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:15.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:15 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:15.160+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:15.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:15.038+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:15.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:15.038+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:15.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:15.038+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:15.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:15.038+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:15.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:15 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:15.038+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:16.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:16.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:16.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:16.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:16.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:16.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:15 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:15.681+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:16.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:16.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:16.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:16.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:16.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:16.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:16 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:16.036+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:52.534760+0000 front 2024-09-21T06:31:52.534787+0000 (oldest deadline 2024-09-21T06:32:16.034898+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:16.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:16 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:16.196+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:17.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:17.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:17.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:17.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:17.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:17.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:16.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:17.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:17.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:17.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:17.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:17.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:17.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:17 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:17.057+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:52.534760+0000 front 2024-09-21T06:31:52.534787+0000 (oldest deadline 2024-09-21T06:32:16.034898+0000) 2024-09-21T06:32:17.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:17.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:17.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:17.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:17.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:17.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:17 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:17.221+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:18.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:17 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:17.664+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:18.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.628011+0000 front 2024-09-21T06:31:04.627774+0000 (oldest deadline 2024-09-21T06:31:29.927730+0000) 2024-09-21T06:32:18.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:13.329535+0000 front 2024-09-21T06:31:13.329694+0000 (oldest deadline 2024-09-21T06:31:36.829543+0000) 2024-09-21T06:32:18.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.431247+0000 front 2024-09-21T06:31:21.431444+0000 (oldest deadline 2024-09-21T06:31:48.431854+0000) 2024-09-21T06:32:18.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:28.432248+0000 front 2024-09-21T06:31:28.432321+0000 (oldest deadline 2024-09-21T06:31:53.732434+0000) 2024-09-21T06:32:18.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:36.633550+0000 front 2024-09-21T06:31:36.633630+0000 (oldest deadline 2024-09-21T06:32:02.533458+0000) 2024-09-21T06:32:18.487 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9[67428]: 2024-09-21T06:32:18.017+0000 7f786a94c640 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:52.534760+0000 front 2024-09-21T06:31:52.534787+0000 (oldest deadline 2024-09-21T06:32:16.034898+0000) 2024-09-21T06:32:18.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:18.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:18.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:18.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:18.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:18.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:18 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:18.201+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:18.986 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:18 smithi038 podman[114199]: 2024-09-21 06:32:18.621999447 +0000 UTC m=+5.550705348 container died fa5d79876fde82abe5d7efa810cb8515e89358208773ae38f5ebbc8cbb29450e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:19.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:18 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:18.680+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:19.354 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:19 smithi038 podman[114199]: 2024-09-21 06:32:19.168348082 +0000 UTC m=+6.097053975 container cleanup fa5d79876fde82abe5d7efa810cb8515e89358208773ae38f5ebbc8cbb29450e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:32:19.354 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:19 smithi038 bash[114199]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:19.405 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:19 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:19.153+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:19.736 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:19 smithi038 podman[114214]: 2024-09-21 06:32:19.353396176 +0000 UTC m=+0.722944472 container remove fa5d79876fde82abe5d7efa810cb8515e89358208773ae38f5ebbc8cbb29450e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:32:20.099 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:19 smithi038 podman[114303]: 2024-09-21 06:32:19.69947695 +0000 UTC m=+0.016929376 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:32:20.099 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:19 smithi038 podman[114303]: 2024-09-21 06:32:19.804105305 +0000 UTC m=+0.121557776 container create 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:32:20.099 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 podman[114303]: 2024-09-21 06:32:20.014754045 +0000 UTC m=+0.332206484 container init 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T06:32:20.099 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 podman[114303]: 2024-09-21 06:32:20.018378082 +0000 UTC m=+0.335830520 container start 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:20.099 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 podman[114303]: 2024-09-21 06:32:20.097963104 +0000 UTC m=+0.415415538 container attach 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:20.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:19.697+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:20.486 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 podman[114303]: 2024-09-21 06:32:20.209517399 +0000 UTC m=+0.526969843 container died 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:20.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:20.168+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:20.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:32:20.883 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 podman[114325]: 2024-09-21 06:32:20.826254115 +0000 UTC m=+0.610988700 container remove 1d38a796063669cd39d3a79c5712065326b70be361b6c6b7d09a9a1016d03277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T06:32:20.883 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.9.service: Deactivated successfully. 2024-09-21T06:32:20.883 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 systemd[1]: Stopped Ceph osd.9 for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:32:20.883 INFO:journalctl@ceph.osd.9.smithi038.stdout:Sep 21 06:32:20 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.9.service: Consumed 21.099s CPU time. 2024-09-21T06:32:20.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:20.901 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:32:20.901 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:32:20.901 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:32:21.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:21.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:21.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:21.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:21.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:21.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:20 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:20.683+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:21.197 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:20 smithi044 systemd[1]: Stopping Ceph osd.10 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.195+0000 7f96f5cf5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.195+0000 7f96f5cf5640 -1 osd.10 90 *** Got signal Terminated *** 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.195+0000 7f96f5cf5640 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:21.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:21.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:21.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:21.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:21.656 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:21 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:21.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:22.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:22.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:22.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:22.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:22.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:22.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:21 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:21.703+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:22.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:22 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:22.194+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:23.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:23.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:23.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:23.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:23.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:23.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:22 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:22.749+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:23.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:23 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:23.216+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:24.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:23 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:23.750+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:24.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:24 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:24.265+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:25.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:24.700+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:04.972974+0000 front 2024-09-21T06:31:04.972798+0000 (oldest deadline 2024-09-21T06:31:30.272890+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.573803+0000 front 2024-09-21T06:31:15.573969+0000 (oldest deadline 2024-09-21T06:31:40.873955+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:20.874567+0000 front 2024-09-21T06:31:20.874668+0000 (oldest deadline 2024-09-21T06:31:48.474997+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.576030+0000 front 2024-09-21T06:31:29.576005+0000 (oldest deadline 2024-09-21T06:31:53.676158+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:38.177947+0000 front 2024-09-21T06:31:38.177895+0000 (oldest deadline 2024-09-21T06:31:59.878024+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:43.979153+0000 front 2024-09-21T06:31:43.979297+0000 (oldest deadline 2024-09-21T06:32:08.079164+0000) 2024-09-21T06:32:25.655 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:25 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10[58343]: 2024-09-21T06:32:25.287+0000 7f96ee2d8640 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.38:6822 osd.6 since back 2024-09-21T06:31:53.280574+0000 front 2024-09-21T06:31:53.280443+0000 (oldest deadline 2024-09-21T06:32:19.180386+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:26.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:25 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:25.678+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:26.980 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:26 smithi044 podman[67652]: 2024-09-21 06:32:26.704421822 +0000 UTC m=+5.613472726 container died d3bae9fb5c21cf45eb2021defb1287cc891231a70c7723a6861017561456c0b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:27.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:26 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:26.712+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:27.330 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67652]: 2024-09-21 06:32:27.069907493 +0000 UTC m=+5.978958397 container cleanup d3bae9fb5c21cf45eb2021defb1287cc891231a70c7723a6861017561456c0b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:27.331 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 bash[67652]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:32:27.648 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67667]: 2024-09-21 06:32:27.329481691 +0000 UTC m=+0.620096518 container remove d3bae9fb5c21cf45eb2021defb1287cc891231a70c7723a6861017561456c0b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:32:27.905 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67759]: 2024-09-21 06:32:27.549912806 +0000 UTC m=+0.015667565 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:32:28.002 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67759]: 2024-09-21 06:32:27.655495135 +0000 UTC m=+0.121249925 container create 9bb723ae43352550d8f5927d4f8bd4c25c139327b75186352cf18fceaee787ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T06:32:28.002 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67759]: 2024-09-21 06:32:27.882990172 +0000 UTC m=+0.348744919 container init 9bb723ae43352550d8f5927d4f8bd4c25c139327b75186352cf18fceaee787ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:32:28.002 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67759]: 2024-09-21 06:32:27.88621039 +0000 UTC m=+0.351965134 container start 9bb723ae43352550d8f5927d4f8bd4c25c139327b75186352cf18fceaee787ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:28.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:27 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:27.710+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:28.378 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:27 smithi044 podman[67759]: 2024-09-21 06:32:27.991541339 +0000 UTC m=+0.457296104 container attach 9bb723ae43352550d8f5927d4f8bd4c25c139327b75186352cf18fceaee787ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T06:32:28.379 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 21 06:32:28 smithi044 podman[67759]: 2024-09-21 06:32:28.089325089 +0000 UTC m=+0.555079838 container died 9bb723ae43352550d8f5927d4f8bd4c25c139327b75186352cf18fceaee787ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:32:28.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:32:28.730 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:28.730 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:32:28.730 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:32:28.730 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:29.069 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:29.070 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:28.751+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:29.070 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:28 smithi174 systemd[1]: Stopping Ceph osd.11 for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:29.070 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.067+0000 7f95c1467640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:29.070 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.067+0000 7f95c1467640 -1 osd.11 90 *** Got signal Terminated *** 2024-09-21T06:32:29.070 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.067+0000 7f95c1467640 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:32:30.144 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:30.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:29 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:29.771+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:31.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:30 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:30.802+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:32.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:31 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:31.817+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:33.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:32 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:32.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:34.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-21T06:31:06.273227+0000 front 2024-09-21T06:31:06.273038+0000 (oldest deadline 2024-09-21T06:31:31.572989+0000) 2024-09-21T06:32:34.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-21T06:31:15.574434+0000 front 2024-09-21T06:31:15.574825+0000 (oldest deadline 2024-09-21T06:31:41.474523+0000) 2024-09-21T06:32:34.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T06:31:21.474869+0000 front 2024-09-21T06:31:21.474931+0000 (oldest deadline 2024-09-21T06:31:44.275403+0000) 2024-09-21T06:32:34.146 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.38:6814 osd.3 since back 2024-09-21T06:31:29.477148+0000 front 2024-09-21T06:31:29.477105+0000 (oldest deadline 2024-09-21T06:31:52.376984+0000) 2024-09-21T06:32:34.146 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-21T06:31:37.678026+0000 front 2024-09-21T06:31:37.677956+0000 (oldest deadline 2024-09-21T06:32:02.977871+0000) 2024-09-21T06:32:34.146 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T06:31:46.478817+0000 front 2024-09-21T06:31:46.478902+0000 (oldest deadline 2024-09-21T06:32:08.178887+0000) 2024-09-21T06:32:34.146 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-21T06:31:59.980022+0000 front 2024-09-21T06:31:59.980133+0000 (oldest deadline 2024-09-21T06:32:23.479969+0000) 2024-09-21T06:32:34.146 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:33 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11[59136]: 2024-09-21T06:32:33.857+0000 7f95b9a4a640 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-09-21T06:32:08.180712+0000 front 2024-09-21T06:32:08.180774+0000 (oldest deadline 2024-09-21T06:32:33.480934+0000) 2024-09-21T06:32:34.895 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:34 smithi174 podman[68347]: 2024-09-21 06:32:34.626738575 +0000 UTC m=+5.698144581 container died c27895ff8e35736f5f56c612d4801d03db2303a96f5661518ed0b36616e203a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:32:35.185 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:34 smithi174 podman[68347]: 2024-09-21 06:32:34.999329578 +0000 UTC m=+6.070735572 container cleanup c27895ff8e35736f5f56c612d4801d03db2303a96f5661518ed0b36616e203a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:32:35.185 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:34 smithi174 bash[68347]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:32:35.602 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68362]: 2024-09-21 06:32:35.183863137 +0000 UTC m=+0.559378082 container remove c27895ff8e35736f5f56c612d4801d03db2303a96f5661518ed0b36616e203a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:32:35.889 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68453]: 2024-09-21 06:32:35.601322763 +0000 UTC m=+0.103977436 container create a20df6da7a84137118d68320e49e1f337f88624396886497650edcb65779b6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:32:35.890 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68453]: 2024-09-21 06:32:35.513194467 +0000 UTC m=+0.015849151 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:32:35.890 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68453]: 2024-09-21 06:32:35.837097541 +0000 UTC m=+0.339752225 container init a20df6da7a84137118d68320e49e1f337f88624396886497650edcb65779b6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T06:32:35.890 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68453]: 2024-09-21 06:32:35.840273218 +0000 UTC m=+0.342927905 container start a20df6da7a84137118d68320e49e1f337f88624396886497650edcb65779b6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:32:36.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:35 smithi174 podman[68453]: 2024-09-21 06:32:35.92016532 +0000 UTC m=+0.422820008 container attach a20df6da7a84137118d68320e49e1f337f88624396886497650edcb65779b6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:32:36.145 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 06:32:36 smithi174 podman[68453]: 2024-09-21 06:32:36.034242415 +0000 UTC m=+0.536897091 container died a20df6da7a84137118d68320e49e1f337f88624396886497650edcb65779b6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:32:36.642 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:32:36.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:36.680 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:32:36.680 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:32:36.680 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:32:36.981 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:36 smithi038 systemd[1]: Stopping Ceph mds.a for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:37.236 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:36 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a[73933]: 2024-09-21T06:32:36.979+0000 7f5b3f057640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:37.237 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:36 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a[73933]: 2024-09-21T06:32:36.979+0000 7f5b3f057640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:32:39.847 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:39 smithi038 podman[114419]: 2024-09-21 06:32:39.590100339 +0000 UTC m=+2.708763526 container died c8bace7c244a28c90c727af8a1ba94c07c42bc3a2f81988ba6ecaaea4fe08daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:32:40.222 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 podman[114419]: 2024-09-21 06:32:40.020328009 +0000 UTC m=+3.138991195 container cleanup c8bace7c244a28c90c727af8a1ba94c07c42bc3a2f81988ba6ecaaea4fe08daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:40.223 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 bash[114419]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:32:40.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:32:40.486 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 podman[114430]: 2024-09-21 06:32:40.221665796 +0000 UTC m=+0.623959098 container remove c8bace7c244a28c90c727af8a1ba94c07c42bc3a2f81988ba6ecaaea4fe08daf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:32:40.486 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T06:32:40.486 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 systemd[1]: Stopped Ceph mds.a for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:32:40.486 INFO:journalctl@ceph.mds.a.smithi038.stdout:Sep 21 06:32:40 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.a.service: Consumed 1.119s CPU time. 2024-09-21T06:32:40.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:40.502 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:32:40.502 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:32:40.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:32:40.817 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:40 smithi038 systemd[1]: Stopping Ceph mds.d for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:41.236 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d[72837]: 2024-09-21T06:32:40.814+0000 7f0f90350640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:41.236 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:40 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d[72837]: 2024-09-21T06:32:40.814+0000 7f0f90350640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:32:45.226 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:44 smithi038 podman[114542]: 2024-09-21 06:32:44.8304628 +0000 UTC m=+4.111003068 container died 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:32:45.486 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:45 smithi038 podman[114542]: 2024-09-21 06:32:45.382899779 +0000 UTC m=+4.663440047 container cleanup 665bac20b9f6edcca0646e5d91a21fa7157afae47225512adf673774707c94c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:32:45.486 INFO:journalctl@ceph.mds.d.smithi038.stdout:Sep 21 06:32:45 smithi038 bash[114542]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:32:45.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:32:45.855 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:45.855 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:32:45.855 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:32:45.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:32:46.188 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:45 smithi038 systemd[1]: Stopping Ceph mds.g for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:46.486 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g[73571]: 2024-09-21T06:32:46.186+0000 7f0640c55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:46.486 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:46 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g[73571]: 2024-09-21T06:32:46.186+0000 7f0640c55640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:32:49.164 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:48 smithi038 podman[114659]: 2024-09-21 06:32:48.897055153 +0000 UTC m=+2.821679079 container died fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:32:49.731 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:49 smithi038 podman[114659]: 2024-09-21 06:32:49.45386456 +0000 UTC m=+3.378488528 container cleanup fb2658f3d42ef52d6f0ca460d97d7284647046db68cae9f7bb678eb474262410 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:32:49.731 INFO:journalctl@ceph.mds.g.smithi038.stdout:Sep 21 06:32:49 smithi038 bash[114659]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:32:49.864 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:32:49.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:49.898 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:32:49.898 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:32:49.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:32:49.986 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:49 smithi038 systemd[1]: Stopping Ceph mds.j for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:50.486 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j[72454]: 2024-09-21T06:32:50.214+0000 7f228687c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:50.486 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:50 smithi038 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j[72454]: 2024-09-21T06:32:50.214+0000 7f228687c640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:32:54.451 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 podman[114780]: 2024-09-21 06:32:54.024074187 +0000 UTC m=+3.907508055 container died 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:32:54.726 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 podman[114780]: 2024-09-21 06:32:54.549628944 +0000 UTC m=+4.433062814 container cleanup 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:32:54.726 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 bash[114780]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:32:54.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:32:54.986 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 podman[114792]: 2024-09-21 06:32:54.725621142 +0000 UTC m=+0.691898568 container remove 690447dad426d3f7183f8831c6e0b4c691540461d262cb9123845febee6cdb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:32:54.986 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.j.service: Deactivated successfully. 2024-09-21T06:32:54.986 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 systemd[1]: Stopped Ceph mds.j for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:32:54.986 INFO:journalctl@ceph.mds.j.smithi038.stdout:Sep 21 06:32:54 smithi038 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.j.service: Consumed 1.097s CPU time. 2024-09-21T06:32:55.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:32:55.009 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:32:55.009 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:32:55.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:32:55.306 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:55 smithi044 systemd[1]: Stopping Ceph mds.b for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:32:55.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: 2024-09-21T06:32:55.304+0000 7ff09891b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:32:55.655 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:55 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b[63245]: 2024-09-21T06:32:55.304+0000 7ff09891b640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:32:59.589 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:59 smithi044 podman[67872]: 2024-09-21 06:32:59.318125564 +0000 UTC m=+4.113595300 container died fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:32:59.905 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:59 smithi044 podman[67872]: 2024-09-21 06:32:59.687426299 +0000 UTC m=+4.482896035 container cleanup fa6591e16fae047cf865705f3fb7f76855241a1e179b86bc69ddfdabfb9bf296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T06:32:59.905 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 21 06:32:59 smithi044 bash[67872]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:33:00.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:33:00.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:00.221 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:33:00.221 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:33:00.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:33:00.535 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:00 smithi044 systemd[1]: Stopping Ceph mds.e for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:00.905 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: 2024-09-21T06:33:00.533+0000 7f8110683640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:00.905 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:00 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e[62691]: 2024-09-21T06:33:00.533+0000 7f8110683640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:33:04.095 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:03 smithi044 podman[67995]: 2024-09-21 06:33:03.800805398 +0000 UTC m=+3.364273230 container died f38fd373386fe497a81f2939170f46dd5b36e41e9d14fbcbc7398832ebea4433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T06:33:04.405 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:04 smithi044 podman[67995]: 2024-09-21 06:33:04.175005807 +0000 UTC m=+3.738473638 container cleanup f38fd373386fe497a81f2939170f46dd5b36e41e9d14fbcbc7398832ebea4433 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:33:04.405 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 21 06:33:04 smithi044 bash[67995]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:33:04.611 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:33:04.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:04.646 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:33:04.646 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:33:04.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:33:04.989 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:04 smithi044 systemd[1]: Stopping Ceph mds.h for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:05.405 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: 2024-09-21T06:33:04.987+0000 7f1fb0c6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:05.405 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:04 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h[62961]: 2024-09-21T06:33:04.987+0000 7f1fb0c6c640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:33:08.097 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:07 smithi044 podman[68127]: 2024-09-21 06:33:07.817504964 +0000 UTC m=+2.947184762 container died ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:33:08.405 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:08 smithi044 podman[68127]: 2024-09-21 06:33:08.195716243 +0000 UTC m=+3.325396041 container cleanup ed38a2f2137b5c69fd35b9b895c925938fbea440b4c44346913b9473be6d7c0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T06:33:08.405 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 21 06:33:08 smithi044 bash[68127]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:33:08.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:33:08.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:08.674 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:33:08.674 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:33:08.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:33:08.992 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:08 smithi044 systemd[1]: Stopping Ceph mds.k for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:09.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: 2024-09-21T06:33:08.990+0000 7f2d58f89640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:09.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:08 smithi044 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k[62409]: 2024-09-21T06:33:08.990+0000 7f2d58f89640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:33:12.085 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:11 smithi044 podman[68249]: 2024-09-21 06:33:11.810704683 +0000 UTC m=+2.918976339 container died 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:33:12.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:12 smithi044 podman[68249]: 2024-09-21 06:33:12.174419917 +0000 UTC m=+3.282691570 container cleanup 524e4169c53f3d0e75f28cd81ffea04301dc57065ba14c62bc71dda0fa71aa62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:33:12.405 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 21 06:33:12 smithi044 bash[68249]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:33:12.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:33:12.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:12.640 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:33:12.640 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:33:12.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:33:12.933 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:12 smithi174 systemd[1]: Stopping Ceph mds.c for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:13.395 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: 2024-09-21T06:33:13.039+0000 7fe474bf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:13.395 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:13 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c[63737]: 2024-09-21T06:33:13.039+0000 7fe474bf4640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:33:16.091 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:15 smithi174 podman[68556]: 2024-09-21 06:33:15.793151088 +0000 UTC m=+2.952529891 container died 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:33:16.366 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 podman[68556]: 2024-09-21 06:33:16.189153101 +0000 UTC m=+3.348531903 container cleanup 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:33:16.366 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 bash[68556]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:33:16.593 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:33:16.616 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 podman[68581]: 2024-09-21 06:33:16.365282788 +0000 UTC m=+0.568527838 container remove 20326aefb5b0eae94653d5dce369278ced9b25b43d5ae22855f9cbc30445ae46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:33:16.616 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.c.service: Deactivated successfully. 2024-09-21T06:33:16.616 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 systemd[1]: Stopped Ceph mds.c for d022e7d2-77df-11ef-baf5-efdc52797490. 2024-09-21T06:33:16.616 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 06:33:16 smithi174 systemd[1]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.c.service: Consumed 5.055s CPU time. 2024-09-21T06:33:16.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:16.630 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:33:16.630 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:33:16.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:33:16.894 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:16 smithi174 systemd[1]: Stopping Ceph mds.f for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:17.394 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f[63465]: 2024-09-21T06:33:16.951+0000 7ffa4e189640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:17.394 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:16 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f[63465]: 2024-09-21T06:33:16.951+0000 7ffa4e189640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:33:18.761 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:18 smithi174 podman[68688]: 2024-09-21 06:33:18.48787193 +0000 UTC m=+1.643458674 container died 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:33:19.136 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:18 smithi174 podman[68688]: 2024-09-21 06:33:18.859731021 +0000 UTC m=+2.015317765 container cleanup 102c438a10fba22efefc3f7204e67da3c522250d8e1be6391626d8f399ddbc6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:33:19.137 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 06:33:18 smithi174 bash[68688]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:33:19.293 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:33:19.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:19.327 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:33:19.327 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:33:19.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:33:19.644 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:19 smithi174 systemd[1]: Stopping Ceph mds.i for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:20.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: 2024-09-21T06:33:19.646+0000 7f01bc99b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:20.145 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:19 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i[64025]: 2024-09-21T06:33:19.646+0000 7f01bc99b640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:33:24.023 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:23 smithi174 podman[68810]: 2024-09-21 06:33:23.659863991 +0000 UTC m=+4.111728659 container died f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:33:24.395 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:24 smithi174 podman[68810]: 2024-09-21 06:33:24.104738246 +0000 UTC m=+4.556602923 container cleanup f1dea45fc8d0770df5a7b362c08f28d60c873b5bf52bded66336cd4ac65d8d90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T06:33:24.395 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 06:33:24 smithi174 bash[68810]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:33:24.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:33:24.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:24.614 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:33:24.614 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:33:24.614 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:33:24.926 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:24 smithi174 systemd[1]: Stopping Ceph mds.l for d022e7d2-77df-11ef-baf5-efdc52797490... 2024-09-21T06:33:25.220 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l[63198]: 2024-09-21T06:33:24.924+0000 7ff357a5a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:33:25.220 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:24 smithi174 ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l[63198]: 2024-09-21T06:33:24.925+0000 7ff357a5a640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:33:28.827 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:28 smithi174 podman[68931]: 2024-09-21 06:33:28.46971974 +0000 UTC m=+3.643550549 container died bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:33:29.144 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:29 smithi174 podman[68931]: 2024-09-21 06:33:29.024601554 +0000 UTC m=+4.198432352 container cleanup bb12fcb611855eaa51262d6568e79e3c47f25b9f8f26fede8b53b7c138882235 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:33:29.144 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 06:33:29 smithi174 bash[68931]: ceph-d022e7d2-77df-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:33:29.467 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d022e7d2-77df-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:33:29.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:33:29.498 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:33:29.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:33:29.711 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:33:32.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:33:32.547 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:33:34.976 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:33:35.179 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:33:37.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:33:37.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:33:37.699 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:33:37.725 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:33:37.727 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi038/crash 2024-09-21T06:33:37.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:33:37.756 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:33:37.756 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:33:37.758 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi044/crash 2024-09-21T06:33:37.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:33:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:33:37.803 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:33:37.805 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi174/crash 2024-09-21T06:33:37.805 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:33:37.851 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:33:37.851 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:33:37.853 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:33:37.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T06:33:37.894 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:33:37.894 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:33:37.937 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:33:37.939 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:33:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:33:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:: No such file or directory 2024-09-21T06:33:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:33:37.962 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.0.log: -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:33:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:33:37.963 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:33:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:33:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:33:37.964 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:33:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:33:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-09-21T06:33:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:33:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log: -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:33:37.965 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:33:37.966 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:: No such file or directory 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:33:37.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:33:37.970 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:33:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:33:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.a.log: 84.1% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log: 95.0% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:33:37.973 INFO:teuthology.orchestra.run.smithi038.stderr: 87.4% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi038.stderr: 95.1% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.11.log: 81.4% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr: 90.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:33:37.974 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.4% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:33:37.975 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:33:37.975 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:33:37.975 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:33:37.976 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.4% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:33:37.976 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:33:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:33:37.977 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:33:37.978 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.x.log: /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:33:37.978 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:33:37.980 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:33:37.980 INFO:teuthology.orchestra.run.smithi038.stderr: 95.1% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:33:37.980 INFO:teuthology.orchestra.run.smithi038.stderr:gzip 95.1% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:33:37.980 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:33:37.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.y.log: 92.5% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:33:37.981 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:33:37.982 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:33:37.984 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:33:37.984 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:33:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:33:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.h.log: 87.4% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:33:37.985 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:33:37.991 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.f.log: 94.9% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:33:37.993 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:33:38.005 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:33:38.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:33:38.025 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:33:38.294 INFO:teuthology.orchestra.run.smithi044.stderr: 94.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:33:38.348 INFO:teuthology.orchestra.run.smithi038.stderr: 90.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:33:38.451 INFO:teuthology.orchestra.run.smithi174.stderr: 91.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:33:38.502 INFO:teuthology.orchestra.run.smithi044.stderr: 91.7% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:33:38.887 INFO:teuthology.orchestra.run.smithi038.stderr: 90.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:33:39.032 INFO:teuthology.orchestra.run.smithi174.stderr: 95.3% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:33:39.818 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:33:39.898 INFO:teuthology.orchestra.run.smithi038.stderr: 93.7% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:33:40.046 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:33:40.124 INFO:teuthology.orchestra.run.smithi044.stderr: 93.8% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:33:40.169 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:33:40.283 INFO:teuthology.orchestra.run.smithi038.stderr: 93.5% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:33:40.341 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:33:40.523 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:33:40.780 INFO:teuthology.orchestra.run.smithi174.stderr: 93.8% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:33:40.781 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-09-21T06:33:40.781 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m2.827s 2024-09-21T06:33:40.781 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m12.819s 2024-09-21T06:33:40.781 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.437s 2024-09-21T06:33:41.003 INFO:teuthology.orchestra.run.smithi038.stderr: 93.6% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:33:41.005 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-09-21T06:33:41.005 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m3.054s 2024-09-21T06:33:41.005 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m10.480s 2024-09-21T06:33:41.005 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m0.357s 2024-09-21T06:33:41.193 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:33:41.204 INFO:teuthology.orchestra.run.smithi044.stderr: 95.2% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:33:41.243 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:33:41.260 INFO:teuthology.orchestra.run.smithi044.stderr: 93.7% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:33:51.487 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:34:12.456 INFO:teuthology.orchestra.run.smithi044.stderr: 93.0% -- replaced with /var/log/ceph/d022e7d2-77df-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:34:12.457 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-21T06:34:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m34.503s 2024-09-21T06:34:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:user 1m1.752s 2024-09-21T06:34:12.458 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m1.743s 2024-09-21T06:34:12.458 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:34:12.458 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi038/log 2024-09-21T06:34:12.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:34:13.848 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi044/log 2024-09-21T06:34:13.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:34:21.733 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi174/log 2024-09-21T06:34:21.734 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:34:23.346 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:34:23.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force 2024-09-21T06:34:23.562 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:34:23.846 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force 2024-09-21T06:34:24.057 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:34:24.372 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d022e7d2-77df-11ef-baf5-efdc52797490 --force 2024-09-21T06:34:24.559 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: d022e7d2-77df-11ef-baf5-efdc52797490 2024-09-21T06:34:24.839 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:34:24.840 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:34:24.859 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:34:24.876 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:34:24.892 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:34:24.892 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:34:24.905 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:34:24.906 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:34:24.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:34:24.918 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:34:25.015 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:34:25.029 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:34:25.029 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:34:25.032 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:34:25.034 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:34:25.047 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:34:25.048 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:34:25.049 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -114us[ -108us] +/- 52ms 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +218us[ +218us] +/- 79ms 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -32us[ -26us] +/- 83ms 2024-09-21T06:34:25.052 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:34:25.054 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:34:25.054 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -109us[ -107us] +/- 52ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +210us[ +210us] +/- 79ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -28us[ -28us] +/- 83ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -111us[ -100us] +/- 52ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 +231us[ +231us] +/- 79ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -39us[ -39us] +/- 83ms 2024-09-21T06:34:25.055 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:34:25.055 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:34:25.065 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:34:25.065 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:34:25.094 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:34:25.185 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:34:25.255 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:34:25.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:34:25.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:25.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:34:25.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:25.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:34:25.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:25.409 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:34:25.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:34:25.429 INFO:teuthology.task.internal:Duration was 1956.474072 seconds 2024-09-21T06:34:25.430 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:34:25.439 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:34:25.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:34:25.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:34:25.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:34:25.483 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:34:25.484 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:34:25.487 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:34:25.949 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:34:25.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-21T06:34:25.949 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:34:25.972 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-21T06:34:25.972 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:34:26.019 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-09-21T06:34:26.019 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:34:26.042 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:34:26.042 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:34:26.044 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:34:26.062 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:34:26.107 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:34:26.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:34:26.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:34:26.132 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:34:27.667 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:34:27.679 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:34:27.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:34:27.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:34:27.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:34:27.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:34:27.777 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.800 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-21T06:34:27.806 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-21T06:34:27.833 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-09-21T06:34:27.851 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:27.869 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:27.886 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:34:27.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:27.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:34:27.919 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:34:27.919 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi038 2024-09-21T06:34:27.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:34:27.981 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi044 2024-09-21T06:34:27.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:34:28.020 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913527/remote/smithi174 2024-09-21T06:34:28.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:34:28.059 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:34:28.059 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:34:28.061 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:34:28.063 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:34:28.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:34:28.129 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:34:28.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:34:28.171 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:34:28.171 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:34:28.174 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:34:28.176 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:34:28.187 INFO:teuthology.orchestra.run.smithi038.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:34 /home/ubuntu/cephtest 2024-09-21T06:34:28.191 INFO:teuthology.orchestra.run.smithi044.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:34 /home/ubuntu/cephtest 2024-09-21T06:34:28.192 INFO:teuthology.orchestra.run.smithi174.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:34 /home/ubuntu/cephtest 2024-09-21T06:34:28.193 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:34:28.212 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:34:28.239 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/norstats}} duration: 1956.4740715026855 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:34:28.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:34:28.316 INFO:teuthology.run:pass